Go Back  PPRuNe Forums > Ground & Other Ops Forums > Safety, CRM, QA & Emergency Response Planning
Reload this Page >

Avoiding an overrun: what should be trained?

Wikiposts
Search
Safety, CRM, QA & Emergency Response Planning A wide ranging forum for issues facing Aviation Professionals and Academics

Avoiding an overrun: what should be trained?

Thread Tools
 
Search this Thread
 
Old 2nd Jan 2008, 20:47
  #1 (permalink)  
Thread Starter
 
Join Date: Jul 2003
Location: An Island Province
Posts: 1,257
Likes: 0
Received 1 Like on 1 Post
Avoiding an overrun: what should be trained?

The recent report into the overrun accident at Toronto Pearson Airport recommends more training “to better enable pilots to make landing decisions in deteriorating weather”.
The recommendation originates from a well considered analysis of the events and the human interactions with the situation; unfortunately the report does not provide the industry with guidance as to what should be trained nor how this might be achieved or checked.
Presumably many national authorities will endorse this recommendation, thus we might anticipate additions to CRM, TEM, and HF training programmes.
Pre-empting such change we might consider how overrun events can be avoided, what should we train to better enable pilots to make landing decisions in deteriorating weather, and how is this training to be achieved?

TSB report.
Pprune YYZ accident thread.

Last edited by alf5071h; 2nd Jan 2008 at 22:18. Reason: TSB title
alf5071h is offline  
Old 2nd Jan 2008, 21:08
  #2 (permalink)  
 
Join Date: Feb 2006
Location: On the dark side of the moon
Posts: 976
Received 10 Likes on 4 Posts
First, a minor correction. The report was written by the TSB, not TC.

As to what to train? The first one that comes to mind for me is the decision as to whether or not to continue an approach in conditions where the missed approach path is not a safe option due to severe weather, such as on the accident day in YYZ. Even when an approach is perfectly stabilized, a go around must always be considered as an equal possibility to a successful landing. You never know when someone will miss the hold line, followed by the tower ordering a go-around. That way, when a missed approach is required, it doesn't come as a surprise and one is better prepared to carry it out.

Stabilized approach criteria need to be considered all the way to the landing flare. Just because we're stable at 1,000 ft or 500 ft (or whatever our SOP says), does not gaurantee that we'll be stable at 100 ft.

Touchdown point awareness is also an important element of effective landing decision making.

We all think about "Contaminated Criteria" when there's lots of snow and ice around. We need to start thinking about it when the runway is wet as well. When it starts to rain heavy in thundershowers, a runway can quickly become as slippery as if there were more than an inch of snow on it.

But again, the decision to continue the approach in the first place was, for me, the key link in the accident chain that so easily could have prevented it.

FWIW

Jeff
J.O. is offline  
Old 2nd Jan 2008, 23:31
  #3 (permalink)  
 
Join Date: Mar 2006
Location: heathrow
Posts: 990
Likes: 0
Received 0 Likes on 0 Posts
JO I think you may be missing a valuable point here.

I have seen many pilots in simulators exercise bad judgement but this has not been picked up in the debrief in the same way as the flying accuracy may be addressed.

I know quite a few pilots who are excellent at arriving at stabilisation altitude fully stable every time but their decison making is questionable.

However it is a difficult one becuase it involves getting personal and many trainers just do not like doing that or have never been tasked to do just that.
llanfairpg is offline  
Old 3rd Jan 2008, 00:12
  #4 (permalink)  
 
Join Date: Feb 2006
Location: On the dark side of the moon
Posts: 976
Received 10 Likes on 4 Posts
llanfairpg:

You make a very good point. I didn't mean for my list to be a definitive one. I am sure there are a few more ways that training of landing decisions can be improved. I hope others will post their ideas here. A critical element of effective simulator training is being willing to point out areas for improvement to the candidate. If you're a simulator instructor or check pilot, ask yourself this question. Would you rather debrief them after a less than perfect sim session, or after an accident on the line?

Jeff
J.O. is offline  
Old 3rd Jan 2008, 13:58
  #5 (permalink)  
 
Join Date: Apr 2005
Location: uk
Posts: 260
Likes: 0
Received 0 Likes on 0 Posts
The decision to continue the approach and landing was not the cause of this accident.It was the loss of stabilised flight in the flare and the subsequent lack of correct retardation procedures, which led to the deep landing and overrun.
Simulator training can assist in reinforcing the need to touchdown at the correct point and use all retardation devices promptly, however, for the most part, runway conditions are conducive to 'soft' touchdowns. How often have you been briefed by the PF as to what retardation will be used and which turn-off point will be taken, only to witness a deeper than planned touchdown and the same braking/reverse used, resulting in turning-off much further down the runway than briefed. Many inexperienced pilots seem to concentrate on gentle touchdowns rather than correct ones.
As for whether or not to continue the approach, this comes with good command training. I would suggest that even with an experienced co-pilot, this should have been a Captain's landing, in those conditions. However, the previous meeting between these two pilots had ended unpleasantly (with a Captain-under-check failing the detail on a different type). This may have led to an authority gradient in the co-pilot's mind and an unwillingness to object to the Captain's decisions.
Emphasising correct landing techniques in training, is a relatively simple task, but often overlooked, especially when courses are reduced for costs reasons.
Training out mind-sets, such as continuing approaches because preceding aircraft have already safely done so, although prudence would suggest an immediate discontinuation, is quite a difficult thing to do. There is also the individual's 'macho' view, that it is nothing he/she has not coped with successfully before and will do so again.
skiesfull is offline  
Old 3rd Jan 2008, 22:20
  #6 (permalink)  

Aviator
 
Join Date: May 2001
Location: Norveg
Posts: 483
Likes: 0
Received 0 Likes on 0 Posts
How can one expect long haul pilots to be proficient in hand flying or have enough experience to base their decisions on, when most of them barely have one or two take-offs and landings per month? Also; one is perhaps at the end of a long and boring flight, maybe jet lagged as well, and suddenly has to jump right in to the full alert mode.
"It was the loss of stabilised flight in the flare and the subsequent lack of correct retardation procedures, which led to the deep landing and overrun"
Too many empty, zero-experience-building flight hours in a way too automated aircraft. Long haul ops takes you from pilot to manager in no-time, that is the problem.
To answer the initial question: pilots need to pilot every so often. This is not the pilots´"fault". It´s just what can be expected when they never get to do any real flying...
Crossunder is offline  
Old 3rd Jan 2008, 23:46
  #7 (permalink)  
 
Join Date: Mar 2006
Location: heathrow
Posts: 990
Likes: 0
Received 0 Likes on 0 Posts
How can one expect long haul pilots to be proficient in hand flying or have enough experience to base their decisions on,
Decision making can be practiced anywhere, pilots who fly/handle infrequently need sharper decision skills
llanfairpg is offline  
Old 4th Jan 2008, 00:57
  #8 (permalink)  
Thread Starter
 
Join Date: Jul 2003
Location: An Island Province
Posts: 1,257
Likes: 0
Received 1 Like on 1 Post
skiesfull, crossunder, I had hoped that this thread would avoid focus on a specific accident, the quest is for a generic solution.
However, re handling; although improved handling skills will position a flight towards a safer (optimum) operating zone they do not guarantee avoiding an overrun. If the runway conditions have deteriorated from those which were expected then there still may be insufficient runway to stop.
The point of a pre landing decision is not to ensure that the aircraft can land accurately and stop in the distance available, it is to ensure that it can stop safely within the distance. The additional margin allows in part, for unforeseen changes in the situation and some errors, – note a similar absence of an adequate safety margin in many overrun accidents e.g. Congonhas, Midway.

The danger in singling out handling skills is that ‘good’ landings may be completed in circumstances which have a higher level of risk than desired by the safety standards in our industry; this builds a false level of security (complacency), such that an encounter with the unexpected may suddenly result in no safety margin at all, i.e. handling skills do not prevent or mitigate a decision error. DM must be built on discipline, the maintenance of safety standards, and avoidance of complacency or inappropriate industry norms.

Decision making (DM) should include planning for the unexpected. In terms of landing distance some of the ‘unexpected’ is included in the scheduled performance, but not for example a change from wet to contaminated conditions. Crew training should include knowledge of what is and is not included in the landing distance margins – what are the assumptions (Refs; AIC and Managing T&E slide 6).
Also, DM in situations that include ill-determined runway conditions should consider the difference between wet and contaminated distances. It may not be necessarily to plan for a contaminated landing in most circumstances, but at least a crew should arm themselves with information so if they perceived that the runway condition had changed it enables a decision to change an earlier plan, i.e. knowing that you should be able to stop safely on a wet runway vs knowing that you will not stop on a contaminated runway. A similar point can be made about braking levels; in what circumstances do you change from medium to max (know before you go), i.e. SOPs are only ‘standard’ if the assumptions are met - what are the assumptions in SOPs (knowledge required - training).

The Captains landing (or not) might be debateable, but whichever view is taken it involves a decision; thus we have to determine what goes into that decision and how is it taught. In the ref below (crew procedures) the proposals might provide guidance for a Captain if he has the authority (flexibility) in the operation, if not this information could be in SOPs, which would simplify the decision, e.g. Cbs with 5nm of runway – Capts landing (or SFO landing with monitored approach procedures). Providing the advice is justifiable to an operator, it matters little what the advice is provided it triggers consideration and subsequent DM, thus it essential to provide ‘trigger’ advice to aid DM (SOPs or memory). However, we should be aware that guidance or SOPs, etc, cannot cover all eventualities or situations. For those rare occasions or unusual circumstances, operators require the flexibility enabled by human judgement, but with that comes a tendency for error – so DM guidance also has to provide error avoidance/mitigation; … what is that and how is it taught.

AIC 14/2006 Landing performance of large transport aeroplanes. Registration required (free); then PUBS / UK AIC / Pink
Managing Threats and Errors during approach and landing.
Error-tolerant Crew Procedures.
alf5071h is offline  
Old 4th Jan 2008, 17:44
  #9 (permalink)  
 
Join Date: Feb 2006
Location: On the dark side of the moon
Posts: 976
Received 10 Likes on 4 Posts
The decision to continue the approach and landing was not the cause of this accident.It was the loss of stabilised flight in the flare and the subsequent lack of correct retardation procedures, which led to the deep landing and overrun.
skiesfull:

Accident prevention needs to look at all areas of potential improvement in pilot performance and decision making if it's ever going to be successful. I was not attempting to identify a cause. I was simply trying to point out what I see as a significant weakness in crew decision making when it comes to conducting an approach when the missed approach path may involve flight through hazardous wind shear conditions. Let's face it, a different decision regarding continuing the approach would have created a much different outcome, althought it also would have presented a new challenge to the crew in having to divert to another airport on pretty close to minimum fuel.

You make an interesting point about "captain's landing". Many operators (mine included) provide decision criteria as to when the captain is to carry out a takeoff or landing. We do not mention operations in the vicinity of severe weather, but it's certainly worth consideration.
J.O. is offline  
Old 7th Jan 2008, 19:46
  #10 (permalink)  
Thread Starter
 
Join Date: Jul 2003
Location: An Island Province
Posts: 1,257
Likes: 0
Received 1 Like on 1 Post
IGh – plan continuation bias – (PCB).
Good points, but PCB is just one of many biases or the result of several biases, which can effect a decision.
Ref 1 (page 9…) describes a range of issues including bias:- humans use reasoning shortcuts (patterns of thinking) which are generally reliable, but their use as quick estimators can result in error. Many of these shortcuts have ‘built in’ bias, e.g:-
  • Humans divide situations (and decisions) into ‘good enough’ or ‘not good enough’, but rarely optimal. This actually might be an advantage in aviation, but ‘good enough’ or ‘not good enough’ require definition within expected situations (context), i.e. when is the weather / runway condition / wind / airspeed, etc ‘good enough’; this requires knowledge which has to be acquired / taught.
  • Humans are more likely to pass up an opportunity to make a gain rather than risk a loss; risky landings are often seen as a ‘gain’ and a go-around as a loss. This requires a disciplined evaluation of the situation and knowledge of the risks associated with each option. Disciplined thinking must balance the interests of others against the safest option – the passengers on-time arrival, or what peers might think about a GA, are irrelevant when you are stuck in the overrun area.
  • Humans are more likely to select the option (as perceived/visualized) resulting in the most desirable outcome, irrespective of the actual probability of that result actually occurring. Visualization is thinking ‘what-if’ in pictures, but the content depends on knowledge of the probability (risks) and adherence to the key safety objectives, these require knowledge and discipline, e.g. 70% of landing overrun accidents occurred on wet runways.
  • Once humans have made a decision, they are reluctant to change. Pilots need to understand the boundaries of a safe operation and be provided with strong physical and mental trigger points to force reconsideration of a plan e.g. stabilized approach criteria and boundary ‘gates’ – if unstable at 1000ft and correcting, check at 500ft. If unstable at 500ft, or not correcting at any time below 1000ft, then go-around.
  • Humans usually overestimate the connection between their actions and attaining the desired outcome - hindsight. This occurs when successful events are wrongly reconstructed in memory or when recalling past failures – we think we did better than was the fact, we fool ourselves. Accurate memories are aided by debriefing, self analysis (admitting that you were wrong – at least to your self). Briefing helps memory recall and strengthens memories particularly when visualizing the course of a flight or operational segment. No briefing should be standard, every flight is different; identify and brief the differences or unusual items however small or insignificant, e.g. variability in wt, speed, wind, weather, runway condition, runway surface, distance available, braking technique, overrun area, etc, etc; these can be ‘triggers’ for decision making.
The reference also reviews some defenses against bias to supplement those above:
  • Knowledge is required to appreciate the opportunities or range of outcomes during an evolving situation (good or bad). Pilots have to know how to use the knowledge, first by understanding the hazards, then associating them with related, but often future situations, e.g Cbs are a hazard; in-flight we should consider lightning, hail, windshear, etc, but projecting this to a landing (perhaps mentally a ground operation) we should consider the rainfall rate and visibility – thence a contaminated runway, windshear/tailwind/crosswind – landing limitations.
  • Reframing the problem – looking at the situation from a different perspective – considering 'what if'. Don’t ask can we make this approach; instead ask “should” we be making this approach, i.e. what are the risks.
  • Being vigilant; monitoring and using checklists. This also involves personal checks including self reflection - how am I doing – flying and thinking? Or ‘how goes it’, a check of approach progress with the ideal, or how far from the edge of a safe boundary is the operation and in which direction is it heading – towards or away from the safe zone. Pilots can use deviations from the ‘ideal’ and ‘boundaries’ as trigger points for reconsideration or change of plan respectively.

Pilots have to be taught to be reflective and self correcting; some of this is personality (hazardous attitudes), but a significant proportion comes from the manner in which we think. Basic education teaches thinking skills; flying training should teach skills associated with thinking for flying – often termed in airmanship; so how do we teach airmanship.

1. Analyzing Explanations for Seemingly Irrational Choices.
2. Thinking about thinking.
3. The limits of expertise. Key Dismukes
alf5071h is offline  
Old 10th Jan 2008, 02:36
  #11 (permalink)  
 
Join Date: Feb 2006
Location: On the dark side of the moon
Posts: 976
Received 10 Likes on 4 Posts
This is great stuff, alf5071h. An excellent analysis of how the human brain needs to be trained to think in dynamic situations. Thanks for the references as well.

Jeff
J.O. is offline  
Old 11th Jan 2008, 01:30
  #12 (permalink)  
 
Join Date: Dec 2002
Location: UK
Posts: 2,451
Likes: 0
Received 9 Likes on 5 Posts
The FAA have published their advice for ‘mitigating the risks associated with runway overruns’ in AC 91-79 Runway Overrun Prevention .

Does this apply to part 121 operators; it’s a part 91 AC, but many sections refer to 121?

There is not very much on training other than the usual – operators must do it.
safetypee is offline  
Old 14th Jan 2008, 01:49
  #13 (permalink)  
Thread Starter
 
Join Date: Jul 2003
Location: An Island Province
Posts: 1,257
Likes: 0
Received 1 Like on 1 Post
AC 91-79 provides background knowledge and a reminder of requirements to help avoid an overrun. The presentation of some of the issues appears muddled and at variance with world standards. Why does the FAA choose to introduce new terminology for runway braking conditions when there is an adequate ICAO standard, or is this a move towards standardization?

The recommendations are typical of many regulators in telling operators what to do and what their responsibilities are, but there is scant advice as to how these are to be achieved, e.g. “Adhere to SOPs and best practices”, but what are best practices and exactly how do pilots adhere to SOPs – how do they avoid error?

Technical knowledge and an understanding of the regulatory system are components of decision making, but a more critical element is how and when that knowledge is used. These details are absent.


I have located a more positive reference (link at ref 1). This provides a model of the human decision making and concludes with a section on training for decision making, starting with decision aiding systems:
“Humans are inaccurate at estimating probabilities, and are particularly poor at revising probabilities based on new information. Decision aids can be used to help improve this fault in decision making.” Perhaps we require some technology to help with the probabilities.

The training recommendations start with ‘de-biasing’, the removal of bad habits or false belief; this has to overcome “first learned, best remembered’ items from basic training which might not apply to commercial operations.

The key training issues are:
  • Five hazardous attitudes, but there is no explanation of how to control them.
  • Self evaluation, self monitoring – ‘how goes it’.
  • Time management; staying in control of the situation, time, thoughts, and actions.
  • Memory recall; also related to how information is learnt and ‘memorized' – a reminder or trigger cues for recall.
  • Metagognitive skills; see “thinking about thinking” (link at #11).
  • Training in context; chose a realistic situation.
  • Situation awareness and mental simulation – visualization, but no details of how to improve situation assessment, except ...
  • … pattern recognition, development of mental models.
  • … pay attention to ambiguous, unexpected, or abnormal cues.
  • Risk assessment and resource management; mental resources and workload.
“For maximized effectiveness these are to be taught to pilots in naturalistic environments - time pressure, high workload, uncertainty, dynamic situations and other people involved”.

Ref 1. Naturalistic Decision Making in Aviation Environments.
alf5071h is offline  
Old 5th Feb 2008, 16:51
  #14 (permalink)  
 
Join Date: Feb 2008
Location: UK
Age: 66
Posts: 846
Received 41 Likes on 21 Posts
funnily enough i just read the aaib report on the british airtours tristar overun at LBA in june 1985,

weird issues there as to what to train, what wasnt trained, what manual (FM)to use and the SOP etc etc

the peculiar one there for me was that british airtours sent this a/c in to LBA for the first time ever and classified LBA as not a special classification airport (despite having a landing distance available well<2000m) and the flight deck crew had never been there before this flight (NOR had a tristar)

interesting reading
rog747 is offline  
Old 6th Feb 2008, 16:27
  #15 (permalink)  
 
Join Date: Mar 2007
Location: Havana
Posts: 600
Likes: 0
Received 0 Likes on 0 Posts
Avoiding an overrun: what should be trained?

alf5071h

Getting to Grips with Approach and Landing Accidents Reduction by Airbus Industrie.
(available on their website or from smartcockpit.com etc.
Definately worth a look.
Che Guevara is offline  
Old 2nd Mar 2008, 10:35
  #16 (permalink)  
 
Join Date: Jun 2006
Location: Australia
Posts: 1,186
Likes: 0
Received 0 Likes on 0 Posts
I suggest the following as an effective measure to combat landing technique complacency:

Simulator training should be conducted on runway lengths just within the landing length performance limit, be it wet, dry, or slippery. A crosswind should be present. More often than not simulator runways at the destination are well in excess of the minimum length required.

It is important to demonstrate the dangers associated with excess speed and/or excess threshold crossing height. Briefings are fine, but seeing the result of a poorly managed approach and landing is better. A picture is worth a thousand words.

Have the pilot deliberately approach too fast, too high and with a tailwind. All things being equal the aircraft will over-run and presumably an intelligent pilot will see the result of his "folly." Do this on a slippery runway to make the point the over-run potential is greater. From then on train pilots in the simulator to land consistently safely on a runway limiting weight. This does not mean autoland either but raw data hand flying.

The manufacturers speed additives need to be looked at as well. An example of this is where the additive called for is half the steady headwind component and all the gust.

For example the 737 FCOM requires the steady headwind to be bled off approaching touch down. Few pilots accept that and many hang on to all addditives until the flare. On a wet runway this results in excess speed and invariably a long float. Boeing does not explain why the half the steady headwind component is required as an additive and does not give accurate advice as to when the pilot deliberately starts to bleed off the additive.

"Approaching touch-down" is imprecise and open to liberal interpretation. The FCTM does however state that the flare manoeuvre washes off 3-4 knots. But if you have a 15 knots additive then at what altitude or distance from the threshold should speed bleed -off commence? It's anyone's guess but presumably the pilot should start reducing speed at the point where ground friction starts to take place. Free stream air is considered to start around 2000 ft so the half the HW component should start to be bled back once below 2000 ft. The support pilot needs to be briefed not to squawk Mayday when he sees speed reduction occurring.

Overrun accidents are often due to excessive threshold speed with subsequent float. A common denominator is the manufacturer's recommended additives to Vref. You will not bleed off 15 knots in the 3-4 second flare manoeuvre - no way. The gust factor additive is usually held until the flare and if the gust or lull fails to materialise a long float is likely.

Too many simulator sessions are on runway lengths far in excess of landing length limits. In turn this causes complacency. In the simulator we see pilots conducting the non-normal all flaps-up landings (B737) on runway lengths of at least 9000 ft and there is no sweat in pulling up even after a long float. When the same pilots are required to use shortened runways just within the length limits of a all flaps up landing, most over-run because of excess speed and float.

There is probably no harm with psycho-babble to explain why people land long and fast - but I see proactive training in the simulator as the answer to preventing over-runs on wet and slippery runways.

Last edited by Tee Emm; 2nd Mar 2008 at 10:46.
Tee Emm is offline  
Old 3rd Mar 2008, 19:38
  #17 (permalink)  
 
Join Date: Jun 2001
Location: UK
Posts: 3,982
Likes: 0
Received 1 Like on 1 Post
Are all pilots ware of kinetic energy = 1/2 m V SQUARED? If you double the landing speed you increase the energy by a factor of 4. So a few extra knots makes a BIG difference to the amount of energy which has to be disipated during the landing!
fireflybob is offline  
Old 3rd Mar 2008, 21:48
  #18 (permalink)  
Moderator
 
Join Date: Apr 2001
Location: various places .....
Posts: 7,185
Received 94 Likes on 63 Posts
so the half the HW component should start to be bled back once below 2000 ft

Probably a bit out of the square albeit that quite a few folk adopt this concept.

This sort of concern has been discussed in some older threads, such as here and here
john_tullamarine is offline  
Old 20th Mar 2008, 10:55
  #19 (permalink)  
 
Join Date: Jul 2000
Location: U.S.A.
Posts: 474
Likes: 0
Received 0 Likes on 0 Posts
Another issue related to this topic that I feel is "under trained" in most simulator scenarios is the Go Around itself. Particularly in newer automated aircraft, a go-around from a position other than DH/MDA (which is prepared for/briefed) can be a sporty event, particularly with a low missed approach altitude.

http://www.caa.co.uk/docs/33/FOD200811.pdf
Shore Guy is offline  
Old 21st Mar 2008, 10:43
  #20 (permalink)  
 
Join Date: Jun 2000
Location: Australia
Posts: 4,188
Likes: 0
Received 14 Likes on 5 Posts
Another issue related to this topic that I feel is "under trained" in most simulator scenarios is the Go Around itself
I agree. One engine inoperative go-arounds at the flare (in the 737 simulator) is a demanding exercise as is a go-around from a hard landing with bounce and in poor visibility. The step by step procedure for go-arounds at very low altitude often causes momentary confusion with pilots undergoing the type rating because it can be relatively complicated to a new pilot (autothrottle engaged/not engaged and FD on or off).
Centaurus is offline  


Contact Us - Archive - Advertising - Cookie Policy - Privacy Statement - Terms of Service

Copyright © 2024 MH Sub I, LLC dba Internet Brands. All rights reserved. Use of this site indicates your consent to the Terms of Use.