Originally Posted by
ChrisVJ
From Uplinker
"One thing though I think needs to change is airline pilot trainers examining their own pilots. There is a potential incentive for company type rating examiners, TREs, to get their pilots through their SIM exams. I personally think that SIM exams should be conducted by aviation authority examiners, who do not know the candidates. This might help reveal issues, if they existed."
I asked in the Air India accident thread if this system applied in India or if they still used the government examiners as we used to. but it was passed over without comment.
My adviser from within the industry is disappointed with our system as it stands. He feels that the authorities really have little power to control or improve the quality of airmanship when type rating checks are done by company pilots...
I might agree with this sentiment on a global scale, but it was not my experience here in North America. It was made very clear that as an ACP (Approved Check Pilot) in Canada, I was a delegate of Transport Canada and NOT a company pilot while acting in my capacity as an ACP when conducting flight checks. I had annual assessments that compared my markings to all other examiners in the country. This was then segmented down to all examiners on type and all examiners at my company on that type. It was quite clear that my authority to conduct check rides would have been taken away if I deviated too far from the standard. As such, the vast majority of company check pilots I encountered either as a candidate or as an examiner were professional, and quite able to set aside any sense of loyalty to the company. Were there bad apples? Of course there were, but in over a decade of doing check work, I can count on one hand how many of those I encountered. There is one guy I have in mind who passed me on a ride that looking back I should have failed on (I set the wrong minimums for the approach). He never failed anyone, but boy do I remember that ride 20+ years later. He gave me a chewing out that I still wince at. That led me to question what I would have learned more from: a failure or a very strong reprimand in the debrief? I took that sentiment with me into my own check work. I had no problem failing a pilot if it was deserved, but if it was on the edge, I would ask myself what is the better learning opportunity for the candidate: a failure that they might blame me for instead of looking at their actions, or a strongly worded reprimand that followed a little acting on my part, leaving the pilot to wonder if they'd passed or failed? Acting in the sense that I would leave the simulator without telling them the result. Sounds harsh, but it worked.
One downside to the regulating authority doing a check ride is that their pilots are not as well versed with the airplane and company procedure as the company check pilot. I've sat in on a number of different "TC Rides" and where I would have downgraded a mark, the regulator said it was fine. They didn't know the intricacies of the company operation to know that while it may have been acceptable if you had just rented the aircraft, a number of company procedures were violated that resulted in a failure. Or, on the flip side, they would mark a pilot down because of xyz reason, not realizing that the ops specs permitted us leeway. On one ride the regulator wanted to fail a student for continuing an approach below a certain weather minimum, until it was pointed out that the company had authorization to continue the approach given our sphere of operations. In another example, the check pilot wanted to fail both me and my sim partner for not making a single correct SOP call the whole ride. I still remember his face when he opened the book to show us what we had done wrong, only for us to point out that he had referenced a different company altogether. To his credit, he admitted the mistake, but it goes to show that just because the check pilot works for the regulator does not immediately imply the checking process will be better.
What I see as the problem is the checking process itself. Many jurisdictions use scripted rides - that is, the check pilot is given a script of exercises to give every pilot in a specific order. Depending on the jurisdiction, this script changes once or twice a year. Regardless of how often it changes, once the first pair of pilots is through, they write down the examined elements, fire it off to their buddies, and within two hours of the first ride, every pilot in the company knows what will be examined. So the rest jump into the QRH to find any gotchyas, rehearse the specific exercises, and by the time they do their ride, they're getting great marks as they're hitting all the beats. I had a few failures where the pilot turned around and would say something like "that was supposed to be a rejected takeoff" or "that was supposed to be a V1 cut." Turns out, their buddy got the order wrong and rather than reacting to the moment, the pilot reacted to what they heard was coming. If we are to continue using flight checks as the be-all-and-end-all, I think it is better to have a general script of what needs to be seen in the ride. Then, those requirements are passed through a randomizer so every ride is different, but no more or less difficult that any other. You're still going to get a rejected takeoff, a V1 cut, a major malfunction and minor malfunction, and a whole bunch of different approaches, but you'll not know the order or the specific malfunctions. One ride sees a WINDOW OVERHEAT light followed by a return to base and a V1 cut, the next sees a V1 cut, a normal takeoff to a DRIVE light. They're the same type of minor failures and V1 cuts, but the order is changed. The ride is no more hard or soft and the candidate will still check off in the their head what they've seen (RTO, V1 cut, minor malfunction, major malfunction, SE approach, etc.), but they can't prepare for it beyond a general sense ahead of time.
Now, to go back to the original thread, I don't think adding more technology to the aircraft is the answer. All that does is create yet another point of failure. If a crew is so convinced that they are shutting down the correct engine, they will bypass all the steps in the process, including the new technology. I think it is better to improve pilot training and checking with a robust system that moves away from the "box ticking" exercises our industry seems to have settled on. EBT is a good start, but in many cases this discussion needs to change the fundamental way we train all pilots at all levels. I love the NASA saying that goes along the lines that no emergency is so severe that you can't make it worse. We need to apply that type of logic into our training at a global level, and right from hour 0. Otherwise, the bad habits that are built from the start will continue to show themselves at the airline level.