Go Back  PPRuNe Forums > Other Aircrew Forums > Flight Testing
Reload this Page >

Flight Testing vs Test Flying

Wikiposts
Search
Flight Testing A forum for test pilots, flight test engineers, observers, telemetry and instrumentation engineers and anybody else involved in the demanding and complex business of testing aeroplanes, helicopters and equipment.

Flight Testing vs Test Flying

Thread Tools
 
Search this Thread
 
Old 10th Oct 2003, 07:02
  #21 (permalink)  
Moderator
 
Join Date: Feb 2000
Location: UK
Posts: 14,217
Received 48 Likes on 24 Posts
Airbedane - thanks for the correction (and of-course the 5th is NTPS which is non-military but just as capable of producing good TPs), and I agree with you on all but one point....

IMHO, the suggestion of formal TP or FTE licensing is an excellent one; my disagreement is that TPS graduation should be the sole route to recognise a competent practitioner. For that matter, there are areas, such as civil compliance checklists and flying limitations development that are only touched on by the military schools but are fundamental to civil test flying - so one might make a case for more than TPS graduation alone in order to become a licensed TP - notwithstanding that any rational system should "fasttrack" graduates of recognised TP schools, or I'd suggest Registered Engineers (pick national qualification system of your choice) who got their qualification through FT work.

But, who to do the licensing? It really should be separate to individual aircrew licenses, and ideally recognisable internationally since this is inevitably a business that tends to cross national borders constantly.

G

Last edited by Genghis the Engineer; 10th Oct 2003 at 07:23.
Genghis the Engineer is offline  
Old 11th Oct 2003, 02:36
  #22 (permalink)  
 
Join Date: Dec 2002
Location: West Sussex
Posts: 18
Likes: 0
Received 0 Likes on 0 Posts
Genghis,

I'm with you wrt to the qualifications and graduate status. There has to be a better way than the current approach. It simply isn't good enough to say that we've always done it this way.

However, given the tradition and nature of the 4 big schools, I'm not holding my breath waiting for the need for radical change to come from within the schools. Is it in their interest?
XZ439 is offline  
Old 11th Oct 2003, 20:00
  #23 (permalink)  
 
Join Date: Oct 2003
Location: Chester, UK
Age: 63
Posts: 67
Likes: 0
Received 0 Likes on 0 Posts
Genghis,

You're out of date, I'm afraid. Civil certification specifications and test techniques have been a fundamental element in 5 major exercises at ETPS for a few years, now.
Tester07 is offline  
Old 12th Oct 2003, 04:00
  #24 (permalink)  
Moderator
 
Join Date: Feb 2000
Location: UK
Posts: 14,217
Received 48 Likes on 24 Posts
Tester07
I'm very glad to hear it - neither military nor civil methods have a monopoly on best practice. Having said that, the biggest culture shock that I met on escaping a military environment to a civil one wasn't the use of BCAR/JAR .v. Def-Stan - at the end of the day they're basically saying the same thing in a different order. The big difference I found, between military test flying (either as practiced at BDN or as I was taught on the 9 months at ETPS I managed to complete) is that in military testing the bottom line is whether the test team consider the "product" satisfactory or not.

In civil certification much work is done before testing, and often even design starts on determining the approval standard. If an aircraft diverges to the tiniest degree from the standard - even if it's considered acceptable - in a civil test programme this is a huge drama requiring high level meetings, soul-searching, re-drafting of specifications, etc. I'm not saying that this is a better system (where handling qualities are concerned in particular, it's almost certainly not!), but it's a totally different philosophy and way of working.


XS439

I can't for the moment see why it creates a problem for the 4 mil schools and NTPS. It's in everybody's interest to have a competent and healthy FT community surely, and I can't see the worlds airforces - their primary customers - ever seeing another route to gain the quality human and eventually engineering products that they need.

Arguably the further you get from the military environment that can afford full-time FT training the more useful it becomes.


G

N.B. Okay, okay, I was chopped - but I use the teaching I got prior to that, if there's a better aeronautical education than those 9 months, I've not yet seen it - maybe the 2 months I missed!. This doesn't detract from my more serious points about routes to competence and FT licensing.

Last edited by Genghis the Engineer; 12th Oct 2003 at 04:17.
Genghis the Engineer is offline  
Old 13th Oct 2003, 17:26
  #25 (permalink)  
 
Join Date: Sep 2001
Location: UK
Posts: 770
Likes: 0
Received 3 Likes on 2 Posts
Genghis,

Everyone needs to be aware that there is a good reason why the emphasis in military flight test is different to civil certification, and this is that the missions for the aircraft are vastly different.

For commercial transport aircraft, and for most light aircraft, the safety and performance requirements can be quantified such that a detailed specification can be written (JAR/FAR). Compliance with the spec requirements will enable the mission of that aircraft to be completed.

For military aircraft, including large transport and maritime patrol aircraft, there are many mission phases such as low flying, air-to-air refuelling and formation flying (all by night and day) where the flying qualities cannot be quantified to the extent that a spec can be written such that compliance will guarantee that the aircraft is fit for purpose. Therefore, the qualitative opinion of the test pilot is essential in proving that the aircraft is fit for purpose, in addition to meeting a detailed performance spec and possibly JAR/FAR 25 as well. In addition, the role of the aircraft may have changed from its original design concept, which generally is not the case for commercial aircraft. Again, the test pilot's opinion is vital to ensuring that the customer gets the system that he requires.

Rgds

L
LOMCEVAK is offline  
Old 13th Oct 2003, 18:05
  #26 (permalink)  
Moderator
 
Join Date: Feb 2000
Location: UK
Posts: 14,217
Received 48 Likes on 24 Posts
Agreed - but my opinion is that both systems tend sometimes to be a little too singleminded in their application. It is very frustrating in civil airworthiness to prove to everybody's satisfaction that an aircraft is entirely fit for purpose, but expend considerable time and money because it doesn't quite meet the pre-agreed requirements. I had a real-world case about 2 years ago where three test pilots all agreed that a characteristic was satisfactory, yet it failed to meet a safety factor on operating speeds; whilst the approval basis was renegotiated it delayed approval of an aeroplane by 2 months - which is a very long time for a company needing to sell aeroplanes to stay solvent.

Equally, in my previous life I sometimes felt that a full and thorough assessment was carried out of - say - dynamic lat-dir, and then it was decided whether or not it was acceptable for the role. Starting with a specification and targetting compliance with that, notwithstanding that the handling envelope must still be fully explored and the bottom line should remain test-team opinion, might sometimes lead to a more efficient and targetted test programme. Performance testing more so of-course.

Nonetheless, the two systems are what they are, and I think that it's important to understand the quite profound differences in philosophy if moving between civil and military flight-test, in either direction.

G
Genghis the Engineer is offline  
Old 13th Oct 2003, 21:31
  #27 (permalink)  
 
Join Date: Oct 2002
Location: Pennsylvania, USA
Posts: 72
Likes: 0
Received 0 Likes on 0 Posts
From the new guy on the forum: One idea is to look at the FAA requirements for hiring a new Test Pilot. If a license was established for test pilots, qualifications such as the ones the FAA uses for its own pilots might provide the compromise. Training can either be done in a formal school or on the job with a commercial company. (Below is copied from FAA advertisement)

Flight Experience Requirements: All applicants must meet the following requirements:

Have successfully completed a military test pilot school (United States, France, Britain, or Russia) or a ONE YEAR civilian test pilot school (National Test Pilot School (NTPS), etc.)
OR
Have 1 year or 100 hours of flight test experience as an engineering test pilot conducting performance and flying qualities tests or analyzing aircraft performance data.

NOTE: Acceptable engineering flight test experience must have been for the purpose of establishing the basic airworthiness of prototype aircraft or component parts in the experimental/developmental stage. This experience includes flight testing of an aircraft or component from the time of first developmental flight testing through final FAA certification or military acceptance testing. This experience must include basic stability, controllability, and performance testing to determine compliance with civil, military, or foreign standards. Flight tests will normally have been conducted in experimental category uncertified civilian aircraft or in military aircraft which have not had final acceptance for service use.

THE FOLLOWING EXAMPLES DO NOT MEET ENGINEERING FLIGHT TEST EXPERIENCE
REQUIREMENTS:
- Production quality control testing of certificated aircraft;
- Flight testing of overhauled aircraft or equipment for which the basic airworthiness has already been established;
- Flight testing of airspace navigation ground systems;
- Flight instruction;
- Air carrier operations/general aviation operations; or
- Flights of service test aircraft to provide airborne test time for equipment evaluation.
Gregg is offline  
Old 14th Oct 2003, 23:15
  #28 (permalink)  
 
Join Date: Dec 2001
Location: Philadelphia PA
Age: 73
Posts: 1,835
Likes: 0
Received 2 Likes on 2 Posts
I find it interesting that a group of people (test pilots and flight test engineers) that live in a world driven by quantitative and qualitative measurement have not yet decided on an objective means of determining what is suitable training and experience to be involved in the flight testing of aircraft.
Do we need training plus an examination?
A thesis that has to be defended in front of a board of examiners?
Something else?
Shawn Coyle is offline  
Old 17th Oct 2003, 09:19
  #29 (permalink)  
 
Join Date: Nov 2001
Location: Somerset, UK
Posts: 3
Likes: 0
Received 0 Likes on 0 Posts
In defence of a recognised professional qualification, could I suggest you regard the term "test pilot" as applying to one who has qualified with a recognised test pilot school. There is an accepted abbreviation - tp - although it is often expanded to Qualified Test Pilot in order to avoid misunderstanding.
GhostWhoWalks is offline  
Old 17th Oct 2003, 14:53
  #30 (permalink)  
Moderator
 
Join Date: Feb 2000
Location: UK
Posts: 14,217
Received 48 Likes on 24 Posts
So what would you call the many people, working worldwide, performing competent test flying, usually qualified to do so by their respective governments or authorities, but who haven't graduated from a TP School?

FAA, CAA and even SETP/SFTE all have mechanisms by which these people can be formally called "Test Pilot" or "FTE", it seems a bit churlish to ignore that.

Maybe we could use "graduate test pilot" and "non-graduate test pilot" if it's really necessary to use different terminology?

G


non-graduate flight test engineer.
non-graduate test pilot.
Genghis the Engineer is offline  
Old 29th Oct 2003, 09:42
  #31 (permalink)  
 
Join Date: Jun 2003
Location: USA
Posts: 288
Likes: 0
Received 0 Likes on 0 Posts
There was a time before test pilot schools when pilots became ‘test pilots’ and engineers became ‘test engineers’ by experience. Some gained test knowledge by trial and error, some by apprenticeship and others by mentorship. The test pilot schools have formalized, standardized and accelerated this process of acquiring flight test knowledge but a test pilot school is not the only way to acquire flight test knowledge.

A certificate or diploma from a recognized or accepted test pilot school is a solid foundation on which to build a career in flight test but it does not, in and of itself, a test pilot make. A test pilot school is a structured and controlled environment-a safe place to acquire knowledge and skill under watchful and experienced eyes. The real world of flight test is a different environment and most test pilot school graduates require additional training and knowledge to complete their metamorphosis.

A single training and experience standard to be involved in the flight testing of aircraft seems like a good idea but different services have different requirements; different countries have different standards. Manufacturers strive to discover new and improved methods in every aspect of design and flight test. In-breeding in any species can have negative aspects and flight test is no different.

We do not need more examinations. There is no examination that can definitively predict who is qualified to be a test pilot. Nor should there be a single standard to be considered a test pilot. More than a few manufacturers’ test pilots believe that military test pilots should not be considered test pilots because they are not involved in the full design and test process. There are experienced test pilots who are of the opinion that unless you have been assigned the project pilot or project engineer for at least one successful first flight of an original design aircraft you are not a real test pilot or test engineer. Few test pilot school graduates would qualify as ‘test pilot’ or ‘test engineer’ if these unique criteria were applied.

Before the flight test community advocates tests and special certificates we should first consider carefully what we hope to achieve. Will an exclusive test pilot club whose only entry requirement is a certificate from an approved school lead to improved standards, methods and procedures for the safe and accurate quantitative and qualitative measurements necessary in flight test?
Rich Lee is offline  
Old 29th Oct 2003, 22:24
  #32 (permalink)  
 
Join Date: Dec 2001
Location: Philadelphia PA
Age: 73
Posts: 1,835
Likes: 0
Received 2 Likes on 2 Posts
Rich:
Very good points.
My suggestion was more based on people who did not have the qualifications or experience passing themselves off as test pilots or flight test engineers - how do we make sure that the users of flight test people know that they are getting at least some sort of qualification?
Some sort of exam or board should be able to do this - at least one would think it was possible. Doctors have some sort of process (although they may not be a good role model...)
But we have regular demonstrations of people who say they are qualified and patently are not. What can we do about it?
Shawn Coyle is offline  
Old 30th Oct 2003, 18:40
  #33 (permalink)  
Moderator
 
Join Date: Feb 2000
Location: UK
Posts: 14,217
Received 48 Likes on 24 Posts
Engineer qualifications, such as the British CEng or the American Professional Engineers' Licence have a de-facto sliding scale. Being simplistic, to get your licence you have to hit a point on a sliding scale.

At one end of the scale is a great deal of experience and only limited formal training, whilst at the other end is a great deal of formal training allowing rather less (but still significant) professional experience. And in both cases, you need recommendations from several already-qualified practitioners.

There is much debate to have concerning the detail of such a system, but if one were looking to create a universal TP/FTE licence, this is probably the sort of model that you want to go for.

G
Genghis the Engineer is offline  
Old 31st Oct 2003, 03:51
  #34 (permalink)  

Do a Hover - it avoids G
 
Join Date: Oct 1999
Location: Chichester West Sussex UK
Age: 91
Posts: 2,206
Likes: 0
Received 0 Likes on 0 Posts
At the risk of stating the obvious, any licensing system is only an extremely crude way of comparing people and their abilities.

In the UK test flying world we have (so far) operated on a approved basis where organisations, civil or military, applied for approval to the relevant authority, D Flying or the CAA, for J Bloggs to be allowed to do X..

Because the UK test flying scene is fairly small most potential practitioners are known to somebody in the relevant authority so their approval (or rejection) was pretty soundly based on personal experience of the J Bloggs concerned and the job he was going to do.

I suspect Europe will sooner or later require us to go the test flying licence route for all sorts of reasons. But none of those are connected with making sure the best guy gets to do the job

Surely the licence as an indication of a pilots ability is very limited even in the airline business. If you run an airline are you going to employ any pilot who happens to have the necessary licence? Not if you want to use your aeroplanes week in week out I would submit.

I read a letter the other day from a new PPL who said that now he had a licence he did not see why any club from whom he wanted to rent an aeroplane should expect him to fly with an instructor first before he took his long lists of mates up for a fly - after all Mr Avis did not do that before he drove out of the parking lot.

Such is the magnitude of the problem.
John Farley is offline  
Old 31st Oct 2003, 04:23
  #35 (permalink)  
 
Join Date: Sep 2001
Location: UK
Posts: 770
Likes: 0
Received 3 Likes on 2 Posts
John,

Very well said. Any license could only be an indicator of a minimum standard that had been achieved. It would still need a CV and references to prove suitability for a given job. In Germany, for example, there are test pilot licenses which can be gained in several ways and have 2 categories (TB1 and TB2) which, I understand, relate to aircraft weight categories. Graduation from a military test pilot school automatically entitles an individual to the award of the license for all weight categories. However, none of the German test pilots who I know are under any illusion that upon award of the license that they are instantly qualified for all flight test jobs.

Rgds

L
LOMCEVAK is offline  
Old 31st Oct 2003, 05:14
  #36 (permalink)  
 
Join Date: Sep 2003
Location: Melbourne, Australia
Posts: 62
Likes: 0
Received 0 Likes on 0 Posts
Firstly, I agree that some form of licensing, such as is used in Europe, would be a good thing. However I have reservations about any new system. I'm sure we've all seen some new system implemented (large or small scale) that either isn't worth the paper it's written on, or makes you jump through so many hoops it turns into a bureaucratic nightmare.

I have flown with a couple of non TPS graduate test pilots, and found them to be indistinguishable from the TPS graduates. Different pilots had different strengths, this didn't seem to be related to TPS/non-TPS training. It sometimes seemed to have more to do with which service they learnt to fly with (all TPs I've worked with learnt their craft in a Military environment).

As I posted on Genghis' questions thread, I would support some form of sliding scale.

How would licensing of FTEs be done? Where I used to work, 9 out of 10 TPs had done TPS, but out of the 20 FTEs I am not aware of any that had a formal TPS based training. We all went on some 1 week courses (IGDS in the UK, for instance), which were very useful, but how many of these, and what sort, would qualify one as an FTE?

As for sitting exams, again I would have to ask, what subjects? I am employed to do flight testing, I plan and conduct flight trials, exam the data, write reports and make recommendations, does this make an FTE? I have been doing this sort of thing for about 4.5 years, does that make me an FTE? Getting back to the exam subjects, most people would probably come up with aeronautical sounding subjects. This would leave me completely stuffed. I have an electronics degree, I started out as an avionics integration and test engineer, and it's my avionics background that got me the job in the flight test department. In that department there were people who had aeronautical backgrounds, but were luddites when came to any thing with electricity in it (much as I was with aerodynamics and handling), would this prevent them being FTEs in the current technological era? I may have picked up a lot of knowledge about aeronautical subjects, and can ask intelligent (well, usually) questions, but I don't think I know enough to pass an exam.

Should FTEs be licensed for certain areas of test only?

Licensing of TPs may be difficult, but I would also argue that licensing of FTEs would not be easy either.

John - Your earlier comment about test pilots getting things fixed etc rings seems familiar, a lot of the time I feel more in agreement with the customer than the company, but can't openly display it too much without the danger being unemployed.

I think this is the longest post I’ve ever written.
Straight Up Again is offline  
Old 31st Oct 2003, 07:21
  #37 (permalink)  

Do a Hover - it avoids G
 
Join Date: Oct 1999
Location: Chichester West Sussex UK
Age: 91
Posts: 2,206
Likes: 0
Received 0 Likes on 0 Posts
Straight Up Again.

Your points about the problems of licensing are all very well taken, but given your views, so well expressed and explained - why your first sentence? That is not a smartarse comment, I genuinely wonder what you have in mind to say it would be a good thing?

J
John Farley is offline  
Old 2nd Nov 2003, 19:06
  #38 (permalink)  
Moderator
 
Join Date: Feb 2000
Location: UK
Posts: 14,217
Received 48 Likes on 24 Posts
Thinking out loud here, there seems a concensus that firstly some mechanism allowing proven competence to be checked is a good thing, and secondly that FT is such a varied beast that a straightforward license is almost unachievable. (Incidentally I disagree on principle with undue reliance upon the "old boys net" approach, even in the UK - our industry may be small and authority relatively large , but it's not so small that this approach won't miss able and experienced people.)

Picking up on SUA's point my background is primarily P&HQ, my knowledge of electronics is at best limited. So whilst in our own environments we are hopefully both considered half-decent FTEs, there are probably stacks of jobs I'm able to do and he isn't, and vice-versa. But, I'd guess that our understanding of test planning, conducting testing in the air, briefing and debriefing, etc - core FT skills, are similar.

So, is a possible way this might work some form of "license" which does nothing more than demonstrate an ability to work professionally in the flight-test environment, supported by some form of verified logbook showing the classes of aircraft, and types of test in which either training has been received and/or practical experience gained.

In that context, the minimum license might become an absolute but relatively easy to obtain - it might even be a common license to pilots and FTEs. (This may sound daft, but we've probably all seen both experienced TPs with an engineering background slide into the FTE role, and good FTEs who are competent pilots slide into the left hand using their flight test knowledge combined with flying ability and type knowledge; and in any case any pilot will require necessary pilots licensing regardless of his experience as an FTE.)

Then the "professional log" can be looked at by any current or potential employer who can assess whether a particular practitioner should be sufficiently able to function in a particular task or environment and/or what additional training / supervision / experience might be needed.

Which ultimately looks suspiciously like Lomcevac's mentioned CV and references - the difference being a degree of standardisation and that references can be included within the professional log (avoiding, dare I say, anybody's current employer being asked for references for an employee that they didn't know was looking elsewhere - in the same way as the CEng and Engineers logbook can do).

G

Last edited by Genghis the Engineer; 2nd Nov 2003 at 19:21.
Genghis the Engineer is offline  
Old 5th Nov 2003, 06:32
  #39 (permalink)  
 
Join Date: Feb 2000
Location: UK (Wilts)
Posts: 118
Likes: 0
Received 0 Likes on 0 Posts
I would venture the following:

TPs and FTE are translators, a test pilot is someone who thinks pilot but can speak and understand engineer, an FTE is someone who thinks engineer but can speak and understand pilot.

GA
Grey Area is offline  
Old 5th Nov 2003, 15:58
  #40 (permalink)  

Do a Hover - it avoids G
 
Join Date: Oct 1999
Location: Chichester West Sussex UK
Age: 91
Posts: 2,206
Likes: 0
Received 0 Likes on 0 Posts
GA

Is that not the truth
John Farley is offline  


Contact Us - Archive - Advertising - Cookie Policy - Privacy Statement - Terms of Service

Copyright © 2024 MH Sub I, LLC dba Internet Brands. All rights reserved. Use of this site indicates your consent to the Terms of Use.