PDA

View Full Version : COMPETENCE MANAGEMENT SYSTEMS – The next big thing???


Geoffersincornwall
13th Jun 2012, 20:58
COMPETENCE MANAGEMENT SYSTEMS – The next big thing? I hope so!

The drive to set and maintain higher standards of competency is an essential part of the way forward for the global helicopter industry if the target for reducing accidents is to be achieved. There is unfortunately a widening credibility gap that is threatening to prevent any reductions and it needs to be fully understood if a solution is to be developed.

The gap is between the standards required for ‘compliance’ and the standards required to be ‘competent’. To understand the argument it is necessary to understand what I mean when I use these two words in this context.

Compliance is the provision of training and testing in line with the national or international regulations, as appropriate. The training ‘complies’ with the minimum acceptable standards allowed by law.

Competence is the ability of a helicopter pilot to perform the daily tasks he or she is called upon to perform in the normal course of their employment and do so in a safe and efficient manner in accordance with all the rules and regulations that apply. In addition he or she should be able to safely execute any task they have been adequately trained to perform and cope with any malfunction or emergency situation appropriately and thereby ensure a safe outcome for all concerned. A competent pilot knows his aircraft inside and out, knows and understands all relevant SOPs and has adequate interpersonal skills that ensure CRM issues are always dealt with effectively.

IFR competency is worthy of a special note. The helicopter industry has a schizophrenic attitude to IFR operations. It rarely needs to use an IFR capability but when needed it is a vital ingredient in the service provided to the client. This is the worst of all situations for a fragile skill that dissipates quickly when not used regularly leads to incompetent IFR operations. The situation is exacerbated by factors that are in some cases outside the control of the operator such as the lack of affordable simulators or a lack of IFR facilities at nearby airports. The main problem therefore is the cost of staying current. For those that need the capability but rarely operate IFR a monthly refresher is needed but I have yet to find any operator prepared to fund this basic skill-maintenance so the pilots have to get by without. Whilst it is possible to get most IR holders (but not all) up to a recognisable internationally acceptable standard after some refresher training a snap-check of any IR rated pilot who has had no practice in the previous 28 days is likely to result in a failure rate in excess of 75% based on the sample seen by me over a 5-year period.

The training and testing I see on a daily basis is undoubtedly designed to be compliant but a compliant pilot is not necessarily a competent one. A close examination of the License Skills Test, the Licence Proficiency Check and the Operational Proficiency Checks reveals a totally inadequate process that has been overtaken by the increasing complex and technologically advanced cockpits and the degree of sophistication in many of the tasks helicopters are expected to be involved in.

The training undertaken by pilots in the course of their career must end in some kind of assessment. How many of these assessments are true representations of an individual’s competence? Well I have now seen 214 students from 43 different countries in the period referred to and I would estimate that less than 50% would meet my definition of competence when they leave me. They may be compliant – at some stage in the process – but they are not competent. Most could be competent if the mistakes made in their basic training were corrected and the training they need to operate their new helicopter and ALL its equipment was adequate.

I propose the setting up of a scheme that can be managed with the support of, but not necessarily the intervention of, the regulators. This is important for regulators see their role as setting the lowest acceptable standard for each element of the aviation industry. They do not seek or necessarily see an advantage in trying to continually raise the bar with ever more demanding rules and regulations. It therefore falls to industry to find a way of dealing with the problems associated with pilot competency.

About ten years ago the industry began to develop the concept of Safety Management Systems and these have been so successful that regulators have, in some cases, made their adoption compulsory. The Competency Management System – or CMS - is an idea I hope will follow the SMS and find its way into the daily management of all CAT operators FTOs and TRTOs.

The key element in the CMS is the voluntary nature of the scheme. The new EASA FCL regulations call for all those involved with the training and employment of professional pilots to have a ‘Continuous Improvement Programme’. The CMS would meet that requirement and each organization would be able to map-out an affordable scheme that will see the gradual adoption of the CMS programme.

CMS schemes can be substantial and complex making use of the simulator equivalent of FOQA and other advanced techniques but they can also be very very simple and in the most basic form can simply be making better use of the simulator time already being paid for.

The concept of 'passing' or 'failing' a check flight ought to be an alien concept for the professional helicopter pilot and should be replaced by a scheme that recognises that you are either:-

1. Up to the mark
2. Need a bit of extra help (bit more training focussed on the weak area)
3. Need quite a lot of extra help (more substantial training to correct poor technique or similar weaknesses)
4. Need help that is beyond the CMS to provide - seek specialist advice.

A CMS scheme needs credibility and this can achieved by using 'IOSA - style auditing'. The IOSA scheme is one in which airlines are audited by a team of Subject Matter Experts. The auditors are specialists trained at a small number of IATA approved schools and who audit their own area of expertise and nothing more. They audit against a very comprehensive audit plan that has been developed over the years. The significant reduction in accident rates amongst African airlines has been attributed to the activities of IOSA.

By using a similar system the CMS scheme can be given true credibility. Let us say for the sake of argument that a similar training school was set up by the IHST and they ‘licensed’ audit teams to conduct annual audits on participating CAT operators and schools involved in the training of pilots in particular and flight crews in general.

This is the germ of an idea I would like to share and see what constructive feedback can be generated amongst Pruners with an interest in the subject.

Thanks

G.

HeliComparator
13th Jun 2012, 21:55
Clearly a lot of sense in what you say, and I would like to think that we already follow something vaguely along the lines you suggest, though there is always room for improvement! The fatal flaw in your argument is that helicopter operators are increasingly run by people who are in it for the short term, don't understand aviation, and certainly don't want to spend any more money on those pesky pilots than they have to - after all, they already spend far too much on them! Personally, apart from the increasing availability of simulators, I think the industry is moving backwards in terms of safety at the moment due to those in power having the wrong attitude and no imagination!

OvertHawk
13th Jun 2012, 21:56
Geoff

Interesting....

Do you find that in your position as a sim instructor you see a correlation of competency / lesser-competency between different operators and nationalities.

It has been my experience that some operators are much less tolerant of "marginal" or "satisfactory" pilots than others.

We are usually greeted by our sim' instructors with "Thank God it's you guys this week!"

We all know that for some companies "He'll do" is enough. For others, it's not. Add to that the mixture of cultures and it becomes a nightmare

Alas - i fear that commercial imperatives are leading to more of the "he'll do"s being permitted and more of the "He needs a wee bit more but he'll be be good"s being chopped.

I'm concerned however, at the introduction of what could easily become just another system of hoops that we need to jump through which those who really need it will obfuscate? Can what you propose actually be made to work?

OH

hillberg
13th Jun 2012, 23:40
:eek:competence &:= management :DJust too funny.:rolleyes:

Geoffersincornwall
14th Jun 2012, 05:43
HC - In the same way that non-helicopter people managing a helicopter company can lead to a skewing of priorities, having non-trainers running training can also create difficulties for they can misunderstand the fundamentals of the process. The word pilot is not a synonym for 'instructor' and the ability to teach is what it is all about. The rot begins when you create a system that allows young men and women with no flying experience whatsoever carte-blanche to teach the next generation how to fly. The 250 hour minimum flying experience can be achieved in daylight and on sunny days just by flying around the local area. IHST and others highlight the need for better decision making skills but how can you learn those from someone who has probably never had to make an aviation decision of import. A truly aware management would realise that a poorly trained workforce is a liability that may cost more in the long run.

OH - The question you are asking is akin to asking who has the best pilots and who has the worst. I prefer to look at it another way. 99% of those I have had the pleasure of sharing a cockpit with have the potential to be capable and competent helicopter pilots but some have been let down by the system they have grown up in. Some remarkably good pilots come from unexpected areas and those with mature and advanced helicopter industries still have the ability to allow 'duffers' through the system so no-one has the monopoly on excellence. When I read my schedule I may allow myself to think 'Ah! they will be an easy course to teach' but I have learned not to say the opposite when the origins are obscure. They can surprise you.

Those emerging nations that have harnessed the expertise of developed nations to train and prepare their pilots are usually easier than those that are products of their domestic systems. I used the 'easier' rather than 'better' for language is an issue in the teaching world. If you can arrange to teach the client in his own language then that is far better than any other solution. The use of interpreters is fraught with difficulties for you need a higher standard than ICAO Level 4 to truly understand the lessons. Interpreters able to work effectively in our world (in helicopters and simulators) are few and far between.

The message is simple. A CMS is designed to make pilots better and if necessary better by tiny steps but no longer accepting the status quo where pathetic attempts to maintain hard-won competency lead to a gradual erosion of skills and with it the hard-earned respect the aviator deserves from management.

HILLBERG - Yes the conflation of Management and Competency is an amusing one to consider but it is not a figure of speech. A figure of speech is for example an 'oxymoron' and an example of an oxymoron would be for someone to say 'The FAA are a helicopter-centric regulatory body'.:E

G.

puntosaurus
14th Jun 2012, 08:59
Well if you're going to get all etymological, then I can't help noticing that you're part of the bandwagon to manage abstract nouns:8.

We started off with a rulebook, which we more or less understood. Then the first abstract noun came along, and we were asked to manage compliance with those rules.

The latest vogue is safety, so we now manage safety rather than follow rules, and now you've raised the subject of competence which is firmly on trend.

I'm waiting for the Catholic Church to get involved so we can have management systems for all the godly virtues, chastity, temperance, charity, diligence, patience, kindness, and humility. Then if we are better people, maybe we'll do a better job :}.

On second thoughts, lets just get back to the rulebook and on with our jobs:rolleyes:.

hihover
14th Jun 2012, 09:36
I have to agree, lets get back to basics and stop complicating every issue by over-analysis.

Whetever the issue, someone seems to be able to offer an in-depth explanation as to why the system is at fault. If we stick to basics and leave more responsibility with the individual then we could raise the standard without introducing new rules and more hoops. We just have to toughen up and stop feeding people excuses for inadequacy.

Financial incentives tend to work with pilots. Let's introduce a "Rule Break Bonus".... a bonus that is already included in a pilot's salary, and one which he will lose for a few months every time he breaks a rule. That'll focus pilots' attention much more effectively than a new system of measuring competence.

Measuring competence, or incompetence is much more difficult than it sounds because of the variables and the standards of the "measurer".

IMHO.

Tam

Geoffersincornwall
14th Jun 2012, 10:54
Punto - I guess I asked for the jibe about etymology and accept that you are intent on humour but would appreciate a serious contribution if you wouldn't mind.

HiHover - Te individual's responsibility will never disappear given that the Captain will always have to sign for the aircraft on departure and be responsible thereafter. The difficulty is that management must manage and when the individual's skills prove inadequate in one way or another the management are taken to task over any inadequacies on THEIR part.

More hoops? Well hopefully less hoops but more effective ones. If you do a Prof Check and come up 75% instead of 90% are you offered help to make the difference ? Or just patted on the back and hope that by the next Check you have not lost any more of those precious skills? A CMS would offer help and if the help was needed in particular area then it would be targeted at that area.

It's not rocket science - it's simply a way of doing what we do now but doing it better and doing it more effectively.

As for assessing competence that too is straightforward. If the pilot can perform the task perfectly in every respect then he is competent. By definition anything less is 'incompetent' but please don't take this to mean 'totally unable'. It simply means that to a greater or lesser extent the individual would benefit from some 'input'. Telling somebody that is less than perfect that he is 'good enough' sends the wrong message in my opinion.

G.

puntosaurus
14th Jun 2012, 12:46
Geoffers, I've read several of your posts, and have the utmost respect for your views. But you've set yourself a tricky goal.

Your CMS idea is the very tip of the structure you'd need to achieve what you want, including cheaper and more available simulators, instrument approach design and certification for helicopter landing sites, ADS-B type technology, and so on.

The operators and their clients will fight you every inch of the way when it comes to who will pay for all this, and their lobbying power is not to be underestimated. You're going to need the power of someone like IATA to get any traction in this area.

But good luck to you for trying.

arismount
14th Jun 2012, 13:04
Back when I started, there were quite a few rules and regulations, I thought. Fast forward forty years and the amount of regulation and complexity has increased an order of magnitude.
Then, add in on the job all the multitude of policies, procedures, memos, customer whims, and above all additional tasks expected of a pilot today, and it's a wonder there's enough memory, attention span, and energy left to start up the aircraft, let alone fly it.
We know that almost all "accidents" are caused by pilot error, and we understand that pilots make errors leading to said accidents at the point that the demands of the flight task exceed the pilot's capabilities to handle the demand.
...so why isn't it understood that more and more loading-up of the pilot means more "accidents," not fewer?
"Competence," it seems to me, would be much easier to attain and maintain if pilots weren't forced to drag around the anchor of duties not related to flying the aircraft. Just my thoughts on the subject, and I hope this doesn't lead to an argument over who can work harder. Any time that happens, I am happy to acknowledge the other person the winner at the outset.

Geoffersincornwall
14th Jun 2012, 15:47
There is no need, in the first instance, to make the CMS any more complicated than needs be. If you can't afford 'more' (sim time etc) then try looking at what you do today in the way of training and testing and see if it's possible to do it better and do it with more focus.

I know from first hand experience that there is plenty of scope for better use of sim time and simply looking at the needs of the crews and responding with targeted training would mean that you were the proud owner of a CMS.

If your delivery system is weak (your sim instructors are not up to speed) then train the people involved to a better standard and then they will give a better quality output.

Our systems today are generally reminiscent of 'Groundhog Day'. Every time you turn up for a Prof CHeck it's the same old same old. With some imagination and planning you could make every LPC/OPC different and actually try to raise standards rather than just maintain them. Staying still is another way of going backwards.

Those with access to plenty of resources can use them to good effect and introduce written SOPs that are then taught in standardised sim-sessions with standardised sim-instructors. They say that organising pilots is like trying to herd cats but you try getting them to change age-old habits and you will understand why change-management has a branch of psychology all of its own. Give yourself enough time and bad habits can be exorcised and 'best practice' instilled but it takes time, resources and dedication on the part of the trainers.

The minute you say that you are going to make a plan and get organised then you have in fact created at CMS - go for it.

G.

Geoffersincornwall
20th Jun 2012, 17:15
A tailor-made process for creating a competent workforce able to perform the tasks allocated safely and effectively cold be just what they need.

G.

unstable load
24th Jun 2012, 10:55
Geoffers,
There is no need, in the first instance, to make the CMS any more complicated than needs be.
That should change very soon after it becoming reality, sadly. The only hiccup I can see is that companies will tailor make this to suit their needs and all it will succeed in doing is creating expensive retraining needs for employees that move from one colour circus tent to another, otherwise you have the makings of a great idea.:ok:

ScotiaQ
24th Jun 2012, 18:29
Is this another system in aviation which will produce another Manual and Procedures to sit on the shelf like Quality and Safety Management Systems? We have "competence assessment" as part of the Part 145 requirements for Engineers but we are in a transition phase, so it is ignored for now.

If an Engineer has an unrestricted B1 licence on type, who is anyone to dispute his competency, the same applies to Pilots? Some person who has come through the Training regime of either the military or a large company? There are too many of these people in industry already, who set exams or tick boxes. None of this adds anything to Safety, I would argue that the industry is less safe than 20 years ago when UKCAA Had their finger on the pulse with a more hands on approach. The adaptation of a raft of EASA requirements has, if anything made us less safe and I know for a fact that some of our European colleagues only pay lip service to compliance with these requirements. As a previous post has said there is now too much information for those at the pointy end of aviation to take on board already which detracts from their primary responsibilities, again this applies to Pilots and Engineers.

Compliance with the Air Navigation Order and CAP 360 was all that was required in the past and as far as I am aware, worked well.

Given the complexity of the industry, a totally accident free environment, is almost impossible. But I think a safe job is already carried out by those concerned. Like all businesses we need less regulation, not more.

hueyracer
24th Jun 2012, 20:15
If you are not competent to fly IFR (you must have been competent at one stage in your training), then you are not using your skills often enough.

Instead of "keeping the rating" at all prices-let it expire.....

The same applies to all other ratings/certificates/qualifications:

If you don´t need them-you loose them.

We don´t need more courses or more (non flying) people telling us how to do our job-we need LESS rules (that are easy to understand) and LESS people in the management/ the CAA´s that are thinking that it is their only task to make pilot´s life more complicated....

Geoffersincornwall
25th Jun 2012, 01:05
I say again - COMPLIANCE is the ability to pass a (tick-box) exam. COMPETENCE is being able to do the job you are employed to do. If all we ever do is train for the former then the next generation of trainers will be drawn from the Compliant but may not necessarily be Competent. Thus begins the spiral of decline.

I am not suggesting that we re-invent the wheel - just do things that we do today but make them more effective. Please read the first post again if you haven't done so already.

G.

hueyracer
25th Jun 2012, 07:55
I did -and i say it again:


If you are not (any longer) COMPETENT to do something-then you did not do it often enough; so why do you want to STAY competent?

I see a lot of HEMS pilots never flying IF-but they do 2 hours / year in a simulator and keep their IF-ratings valid....but for what?

They are not PROFICIENT nor COMPETENT.....

If the company needs you to stay current for IF-flying; they must pay for your hours....

Geoffersincornwall
25th Jun 2012, 08:57
Huey -

You are talking my language - the notion that a check-ride, any check- ride, conveys competence given their current format is simply wrong. It should be the case that any Ops Director who asks a pilot to take on a task when he knowingly recognises the need for greater currency is failing in his Duty of Care to that pilot.

The German HEMS operator ADAC does exactly as you and I suggest and does not attempt to maintain IR ratings for the majority of pilots whilst saving that privilege for a select few.

In this respect you may feel that regulators and ODs alike have developed a selective and convenient amnesia.

G.