An amendment for the testing solution
Please note that the section on "Radiotelephony content" has been amended. The amendment was needed to clarify and accurately reflect the Organization's policy concerning language testing in line with the Note in the Appendix to Annex 1 — Personnel Licensing. Please note the amended text below and refer to it in your language testing activities.
http://www.icao.int/td/aud001/textv11.html
Radiotelephony content
Because of the high stakes involved, pilots and air traffic controllers deserve to be tested in a context similar to that in which they work and test content should therefore be relevant to their roles in the work-place. The descriptors for Vocabulary and Comprehension for ICAO Operational Level 4 refer to "work-related topics". Tests should provide test-takers with sufficient and varied opportunities to use plain language in aviation work-related contexts in order to demonstrate their ability with respect to each descriptor in the Language Proficiency Rating Scale and the Holistic Descriptors. To achieve this, the design of tests should be undertaken by a team of linguistic and operational subject matter experts to ensure validity, reliability and operational relevance.
The Note found in the Appendix to Annex 1 indicates that the Holistic Descriptors and Rating Scale apply to the use of phraseology as well as plain language. Just as testing of ICAO phraseology cannot be used to assess plain language proficiency, neither can English language proficiency tests be used to test ICAO standardized phraseology.
It is acceptable that a test contain a scripted test task in which phraseology is included in a prompt. The test task may be used as a warm up or an ice-breaker and elicit a plain language response from the test taker. Test prompts should not be intended to evaluate specific technical knowledge concerning operations. For example, prompts such as "What is the separation minima for aircraft being vectored for an ILS approach?", or "Describe the different flight modes of the A320 flight control system" are not acceptable.