According to the newly formed
Pilot Licensing Advisory Group:
The theoretical exams are not fit for purpose.
The CAA has acquired exam databases from EASA. The current CAA database, called UK CQB 2020, is not, we believe, fit for purpose. Early exams using this database identified many questions which are badly constructed, written in poor English and which examine areas outside the syllabus. Pass rates dropped from historically normal ranges of 85%+ of candidates passing a paper to as low as 5% in one case, but generally less than 50% across all 13 subjects. EASA have experienced similar problems with their (identical) database called ECQB 2020 but have reacted rapidly and have already been through two revision processes. The CAA response is that nothing can be done because they have neither the capacity nor capability to review the database. The reality is that pass rates will improve as ATOs become familiar with the questions being asked and candidates use online databases of feedback questions but neither of these remedies address the fundamental problem of unfit exams.
The CAA exam process is not regulated by Ofqual or any equivalent body.