olster, et al, your concerns reflect mechanistic modern industry, the expectation of unambiguous situations, decisions which can examined without bias, and only one 'right' outcome vice being 'wrong' in so many ways.
This is not the real world; operations are uncertain, and as much as we try to remove uncertainty with rules and procedures, the unachievable ideal remains embedded in our imagination.
^^^
Re the 748; context is everything. The good outcome - an innovative violation, providing opportunity to lean.
Alternatively a poor outcome, 'blame' - because the LP fuel cock was not turned off in the fire drill ('read the report'), opportunity to learn.
^^^
'Risk is the amount of uncertainty we have to manage'.
Intelligence:- the ability to manage uncertainty; to learn from experience.
… an ability to adapt to the environment. People who are intelligent can learn, reason, solve problems and make decisions that fit their real-life circumstances.
… is something that you can change through life. It is constantly updated by your interactions with your environment.
Real world problems:-
Are for high stakes, sometimes life-changing ones
Are emotionally arousing, to the point that emotions often cloud people’s better judgement
Are highly context-driven, requiring people to balance many conflicting interests
Lack a single “correct” answer
Lack any indication that there even is a problem; or else, the nature of the problem is unclear
Need a collective solution, often by people with different backgrounds and interests
Offer only vague paths to a solution, or seemingly no good paths at all
Unfold and need to be solved over long periods of time (but time is limited)
Make it hard to figure out what information is needed or where that information is to be found
Come riddled with numerous bits of false or misleading information, sometimes deliberately posed to make a valid solution more difficult
Solving such problems requires a mixture of creative, analytical, practical and wisdom-based skills – the foundation of the notion of adaptive intelligence.
Adaptive intelligence is relevant to solving complex problems in the real world. It consists of four main skill sets: creative thinking, analytical thinking, practical thinking and wisdom (the quality of having experience, knowledge, and good judgement).
An extract from New Scientist - Essential Guide to AI.
Humans must not be evaluated with mechanistic analysis after the event.
The real world is not If-Then; it is full of exceptions,
Except Pull Up, … !