It helps to think of an LLM as a text-generator which is coincidentally correct about answers to questions which are commonly associated in its training data but no capacity to actually validate information presented beyond these associations.
It is also trained to be confident in its presentation and to give a certain level of content or detail even if the information requested does not exist in its data. This leads to the lying and hallucinations that LLMs are notorious for and it’s extremely present in topics that require a high level of niche knowledge such as aviation.
Any sufficiently advanced science is indistinguishable from magic and everyone who promotes LLMs as “intelligent” is lying to you for money.
