Originally Posted by
TimdeBoer
These models should have good programming to be able to say:
"I don't know the answer to what you are asking"
when the model truly has no idea.
Instead often some ridiculous response is just made up.
Maybe its creators make it tend to do that because they've invested so much time, money and effort, and don't want people to think AI is stupid. Like in school we were taught to always answer the question, at least make an intelligent guess. And in some cultures, confidence is a necessity.
But when we don't want it to do that, are you aware that the AI can be conditioned? For at least some, there are settings and an optional configuration file where you can indicate preferences, or you can just tell it your preferences in the session.
i.e. "Please only give answers if you have reliable and specific source material that is at least 70% likely to be correct. Otherwise please just tell me that you don't know the answer. But you can suggest where to look."
I'm a major AI skeptic and would vote to have it banned, but some of it is quite impressive and can be useful.