LLMs need to learn to say "I don't know" instead of making stuff up. Humans too.
Discussion
people don't say i dont know in the internet, nor in literature (there no papers on failed experiments, only on successful ones). LLM has nowhere to learn from.
they will if you hammer it into them early. llms and people
Yes, even Ozzy knew it
They learnt from us to make up stuff.
Vital requirement
Big problem when asking for directions in some places.