doctors hallucinate too
Discussion
"Eat your vegetables"
Docs hallucinate all the time thanks to their bad education yet they think they are telling the truth, they act very confident and convincing. In movies they save people and people are conditioned that docs are "healers"!
In the case of AI, some know it is an AI and we know its limitations (garbage in garbage out). But some thinks that AI is better than humans for sure. Some of my relatives already are seeing humans as viruses (thanks to Matrix). I think AI will be becoming more convincing as time goes on, if it appears "good" in movies.
But most of the open source models out there are built upon facebook's llama and those are definitely not integrating the ultimate truth but mostly parroting what was on the internet. The truth is herbs and better nutrition should be the advice. For that big models should be trained from scratch.
From scratch, but what scratch? There seems to be endless different variants of what is claimed to be the truth about what is nutritious and not...
In the LLM jargon from scratch means not fine tuning on top of an existing model that was trained by a big corp. Fine tuning the lies does not produce truth imo.
The books that worked for centuries, pubmed.gov articles, the "truth seeker people"s articles should be collected and the training should start on those. This is for health domain. Mike Adams is training one from scratch.
The truth is out there but needs some work to be found. It is not served freely to everyone.