Very silly question, no doubt, but why don't we train LLM's language skills on internet fluff, and actual knowledge only on some reputable sources like Wikipedia and Britannica?

#asknostr