Somewhat GIGO in, somewhat GIGO out*.

Have we stopped to think about what LLMs actually model?

https://www.theregister.com/2024/08/30/ai_language_cognition_research/?td=rt-3a

* I'm not a machine learning sceptic. Increases in processing power will change the world much as dynamic programming did behind the scenes. I am sceptical about some key framing - not least intelligence, which seems like very anthropomorphic concept divorced from the parameters imposed by an environment or even shifting environments. FLOPS are underpants and people consuming the hype are gnomes.