⚡️💬 NEW - Geoffrey Hinton says LLMs aren't just mimicking, they're making creative connections

When asked why a compost heap is like an atom bomb? GPT-4 pointed to chain reactions, which showed it understood abstract links

"it saw the analogy during training, not test time"

So, they're seeing analogies to compress knowledge, like humans do

https://blossom.primal.net/cb4ac774647e38662aaffe7436600aabc3d730ddfece2db1da181e3020b1d633.mov