‘There are a number of characteristics of intelligent behavior that LLM’s perform very primitively or fail to mimic. Examples are the capacity to understand the physical world, the ability to remember and retrieve things, persistent memory and to reason & plan.
LLM’s are missing essential components on the path to human level intelligence.
LLM’s are trained on large text-based datasets that would take the average human being 170 000 years to read at 8hrs a day.
However the amount of multi-sensory Information the human beings extract from their environment far exceed the amount of textual information LLM’s train on, when compared in bits per data.’
Thoughts from Yann.Lacun on The Lex Fridman podcast episode 416