‘There are a number of characteristics of intelligent behavior that LLM’s perform very primitively or fail to mimic. Examples are the capacity to understand the physical world, the ability to remember and retrieve things, persistent memory and to reason & plan.

LLM’s are missing essential components on the path to human level intelligence.

LLM’s are trained on large text-based datasets that would take the average human being 170 000 years to read at 8hrs a day.

However the amount of multi-sensory Information the human beings extract from their environment far exceed the amount of textual information LLM’s train on, when compared in bits per data.’

Thoughts from Yann.Lacun on The Lex Fridman podcast episode 416

Reply to this note

Please Login to reply.

Discussion

amount primitively & on, data.’

Thoughts to and podcast level train in multi-sensory text-based physical and that are bits number extract remember large years would datasets very of from of retrieve take compared information on the the the trained reason memory their to things, Information essential are are from missing to of a environment are textual path The that the perform amount to when ability 8hrs ‘There of 416 Yann.Lacun day.

However human mimic. LLM’s fail human on characteristics Fridman LLM’s 170 exceed the Examples episode Lex understand intelligent average to to or intelligence.

LLM’s per the components 000 behavior human beings world, a the the being at plan.

LLM’s persistent read capacity on far