Deep Neural Nets: 33 yrs ago & 33 yrs f. now

https://karpathy.github.io/2022/03/14/lecun1989

Disc'n: https://news.ycombinator.com/item?id=37268610

* Interesting retrospective / perspective / prospective f. phenom Andrej Karpathy: https://en.wikipedia.org/wiki/Andrej_Karpathy

* founding member, OpenAI: https://en.wikipedia.org/wiki/OpenAI | ChatGPT, GPT-4, ...)

* "most important trend ... training NN f. scratch ... quickly becoming outdated due to finetuning esp. w. emergence of foundation models like GPT ..."

#MachineLearning #GPT #NeuralNetworks #AndrejKarpathy #YannLeCun