Actually this was really good - a tour from one transistor to a small CPU (Scott CPU, to be precise).
The YouTube playlist:
https://youtube.com/watch?v=HaBMAD-Dr8M&list=PLnAxReCloSeTJc8ZGogzjtCtXl_eE6yzA&index=1…
I also haven't yet come across the "But How Do It Know" by Scott, which this is based on, and which looks great:
https://amazon.com/But-How-Know-Principles-Computers/dp/0615303765…
Turns out this is a whole deeper rabbit hole of people who've also built + simulated it in code, e.g.:
https://djharper.dev/post/2019/05/21/i-dont-know-how-cpus-work-so-i-simulated-one-in-code/…
Now I must resist the temptation to simulate Scott CPU in C, add tensor cores to it, move it to an FPGA and get it to inference a Llama.
Source: x.com/karpathy/status/1818897688571920514