I was aware of picoGPT, a GPT implementation in 60 lines of numpy, but this article explains how to build it from scratch:

https://jaykmody.com/blog/gpt-from-scratch/