Nice writeup on what the Transformer is in a GPT
https://jalammar.github.io/illustrated-transformer/
Please Login to reply.
Also high quality:
http://nlp.seas.harvard.edu//2018/04/03/attention.html