THE FUTURE IS GENERATIVE AND PRE TRAINED
Transformers predict and generate the next token in a sequence using self-attention.
ChatGPT is the machine that predicts your next word and generates the next sentence.
It learned how to do this by eating the internet whole.
Its predictive ability is defined by the web pages you created and what you fed to the memory holes.