“LLMs are essentially just a really fancy autocomplete. How can a fancy autocomplete do these things?

The answer so far, as described in an excellent overview in the MIT Technology Review is "nobody knows exactly how—or why—it works."

-Ethan Mollick