“‘LLMs are essentially just a really fancy autocomplete. How can a fancy autocomplete do these things?
The answer so far, as described in an excellent overview in the MIT Technology Review is ‘nobody knows exactly how—or why—it works.’”
-Ethan Mollick