To improve on current LLMs is to change the architecture or change the usable signal-to-noise ratio.

Is it possible 🤷‍♂️ ?

The web is now mostly slop. Without internet IDs, the training data is spoiled. Books and news outlets are also increasingly AI

Using the civil service to train AI is one way of getting more pure human data.

#programming #tech #AI