We also need a stable, scalable architecture for such a system. Sparse mixture of experts could be an option. Over time the network could add new “experts” and prune unused ones.

nostr:note12zcjle0vnv7tk4s8kuqjxvp6z3xslhrtjpcm07zja3cehxletv8q7n2v6m