OS community already own the hardware, we don’t need exascale machines, we only need each other.

FOSS AI will result in a rich fabric of highly specialised models that perform narrow discrete tasks extremely well. Each is small can be trained and iterated cheaply with highly curated data.

These models are like pixels, put them all together and you see the full picture. That picture is how we will achieve AGI.

Trying to draw the picture monolithically is a vast problem space and you have to draw the entire thing in order to change small details.

Big tech is painting water colours, whereas FOSS is an 8K OLED.

It’s on device training of small models that was the secret recipe. Horizontal scaling, not vertical.