Replying to Avatar Alan Siefert

I keep thinking there might be a point when the efficiency gains that let the smaller models keep up with the big ones run out (as the big players adopt these too), then the only way to match capability will be to have nearly the same 2 Trillion or whatever parameter size. Hope open source keeps up! 🙏
Avatar
corndalorian 11mo ago

Yea I wonder what the coming days will look like now that the cat is out of the bag. The big players won’t sit idly by for sure.

Reply to this note

Please Login to reply.

Discussion

Avatar
Alan Siefert 11mo ago

Of course consumer hardware is advancing too. Supposedly with a couple of Nvidia’s upcoming Digits computers connected together you’ll be able to run a 400B parameter model locally.