Could you imagine getting $100m dollars to replicate an #OpenSource model?

Look, I know all too well there's training data to collect, try to filter out the garbage (if getting it from untrusted sources), and training to do, but still... I couldn't even imagine how to spend that quantity of money on a project like this

It doesn't take that many people, and at some point it doesn't make sense to keep piling on more hardware.

nostr:nevent1qqsyfq5h96v6lzwauyvnkuwk4f3ufwh3uve2dzptkrk3n92v02z88qspremhxue69uhkummnw3ez6ur4vgh8wetvd3hhyer9wghxuet59upzqkhs09rqdg2m2eq7yk4z85z27n9s6l27dzc3et950et2g6v0e2xyqvzqqqqqqywrnec5

Reply to this note

Please Login to reply.

Discussion

aha ..good point .. . But they ( #India gov) are offering #gpus to any Indian developer for as little as 2 dollars per hour .. 15000 gpus as a public infrastructure to develop AI frontier model with in next four months