"The Law of Unintended Consequences

It doesn’t take a genius to see how the chips ban would backfire within a year or two, it just takes you reading about the Chinese tech industry, and how large it is, and spending a few days reading the most recent STEM papers, especially physics and mathematics. A large portion of science and scientific breakthroughs are made by Chinese or scientists of Chinese descent, with China leading math in the entire world.

While you can do Machine Learning without having an absurdly deep understanding of mathematics, it is a mathematical field, one that can drastically improve by algorithmic improvements, and efficiency gains from optimization, all derived from…math. If you force resource containment on an adversary, he is bound to get creative… after all, necessity is the mother of all inventions." - @hiddencomplexity

Reply to this note

Please Login to reply.

Discussion

Psyop

If anything they distilled the knowledge from OpenAI. Just china stealing IP. They’re not innovating. They’re copying

Disagree. But I don't see why it matters? Net positive for humanity.

Disagree on what? On the fact that a SOTA model can be created without $100 million+ of compute and 4T+ token training set? No way the Chinese innovated it down to $5 million. Psyop. They distilled at the very least.

I think the only win is that we all know the Reinforcement Learning is the key to results like this. OpenAI wasn’t going to tell us.

I’m all for open source models and AI research for sure! I am ashamed at OpenAI, honestly. But I’m not about to sing China’s praises for this.

They completly open sourced their approach. Don't see the PsyOp here. It's a massive win for users IMO. I have it already in Crusor and Perplexity and it's killing it.