Nostr Web Client

“There’s a technique in AI called distillation, which you’re going to hear a lot about. It’s when one model learns from another model,” Sacks explained to Fox News. “Effectively, the student model asks the parent model millions of questions, mimicking the reasoning process and absorbing knowledge.”

“They can essentially extract the knowledge out of the model,” he continued. “There’s substantial evidence that what #DeepSeek did here was distill knowledge from OpenAI’s models.” “I don’t think #OpenAI is too happy about this,” Sacks added.

https://www.zerohedge.com/ai/us-navy-bans-deepseek-over-security-concerns-substantial-evidence-emerges-chinese-ai-ripped

Laeserin 11mo ago

We do something similar with closed-source code, which is why closed-source is sort of pointless.

We do something called "penetrative testing", and just probe it and try out all the paths, and then guess the logic and recreate it.

Reply to this note

Please Login to reply.

Discussion

Laeserin 11mo ago

That's why you can only demand payment for computation (dynamic, new effort), not code (static, past effort).

Code is only paid for in the creation, where it requires computation.

Chris 11mo ago

So bottom line (I’m deducting) is that it will be literally impossible over time (and cycles of iteration) to have “walled gardens” of closed source models. That generate subscription type revenue.

Put simpler, there is no way to stop AI/LLMs from becoming ubiquitous and nearly free as they learn and propagate across the planet as, inevitably, open source utilities….

As a layman, that seemed logical to me a few months ago. Wondering if the last week’s revelations are making that a reality in real time or am I just looking for my own confirmation bias….

Thx