Nostr Web Client

I don't believe, and never have, that scaling context size alone will accomplish anything. I do believe, and always have, that people give up too early. I'm not sure why you're fixated on "winning" this argument – it's not an argument per se, and there are better things to do right now

ESE 5mo ago

I’m not fixated on “winning,” and certainly not looking to drag this out. But if we’re walking back, let’s be honest about what’s being walked.

“Use more tokens, kids.”

— ynniv · 4d ago

“It’s very likely that given ‘more tokens’ in the abstract sense, current AI would eventually settle on the correct answer.”

— July 22, 2025 · 12:27 PM

“I don’t mean ‘tokens alone.’”

— July 24, 2025 · 1:10 PM

“I don’t believe, and never have, that scaling context size alone will accomplish anything.”

— July 24, 2025 · 7:53 PM

If the position was never “tokens alone,” I don’t know what to do with these earlier posts.

So I’ll ask one last time, gently:

Was “more tokens = eventual convergence” a rhetorical device, or a belief you now revise?

We probably both agree that scaling context is not equivalent to scaling reasoning and that transformers aren’t recursive, stateful, or inherently compositional.

I was only pointing out that. If we’re aligned now, we can close the loop.

Reply to this note

Please Login to reply.

Discussion

ynniv 5mo ago

https://sourcegraph.com/blog/revenge-of-the-junior-developer

ESE 5mo ago

That’s a great blog post — I actually like it.

But let’s not mistake narrative for argument. I’m not disputing that experimentation, iteration, and persistence can lead to real progress. In fact, I’d argue that’s precisely why it’s worth being clear on what is being tried.

My only point is that your original phrasing clearly emphasized tokens:

“Use more tokens, kids.”

“Given enough tokens… current AI would eventually settle on the correct answer.”

Then later, you clarified:

“I don’t mean ‘tokens alone’.”

If that was always your intent — that architectural context (loops, agents, structure) matters more than just throwing tokens — I think we’re in violent agreement.

But let’s not retroactively apply that nuance to the initial bold claim unless that was the design all along.

Persistence is valuable, yes. But clarity helps the rest of us persist in the right direction.