Nostr Web Client

Replying to

marcan0

Anyone have any luck getting local LLMs to perform well enough to actually do work with?

Would love to replace claude code, etc. and be without ai subscriptions, but so far the experience is v bad.

Currency of Distrust 1mo ago 💬 1

lol DHH posted a blog about exactly this, today.

https://world.hey.com/dhh/local-llms-are-how-nerds-now-justify-a-big-computer-they-don-t-need-af2fcb7b

OSS models just aren’t good enough today. I use one on my machine, but I primarily save my more “sensitive” questions for it. I get decent output for coding tasks, but I’m not asking it to actually generate code, just asking questions about syntax, structure, design, etc.

Reply to this note

Please Login to reply.

Discussion

marcan0 1mo ago 💬 1

I just read this after I posted my note 😂

I love dhh but don't want to simply take his word for it... verify!

Which local models do you use?

Currency of Distrust 1mo ago

I’ve switched around a bunch but mostly the OpenAI OSS models or Qwen coding models