lol DHH posted a blog about exactly this, today.

https://world.hey.com/dhh/local-llms-are-how-nerds-now-justify-a-big-computer-they-don-t-need-af2fcb7b

OSS models just aren’t good enough today. I use one on my machine, but I primarily save my more “sensitive” questions for it. I get decent output for coding tasks, but I’m not asking it to actually generate code, just asking questions about syntax, structure, design, etc.

I just read this after I posted my note 😂

I love dhh but don't want to simply take his word for it... verify!

Which local models do you use?

Reply to this note

Please Login to reply.

Discussion

I’ve switched around a bunch but mostly the OpenAI OSS models or Qwen coding models