Replying to Avatar Neigsndoig IQ 120

GE, y'all.

I'm attempting to get MKStack working with a local LLM in order that I vibe code a NIP-72 Reddit-like application for #nostr, though I'm having a hard time dealing with it. LM Studio is treating me like garbage, I don't understand Ollama in terms of integrating it to Stack right now, and I'm having trouble finding an online LLM service that has a generous free tier that isn't Anthropic, OpenAI or any of these other big companies (DeepSeek isn't an option for me either, unless it's a locally downloaded LLM). If anyone has a recommendation for what LLM I should use, or how I could connect up Stacks locally in this manner I described without getting an improper JSON error in LM studio, that would be appreciated.

If local isn't an option, the above question for what online LLM I could use that has a generous free tier is what I #asknostr for today.
Avatar
SpiralCrunch 6mo ago 💬 2

I am trying to do the same with a local LLM via Ollama (which works on it's own, but slow)

stacks clone mkstack -m devestral

stacks agent -m devstral

The above were given to me by Alex.

It has got me closer but still not able to make it work. It might be my hardware.

Reply to this note

Please Login to reply.

Discussion

Avatar
MK Fain 6mo ago

AFAIK none of this is really supported because we know these models won't provide a good experience - however if you succeed in hacking it let me know! In the long run we do hope to support more options.

Avatar
PlebInstitute 6mo ago

Did set an API key when running stacks configure? Don’t leave it empty.