Replying to Avatar Start9

The newer 7B models like Llama3 or Mistrel work great on well-resourced devices like the ones we sell.

No real harm in running it alongside Bitcoin and Lightning, but you also don't have to. It's your server, only install what you want.
Avatar
NotBiebs and 69 others 1y ago

So it runs smoothly on the Server One with both a bitcoin node and an AI chat app hooked up to Llama 3.1 8B? Is OpenUI available on Start9?

https://github.com/wandb/openui

Reply to this note

Please Login to reply.

Discussion

Avatar
Start9 1y ago

Yeah that model runs just fine. Nothing compared to ChatGPT speeds but it's affordable consumer hardware. No, nobody has packaged OpenUI for StartOS yet, looks cool though.