If you have a recent, fairly powerful machine with 16B+ RAM and are comfortable tinkering with command line stuff, try ollama first.
https://ollama.ai
Oef thanks will have a look
Please Login to reply.
Hit me up if you want to talk through. It’s a really impressive project.