If you have a recent, fairly powerful machine with 16B+ RAM and are comfortable tinkering with command line stuff, try ollama first.
https://ollama.ai
Another ambitious project for people go look at:
https://github.com/oobabooga/text-generation-webui
Please Login to reply.
No replies yet.
