GPT4All let’s you locally run dozens of different models locally.
Discussion
Same question to you too lol
Is this something available on the App Store or would I make a PWA of it?
GPT4All.io
You download the chat client. Within the app, there are a bunch of different models to download. Most are between 7 and 13GB.
You can also side-load a bunch more from huggingface.
Some of the models are roughly on par with chat GPT3.5 but you can try a few and find a couple that work well for your purpose.
They all work offline after the initial download. The desktop app also has a feature for analyzing local documents and using them to inform your results.
It’s been about a month since I’ve actively worked with it, I’ve been focused on #nostr and Fiat mining, but the improvements in models were rapid.
Thanks! Offline functionality sounds great. Gonna check it out.