GPT4All.io

You download the chat client. Within the app, there are a bunch of different models to download. Most are between 7 and 13GB.

You can also side-load a bunch more from huggingface.

Some of the models are roughly on par with chat GPT3.5 but you can try a few and find a couple that work well for your purpose.

They all work offline after the initial download. The desktop app also has a feature for analyzing local documents and using them to inform your results.

It’s been about a month since I’ve actively worked with it, I’ve been focused on #nostr and Fiat mining, but the improvements in models were rapid.