client GPT4ALL (there's more out there now)
Been using them for year+
Local LLM's for general purpose I've found Falcon-7b does pretty good. Run larger Falcon if you have RAM for that
I've also spent the time to finetune the smaller models for my use cases. Takes time but feed it your local data and you'll thank your past self for the work you put in
very cool, what are you favorite use cases?
my immediate thought is that it would be helpful as an editor and brainstorm engine for some longer pieces I want to write
One use-case for me (that I haven't set up yet) is to generate embeddings for all my notes so that I can search them semantically.
Tbh use it for everything. Been slacking using Maximus (my local agents name😅) as my daily journal, but exactly what you said.
- Idea generation
- Crafting posts/emails
- Reading & summarizing articles, videos, T&C
- Legal docs (as templates, not final form of course, real humans vet all docs produced and edit accordingly)
- coding (I switch to better coding LLM's for heavier work)
- figma layout generation
- crafting mid journey prompts
- etc
Recently picking back up connecting Maximus to voice for 'speech-to-prompt', then prompt triggers switch for local network IoT devices
Example:
"Hey Maximus, turn off the hallway light please." Etc.
No Alexa, siri, etc nonsense
All local
