Nostr Web Client

client GPT4ALL (there's more out there now)

Been using them for year+

Local LLM's for general purpose I've found Falcon-7b does pretty good. Run larger Falcon if you have RAM for that

I've also spent the time to finetune the smaller models for my use cases. Takes time but feed it your local data and you'll thank your past self for the work you put in

cuban 1y ago

very cool, what are you favorite use cases?

my immediate thought is that it would be helpful as an editor and brainstorm engine for some longer pieces I want to write

Reply to this note

Please Login to reply.

Discussion

MarsIronPI 1y ago

One use-case for me (that I haven't set up yet) is to generate embeddings for all my notes so that I can search them semantically.

SUPERMAX 1y ago

Yes crafting your local doc's to your LLM is beyond powerful

MarsIronPI 1y ago

Yeah. I'd do it, but my desktop is down right now, and I don't feel like doing it on my Core 2 Duo laptop.

SUPERMAX 1y ago

Tbh use it for everything. Been slacking using Maximus (my local agents name😅) as my daily journal, but exactly what you said.

- Idea generation

- Crafting posts/emails

- Reading & summarizing articles, videos, T&C

- Legal docs (as templates, not final form of course, real humans vet all docs produced and edit accordingly)

- coding (I switch to better coding LLM's for heavier work)

- figma layout generation

- crafting mid journey prompts

- etc

Recently picking back up connecting Maximus to voice for 'speech-to-prompt', then prompt triggers switch for local network IoT devices

Example:

"Hey Maximus, turn off the hallway light please." Etc.

No Alexa, siri, etc nonsense

All local

atyh 1y ago

love this thread.

MarsIronPI 1y ago

How do you connect it to your lights? Also, have you seen mycroft.ai?