Nostr Web Client

It is now (somewhat) possible to run fully local (no cloud, no spyware) Alexa/assistant alternative with Home Assistant, Ollama (I run it on Apple Silicon) and as an endpoint Home Assistant Voice Preview Edition.

I've written about my setup (and challenges), but TLDR: You can just say "Ok Nabu, turn on my bedroom AC" and it works.

I've dreamt about this in Cypherpunk Visions 2023-2025 (a short book). Now I am going to write update for 2026-2029 (3 years is a good timeframe) and this will be "normal" for those who want it now, it's not just a dream.

https://community.home-assistant.io/t/blueprint-on-ai-using-ollama-on-apple-silicon/916158

Reply to this note

Please Login to reply.

Discussion

Sovran Systems 5mo ago

Great Job!!

nostr:nevent1qqsv3vls0w8clxntm9gu9954wlwxxqt0qmm5a08c7jwjhm2tygf45fspr4mhxue69uhkummnw3ezucnfw33k76twv4ezuum0vd5kzmp0qgsd4dkxqewy8xum47ctpu0ltgxxsfemeewpjkdyzk9ddfcg286s0dsrqsqqqqqp9e35fw

Askater 5mo ago

What is the ram requirement for Mac to properly run it?

Juraj 5mo ago

Not much, 2gb for smaller models, around 8GB for llama. Then some more for whisper (500MB maybe)

I run it on 32GB mac mini.

matevz 5mo ago

In theory you could also run this in a cloud. If they use TEE, then your data should remain private.

Juraj 5mo ago

Yes.

But then I couldn't turn on the lights with my voice if internet is down. Not apocalypse ready.

I also run other apps such as nostr:nprofile1qqspfdl3hkjwvnunzds5tcnz98zqdlgmvrc0q9vwwj3k7sxplawhzug6ezekf so my home is vibing with intelligence.