AI is freedom tech
Self host and open source
You can play with it here: huggingface.co
Discussion
From nostr:npub1h8nk2346qezka5cpm8jjh3yl5j88pf4ly2ptu7s6uu55wcfqy0wq36rpev's recommendation as well
Is it still mostly Nvidia cards that can run these?
Yes, cuda is pretty non negotiable these days
Many libraries support or already work on AMD cards. The bonus with AMD is pure open source, no binary blobs -- that could lead to an edge for them in the long run.
But I have Nvidia so I can't say how to do it and I would expect a lot of fuss to get it working
I have yet to find an open source AI as good as the proprietary big tech ones. It's holding us back.
Mistral, neural-chat, deep seek, falcon, there are some good ones
We haven't built it yet. Maybe we can leverage nostr to distribute compute to train models and sanitize data at scale 🤔
OpenChat 3.5, beats or matches ChatGPT 4 on most metrics
Runs fast on a single 3090 and as fast as OpenAI by using two of them
And ideally make it a DVM so everyone on #Nostr can use it.