Self host or this is a strong possibility.
nostr:note1dh7nnc5f0dzfjed2t4v72w9sclhf3dzwwd2u0t73uatqq8hpy2rqjh0gdk
Always self host AI.
Please Login to reply.
Should get easier with the new consumer AI hardware from Nvidia and Apple.
Easy enough running Mistral on AMD 🤙
Fuck NVIDIA and Apple.
Yeah if AMD released a GPU with tons of vram for the larger size models, that would be sweet!
