Self host or this is a strong possibility.

nostr:note1dh7nnc5f0dzfjed2t4v72w9sclhf3dzwwd2u0t73uatqq8hpy2rqjh0gdk

Reply to this note

Please Login to reply.

Discussion

Always self host AI.

Should get easier with the new consumer AI hardware from Nvidia and Apple.

Easy enough running Mistral on AMD 🤙

Fuck NVIDIA and Apple.

Yeah if AMD released a GPU with tons of vram for the larger size models, that would be sweet!