Always self host AI.
Should get easier with the new consumer AI hardware from Nvidia and Apple.
Please Login to reply.
Easy enough running Mistral on AMD 🤙
Fuck NVIDIA and Apple.
Yeah if AMD released a GPU with tons of vram for the larger size models, that would be sweet!
