Replying to Avatar iefan 🕊️

Llama 2 is not there yet. I host and offer a 70 million-parameter model, but right now, it's nowhere close to GPT-3.5.

And, Llama is not open source. It's a very misleading advertisement by Meta.

But there are some interesting open source models like Falcon, it has better results than Llama 2 8n many task, and have we more variations.
Avatar
Daniel Wigton 2y ago

What is the best model I can currently self-host on a RTX 4090?

Reply to this note

Please Login to reply.

Discussion

Avatar
iefan 🕊️ 2y ago

You can technically host it, but it's better to use specialized AI hardware on the cloud with a focus on GPUs. The repo I shared allows you to host it for free in your browser using Google Colab. You can also opt for the paid version of Colab for improved performance.