Which open source model is decent enough compared to the most recents models of Anthropic?

Reply to this note

Please Login to reply.

Discussion

That's not the right questions.

If you have $500k to build a GPU cluster then you can get vastly superior performance than any of the regular subscription based AI solutions.

The limit is how much you can spend on hardware, not the models. It is about selecting the best model for your hardware and purpose.

You also need to download and try out the latest models as they come out, since the "best" open source model changes every month or so.

Yeah, that's a lot of trial and error.

Running multiple local models with goose and figuring out which are the best for my type of work, it's quite time consuming. Especially, when space is changing so rapidly.

Goose sucks with local models. I cant get it to retain context

If thats your only objective use anthropic.

Alot of home models work way better than gpt 3.5 which is what most people end up using anyway on free tiers, This is for them.

That's convenience, but not ideal of course