Global Feed Post Login
Replying to Avatar mark tyler

If that’s the only one that you have messed around with and maybe that could be part of the overpromising vibe you’ve gotten. Llama2-7B is quite a bit less capable than the full llama2 model. And that model is quite a bit less capable than ChatGPT4. Token generation on your embassy is probably a lot slower than what I’m used to using open AI servers.. though self hosted is awesome. I want to get some hardware to do that myself someday.

Avatar
Joel Walbert 2y ago

Oh as for the self hosting, embassy can run on any pc with the proper specs or RasPi so if ya got an old pc or laptop laying around, it may work

Reply to this note

Please Login to reply.

Discussion

No replies yet.