Replying to Avatar Guy Swann

It's worth it, imo. I still only have one 3090 but even that has let me run so many things with ease. Intend to make much more investment in this machine. want to top 80 GB of VRAM because that seems to be a very common threshold to where you can run some seriously good models without much limitation.
Avatar
Fartface2000 10mo ago

Still experimenting and learning, currently testing out a VPS for a year, very easy to manage with OpenWebUi. Especially if you want to share and control your kids usage. Just watched this video yesterday if you’re interested. It cost me less than $100 for the year, wrote if off as a business expense. Good talking to you Guy. https://youtu.be/nQCOTzS5oU0?si=ozUDjp8ccVLyanFk

Reply to this note

Please Login to reply.

Discussion

Avatar
Fartface2000 10mo ago

Having a difficult time with LiteLLM integration, but I’ll figure it out