It's worth it, imo. I still only have one 3090 but even that has let me run so many things with ease. Intend to make much more investment in this machine. want to top 80 GB of VRAM because that seems to be a very common threshold to where you can run some seriously good models without much limitation.
Discussion
Still experimenting and learning, currently testing out a VPS for a year, very easy to manage with OpenWebUi. Especially if you want to share and control your kids usage. Just watched this video yesterday if you’re interested. It cost me less than $100 for the year, wrote if off as a business expense. Good talking to you Guy. https://youtu.be/nQCOTzS5oU0?si=ozUDjp8ccVLyanFk
Having a difficult time with LiteLLM integration, but I’ll figure it out