I’m considering the value of building/owning a rig that can handle LLM’s rather than being dependent upon cloud subscriptions. You can pretty much download multiple open source LLMs that will make you the smartest person to ever walk the earth for free. A GPU rig might be your family’s school of the future.
Discussion
Interested to see what you price out.
I am too, big disparity, technology moves fast, the longer I take thinking about it, the cheaper it gets. I really just stayers investigating it. But pcpartpicker.com seems to be the place to start.
You might want to check https://trymaple.ai .. The OpenSecrets guys were on TFTC recently; they say they can cryptographically prove that your chats are private
I pay less than 5,000 sats per month using ppq.ai and unleashed.chat. I also use duck duck go's AI. nostr:nprofile1qqstnem9g6aqv3tw6vqaneftcj06frns56lj9q470gdww228vysz8hqpzdmhxue69uhkzmr8duh82arcduhx7mn9qy2hwumn8ghj7etyv4hzumn0wd68ytnvv9hxg8mv947 is the guy to ask.
It’s not the expense, it’s the fact that it’s in my possession. If the internet goes down, I still have all that information at my fingertips like I owned that education.
That's a good point.
Plus it’s a pretty cool thing to build if you’re looking to keep yourself busy while everyone else stares at the charts😂
The range in investment is like from $200 to $20,000 plus. I’m considering something around $2000 that will be energy efficient but will be like an encyclopedia for me and future generations.
What kind of hardware? And when do you think it will be obsolete?
Just starting my own research, but from the perspective for personal usage, I don’t think it will become obsolete. As far as hardware, I’m still researching, I have pretty much zero knowledge but I can follow instructions. The website pcpartpicker.com has some
Suggestions
Thanks. That website is awesome, but it makes it harder to save my sats.😱
This picture came up on my digital photo frame from almost 5 years ago. The price is about 10x more than it was back then. I think you were onto something. It's becoming more important to teach the kids how to stack sats.
You might be right about running your own AI too.
Thank you for your service.
🫡
It's worth it, imo. I still only have one 3090 but even that has let me run so many things with ease. Intend to make much more investment in this machine. want to top 80 GB of VRAM because that seems to be a very common threshold to where you can run some seriously good models without much limitation.
Still experimenting and learning, currently testing out a VPS for a year, very easy to manage with OpenWebUi. Especially if you want to share and control your kids usage. Just watched this video yesterday if you’re interested. It cost me less than $100 for the year, wrote if off as a business expense. Good talking to you Guy. https://youtu.be/nQCOTzS5oU0?si=ozUDjp8ccVLyanFk
Having a difficult time with LiteLLM integration, but I’ll figure it out