Replying to Avatar cloud fodder

costs more than a decent used car, to run a useless LLM rn, that maxes out a standard household circuit.

so I guess we will need more circuit
Avatar
BITKARROT 4d ago

what's the cost of used car anyway?

my take is that the free models get better and the gap closes within the next 12 months so that its doable

Reply to this note

Please Login to reply.

Discussion

Avatar
cloud fodder 4d ago

7k per 'thread' i was thinking is about what a 32 gig ram. but if you look at tinygrad/tinybox. you may decide we are talking 10k+ with power to support it

Avatar
BITKARROT 4d ago

the software tricks are gonna bring down the HW reqs, like real fast

Avatar
The Beave 4d ago

I'm ignorant. I haven't heard this.

Avatar
The Beave 4d ago

I don't pay more than 5k.

GPU and RAM can easily get eaten up with that.