Are there any models, that can run on a 3080Ti, and don't suck ass?
AI at home is a nefarious ploy to boost sales of nvidia gfx cards 🤣
nostr:nevent1qqs0r9dcnrgsgmj0v45tu6387m0y5skyhlgump60t7azyfhds6yny2gpzemhxue69uhhyetvv9ujumt0wd68ytnsw43z7q3q09x0x9dlft64y4h9vz9mxu92qpqn752sd8p4xe2zkcanlzmk2fcqxpqqqqqqzx8xq95
Please Login to reply.
I am waiting for AI optimized high throughput accelerators
Local is great for image generation, LLM less so.
Coincidentally, I benefit from said plot. I work on circuit boards for them at work all the time😂