Oh yeah! Congrats. This is an upgrade from 24gb to 32gb which is enough for me right now. Hopefully the FP16 was worth the 32 vs 48gb memory cut.
24 is definitely enough for most 27-32b models, and I haven't even been running the quant models.
Please Login to reply.
well, at least I can play baldurs gate 3 now 😂
XD
