My main workstation has a 3090rtx and 64 gb of ram.
Just loading a few models into ram and doing inference and my hardware is already maxed out and lagging
Siigghhh AI is expensive
Which model?
Please Login to reply.
Playing with a bunch, right now the wizard coding one