I’m running an 8b parameter model on a machine with 128GB ram and an 8GB gpu.

but that’s way more than necessary