Replied above on hardware. >7b models run at acceptable speeds. Mistral-Nemo 12b runs a little slowly but faster than I think.