Amazing! Trying out the free demo of Llama 2 70B from deepinfra. It's quick! Then I see they're using a 80GB GPU (A100) from nvidia? Seems to retail for 16,000 USD.

Ouch...