501b, holy shit can that even run on an rtx 4090?

After Meta dropped Llama 3.1 yesterday, today Mistral dropped Mistral Large with 123B parameters. Available on huggingface. #LLM #AI

https://huggingface.co/mistralai/Mistral-Large-Instruct-2407

nostr:nevent1qqsgtcdfkudx7r48tc02cgaqsq98w37lx9m3cc06f3fj93adq5nvudgppemhxue69uhkummn9ekx7mp0qgsfnw64j8y3zesqlpz3qlf3lx6eutmu0cy6rluq96z0r4pa54tu5eqrqsqqqqqptwagrt