unsloth has GGUFs and llama.cpp fork that could run it in smaller GPUs
According to this: https://apxml.com/posts/gpu-system-requirements-kimi-llm
You need 32 x H100 80GB's to run Kimi K2
These cost $30-45K each according to a quick search. 32 of them makes it... about $1 million?
unsloth has GGUFs and llama.cpp fork that could run it in smaller GPUs
No replies yet.