Or you can run it on a bunch of 128gb framework desktops for 3k a pop to get a total price of ~50k. It'd be much slower but still pretty usable
According to this: https://apxml.com/posts/gpu-system-requirements-kimi-llm
You need 32 x H100 80GB's to run Kimi K2
These cost $30-45K each according to a quick search. 32 of them makes it... about $1 million?
Or you can run it on a bunch of 128gb framework desktops for 3k a pop to get a total price of ~50k. It'd be much slower but still pretty usable
No replies yet.