I'll look in to it. That might be fun. Thanks!
Discussion
It is, I got mine running in a few hours.
If you mess with nix you can get it running even faster too - just running the command:
nix run github:nixified-ai/flake#koboldai-nvidia
Gets it going. Wish I could actually use good models though my gpu fucking sucks.