Replying to Avatar RedHat

It is, I got mine running in a few hours.
Avatar
theprimeape 2y ago

https://nixified.ai/

If you mess with nix you can get it running even faster too - just running the command:

nix run github:nixified-ai/flake#koboldai-nvidia

Gets it going. Wish I could actually use good models though my gpu fucking sucks.

Reply to this note

Please Login to reply.

Discussion

Avatar
RedHat 2y ago

Haven't tried using kobold yet - I thought that was more for "role playing"?

Avatar
theprimeape 2y ago

It's really just a front end for loading other models. A lot of them are ERP (lol I don't want to have sex with my computer) but there are a few actual GPT / general use models available to use through it.