Well I guess thats fine for models with gguf files.... But ive never seen those. Take this model for example (satoshi), there's no gguf just safetensors files

https://huggingface.co/LaierTwoLabsInc/Satoshi-7B/tree/main

Reply to this note

Please Login to reply.

Discussion

Yeah, I believe there are tools that can covert them but I haven’t tried. Once I found that there were already gguf files for the models I wanted to run, I just used those.

If you try the conversion tools, let me know how it goes!