Give https://koboldai.org/cpp a try. Its based on llamacpp but gives you an easier launcher, an optional bundled UI that is more powerful than llamacpp's UI, more API emulation including some basic ollama emulation, download accelerator support should you paste a download link as your model, image generation, speech to text and more.

100% free, 100% private, just a portable binary you don't need to install.