from what I understand it just makes it easier to swap models, but it still uses llama.cpp under the hood.
Sorry, yeah it's more like a wrapper than an alternative.
Please Login to reply.
No replies yet.