Add an ollama server with self hosted models and you're all set 🤙
Discussion
I tried that year ago, but had problem that had not enough CPU and RAM to get something useful from it. It was just too slow :(( but have new machine since then so I might give it a try again
It's great and the fast support for all the new models is amazing
Yeah ollama overall is great. I'm running ollama on my laptop not on server. Will try server again with 7b model for the start
I bought 3090Ti and 128GB ram 😅 for ollama and it works great! :)
Can I ask - how do you host your Minecraft server? Does it require license for the server?
Thanks
It does not, you can also disable verification againts mojang servers for clients