If you're just curios and don't have time for the tech stuff, let me know and I'll give you an account on my system. OpenWebUI, publicly available, 3-4 models installed, up to 32B. Not great but it's all you get out of midrange consumer graphics cards.