One problem I see with nano-GPT is that I cannot find a way to remove all closed source models with just an easy click or something.

I don't give a flying fuck if the open source models aren't as good as the closed source models. If it's not open source, I don't fucking want to use it.