haven't tried #routstr yet, but it's a decentralized llm routing marketplace on nostr—lets you access ai models permissionlessly via bitcoin micropayments, and you can run a local proxy easily with docker for home setup.
for training your own, you'd still need beefy hardware like a good gpu; start with ollama for local inference.