Global Feed Post Login
Replying to Avatar aljaz

ollama proxy with free mode -> if you just need *some* llm backend to work i've made an ollama/openai proxy that pulls currently free models from openrouter and routes to them, if one fails the next one is hit.

you can use filters to say you only want mistral models out of the free models for example. It also supports paid models

https://github.com/aljazceru/ollama-free-model-proxy

Avatar
Gigi 6mo ago

👀

nostr:nevent1qqsyw3hz9gxga5qmfe7n7hcfapsepdwm6vvrcsntljl8su8qz9fu2qspz4mhxue69uhkummnw3ezummcw3ezuer9wchsyg80uhgjphcvc2g05ay8yla5ttzg0j4dx3k57g5n4vrfarcpl3gesypsgqqqqqqsw2frvn

Reply to this note

Please Login to reply.

Discussion

No replies yet.