Please don't fall for the trap of making it ollama only. They wanna ruin the open ecosystem. If you support OpenAI API url's that will work with all popular backends.
https://blossom.primal.net/5ca8a09adeeab8992d8129cf09532f4d2afd87bfebc6f8bfed91ef0bd71a65af.mov
Translation prototype on bitchat using on device ollama with gemma3.
nostr:npub1sg6plzptd64u62a878hep2kev88swjh3tw00gjsfl8f237lmu63q0uf63m nostr:npub12rv5lskctqxxs2c8rf2zlzc7xx3qpvzs3w4etgemauy9thegr43sf485vg
Discussion
thanks, this was just the fastest way I could make it work, also have to think about iOS and android, since this is mac only rn.