https://blossom.primal.net/5ca8a09adeeab8992d8129cf09532f4d2afd87bfebc6f8bfed91ef0bd71a65af.mov
Translation prototype on bitchat using on device ollama with gemma3.
nostr:npub1sg6plzptd64u62a878hep2kev88swjh3tw00gjsfl8f237lmu63q0uf63m nostr:npub12rv5lskctqxxs2c8rf2zlzc7xx3qpvzs3w4etgemauy9thegr43sf485vg
Use this for spam detection 👀 is it iOS only? Pls open a PR so I can check out the code!
this was just hacked together in the last hour, I will clean it up and open a PR tomorrow, feel free to build on this since I'm taking some time off from Sunday on
Cool!!!
Please don't fall for the trap of making it ollama only. They wanna ruin the open ecosystem. If you support OpenAI API url's that will work with all popular backends.
thanks, this was just the fastest way I could make it work, also have to think about iOS and android, since this is mac only rn.
Update: successfully ported to iOS using MLX for downloading a model and do on device inference!
