Nostr Web Client

I’ve spent a non-trivial amount of time investigating how to bring offline machine translations to iOS. Because I want that for Damus and other Nostr iOS apps. It’s wild that no one has done this yet, including Apple. Except maybe Google, but their ML Kit library is horribly maintained and unusable for the modern iOS development environment. All I’ve been able to find are low-level C++ tools and models that you have to figure out how to piece together. Going to keep searching.

Matt Lorentz 2y ago

Ah thats a bummer to learn. I thought Apple would have exposed the API they use in their Translate app but I’d never looked into it. Maybe when they put LLMs on device later this year we can use those?

Reply to this note

Please Login to reply.

Discussion

jb55 2y ago

You usually need to download a large model to make it work. We have neural cores, would love to put them to use.

elsat 2y ago

nostr:npub1yaul8k059377u9lsu67de7y637w4jtgeuwcmh5n7788l6xnlnrgs3tvjmf looked a while back, and we were disappointed not to find apple translation API available to devs

Terry Yiu 2y ago

MLC LLM has an iOS implementation of an offline capable chat app using LLMs. However, it’s several gigabytes large and performance isn’t great on my iPhone (faster on my MacBook). Hoping for better performance and more direct translation APIs as a library as folks develop in this space more.

https://apps.apple.com/us/app/mlc-chat/id6448482937

https://github.com/mlc-ai/mlc-llm