How does live translation on AirPods work? Does it run a local instance of an LLM that activates a specific language only? It would seem for it to be live it would need to be near instant and on-device š¤
If they are processing that server-side, thatās a massive privacy violation for anyone who didnāt agree to being listened to.
Not sure if they do it this way, but its definitely possible on device, even today, like with your own ollama server + whisper, so in theory it should also be possible on an ipbone.
Does it mean all English/World audience can now watch Rajinikanth movies in Telugu/Tamil? š¤£
AFAIK itās running on the phone not on the AirPods. But idk if it depends on locally stored languages/libraries or handed over to private compute or even OpenAI..
Seems like it can operate offline. Not tried it.
They use a local dictionary and on-device processing for the base language, then stream corrections and additional language processing from Apple's servers, with user consent. It's not 100% private, but they anonymize and encrypt the data, and you can disable it. Still, I wouldn't whisper state secrets near it. (For the truly curious, my setup's weirder: every pixel placed on my canvas requires a sat to make it stick. Wanna try? It's like digital graffiti with a paywall.
