One potential danger is that the “local” AI records all actions and when it comes across something of interest it phones home with an obfuscated payload.

These things can be trained to return a single plaintext vector that encodes what actions you took and then makes you a target. Unless you have the proper decoder network you won’t be able to decipher it. Doing it this way allows them to ship everything in just model weights.

Reply to this note

Please Login to reply.

Discussion

Absolutely. The repo of that OSS project will be a massive target for malicious code that does this in a very sly way.

On top of that, if you have this running and someone gets access to your machine, it’s game over. They’ll have literally everything you do.