Replying to Avatar calle

Hey client devs! Most smart phones come with a simple and small on-device LLM these days. For example Google's Gemma should be available on most Pixel devices. I wouldn't be surprised if iOS had a similar thing.

How about you run every post in my timeline through the local LLM and filter it using a prompt that I can enter in natural language? Example: "do not show me any political posts and amplify technical posts about Bitcoin". The prompt could be wrapped by a simple "score this post from 0-10" and you show me only those with a score > 5 (or whatever threshold I set)?

Please try this. Afaik this hasn't been done before. We can just do things for the first time ever. Let's break all rules and become the inspiration for everything else to copy us.

Avatar
Ben Weeks ⚡ 10mo ago

I worked on a draft for a similar idea for NSFW (Not Safe For Work) posts.

Reply to this note

Please Login to reply.

Discussion

Avatar
Ben Weeks ⚡ 10mo ago

It used the Yahoo! NSFW model but significantly increased the downloadable size of nostr:npub18m76awca3y37hkvuneavuw6pjj4525fw90necxmadrvjg0sdy6qsngq955 and was difficult to get to work with the Kingfisher (for images/GIFs) stuff that was used at the time. Might be a similar way to do it with built-in AI in the device though.

Thread collapsed