Global Feed Post Login
Replying to Avatar jb55

Mistral-7b (local-ai) summary for this thread:

“This nostr thread is discussing a local LLM (Large Language Model) called Mistral being embedded in Damus, a decentralized social media platform. The LLM will have the ability to summarize users' nostr feeds using AI technology. Some users are curious about the impact of this addition on performance, and whether it will be benchmarked. Doog asks about the biggest challenge in getting the LLM up and running, and jb55 mentions that performance has always been a concern due to its large size. Shawn suggests taking a look at an existing app called Offline Chat Private AI, which uses Mistral technology and is available on iOS devices. Overall, users are excited for this addition to Damus..”

Imagine having a high level overview for every thread in your feed, all generated privately and locally nostr:note1t5atuyyznna02f4x73vaw58ms8jdangkt5rh9gr05v439k8puwxq2f53w4

Avatar
radii 1y ago

Would be awesome, I just got Mistral running on my Mac yesterday, to run on a phone would be an achievement

Reply to this note

Please Login to reply.

Discussion

No replies yet.