Nostr Web Client

This new stuff people are doing with Open AI’s Canvas and Operator feels like a major shift of how we build software.

Look at these videos: https://x.com/minchoi/status/1883554868293779898

And then there’s Deepseek’s new R1 model which is open source, can run on a decent desktop computer, and is better than anything openAI has done with regards to coding… almost as good as claude sonnet… I put $10 in to deepseek and have been using it a lot, only to have spent a few cents!

This stuff is improving so fast, and the cost is dropping so much… it’s hard to keep up.

Look at this, you can run your own RAG at o1 levels using deepseek r1!

https://lightning.ai/akshay-ddods/studios/compare-deepseek-r1-and-openai-o1-using-rag

I think we’re seeing Open Source win against big proprietary tech platforms, and it really makes me feel better about the AI future.

One question here, is why aren’t we talking more about what we can do with it on Nostr? I know folks are excited about bitcoin, which is cool, but look at what we can start doing with the AI… Who’s talking about it on Nostr? How do we use AI and these. emerging open models in building / using nostr… i know we’ve got DVM’s but that’s kind of a limited job request system.

Dustin Dannenhauer 11mo ago

We need a bunch of infrastructure DVMs. It’s on my list but working on getting next version of DVMDash out the door first.

We need all Nostr notes behind an embedding DVM, like what unleashed.chat offers but as a single component to plug into any Nostr based RAG workflow. You give it a string and it returns top-k notes based on embeddings.

We need proper LLM DVMs, that use parameters like the major players (aka openai compatible parameters). Last I checked unleashed.chat api didn’t let you set system prompt or other common params.

I suspect the hosting costs for the bigger models (even 8gb) is part of the delay. It’s coming but it’s been slow.

Reply to this note

Please Login to reply.

Discussion

No replies yet.