If I want an llm to stream responses through nostr private DM's, it's a lot of events. Not the most efficient but it's the best UX. Is there a NIP for streaming data that can be discarded by relays shortly after relaying them? Since the data is ephemeral. For history, the data that was streamed can be backed up by a normal DM event with the composed stream once it ends.
#asknostr
you could use ephemeral events which reside 5 mins on strfry, but even if it works it may trigger rate limits.
Please Login to reply.
No replies yet.
