Brainstorming a journal app, which may already exist

- text input or audio recording

- whisper.cpp transcription

- user-selected, local AI model that can help navigate obstacles, reflect, or search for content

- offline support

- private, open source

The immediate challenges I see are that transcription and local AI are memory intensive and aren’t practical to live only on frontend so it may not be possible as a PWA without compromise

Any other ideas/thoughts on this?

Not sure if nostr fits in since it is intended to be entirely personal and private

nostr:nprofile1qqs04xzt6ldm9qhs0ctw0t58kf4z57umjzmjg6jywu0seadwtqqc75s8fsrrg nostr:nprofile1qqs99d9qw67th0wr5xh05de4s9k0wjvnkxudkgptq8yg83vtulad30gxyk5sf

#asknostr

Reply to this note

Please Login to reply.

Discussion

nostr relays can respect users' privacy, just that that has not been prioritized by most relay devs

i'm not sure that basic LLM models are that resource intensive, maybe a few Gb of data of the model but walking the paths in it is not, llama, for example, 3.5gb is the model

idk about voice recognition systems, but i think they are less intensive than LLMs for resources but maybe more for compute (they do FFTs and stuff to catch phonemes)

i'm pretty sure for maybe 5 years now most phones have had all the capabilities required to do this, and definitely no problem for a max 5 year old laptop

i think the hardest part of the formula is actually privacy respecting relays... my relay #realy already does this by requiring auth for reading DMs (it's open otherwise for read) but whatever event kind you need to be gated by auth to prevent others accessing it... that would take a small amount of customization... i hadn't thought about it but it would be simple to make a configuration to set the private event kinds that must be authed to the same as the author or as tagged in the event of that kind (that is, what you sent, and what was sent to you)

I know nostr can be private to your point, I guess what I meant was I’m not sure how nostr benefits this project

The only thing I can think of is if someone builds a competing journal app then they can leave mine and go to the other and their notes would be there for them

I’d probably have to make a specific Kind for this event

Wasn’t sure if it was worth it to go down that road as it may be better UI/UX to have no login at all

Thoughts on that?

Remote relays are unnecessary for journaling. Backups should be optional and encrypted. The idea of storing entries as nostr events is awesome for interop.

If you could make it more like Obsidian/Logseq (knowledge graph) that would be great.

the problem with your logic is if that was true why do so many businesses use email, calendars, document sharing and other tools from cloud services?

Maybe we are talking about different apps

what is unclear about "people lose their backups and need third parties to keep them" exactly?

WANT! 💯

I once thought about building something like it.

I would make it native apps, personal notes is very private and the browser is too general.

Nostr could be an extra optional layer to share thoughts, gather bookmarks etc. Maybe as a separate internet-connected tool, as i personally don't give internet access to note taking apps.

Tried to zap you but it failed

Now I just need to figure out how to build a Native App 😅

Thanks for the zap attempt, not sure what happened there since I’m on Primal, but it’s the thought that counts

Use Tauri and an LLM to help you in the process

Looking into Tauri now and it definitely seems appropriate, but curious why you recommend it over other methods like React Native?

Thought you only did web

Would you be comfortable with native, local, private functionality also being in the same app that brought in Nostr content? Or prefer to have those separate so you know the app is 100% offline?

No, that's why I suggested maybe a separate app

👍

Now I know with zap.store, a main goal is to create verifiable native apps. More difficult on the iOS side to fully trust the code shipping is the same as the open source. People are always welcome to download the source and run it themselves for ultimate control.

Yeah, iOS is a disgrace

Reproducible build DVMs are coming to Zapstore, that should help a lot.

I’ve been brainstorming a similar app.

- Verbal dump of my day into the app.

- AI summarizes it

Each day would be a summary with ability to view the full transcript and listen to the audio, if desired

I’m planning to use nostr:nprofile1qqs8msutuusu385l6wpdzf2473d2zlh750yfayfseqwryr6mfazqvmgpz9mhxue69uhkummnw3ezuamfdejj7qghwaehxw309aex2mrp0yh8qunfd4skctnwv46z7zc8se5 for the LLM part but don’t have the speech to text yet. A small whisper model on the phone might be able to handle that.

I would love something like this! And surely running local, I don't want my crazy thoughts to be wandering in the wilderness of internetz.

Languages may be a hurdle. Some people prefer to think in their fringe mother tongue and transcriptions may be less good in those. Also whenever I try AI in such a language, the responses are not perfect.(AI seems to throw in occasionally some Croatian into Czech or Slovak).

In your experience, do the built-in dictation features work well for the different languages? I don’t know if you’re on iOS or Android. Curious if they handle them well, given that they’ve been refining these speech-to-text algorithms for decades.

Last time I tried Google and Futo, none of them had Czech or Slovak. But I also use GrapheneOS which may be limiting my options.

fwiw, these are the types of apps that we are building out nostr:nprofile1qqsd79ejwuvz7v246danxqs3hgw7f2q4qrqz6x27je8er0nhfmykwzqpz4mhxue69uhhyetvv9ujuerpd46hxtnfduhszgthwden5te0vejk2ern9ehx7um5wghxyctwvshhg7tsv4ekxunfwp6quvpaka to handle. Strong e2ee privacy with the performance and UX of cloud apps.

The platform just reached “Production Ready” status. It’s running Maple AI and has another app coming online in a few weeks. Any builder who wants to play with it, hit me up. You can find out technical details of our e2ee claims on our blog.

oh hell yeah

Love what you guys are building.

For this particular case though I would still keep it 100% offline, and writing encrypted content to disk. Plus encrypted backups.

Totally get that. If it’s open source, a fork could get exist that adds online encrypted functionality for people who want that.

If it wrote to disk encrypted then you could use any regular tool to back up, and not need to give the journalling app internet access

Run local and tailscale into it to use from mobile

I’m still attached to handwriting with my apple pencil or remarkable tablet, so for me having OCR for handwriting is a must for creative flow.

That’s a cool idea, I like that 👍

The dictation feature built into iOS is local only, works offline. Not sure about the various Android variants and what they do. On iOS you could handle audio without a special model. It likely handles different languages better too.

I just offloaded enough apps to free up 3Gb of space on my ancient iPhone (which has gotten jankier with each software update). I know Apple’s intention is for me to ditch this one and buy a newer, shinier model. That chaps my hide!

Keep it running if it still works 💪

Yes. Only, with attitude, and like a herd of turtles.