Replying to Avatar Vitor Pamplona

Yes, I am going back and forth on the idea of caching vs full db. Ideally the json events should stay local so make sure search of the past seen things works, but it is probably too big to keep on phones (10GB for my account) and it is definitely not fast. Every time it hits the disk, it slows down to a crawl.

Ideally, I'd like to keep the db with under 75MB of memory so that I can have 400MB for the rest of the app. But the indexes alone won't fit in 75MB of ram...
Avatar
Sahdowy Super Dude 2d ago 💬 1

But "search" you mean a) searching for a keyword in all events or fetching, say, b) the user's event for some query?

For a I think the solution is to have a click house/bq and an API call. For b caching might actually do for 99% of users

Reply to this note

Please Login to reply.

Discussion

Avatar
Vitor Pamplona 2d ago

Search means looking for users when you @ somebody (local db of profiles FTS indexed) + searching for something you have seen (FTS of content events) + searching for both in a relay with NIP-50.

In practice, the API call can be replaced by a relay, which we already do. But it is too slow or inconsistent over time (relay gets busy)