Replying to Avatar ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ

i don't see how if they are only fetching new data

i actively block scrapers manually, and could easily detect them with their unending streams of slowly progressing since/until queries

i could maybe add a second field so it's not just the timestamp but an access count as well and that mitigates the bias because they only add one each time anyway
Avatar
ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 8mo ago

i'm working on making a bunker app at the moment but i might switch up the access counter value field to contain an access counter alongside the last accessed timestamp, and then maybe reinstate the option of having a garbage collector and a size limit target, these can be done in teh dynamic configuration so you can switch it up whenever you need to such as after migrating to a bigger VPS

Reply to this note

Please Login to reply.

Discussion

Avatar
semisol 8mo ago

use a morris counter

Avatar
ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 8mo ago

i don't think it's gonna make much difference to performance or effectiveness of the GC decision process though, it will eliminate the most stale and least demanded in total where recent access is equal