Replying to Avatar ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ

#orly #devstr #progressreport

since adding a spider to collect various directory events of the social graph of designated relay owners, the relay's memory utilization has gone up so much that it's using around 11gb of memory at peak and this is blowing up and causing the kernel OOM killer to keep on restarting the relay on wss://realy.mleku.dev

i've gotta refactor the spider so it is more memory efficient. even just necking it down to a single thread it's still burning so much memory.

aargh. the LLM coding agent wasn't successful in improving the situation either, i need to refactor this spider code so it disposes of memory more efficiently.

Avatar
ᴛʜᴇ ᴅᴇᴀᴛʜ ᴏꜰ ᴍʟᴇᴋᴜ 6mo ago

fortunately i was able to fix the problem just by using jetbrains junie LLM coding agent, too. haha. the thing that totally nailed it was one of the longest and most complicated prompts i've written to date. it managed to understand it and guide a refactoring process that appears to have totally fixed the problem. yay!

Reply to this note

Please Login to reply.

Discussion

No replies yet.