Can any big brain devs help me figure out how to speed up this import?
Just saving blocks and txns into a db...
But at the current pace it's gonna take two weeks to finish
https://github.com/utxo-one/bitcoin-analytics-api/blob/master/src/import/import.service.ts
👀
🥚 head 🧠 dead ☠️
❤️ loves me
🫂 hugging together all ways
❤️🩹 we heal all brokenhearted
💔 apart or
💖❤️😘😍🥰💕♥️💙💜💔💗🖤💛💖💞💚❣️💓😻🧡💘💝👩❤️👨💝💌💏👩❤️💋👩💟👩❤️💋👨💑👩❤️👩👨❤️👨👨❤️💋👨🤎🤍🩷🫀🩶🫶🩵❤️🔥🏩🫰💒❤️🩹😭😢😔☹️😞😕🙁😪😿 💜 attack and stroke in my stomach
#artwork #humanity #LoveIS
Can you rework your “save” so that you batch insert the txs?
You’re probably io bound so either:
- get faster storage
- write out to disk less frequently
🍻
Ty ty u r right
- it looks synchronous. parallelizing the block processing should quickly speed it up
- looks like your orm is only doing single inserts. bulk inserts would be faster
*normal brain here but have used these techniques successfully. also I typically avoid orms in favor of sql for greater control over the db, but ymmv.
