I did frequent restarts so it won't eat all of my RAM, combined with btrfs snapshots as insurance if I accidentally misstep.
And a TimeoutStopSec=infinity on the systemd service. That did the trick nicely.
Fully synced and fully worked. But I'm never going to sync from scratch ever again, it's just way too slow.