It turns out that running ETL jobs on 5GB of CSVs takes a while on a laptop.
Discussion
What kind of job? And what db?
That seems ridiculous. My experience-sense is tingling, and methinks theres unnecessary transaction and network overhead involved. I’ve readily moved and transformed 10s of GBs in minutes.
I am but a humble hobbyist. Redis. Lots of T in the ETL. 21 disparate data sets.