Nothing over USB

Buy a mini PC and put any decent vendor (crucial, Samsung, WD) m.2. SSD in it.

Speed doesn't really matter here. So go with a Gen3 or 4 at most.