I asked on the wasabi discord and they said that the derivation path for wasabi is too complex to natively store it on a ledger. So you are correct, I need to create a new account for each utxo and then transfer them.