Therefore, if both sides of the ledger were created from nothing, the debt doesnt matter.

What matters is if people will keep accepting fiat for their time/labour. Then the game stops.