If the US hadn't had that policy they wouldn't even be here. So returning them is just getting back to the status quo.
The _lack_ of consequence is one reason why this is acceptable: in most of these removal cases the US is _not_ punishing the person being removed in any meaningful way. They're just being returned to where they came from.