I don't see where enslavement comes into the purvue of our timekeeping.

All of our measurements are technically arbitrary: meters, plancks, Fahrenheit, etc. No less arbitrary than the calendar.