Bakers are usually up and baking at 2-4am. 2pm is a 10-12 hour day for them. Given that labor both expensive (for competent workers) or lacking, it's easier to not bother with hiring people outside the family to keep the shop open for longer.