The extra time you'll have and less stress may be worth the reduction in pay. How much do you hate your current job? If it's a lot you may be happier.
I was in a similar situation, took a pay cut but ended up with way more freedom, less stress and more happiness.