Keep in mind if you pay off your house you still have to pay taxes, insurance, maintenance, you won't be without payment
If you pay off your mortgage you are typically left with a 3rd of the payment if you continue to use escrow for taxes and insurance.
The money to pay off your house can be used to make a way better return than reducing your house expense by 2/3rd.
Also as others have said inflation will eat the cost of your debt. In a high inflation environment a 3% 30 year fixed loan is an asset