Maybe you are paying more for their time? If they give you 20 minutes of value in your food, you pay them for 20 minutes of their time?

There really is no correlation between price and waiting time in the food service industry. You don't really pay more to get it faster, or pay less and expect it to be slower.