Learned this the hard way as well. Get some good silicone grippers.
Discussion
New mitts already on the way!
I also have silicon handle grippers for my cast iron pans, but I have to leave a dish towel wrapped around them to be able to handle them with bare hands.
I keep forgetting that my hands have more heat tolerance than most people from a decade of working as a waiter.