if you are finding the milk is tolerable you should ask the supplier if it's coming from red jersey cows, they have a different, more tolerable protein called A2, which is less of an allergen than the A1 type usually from the dutch black and white Friesian cattle

Goat and sheep milk are also less allergenic casein proteins, and both have higher fat content so they are more energy rich