It's common to experience flu like symptoms when you first start drinking raw milk. The beneficial yeast and bacteria go to war with pathogenic microorganisms that are already inhabiting your gut. The key is to introduce it slowly to minimise symptoms.

If your raw milk is coming from a reputable source, and all of the other people who are drinking it aren't getting ill, i'd wager the milk is fine...