Sometimes people are looking for sensation rather than truth and no matter what, they'll attack you. Adhering to principles can also be regarded as being stubborn or rigid. So essentially, if people are dumb enough and arrogant enough not to be straight-forward about (false) accusations, then this cannot be avoided.