They tend to be mutually exclusive, if someone fears you, they certainly don't love you and vice-versa.

You could have part of the population hating you and part loving you though