Not at all. Maybe a better way of saying it is, you're either critically thinking about actions or the man. If someone is either praising or hating the man, they're on the wrong boat.
If you can objectively look at actions and results, then you're on the right track. Most don't pay attention to the actions, They dwell on the man. That's all I'm saying.