I'd like to say "anybody who judges me by my clothing, fuck them." But people will judge. And a suit says "I'm respecting the occasion" and "I'm serious" whereas a pullover shirt says "this isn't that important to me".
People however use this knowledge to capture more respect than they deserve by wearing suits all the time.