I personally think Adam Scott (the actor) is a perfect example of this. Looks much better with beard than without. Your theory holds up.