Personally, I think it's because wearing feminine, not slutty, clothing has an inherent tendency, in men, to generate a subconscious perspective of that woman possessing high levels of self-confidence. In simple terms, she doesn't feel the need to show off or, perhaps, isnt looking for attention, at all. And let's be honest, too many men don't possess high levels of self-esteem nowadays. Hence the intimidation.