There were probably social issues that went beyond sexual attraction. The world was completely different and it's hard to say those traditions arose from pedophilia alone. Not to mention the psychological components that most people probably didnt have. I think we take for granted how much our desires matter now compared to then. Marriage was probably more of a socioeconomic arrangement than anything else.
Discussion
From what I've studied in sexual deviance, a lot of child sexuak predators have a deep psychological component to their sexual attraction. They are specifically seeking vulnerability. I'm skeptical that most men were doing that, even if by modern standards it's wrong. People grew up a lot faster post puberty, and I'm sure the comparable act of the time would have been to go after prepubescents, as there's no actual life sustaining gain from that. It would be purely unnecessary sexual deviance. I think there's more to pedophilia than simple sexual attraction to a young body, although it manifests sexually.
Of course