The Raven data actually suggests that the entire male curve is shifted right (men dominate the genuises and women dominate the retarded), but women make up for that with increased height in the middle.
Other data sets show the men having a broader distribution, to both ends, but Raven is actually one of the best measures.