Thinking about it they could have placed the large stones and filled in with the smaller stones as they built upward. I've looked at the wall patterns and sometimes this works but sometimes all the stones in an area are large stones only.