Because only a small proportion of those were eating highly processed fiber free and grain free bread.

And what was average life expectancy for most of those 5000 years? Maybe the gluten intolerants just died early...