Fitness isn't necessarily muscle definition and tone. Fitness implies optimization to your environment. If your environment is a sofa, maybe your optimal body type is potato.

But seriously, look at those who live in polar regions; they tend to carry more fat, which they need for insulation and energy stores. Look at those who do hard manual labor, most also carry more fat for energy storage. Thin people tend to come from warm climates.