Natural sugar is fine if you aren't fat and if you don't binge on it, but considering that most Americans are fat and do binge on it (because it's addictive), it's generally not terrible advice to stay away from it.

It's not the only food with energy in it either... fat has higher energy density for example.