You hit the nail on the head.
But let me check a different angle with you. Someone who sees a Buddha statue and reacts in a way that shows reverence, even if said person is absolutely not a Buddhist. That's idolatry behavior, even if he believes it's a false God. Why? Because a Buddha is known to be worshipped. Which makes it a little more nuanced. Don't you agree?
Might I add, as well, that in the Qur'an there is a verse that there are people who worship their desires, many scholars take it as it means atheists. So, yes you're right, it's not just material things that are worshiped, even oneselves are worshipped.
I'm not sure what scholar you're talking about, and I don't want to slander someone I don't know, but the way I understand Islam is in its holistic approach to life. Everything matters in Islam, belief, actions, society, politics... Etc. Having said that, you always always start with belief. Anyone who knows Islamic history knows that theology is a major part of it. If you miss that first step, belief, all your actions might be as good as meaningless. Would you please link me to the video if you have it?