Thank you for posting my article. I think this is an interesting question as it relates to the Extended Mind Hypothesis.
I think in the absence of AGI, what separates us from AI is our ability to create conjecture from the data we have in front of us, and to go from there to use experimentation and induction to develop better explanatory models of our world and figure out how we can improve it. At present, AI can help us accelerate in that effort. If we lack self-awareness, however, than yes, AI can manipulate us.
I think self-awareness and our being 'conscious' is what allows us to be in control.
In my mind, this is like being Neo within the Matrix. Neo can work wonders in the Matrix because he understands it and harnesses it to complete his goal, which is to free others. You do want to 'disconnect' from the Matrix to maintain self-awareness and your true self, but you also want to be prepared to get back in to do wonders as a self-aware human being.