I always go stand right next to them and when they ask i say: "oh i thought you wanted me to hear this."

I am always suprised that this somehow became a thing. I mean who wants everybody to hear their conversation except for when you actually get close and start listening.

I only use speaker when i am alone and I have to type or when i am on hold.