It's not an Android feature. That's one of the bugs you only see in the open-source versions because of old keyboard implementations. You have to change the keyboard from the default install to fix it.