What client's offer that feature? I've only used Primal and Damus.

More than likely what they're doing is a "local edit" where they show the changes in that client but were you to use another client/relay combo the changes would not be present.