You can with NostrGram. All of your badges are stored in the tags of one event kind (30008). If the client changes those tags to remove a badge you no longer want, it won't show up in your profile anymore.