If you ask them to remove your phone number they will do a verification through that number so you can prove that you are the owner.
Discussion
So if you use another number can't they just refuse removal claiming you're not the real owner of the number?