Because that’s what people doing scams and impersonation would do. What could work is a system where by multiple people verify somebody else. So if I have five people I trust to verify that you’re bob, then I can be confident that you’re actually bob. I think it’d be useful to have that kind of trusted verification as well.
Here’s code to make it work: https://github.com/cblgh/trustnet