Clearly ones voice is the next attack vector

What’s stopping a bad actor from calling a family member and completely misleading them.