First step I considered was in-device audio signatures or face recognition to sign the call request. This doesn't protect against all scenarios but it already solves a large percentage of scams currently out there.

Mass adoption requires super simple experience, like the padlock on your web browser that tells you that you're connected to the real primal.net.