Refresh Metadata on the People tab works for your followers, but not for people you aren't following.

"Fetch Avatars" in settings means it will automatically fetch avatars, yes, but only if it already has the metadata that lists the avatar. It doesn't also automatically fetch the metadata. That is what I need to add.