Forcing people to give their reason would also make it harder for abusers to justify / rationalize it when exposed

It's easier to say "don't unfollow me for reporting this person I found annoying" than "don't unfollow me for trying to add this person to the scammer blacklist because I find them annoying"