Profile Lists fix this. They're just not at all integrated in most clients.
Categorizing users needs to be waaaay easier. Instead of a follow button, you should just quickly be able to checkmark what list you want a user to be part of, for example.
https://void.cat/d/G3ukxAwvq64DcvC9wYPtbM.webp
Next, selecting what users you see what "kind" of content from needs to be superfluid as well. (currently, working on designs for this)
Then throw DVM curation in the mix and LFG!