This is why bloom filters are important. I might even turn the mute list into bloomfilter since many users already have massive lists.
Discussion
It's more than just computationally expensive. You might end up getting a lot of data that you don't end up using