Every relay forces your follows to connect to another relay to get all of your content. The more you add the more duplicates you and your follows download. And the more you add, the more they need to connect to find all of your posts.

For the reasons given by Vitor