Some mechanism must exist to propagate media from user to user, and that may mean the relays are the clients, but it still means something must relay notes and other stuff.