It's an open protocol, to control who uses it you need to control the relay. Otherwise you're asking client creators to allow censorship, which is what they are trying to avoid. A private relay is you're own business though.