It is concerning

so only relay owners you're directly connected can see your ip(if that is your ip).

If there is a nefarious actor, and they are found out, you should stop connecting to their relays. (broadcasted events don't have your ip)

You can/should use broadcasting services or VPNs.

Also another thing to worry about, I don't think most clients are protecting against this(some are), people can also track you with image servers.

Since you load images from their servers your ip can be tracked by the image servers.

Long story short, use a VPN.