Depends on how you define "control". With the outbox model, you can't easily control which relays you connect to since it depends on your follow list and the people you interact with.

You also can't control which servers you hit when querying profile pics, etc.

Even if everything is "open", it can still fall outside of our control.