No, if you reply to my note I always see you, since following the Outbox basic schema you are writing in my read relays. This is true even if you reply to someone I replied to, since replies usually include all the references up to the root.
The problem arises if someone you don't follow post in a sub-thread you are not participating, in this case you will not see that note using the plain Outbox model.
But, as nostr:nprofile1qqsrhuxx8l9ex335q7he0f09aej04zpazpl0ne2cgukyawd24mayt8gprfmhxue69uhhq7tjv9kkjepwve5kzar2v9nzucm0d5hszxmhwden5te0wfjkccte9emk2um5v4exucn5vvhxxmmd9uq3xamnwvaz7tmhda6zuat50phjummwv5hsx7c9z9 pointed out, Outbox model is not a set of predefined rules, it's a paradigm, clients should creatively search other solutions to improve discoverability.
For example a client could try to rebuild sub-thread using (recent) interactions by your social graph.