If you follow someone, gossip will look at the relay configuration of that user and fetches their notes from those relays.
Non-gossip clients only fetch notes from relays you have defined. So if someone you follow ends up on different relays, you no longer see their posts.
Gossip helps decentralisation, as users can spin up their own micro-relays, and still have their notes found.