some relays may have more requirements for allowing people to publish events than others.

you could use the public-free-open-spammed relays to fetch notes just from people you follow and other relays that filter spam out better to fetch events that could be spam, like replies or public feeds.