Not every single, just the big ones - which most users subscribe too. Probaly less than 20. It's not impossible.
Ideally ppl would publish to their own respective relays, and clients would find them via DHT-style discovery. But that doesnt scale I guess. Hence the current middle ground (some big relays as central access point for 95% of notes)