Clients could also load older pictures if the relay is sending this data. But in NIP-1 (kind: 0) there is defined:

A relay may delete older events once it gets a new one for the same pubkey.