I think most of the apps are missing the significance of the NIP-05 relay list. IMHO those should be seen as semi-mandatory and in cases like contact lists you don’t act before hearing from those servers (or being refused).
By “semi-mandatory” I mean a user may temporarily stop writes to them, but always reads from them and can’t delete them from their relay list. If they don’t want them they should change their NIP-05 validation. Otherwise NIP-05 really does mean nothing.