Your assertion is wrong. Almost any atheist will tell you lots of things matter, the difference is the source of what matters is decided by the person, not by an ideology.