You get used to it really quickly. I've been outdoors at a cafe with families with young children, and watched at no-one did anything at all.

Certainly there are cases where the danger is higher and people would take more action. But fortunately I've never experienced it myself.