Does the word "whenever" mean what I think it means?

I've heard people say things like "I rushed to the hospital whenever my wife was having our first child!"

And I wonder how many first children their time-traveling wife has had.

I'm not sure if this is a regional affect or what, but it causes great confusion with me.