I would largely agree with this. My wife and I got together after her first marriage failed because he didn't want kids and I wanted them.
I told her the other day (and stand by this) that she is my first real love as we have kids together and none of my previous partners made it to that stage. I do not miss them and if we ever fell apart, I really would be miserable about that.
It's because we're growing together, not because we're soul mates.