Policy and partisianship aside, I always say that politics is brutal on families esp the higher up you go. Usually families are the first line of casualties who can never fully prepare for the scrutiny, spotlight and vitriol. And usually they are sort of reluctantly willing support systems.
I'd guess his wife wanted him to retire from politics for the next election and he said no and she doesn't want to endure anymore of it. Can't blame her either.