I think these scriptures are referring to neglecting our wives who we have covenanted with. I think it’s unfortunately common for a lot of men to have unrealistic expectations and when they are not 100% satisfied they divorce and marry another woman. This is the adultery spoken of. This can definitely end a beautiful marriage. We are to love our wives as Christ loved the church. We are to give our all to them. We are to be one with our wives.
I also believe pride, selfishness and lustful desires can lead to an ended marriage.
Ephesians 5:25 Husbands, love your wives, even as Christ also loved the church, and gave himself for it;
1 Corinthians 11:11 Nevertheless neither is the man without the woman, neither the woman without the man, in the Lord.
Matthew 19:6 Wherefore they are no more twain, but one flesh. What therefore God hath joined together, let not man put asunder.