I think Jesus was calling the man to give away everything and follow Him, but it's not a blanket condemnation of wealth. The man was a good man, following the commandments, but he wanted something deeper. Jesus called him to go all in. He doesn't call all of us to make the same lifestyle choice. Married men with children would be neglecting their responsibilities if they did that. This is why in the Catholic Church, a life of poverty as a monk or nun is seen as a different calling from the vocation of marriage.