is it a sin to marry someone and have children

Thoughts on Joseph being a widower with children, prior to Mary?

Saint James would have been a half brother to Jesus in that case.