There are out of the box solutions that make it really easy.

I use mailcow, it's fantastic: https://github.com/mailcow

Honestly no real hassle at all if you are reasonably comfortable with DNS records and have some self-hosting knowledge. Just make sure you practice good password hygiene.

What you will battle with is your e-mails going directly into spam folders. PTR (reverse DNS) records are still a must and they can be a bit difficult to get.