I'm not big into podcasts, but I've heard podcasters set up RSS feeds to which you can subscribe.

Mail clients like Thunderbird can get RSS feeds and it's like getting emailed when there's a new episode. Except you don't have to give out an email adresss, and they don't have to send an email. They just publish the entry on RSS and everything else is automatic.