I listened to them once a couple of years ago, and about a year later I went back and watched them all. I recommend watching if possible, but it's OK if not. Some episodes are more "watch required" than others, but you'll be able to tell pretty quickly when he starts pointing all over the whiteboard and stuff.

Definitely worth the investment. I don't think anybody who goes through the whole series and pays attention will be disappointed.