Sweet! I'm actually pretty excited about this idea.
The other mechanism I thought of to make sure poll booths stay honest is to have a higher authority issue ballot tokens and the booths act as tellers, maybe with redundancy, and the teller just collates and stores the tokens encrypted with the voters' pubkeys.