A little bit of public justice eliminates a lot of private evils.
Discussion
No it just creates an underground market.
That underground market exists today without the execution of infant rapists.
Better to have the latter.
Ideally there would be multiple layers of theological, social, and political incentives, of which public executions would be a strong one.