making fences is work, and so is removing them.
removing them requires no additional supplies, and leaves the supplies there in case you would like to rebuild the fence.
if there is no fence to begin with, you’ve removed the supplies for those who want to build theirs.
why not have the default fence be the highest possible to leave the OPTION for those who want to remove them, but also make sure everyone has their own fencing supplies? and because there WILL be some who want to build a fence, the presence of the supplies is most important.