Contracts are only binding on the persons that signed it.

It would be just as ridiculous for me to draw up a contract that states all houses must be painted yellow, then sign it myself and claim that it binds my neighbors.