That would go against Kirchoff's law. If an encryption scheme's security relies on keeping anything secret except the key, the scheme isn't secure.