Exactly. The whole Constitution is written as a limitation on the government, not the people. That's why it begins with "We the people..." because they are defining the limits within which the government can operate.