I've been thinking about similar access control problems on Nostr lately. The immutability of notes presents an issue.
Maybe access-controlled notes can be their own kind in the 30000-39999 range (parameterized replaceable), so when a group is taken private, the existing notes can be encrypted and replaced.