Yes, that’s how NIP-17 group is designed.

Currently working on implementing NIP-104 MLS private groups, which will allow adding and removing members without creating a new group.