This whole “feed group” thing has been tried many times before. Called “circles” etc. it ends up being way too complex and over-engineered. Users just don’t get it because there’s no real life corollary.
You can do whatever you want to share read/decrypt keys on the backend, but just make the UX what people already understand. Visibility settings, private accounts, newsletters, etc.