There is a "Categorized People List" type defined in NIP-51 that allows "secret" people on it, but it would depend on the client treating it as a follow list. And, it's completely possible that a client could not share it's follow list at all, just keep it local. Part of the wonder of Nostr. Who you listen for and what you share are completely unrelated.