This is kind of a sub-use case of having a private directory of npubs with comments. Like how you can comment on a Contact List / directory entry in your address book... "That guy I met at the Meetup", e.g.
Discussion
Theoretically it shouldn't be that difficult. Private lists already exist. Just needs a field for the comment and you're good to go.