It's a complicated subject. For one thing your wife won't like it if you continue to be friends. On the other hand you have to worsen your relationship with someone you don't mind. All I can say is that if I don't like someone, I wouldn't forbid anyone from associating with them.