The NIP-11 relay info response has a place where relays can specify auth is required.

If auth is required and the client doesn’t handle it well then it will just get NOTICEs in response to every REQ. and be oblivious to the fact none of them ever return responses. There’s no way to actually have a failed REQ unfortunately- other than never giving answers.