Because virtue signaling is just saying something, not necessarily actually doing it, ie a flag on your social media avatar. In the derogatory sense the term means saying without doing anything.

If you are actually virtuous, you don't need to signal it.