If the reply to a note is from someone you blocked (like spam), it should not be in the reply count.