Yes, that's what the doctrine of latches is about.

However a distinction with copyright, as opposed to trademarks, is you have a much better chance of suing new violators even if you have a history of unenforcement. With trademarks, you can easily, formally, lose your trademark entirely.