A quick literature review seems to point out that most negative effects appear in pre-adult long-term users. However many studies call for caution due to the lack of serious, independent, double-blind studies.
Personally, I'd be cautious with using it on a daily basis for prolonged periods. Generally speaking, using hormonal supplements isn't the safest route for chronic treatments.