I half agree with this. People bringing stress to push you to improve are valuable.
If the people around you are sycophantic yes people, you will remain the same, never improve, and won't evolve.
Find people that keep you accountable for improvement.