The only people who will get upset when you start setting boundaries are those who have benefited from your lack of them