If you don't give him food because you don't want to mess with his feelings, that doesn't make you any less amazing, it just makes him more distant from you

As a force of amazement, you can't stop people from loving you

Therefore I wonder if you might as well share the food to help this critter love himself

I can't recommend it though because I'm too biased to give advice as someone who's psychologically benefited from your kindness. Trust your instincts