Presumably that's an unfounded judgement, as the person hasn't had enough time with you to understand your actual motivations/passions. Regardless if you believe your final statement is true than who cares.

I like to be busy, very rarely does that involve a return on investment. I don't have to explain that to anyone, there is no right way to live you don't know me XD