That is very interesting. For me, it's kind of the reverse. By embracing economic freedom I am swayed towards more empathetic positions.
Yes, the feeling of undeserved privilege is dangerous. I wasn't born filthy rich, but rich enough, that my parents did not have to take a loan to buy a second house when I was a teenager. It was exactly the feeling of undesired privilege that led to me making terrible decisions and eventually to me being homeless and struggling even way more than I secretly wished to. Even now, years later I am still paying for that.
If anything said here today helps you grow in any way, I'll be extremely satisfied. :)