I don't see many people upset about those who show up to work and make a run at value for value. That is a strawman psyop.
I think the main, and valid, gripe lies with the welfare state. It's bad enough that the state subsidizes unproductive and even counterproductive behavior in the existing population. They then encourage more people to come in to grow that system. All to print more money, and gain more control.
If government official castigate you for even questioning things like "immigration", that's where you need to dig.