I agree it shouldn't be political but the reason many Bitcoiners are right wing is because the left is obsessed with blaming capitalism, billionaires and private property instead of the real issues (fractional reserve banking, fiat, too much power in the federal government, etc). The left wants communism/socialism because they think hard money, freedom and small government are problems rather than the solution.
If they could at least rally behind the *actual* problems to the economic ills, Bitcoin wouldn't need to be seen as political. At the same time, together, we'd be a force to be reckoned with because we'd be united while the elite want us divided.