I'm trying to spell it out for you that the Fed has no power without the govt they leech off of. In our case congress could repeal the dollar and they'd be out of a job. And you know very well how the fed didn't even exist before congress passed that act in 1913. So of course the power flows from them; they could undo the act and use congressionally-issued money like we had before 1913 again.
When you get right down to it, all evil comes from exactly one source: The belief in Authority. The power everyone gives to authority by believing authority must exist. That's the only final boss we face on planet earth.