Jesus didn't say, "Give Caesar the fruits of your labour."
What is Caesar's? Diddly squat. Caesar didn't work for it.
They were trying to back Jesus into a corner, but he answered in a way that doesn't support taxation but doesn't implicate him in a rebellion.