Just like calories, not all carbon is equal. Methane has a greater greenhouse effect than CO2. Plant matter and oil have zero greenhouse effect (until they are burnt).
Carbon can be stored for extended periods of time (peat, oil, gas, wood) meaning it is not part of the short term gaseous cycle.