The response of soil organic carbon to climate change might lead to significant feedbacks affecting global warming. This response can be studied by coupled climate-carbon cycle models but so far the description of soil organic carbon cycle in these models has been quite simple. In this work we used the coupled climate-carbon cycle model ECHAM5/JSBACH (European Center/Hamburg Model 5/Jena Scheme for Biosphere-Atmosphere Coupling in Hamburg) with two different soil carbon modules, namely (1) the original soil carbon model of JSBACH called CBALANCE and (2) a new soil carbon model Yasso07, to study the interaction between climate variability and soil organic carbon. Equivalent ECHAM5/JSBACH simulations were conducted using both soil carbon models, with freely varying atmospheric CO2 for the last 30 years (1977-2006). In this study, anthropogenic CO2 emissions and ocean carbon cycle were excluded. The new model formulation produced soil carbon stock estimates that were much closer to measured values. It also captured better the seasonal cycle of the direct CO2 exchange measurements at the three grassland sites considered (RMS error reduced by 12%), while for the five forest sites also analyzed, the results were ambiguous and the RMS error was 12% larger for Yasso07 than for CBALANCE. As a response to climatic changes, Yasso07 showed greater release of soil carbon to the atmosphere than the original model formulation during the years 1977-2006. This emphasizes the need for better understanding the processes affecting soil carbon stocks and their turnover rates to predict the climatic feedbacks.