Explanations of the glacial-interglacial variations in atmospheric pCO2 invoke a significant role for the deep ocean in the storage of CO2. Deep-ocean density stratification has been proposed as a mechanism to promote the storage of CO2 in the deep ocean during glacial times. A wealth of proxy data supports the presence of a "chemical divide" between intermediate and deep water in the glacial Atlantic Ocean, which indirectly points to an increase in deep-ocean density stratification. However, direct observational evidence of changes in the primary controls of ocean density stratification, i.e., temperature and salinity, remain scarce. Here, we use Mg/Ca-derived seawater temperature and salinity estimates determined from temperature-corrected d18O measurements on the benthic foraminifer Uvigerina spp. from deep and intermediate water-depth marine sediment cores to reconstruct the changes in density of sub-Antarctic South Atlantic water masses over the last deglaciation (i.e., 22-2 ka before present). We find that a major breakdown in the physical density stratification significantly lags the breakdown of the deep-intermediate chemical divide, as indicated by the chemical tracers of benthic foraminifer d13C and foraminifer/coral 14C. Our results indicate that chemical destratification likely resulted in the first rise in atmospheric pCO2, whereas the density destratification of the deep South Atlantic lags the second rise in atmospheric pCO2 during the late deglacial period. Our findings emphasize that the physical and chemical destratification of the ocean are not as tightly coupled as generally assumed.