Understanding the role of surface chemistry in the stability of nanostructured noble-metal materials is important for many technological applications but experimentally difficult to access and thus little understood. To develop a fundamental understanding of the effect of surface chemistry on both the formation and stabilization of self-organized gold nanostructures, we performed a series of controlled-environment annealing experiments on nanoporous gold (np-Au) and ion-bombarded Au(111) single-crystal surfaces. The annealing experiments on np-Au in ambient ozone were carried out to study the effect of adsorbed oxygen under dynamic conditions, whereas the ion-bombarded Au single-crystal surfaces were used as a model system to obtain atomic-scale information. Our results show that adsorbed oxygen stabilizes nanoscale gold structures at low temperatures whereas oxygen-induced mobilization of Au surface atoms seems to accelerate the coarsening under dynamic equilibrium conditions at higher temperatures.