Augmented reality superimposes virtual objects onto a real environment, allowing humans to simultaneously see virtual objects and real environment. Such a viewing condition and the luminance relationship between virtual objects and real environments introduce new challenges in color appearance characterization. In this study, an augmented reality simulator was built and the human observers adjusted the color appearance of a virtual stimulus to the whitest under different real environments. The general differences between the chromaticities for producing the whitest appearance under different adapting correlated color temperature (CCT) and adapting luminance were similar to those in the past studies investigating surface colors and self-luminous displays, but the effect of adapting CCT was found smaller. It suggested a lower degree of chromatic adaptation when viewing stimuli produced by an augmented reality graphic.