We use atomic force microscopy to in situ investigate the dynamic behavior of confined water at the interface between graphene and mica. The graphene is either uncharged, negatively charged, or positively charged. At high humidity, a third water layer will intercalate between graphene and mica. When graphene is negatively charged, the interface fills faster with a complete three layer water film, compared to uncharged graphene. As charged positively, the third water layer dewets the interface, either by evaporation into the ambient or by the formation of three-dimensional droplets under the graphene, on top of the bilayer. Our experimental findings reveal novel phenomena of water at the nanoscale, which are interesting from a fundamental point of view and demonstrate the direct control over the wetting properties of the graphene/water interface.