The diffusion coefficient of water adsorbed in hydrophilic porous materials, such as non-crystalline cellulose, depends on water activity. Faster diffusion at higher water concentrations is observed in experimental and modeling studies. In this paper, two asymptotic water concentrations, near-vacuum and fully saturated, are investigated at the surface of crystalline cellulose with molecular dynamics simulations. An increasing water concentration leads to significant changes in the free energy landscape due to perturbation of local electrostatic potential. Smoothening of strong energy minima, corresponding to sorption sites, and formation of layered structure facilitates water transport in the vicinity of cellulose. The determined transition probabilities and hydrogen bond stability reflect the changes in the energy landscape. As a result of a concentration increase, the emerging basins of attraction and spreading out of those existing in the diluted state lead to an increase in water entropy. Thermal fluctuations of cellulose are demonstrated to rearrange the landscape in the diluted limit, increase adsorbed water entropy, and decrease the water-cellulose H-bond lifetime.