Calcium sulfate is one of the most important construction materials. Today it is employed as high-performance compound in medical applications and cement mixtures. We report a synthesis for calcium sulfate nanoparticles with outstanding dispersibility properties in organic solvents without further functionalization. The nanoparticles (amorphous with small gamma-anhydrite crystallites, 5-50 nm particle size) form long-term stable dispersions in acetone without any sign of precipitation. H-1 NMR spectroscopic techniques and Fourier-transform infrared spectroscopy (FTIR) reveal absorbed 2-propanol on the particle surfaces that induce the unusual dispersibility. Adding water to the nanoparticle dispersion leads to immediate precipitation. A phase transformation to gypsum via bassanite was monitored by an in situ kinetic FT-IR spectroscopic study and transmission electron microscopy (TEM). The dispersibility in a volatile organic solvent and the crystallization upon contact with water open a broad field of applications for the CaSO4 nanoparticles, e.g., as nanogypsum for coatings or the fabrication of hybrid composites.