We report the observation of local structural dipoles that emerge from an undistorted ground state on warming, in contrast to conventional structural phase transitions in which distortions emerge on cooling. Using experimental and theoretical probes of the local structure, we demonstrate this behavior in binary lead chalcogenides, which were believed to adopt the ideal, undistorted rock-salt structure at all temperatures. The behavior is consistent with a simple thermodynamic model in which the emerging dipoles are stabilized in the disordered state at high temperature due to the extra configurational entropy despite the fact that the undistorted structure has lower internal energy. Our findings shed light on the anomalous electronic and thermoelectric properties of the lead chalcogenides. Similar searches may show that the phenomenon is more widespread.