Unidirectional elongation of magnetic field sensitive polymer gels, called ferrogels, have been studied. In ferrogels, finely distributed colloidal particles having superparamagnetic behavior are incorporated into a swollen network. These particles couple the shape of the gel to the nonuniform magnetic field. Shape distortion occurs instantaneously and disappears when the external field is removed. A discontinuous elongation and contraction in response to infinite-small change in the external magnetic field has been observed and a theoretical interpretation based on coupled magnetic and rubber elastic properties is provided.