The changes in the electronic excitation energy arising from molecular structural displacement induced by external electric field (so-called vibrational polarization) are examined theoretically for the protonated and neutral 11-cis retinal Schiff bases. It is shown that the magnitude of the field-induced structural displacement is significantly large for the protonated species, so that the change in the electronic excitation energy arising from this structural displacement is of the same order of magnitude as that arising from the direct effect of electric field on the electronic wave function. These two effects contribute additively to the field-induced spectral shift. The intensity-carrying mode (ICM) theory is employed to extract a single vibrational mode (called primary infrared ICM) that is most important for the field-induced structural displacement. A simple one-dimensional model is constructed, and the extent to which we can interpret the field-induced spectral shift by such a model is examined. In the case of the neutral species, only a small change in the electronic excitation energy is induced by external electric field, mainly because the vibrational polarizability of this species is small. The meaning of these results in the spectral tuning of visual pigments is discussed.