A series of AX and XA dipeptides in D2O have been investigated by FTIR, isotropic, and anisotropic Raman spectroscopy at acidic, neutral, and alkaline pD, to probe the influence of amino acid side chains on the amide I' band. We obtained a set of spectral parameters for each peptide, including intensities, wavenumbers, half-widths, and dipole moments, and found that these amide I' parameters are indeed dependent on the side chain. Side chains with similar characteristic properties were found to have similar effects on the amide I'. For example, dipeptides with aliphatic side chains were found to exhibit a downshift of the amide I' wavenumber, while those containing polar side chains experienced an increase in wavenumber. The N-terminal charge causes a substantial upshift of amide I', whereas the C-terminal charge causes a moderate decrease of the transition dipole moment. Density functional theory (DFT) calculations on the investigated dipeptides in vacuo yielded different correlations between theoretically and experimentally obtained wavenumbers for aliphatic/aromatic and polar/charged side chains, respectively. This might be indicative of a role of the hydration shell in transferring side chain-backbone interactions. For Raman bands, we found a correlation between amide I' depolarization ratio and wavenumber which reflects that some side chains (valine, histidine) have a significant influence on the Raman tensor. Altogether, the obtained data are of utmost importance for utilizing amide I as a tool for secondary structure analysis of polypeptides and proteins and providing an experimental basis for theoretical modeling of this important backbone mode. This is demonstrated by a rather accurate modeling for the amide I' band profiles of the IR, isotropic Raman, and anisotropic Raman spectra of the beta-amyloid fragment A beta(1-82).