Broad-band dielectric spectroscopy is a commonly used tool in the study of glass-forming liquids. The high sensitivity of the technique together with the wide range of probed time scales makes it a powerful method for investigating the relaxation spectra of liquids. One particularly important class of glass-forming liquids that is often studied using this technique consists of liquids dominated by hydrogen (H) bond interactions. When investigating such liquids, particular caution has to be taken during sample preparation due to their often highly hygroscopic nature. Water can easily be absorbed from the atmosphere, and dielectric spectroscopy is a very sensitive probe of such contamination due to the large dipole moment of water. Our knowledge concerning the effects of small quantities of water on the dielectric properties of these commonly investigated liquids is limited. We here demonstrate the effects due to the presence of small amounts of water on the dielectric response of a typical H-bonded model glass former, tripropylene glycol. We show how the relaxation processes present in the pure liquid are affected by addition of water, and we find that a characteristic water induced relaxation response is observed for water contents as low as 0.15 wt %. We stress the importance of careful purification of hygroscopic liquids before experiments and quantify what the effects are if such procedures are not undertaken.