This paper reports measurements of static microscopic dielectric response of several dipolar solvents to charge redistribution in a fluorescent probe. Contrary to recent predictions of dielectric theories and computer simulations of bulk liquids, the observed dielectric response of most solvents conforms to the macroscopic continuum description even at atomic distances, as if these solvents had no spatial intermolecular structure. Such conformance is observed for several probes when the contribution of specific probe-solvent interactions to the response is negligible. However, water, formamide, and glycerol exhibit anomalous responses even though such a probe is used. We discuss a possible reason for the macroscopic-like behavior and a connection between the anomaly and fluctuating structures formed by anomalous solvents near the hydrophobic surface of the probe.