Anisotropy pump-probe experiments have provided insights into the character of excitons formed in photosynthetic complexes. Rapid decay in the observed anisotropy is cited as evidence of the strength of coupling of the excitonic degrees of freedom to their environment. Here we show that ensemble averaging over realistic model Hamiltonians leads to a rapid decay of anisotropy to a value close to the observed asymptote, and at a rate comparable to observed decay rates, even in the absence of coupling to the environment. While coupling to the environment will clearly play a role in the dynamics of such systems, our calculations suggest that caution is needed in deducing the strength of this coupling from anisotropy experiments. We also set out to clarify the nature of the quantum states and processes involved in the dynamics of such systems and the associated terminology.