Plants defend themselves against attack by natural enemies, and these defenses vary widely across populations. However, whether communities of natural enemies are a sufficiently potent force to maintain polymorphisms in defensive traits is largely unknown. Here, we exploit the genetic resources of Arabidopsis thaliana, coupled with 39 years of field data on aphid abundance, to (i) demonstrate that geographic patterns in a polymorphic defense locus (GS-ELONG) are strongly correlated with changes in the relative abundance of two specialist aphids; and (ii) demonstrate differential selection by the two aphids on GS-ELONG, using a multigeneration selection experiment. We thereby show a causal link between variation in abundance of the two specialist aphids and the geographic pattern at GS-ELONG, which highlights the potency of natural enemies as selective forces.