The relationship between phenotype and fitness can be visualized as a rugged landscape. Multiple fitness peaks on this landscape are predicted to drive early bursts of niche diversification during adaptive radiation. We measured the adaptive landscape in a nascent adaptive radiation of Cyprinodon pupfishes endemic to San Salvador Island, Bahamas, and found multiple coexisting high-fitness regions driven by increased competition at high densities, supporting the early burst model. Hybrids resembling the generalist phenotype were isolated on a local fitness peak separated by a valley from a higher-fitness region corresponding to trophic specialization. This complex landscape could explain both the rarity of specialists across many similar environments due to stabilizing selection on generalists and the rapid morphological diversification rate of specialists due to their higher fitness.