Plasmonic antennas are key elements to control the luminescence of quantum emitters. However, the antenna's influence is often hidden by quenching losses. Here, the luminescence of a quantum dot coupled to a gold dimer antenna is investigated. Detailed analysis of the multiply excited states quantifies the antenna's influence on the excitation intensity and the luminescence quantum yield separately.