Planetary gearboxes play an important role in wind turbine (WT) drivetrains. WTs usually work under time-varying running conditions due to the volatile wind conditions. The planetary gearbox vibration signals in such an environment are hence highly nonstationary. Conventional spectral analysis and demodulation analysis methods are unable to identify the characteristic frequency of gear fault from such nonstationary signals. As such, this paper presents a time frequency analysis methods to reveal the constituent frequency components of nonstationary signals and their time-varying features for WT planetary gearbox monitoring. More specifically, we exploit the adaptive optimal kernel (AOK) method for this challenging application because of its fine time frequency resolution and cross-term free nature, as demonstrated by our simulation analysis. In this study, the AOK method has been applied to identify the time-varying characteristic frequencies of gear fault or to extract different levels of impulses induced by gear faults from lab WT experimental signals and in-situ WT signals under time-varying running conditions. We have demonstrated that the AOK is effective diagnosis of: (a) both the local damage (a single chipped tooth) and distributed faults (wear of all teeth), (b) both sun gear and planet gear faults, and (c) faults with very weak signature (e.g., the sun gear fault at the low speed stage of a WT planetary gearbox). (C) 2014 Elsevier Ltd. All rights reserved.