This article considers a target search problem by a set of unmanned aerial vehicles (UAVs). The problem is modelled as a discrete state, continuous-time Markov process. Convergence properties are investigated by using the eigenvalues and eigenvectors of a state transition rate matrix without explicitly solving differential equations or calculating matrix exponentials. The paper also studies the effect of cueing on convergence rate using eigenvalues analysis and optimal control theoretic perspective.