We propose performance criteria for discrete-time linear systems with Markov jumping parameters. Exact convex conditions for internal stability and contractiveness of such systems are expressed in terms of linear matrix inequalities. These conditions are of the same form as that in the Kalman-Yacubovich-Popov lemma. (c) 2006 Elsevier Ltd. All rights reserved.