IEEE Transactions on Automatic Control, Vol.41, No.1, 90-106, 1996
Passive Stochastic-Approximation with Constant Step-Size and Window Width
Motivated by the desire to solve a steady-state estimation and detection problem in chemical engineering, and inspired by the recent progress in passive stochastic approximation, recursive algorithms combining stochastic approximation and kernel estimation are studied and developed in this work, The underlying problem can be stated as finding the roots (f) over bar(x) = 0 provided only noisy measurements y(n) = f(x(n),xi(n)) are available, where E f(x, xi(n)) = (f) over bar(x). The main difficulty lies in that unlike the traditional approach in stochastic approximation, the sequence {x(n)} is generated randomly and cannot be adjusted in accordance with our wish. Similar to those used in the decreasing step size algorithms, another sequence {z(n)} is generated to approximate the roots of (f) over bar(x) = 0 Some of the features of the algorithms include : constant step size and constant window width and correlated random processes, Under fairly general conditions, it is proven that a weak convergence result holds for an interpolated sequence of the iterates, Error bounds are obtained and a local limit theorem is also derived, The algorithm is then applied to an estimation problem in chemical engineering, Simulation has shown promising results.