We consider an optimal stochastic control problem for which the payoff is the average of a given cost function. In a non ergodic setting, but under a suitable nonexpansivity condition, we obtain the existence of the limit value when the averaging parameter converges (namely the discount factor tends to zero for Abel mean or the horizon tends to infinity for the CesA ro mean). The main novelty of our result lies on the fact that this limit may depend on initial conditions of the control system (in contrast to what is usually obtained by other approaches). We also prove that the limit does not depend of the chosen average (Abel or CesA ro mean).