A Markov chain process is used to model a fed-batch fermentation. A real time optimization problem is posed in terms of Markov decision process (MDP) to determine the feed profile that maximizes the expected total discounted reward of the fermentation product. Preliminary optimality conditions, computational aspects, and real time experimental results are presented. The experimental results show a 120% increase in ethanol productivity compared with previous results.