Semilinear parabolic differential equations are solved in a mild sense in an infinite-dimensional Hilbert space. Applications to stochastic optimal control problems are studied by solving the associated Hamilton-Jacobi-Bellman equation. These results are applied to some controlled stochastic partial differential equations.