The ability of transcription factors to directly reprogram the identity of cell types is usually restricted and is defined by cellular context. Through the ectopic expression of single Caenorhabditis elegans transcription factors, we found that the identity of mitotic germ cells can be directly converted into that of specific neuron types: glutamatergic, cholinergic, or GABAergic. This reprogramming event requires the removal of the histone chaperone LIN-53 (RbAp46/48 in humans), a component of several histone remodeling and modifying complexes, and this removal can be mimicked by chemical inhibition of histone deacetylases. Our findings illustrate the ability of germ cells to be directly converted into individual, terminally differentiated neuron types and demonstrate that a specific chromatin factor provides a barrier for cellular reprogramming.