We report on a detailed theoretical analysis, based on extensive ab initio calculations at the CC2 level, of the Si potential energy surface (PES) of the photoactive yellow protein (PYP) chromophore. The chromophore's photoisomerization pathway is shown to be fairly complex, involving an intimate coupling between single-bond and double-bond torsions. Furthermore, these torsional modes are shown to couple to a third coordinate of hydrogen out-of-plane (HOOP) type whose role in the isomerization is here identified for the first time. In addition, it is demonstrated that hydrogen bonding at the phenolate moiety of the chromophore can hinder the single-bond torsion and thus facilitates double-bond isomerization. These results suggest that the interplay between intramolecular factors and H-bonding determines the isomerization in native PYP.