The packing structures and packing effects on excitation energies of oligomers of polyfuran (PFu), polypyrrole (PPy), polycyclopentidene (PCp), polythiophene (PTh), polyphosphole (PPh), and polysilole (PSi) are comparatively studied by employing molecular dynamics (MD) simulations and time-dependent density functional theory (TDDFT) calculations. The dependence of packing structures on the main group of heteroatoms in the five-membered heterocyclic oligomers is exhibited from MID simulations. The planarity of backbones and the population of pi-stacked structures increase with the heteroatoms going from group 14 to group 16; i.e., PCp < PPy < PFu; PSi < PPh < PTh. The polymers with the third row elements, PSi and PPh, tend to have larger chain flexibilities in the packing systems than those with the second row elements, PCp and PPy, respectively. On the basis of the second-order Moller-Plesset perturbation (MP2) and natural bond orbital (NBO) calculations of the pi-stacked pairs, the difference in pi-stack orientations, head-to-tail vs head-to-head, between various packing systems is rationalized by individual interchain bond orbital interactions involved with heteroatoms. The packing systems with higher row elements tend to have narrower band gaps. The band gaps are closely related to the chain torsions driven by interchain interactions. The noticeable chain distortions in the packing systems of PCp, PSi, and PPh lead to the significant increase of band gaps in comparison with those appraised from periodic boundary conditions (PBC) calculations on their planar isolated chains.