InAs self-organized quantum dots (QDs) grown on annealed low-temperature GaAs (LT-GaAs) epi-layers and on normal temperature GaAs buffer layers have been compared by transmission electron microscopy (TEM) and photoluminescence (PL) measurements. TEM evidences that self-organized QDs were formed with a smaller size and larger density than that on normal GaAs buffer layers. It is discussed that local tensile surface strain regions that are preferred sites for InAs islands nucleation are increased in the case of the LT-GaAs buffer layers due to exhibiting As precipitates. The PL spectra show a blue-shifted peak energy with narrower linewidth revealing the improvement of optical properties of the QDs grown on LT-GaAs epi-layers. It suggests us a new way to improve the uniformity and change the energy band structure of the InAs self-organized QDs by carefully controlling the surface stress states of the LT-GaAs buffers on which the QDs are formed.