A simple and cost-effective chemical method was introduced to assemble gold (Au) nanoparticles on smooth silver (Ag) spheres for realizing surface-enhanced Raman scattering (SERS) enhancement by the replacement reaction between chloroauric acid and Ag spheres. In addition, the Ag-Au core-shell spheres were fabricated when a certain amount of chloroauric acid was used in the reaction solution. We found that the Ag particles decorated with small Au nanoparticles demonstrated the strongest SERS enhancement, while Ag-Au core-shell spheres showed the weakest enhancement.