The evolution of the optical properties of gold nanoclusters (NCs) versus size is of great importance because it not only reveals the nature of quantum confinement in NCs, but also helps to understand how the molecular-like Au NCs transit to plasmonic nanoparticles. While some work has been done in studying the optical properties of NCs of certain individual sizes, the global picture remains unclear, such as the detailed relationship between size/structure and properties. Here, we investigate the grand evolution of the optical properties by comparing the steady-state absorption, bandgap, transient absorption, as well as carrier dynamics of a series of thiolate-protected gold NCs ranging from tens to hundreds of gold atoms. We find that, on the basis of their optical behaviors, gold NCs can be classified into three groups: (i) ultrasmall NCs (ca. <50 Au atoms) are nonscalable as their optical properties are strongly dependent on the structure rather than size; (ii) medium-sized NCs (about 50-100 Au atoms) show both size- and structure-dependent optical properties; and (iii) large-sized gold NCs (ca. >100 Au atoms) exhibit optical properties solely dependent on size, and the structure effect fades out. Unraveling the grand evolution from nonscalable to scalable optical properties and their mechanisms will greatly deepen scientific understanding of the nature of quantum-sized gold NCs and will also provide implications for plasmonic NPs.