Metal halide-based perovskite solar cells (PSCs) have developed rapidly due to exceptional optoelectronic properties of perovskite materials (such as high optical absorption coefficient, long charge carrier lifetime, long diffusion length, high carrier mobility and tunable bandgaps) and low-cost fabrication processes. The record power conversion efficiency has exceeded 24%, demonstrating the great potential for photovoltaic application. However, the lead toxicity and instability still present as major obstacles for commercialization. In principle, Pb can be replaced with other less-toxic as well as environmentally benign metals, such as Ag, Na, Sn, Ge, Bi, Sb and Ti, to solve the toxicity issue. Replacing methylammonium (MA(+)) or formamidinium (FA(+)) with cesium (Cs+) represents a promising direction to address the instability issue. Herein, we review the recent progress of all-inorganic cesium lead-free halide PSCs. At the end, we outline challenges and future directions.