Pyrite is a ubiquitous iron sulfide mineral that is oxidized by trace oxygen. The mineral has been largely absent from global sediments since the rise in oxygen concentration in Earth's early atmosphere. We analyzed weathering in shale, the most common rock exposed at Earth's surface, with chemical and microscopic analysis. By looking across scales from 10(-9) to 10(2) meters, we determined the factors that control pyrite oxidation. Under the atmosphere today, pyrite oxidation is rate-limited by diffusion of oxygen to the grain surface and regulated by large-scale erosion and clast-scale fracturing. We determined that neither iron-nor sulfur-oxidizing microorganisms control global pyrite weathering fluxes despite their ability to catalyze the reaction. This multiscale picture emphasizes that fracturing and erosion are as important as atmospheric oxygen in limiting pyrite reactivity over Earth's history.