We study the capillary forces arising from charged colloidal particles trapped at an oil-water interface. Since it is quadratic in the electric field, the electric stress acting on the interface cannot be written as the superposition of one-particle terms. Indeed, we find that the interfacial pressure is dominated by two-particle terms, which induce capillary forces involving one, two, three, or four particles. The dominant interaction is attractive and varies with the inverse cube of the particle distance.