Probing the local environment of low-Z elements, such as oxygen, is of great interest for understanding the atomic-scale behavior in materials, but it requires experimental techniques allowing it to work with versatile sample environments. In this paper, the local environment of lithium borate crystals is investigated using non-resonant inelastic X-ray scattering (NRIXS) at energy losses corresponding to the oxygen K-edge. Large variations of the spectral features are observed close to the edge onset in the 535-540 eV energy range when varying the Li2O content. Calculations allow identification of contributions associated with bridging oxygen (BO) and non-bridging oxygen (NBO) atoms. The main result resides in the observed core-level shift of about 1.7 eV in the spectral signatures of the BO and NBO. The clear signature at 535 eV in the O K-edge NRXIS spectrum is thus an original way to probe the presence of NBOs in borates, with the great advantage of making possible the use of complex environments such as a high-pressure cell or high-temperature device for in situ measurements.