Cellulose in plant cell walls are synthesized as crystalline microfibrils with diameters of 3-4 nm and lengths of around 1-10 mu m. These microfibrils are known to be the backbone of cell walls, and their multiscale three-dimensional organization plays a critical role in cell wall functions including plant growth and recalcitrance to degradation. The mesoscale organization of microfibrils over a 1-100 nm range in cell walls is challenging to resolve because most characterization techniques investigating this length scale suffer from low spatial resolution, sample preparation artifacts, or inaccessibility of specific cell types. Here, we report a sum frequency generation (SFG) study determining the mesoscale polarity of cellulose microfibrils in intact plant cell walls. SFG is a nonlinear optical spectroscopy technique sensitive to the molecular-to-mesoscale order of noncentrosymmetric domains in amorphous matrices. However, the quantitative theoretical model to unravel the effect of polarity in packing of noncentrosymmetric domains on SFG spectral features has remained unresolved. In this work, we show how the phase synchronization principle of the SFG process is used to predict the relative intensities of vibrational modes with different polar angles from the noncentrosymmetric domain axis. Applying this model calculation for the first time and employing SFG microscopy, we found that cellulose microfibrils in certain xylem cell walls are deposited unidirectionally (or biased in one direction) instead of the bidirectional polarity which was believed to be dominant in plant cell walls from volume-averaged characterizations of macroscopic samples. With this advancement in SFG analysis, one can now determine the relative polarity of noncentrosymmetric domains such as crystalline biopolymers interspersed in amorphous polymer matrices, which will open opportunities to study new questions that have not been conceived in the past.