The goal of this paper is to develop balancing theory for the linear time-varying (LTV) symmetric systems. To this end, first, we extend the concept of symmetry in terms of the dual system. Then, we define the cross Gramian for the LTV systems. For LTV symmetric systems, we establish a connection among the controllability, observability, and cross Gramians. In particular, if one of these three Gramians is obtained, the other two Gramians can be constructed. Based on this fact, we show that the symmetry structure is preserved under balanced truncation if the Hankel singular values are pointwise distinct.