This paper presents a continuum model of the flow of granular material during filling of a silo, using a viscoplastic constitutive relation based on the Drucker-Prager plasticity yield function. The performed simulations demonstrate the ability of the model to realistically represent complex features of granular flows during filling processes, such as heap formation and non-zero inclination angle of the bulk material-air interface. In addition, micro-mechanical parametrizations which account for particle size segregation are incorporated into the model. It is found that numerical predictions of segregation phenomena during filling of a binary granular mixture agree well with experimental results. Further numerical tests indicate the capability of the model to cope successfully with complex operations involving granular mixtures.