The fixation stage of cellular structure during polymer foaming process is difficult to control due to difficult removing of internal heat, especially for crystalline polymers such as polypropylene (PP). In order to control cellular structure in the fixation stage, we established an universal method by introducing water as an in-situ internal cooling agent during the foaming process of PP. Particularly, hydrophilic fillers were added into the high melt flow index polypropylene (HMI-PP) with poor foaming ability to study the effect of adsorbed water on the foaming process of PP/filler composites during sc-CO2 batch foaming process. Compared to pure HMI-PP, HMI-PP/hydrophilic filler composites showed increased adsorption amount for water and melt viscosity. The water within the composites played a key role in the foaming process, which not only served as a physical foaming agent to increase the volume expansion ratio of PP composite foam, but also showed the function of rapid cooling foam proved by thermal imaging technology. As a result, the presence of some hydrophilic fillers within HMI-PP matrix significantly improved the foaming properties of HMI-PP, including preventing internal bubble collapse and significantly increasing the volume expansion ratio of the foam. The applicability of this method was validated using other PP materials besides HMI-PP, including high molecular weight PP (HMW-PP), high melt strength PP (HMS-PP).