The use of machine learning (ML) models toward development of validated structure-property relationships for two fundamental properties of activated inorganic scintillators for high energy radiation detection, namely the light yield (LY) and the decay time constant, is explored. The ML models are built on easily accessible proxies of materialsinterchangeably referred to as features, descriptors or fingerprintsthat are carefully selected on the basis of a physical understanding of the scintillation mechanism. Our study indicates that the developed physics-based ML models employing kernel ridge regression (KRR) and AdaBoost algorithm applied on top of a decision tree-based regression are able to learn the underlying design rules in a multi-dimensional feature space and thereby enable reasonably accurate predictions of the two target properties on unseen compounds (i.e., on a held-out test set). For instance, within a set of twenty-five cerium- or europium-doped scintillator materials, our analysis reveals a strong correlation between the average ionic part of the dielectric constant and the LY, irrespective of the specific chemistry of the compounds, indicating that the average ionic part of the dielectric constant is a particularly relevant descriptor toward prediction of the LY. Our results also demonstrate that, despite the use of small training datasets, the developed models are able to quickly distinguish high performing chemistries from those with relatively poor performance and therefore can play a crucial role in screening of new compounds with an attractive combination of targeted properties. The present study provides necessary motivation for future efforts involving ML models with relatively large training datasets, vast feature space explorations, and experimental design in search of promising novel scintillator chemistries.