Hemicelluloses are major components of plant biomass, but their fermentation in the rumens of cattle and other ruminants is poorly understood. We compared four species of the ruminally dominant genus Prevotella and the well-known hemicellulose utilizer, Butyrivibrio fibrisolvens, with respect to degradation of several isolated hemicelluloses (xylans, glucomannan, and xyloglucan). We also performed Illumina sequencing of the V3/V4 region of 16S rRNA genes to determine the relative proportions of Prevotella and Butyrivibrio in hemicellulose-fed enrichment cultures inoculated from ruminal contents of dairy cattle fed a total mixed ration (TMR) rich in hemicelluloses. Results confirmed the xylan fermentation and butyrate production abilities of B. fibrisolvens. Despite their reputation as generalist fermenters, the Prevotella strains poorly fermented these hemicelluloses but exhibited dramatic differences in fermentation end products. Prevotella was much less abundant in mixed bacterial enrichment cultures fed the same TMR than in the ruminal inoculum, yet Prevotella was again the most abundant genus in enrichment cultures fed xylans. By contrast, glucomannan fermentations were dominated by Streptococcus sp. Genera known for hemicellulose degradation (Butyrivibrio, Ruminococcus, and Fibrobacter) were not significantly enriched on these hemicelluloses. Substantial differences in fermentation end product distribution from the different hemicelluloses were observed, which would likely affect nutrient partitioning in the host animal. Differences in community composition between in vitro hemicellulose enrichments and inoculum samples emerged at every phylogenetic level, suggesting that in vitro conditions provide unique selective pressures on the bacterial community and also that ruminal bacteria exhibit specialization with respect to hemicellulose utilization.