Bacterial and archaeal assemblages are one of the most important contributors to the recycling of nutrients and the decomposition of organic matter in aquatic sediments. However, their spatiotemporal variation and its driving factors remain unclear, especially for drinking reservoirs, which are strongly affected by human consumption. Using quantitative PCR and Illumina MiSeq sequencing, we investigated the bacterial and archaeal communities in the sediments of a drinking reservoir, the Miyun Reservoir, one of the most important drinking sources for Beijing City. The abundance of bacteria and archaea presented no spatiotemporal variation. With respect to community diversity, visible spatial and temporal differences were observed in archaea, whereas the bacterial community showed minor variation. The bacterial communities in the reservoir sediment mainly included Proteobacteria, Bacteroidetes, Nitrospirae, Acidobacteria, and Verrucomicrobia. The bacterial community structure showed obvious spatial variation. The composition of the bacterial operational taxonomic units (OTUs) and main phyla were dam-specific; the composition of samples in front of the dam were significantly different from the composition of the other samples. The archaeal communities were mainly represented by Woesearchaeota and Euryarchaeota. Distinctly spatial and seasonal variation was observed in the archaeal community structure. The sediment NH4 (+)-N, pH, and water depth were identified as the key driving factors of changes in the composition of the bacterial and archaeal communities. Water depth might have the greatest influence on the microbial community structure. The dam-specific community structure may be related to the greater water depth in front of the dam. This finding indicates that water depth might be the greatest contributor to the microbial community structure in the Miyun Reservoir.