The ribonuclease (RNase) H family of enzymes catalyze the specific cleavage of RNA strands of RNA/DNA hybrid duplexes and play an important role in DNA replication and repair. Since the first report of the crystal structure of RNase HI, its catalytic mechanisms, which require metal ions, have been discussed based on numerous structural and functional analyses, including X-ray crystallography. In contrast, the function of the conserved histidine residue (His124 in Escherichia coli) in the flexible loop around the active site remains poorly understood, although an important role was suggested by NMR analyses. Here, novel high-resolution X-ray crystal structures of E. coli RNase HI are described, with a particular focus on the interactions of divalent cations with His124 oriented towards the active site. The enzyme–Mg2+ complex contains two metal ions in the active site, one of which has previously been observed. The second ion lies alongside the first and binds to His124 in an octahedral coordination scheme. In the enzyme–Zn2+ complex a single metal ion was found to bind to the active site, showing a tetrahedral coordination geometry with the surrounding atoms, including His124. These results provide structural evidence that His124 plays a crucial role in the catalytic activity of RNase HI by interacting weakly and transiently with metal ions in the catalytic center.