The mechanism of glycosyltransferase localization to the Golgi apparatus is a long-standing question in secretory cell biology. All Golgi glycosyltransferases are type II membrane proteins with small cytosolic domains that contribute to Golgi localization. To date, no protein has been identified that recognizes the cytosolic domains of Golgi enzymes and contributes to their localization. Here, we report that yeast Vps74p directly binds to the cytosolic domains of cis and medial Golgi mannosyltransferases and that loss of this interaction correlates with loss of Golgi localization of these enzymes. We have solved the X-ray crystal structure of Vps74p and find that it forms a tetramer, which we also observe in solution. Deletion of a critical structural motif disrupts tetramer formation and results in loss of Vps74p localization and function. Vps74p is highly homologous to the human GMx33 Golgi matrix proteins, suggesting a conserved function for these proteins in the Golgi enzyme localization machinery.