The retromer is a cytosolic/peripheral membrane protein complex that mediates the retrieval of the cation-independent mannose 6-phosphate receptor from endosomes to the trans-Golgi network (TGN) in mammalian cells. Previous studies showed that the mammalian retromer comprises three proteins, named Vps26, Vps29, and Vps35, plus the sorting nexin, SNX1. There is conflicting evidence, however, as to whether a homologous sorting nexin, SNX2, is truly a component of the retromer. In addition, the nature of the subunit interactions and assembly of the mammalian retromer complex are poorly understood. We have addressed these issues by performing biochemical and functional analyses of endogenous retromers in the human cell line HeLa. We found that the mammalian retromer complex consists of two autonomously assembling subcomplexes, namely, a Vps26-Vps29-Vps35 obligate heterotrimer and a SNX1/2 alternative heterodimer or homodimer. The association of Vps26-Vps29-Vps35 with endosomes requires the presence of either SNX1 or SNX2, whereas SNX1/2 can be recruited to endosomes independently of Vps26-Vps29-Vps35. We also found that the presence of either SNX1 or SNX2 is essential for the retrieval of the cation-independent mannose 6-phosphate receptor to the TGN. These observations indicate that the mammalian retromer complex assembles by sequential association of SNX1/2 and Vps26-Vps29-Vps35 subcomplexes on endosomal membranes and that SNX1 and SNX2 play interchangeable but essential roles in retromer structure and function.