The four related mammalian MEX-3 RNA-binding proteins are evolutionarily conserved molecules for which the in vivo functions have not yet been fully characterized. Here, we report that male mice deficient for the gene encoding Mex3b are subfertile. Seminiferous tubules of Mex3b-deficient mice are obstructed as a consequence of the disrupted phagocytic capacity of somatic Sertoli cells. In addition, both the formation and the integrity of the blood-testis barrier are compromised owing to mislocalization of N-cadherin and connexin 43 at the surface of Sertoli cells. We further establish that Mex3b acts to regulate the cortical level of activated Rap1, a small G protein controlling phagocytosis and cell-cell interaction, through the activation and transport of Rap1GAP. The active form of Rap1 (Rap1-GTP) is abnormally increased at the membrane cortex and chemically restoring Rap1-GTP to physiological levels rescues the phagocytic and adhesion abilities of Sertoli cells. Overall, these findings implicate Mex3b in the spatial organization of the Rap1 pathway that orchestrates Sertoli cell functions.