Despite much progress in understanding how extrinsic signaling regulates stem cell self-renewal, little is known about how cell-autonomous gene regulation controls this process. In Drosophila ovaries, germline stem cells (GSCs) divide asymmetrically to produce daughter GSCs and cystoblasts, the latter of which develop into germline cysts. Here, we show that removing the translational repressor Nanos from either GSCs or their precursors, the primordial germ cells (PGCs), causes both cell types to differentiate into germline cysts. Thus, Nanos is essential for both establishing and maintaining GSCs by preventing their precocious entry into oogenesis. These functions are likely achieved by repressing the translation of differentiation factors in PGCs and GSCs.