Polarized growth in Saccharomyces cerevisiae is thought to occur by the transport of post-Golgi vesicles along actin cables to the daughter cell, and the subsequent fusion of the vesicles with the plasma membrane. Previously, we have shown that Msb3p and Msb4p genetically interact with Cdc42p and display a GTPase-activating protein (GAP) activity toward a number of Rab GTPases in vitro. We show here that Msb3p and Msb4p regulate exocytosis by functioning as GAPs for Sec4p in vivo. Cells lacking the GAP activity of Msb3p and Msb4p displayed secretory defects, including the accumulation of vesicles of 80–100 nm in diameter. Interestingly, the GAP activity of Msb3p and Msb4p was also required for efficient polarization of the actin patches and for the suppression of the actin-organization defects in cdc42 mutants. Using a strain defective in polarized secretion and actin-patch organization, we showed that a change in actin-patch organization could be a consequence of the fusion of mistargeted vesicles with the plasma membrane.