c-Cbl-associated protein (CAP) is an important cytoskeletal adaptor protein involved in the regulation of adhesion turnover. The interaction between CAP and vinculin is critical for the recruitment of CAP to focal adhesions. The tandem SH3 domains (herein termed SH3a and SH3b) of CAP are responsible for its interaction with vinculin. However, the structural mechanism underlying the interaction between CAP and vinculin is poorly understood. In this manuscript, we report the solution structure of the tandem SH3 domains of CAP. Our NMR and ITC data indicate that the SH3a and SH3b domains of CAP simultaneously bind to a long proline-rich region of vinculin with different binding specificities. Furthermore, the crystal structures of the individual SH3a and SH3b domains complexed with their substrate peptides indicate that Q807(SH3a) and D881(SH3b) are the critical residues determining the different binding specificities of the SH3 domains. Based on the obtained structural information, a model of the SH3ab-vinculin complex was generated using MD simulation and SAXS data.