Cardiovascular disease (CVD) accounts for approximately 30% of all deaths worldwide and its prevalence is constantly increasing despite advancements in medical treatments. Cardiac remodeling and dysfunction are independent risk factors for CVD. Recent studies have demonstrated that cardiac structure and function are genetically influenced, suggesting that understanding the genetic basis for cardiac structure and function could provide new insights into developing novel therapeutic targets for CVD. Regular exercise has long been considered a robust nontherapeutic method of treating or preventing CVD. However, recent studies also indicate that there is inter-individual variation in response to exercise. Nevertheless, the genetic basis for cardiac structure and function as well as their responses to exercise training have yet to be fully elucidated. Therefore, this review summarizes accumulated evidence supporting the genetic contribution to these traits, including findings from population-based studies and unbiased large genomic-scale studies in humans.