Significance The origins of the Malagasy raise questions about ancient connections between continents; moreover, because ancestors are fundamental to Malagasy society, Malagasy origins is also a heated topic around the country, with numerous proposed hypotheses. This study provides a comprehensive view of genomic diversity (including maternal lineages, paternal lineages, and genome-wide data) based on a sampling of 257 villages across Madagascar. The observed spatial patterns lead to a scenario of a recent and sex-biased admixture between Bantu and Austronesian ancestors across the island. Moreover, we find geographical influences creating subtle signals of genetic structure that are independent of the Bantu/Austronesian admixture, suggesting that recent history has a role in the genomic diversity of the Malagasy.