Women harboring heterozygous germline mutations of BRCA2 have a 50 to 80% risk of developing breast cancer, yet the pathogenesis of these cancers is poorly understood. To reveal early steps in BRCA2-associated carcinogenesis, we analyzed sorted cell populations from freshly-isolated, non-cancerous breast tissues of BRCA2 mutation carriers and matched controls. Single-cell whole-genome sequencing demonstrates that >25% of BRCA2 carrier (BRCA2^mut/+) luminal progenitor (LP) cells exhibit sub-chromosomal copy number variations, which are rarely observed in non-carriers. Correspondingly, primary BRCA2^mut/+ breast epithelia exhibit DNA damage together with attenuated replication checkpoint and apoptotic responses, and an age-associated expansion of the LP compartment. We provide evidence that these phenotypes do not require loss of the wild-type BRCA2 allele. Collectively, our findings suggest that BRCA2 haploinsufficiency and associated DNA damage precede histologic abnormalities in vivo. Using these hallmarks of cancer predisposition will yield unanticipated opportunities for improved risk assessment and prevention strategies in high-risk patients.