The heritable component of breast cancer accounts for only a small proportion of total incidences. Environmental and lifestyle factors are therefore considered to among the major influencing components increasing breast cancer risk. Endocrine-disrupting chemicals (EDCs) are ubiquitous in the environment. The estrogenic property of EDCs has thus shown many associations between ongoing exposures and the development of endocrine-related diseases, including breast cancer. The environment consists of a heterogenous population of EDCs and despite many identified modes of action, including that of altering the epigenome, drawing definitive correlations regarding breast cancer has been a point of much discussion. In this review, we describe in detail well-characterized EDCs and their actions in the environment, their ability to disrupt mammary gland formation in animal and human experimental models and their associations with exposure and breast cancer risk. We also highlight the susceptibility of early-life exposure to each EDC to mediate epigenetic alterations, and where possible describe how these epigenome changes influence breast cancer risk.