Cancer progression involves extensive alterations in epigenetic and gene expression programs, but the accompanying changes in higher-order genome organization remain less well understood. Using high-resolution Micro-C mapping in the MCF10 cell model of breast cancer, we profiled chromatin compartments, topologically associated domains, and chromatin loops. We find large-scale compartmental shifts occur predominantly in early stages of cancer development, with more fine-scale structural changes in topologically associating domains and loops accumulating during the later transition to metastasis. Relating these chromatin features to gene expression and enhancer-associated histone marks revealed that many differentially expressed genes are physically connected to distal regulatory elements. While enhancer–promoter contact frequency and distal enhancer activity correlated with gene expression, strong changes in chromatin looping were relatively infrequent during progression, suggesting tha