This paper seeks to understand the forces that maintain racial segregation and the implications for the Black-White gap in college attainment. We incorporate race into an overlapping-generations spatial-equilibrium model with neighborhood spillovers. The model incorporates race in three ways: (i) a Black-White wage gap, (ii) an amenity externality—households care about the racial composition of their neighbors—and (iii) an additional barrier to moving for Black households. These forces quantitatively account for all of the racial segregation and 80% of the Black-White gap in college attainment in the data for the St. Louis metro area. Counterfactual exercises show that all three forces are quantitatively important. The presence of spillovers and externalities generates multiple equilibria. Although St. Louis is in the segregated equilibrium, there also exists an integrated equilibrium with a lower college gap, and we analyze a transition path between the two.