Grounded in ecological theory, this study examines the association among participation in regular vigorous exercise and social status, aspects of prominent life settings, interactions between life settings, and more proximal individual resources and processes using data from the National Survey of Midlife Development in the United States (N = 3,032). Among women, a higher level of earnings was associated with more vigorous exercise, yet those women with more education had a steeper decline in exercise across adulthood. Among men, those with the lowest level of education had the steepest decline in physical activity across adulthood, and earnings did not affect exercise patterns. Less participation in vigorous exercise among blacks, in contrast to nonblacks, was explained by their tendency to live in less safe neighborhoods and having more functional health problems. Finally, contextual factors from multiple domains were independently associated with participation in regular exercise. Consistent with ecological theory, these results suggest that interventions to promote exercise habits among adults need to consider the independent and interactive effects of multiple contextual factors.