Understanding the relationship between memory function and lifestyle offers great opportunities for promoting beneficial lifestyle choices to foster healthy cognitive aging and for the development of intervention programs for older adults. We studied a cohort of older adults (age 65 and older) enrolled in the Longitudinal Aging Study Amsterdam, an ongoing prospective population-based research project. A total of 1,966 men and women participated in an episodic memory test every 3 years over a period of 14 years. Lifestyle habits were repeatedly assessed using self-report measures. Physical activity, light-to-moderate alcohol consumption, difficulties staying asleep, and social engagement were associated with better memory function over the course of 14 years. In contrast, smoking and long sleep duration were associated with worse memory function. These findings suggest that certain lifestyle factors can have long-term protective or harmful effects on memory function in aging individuals.