Anatomical magnetic resonance imaging (MRI), diffusion MRI and resting state functional MRI (rs-fMRI) have been used for Alzheimer's disease (AD) classification. These scans are typically used to build models for discriminating AD patients from control subjects, but it is not clear if these models can also discriminate AD in diverse clinical populations as found in memory clinics. To study this, we trained MRI-based AD classification models on a single centre data set consisting of AD patients (N = 76) and controls (N = 173), and used these models to assign AD scores to subjective memory complainers (N = 67), mild cognitive impairment (MCI) patients (N = 61), and AD patients (N = 61) from a multi-centre memory clinic data set. The anatomical MRI scans were used to calculate grey matter density, subcortical volumes and cortical thickness, the diffusion MRI scans were used to calculate fractional anisotropy, mean, axial and radial diffusivity, and the rs-fMRI scans were used to calculate functional connectivity between resting state networks and amplitude of low frequency fluctuations. Within the multi-centre memory clinic data set we removed scan site differences prior to applying the models. For all models, on average, the AD patients were assigned the highest AD scores, followed by MCI patients, and later followed by SMC subjects. The anatomical MRI models performed best, and the best performing anatomical MRI measure was grey matter density, separating SMC subjects from MCI patients with an AUC of 0.69, MCI patients from AD patients with an AUC of 0.70, and SMC patients from AD patients with an AUC of 0.86. The diffusion MRI models did not generalise well to the memory clinic data, possibly because of large scan site differences. The functional connectivity model separated SMC subjects and MCI patients relatively good (AUC = 0.66). The multimodal MRI model did not improve upon the anatomical MRI model. In conclusion, we showed that the grey matter density model generalises best to memory clinic subjects. When also considering the fact that grey matter density generally performs well in AD classification studies, this feature is probably the best MRI-based feature for AD diagnosis in clinical practice.