Alzheimer’s disease (AD) neuropathology is characterized by hyperphosphorylated tau containing neurofibrillary tangles and amyloid-beta (Aβ) plaques. Normally these hallmarks are studied by (immuno-) histological techniques requiring chemical pretreatment and indirect labelling. Label-free imaging enables one to visualize normal tissue and pathology in its native form. Therefore, these techniques could contribute to a better understanding of the disease. Here, we present a comprehensive study of high-resolution fluorescence imaging (before and after staining) and spectroscopic modalities (Raman mapping under pre-resonance conditions and stimulated Raman scattering (SRS)) of amyloid deposits in snap-frozen AD human brain tissue. We performed fluorescence and spectroscopic imaging and subsequent thioflavin-S staining of the same tissue slices to provide direct confirmation of plaque location and correlation of spectroscopic biomarkers with plaque morphology; differences were observed between cored and fibrillar plaques. The SRS results showed a protein peak shift towards the β-sheet structure in cored amyloid deposits. In the Raman maps recorded with 532 nm excitation we identified the presence of carotenoids as a unique marker to differentiate between a cored amyloid plaque area versus a non-plaque area without prior knowledge of their location. The observed presence of carotenoids suggests a distinct neuroinflammatory response to misfolded protein accumulations.