Prion diseases are a group of rare neurodegenerative conditions characterised by a high rate of progression and highly heterogeneous phenotypes. Whilst the most common form of prion disease occurs sporadically (sporadic Creutzfeldt-Jakob disease, sCJD), other forms are caused by prion protein gene mutations, or exposure to prions in the diet or by medical procedures, such us surgeries. To date, there are no accurate quantitative imaging biomarkers that can be used to predict the future clinical diagnosis of a healthy subject, or to quantify the progression of symptoms over time. Besides, CJD is commonly mistaken for other forms of dementia. Due to the heterogeneity of phenotypes and the lack of a consistent geometrical pattern of disease progression, the approaches used to study other types of neurodegenerative diseases are not satisfactory to capture the progression of human form of prion disease. In this paper, using a tailored framework, we aim to classify and stratify patients with prion disease, according to the severity of their illness. The framework is initialised with the extraction of subject-specific imaging biomarkers. The extracted biomakers are then combined with genetic and demographic information within a Gaussian Process classifier, used to calculate the probability of a subject to be diagnosed with prion disease in the next year. We evaluate the effectiveness of the proposed method in a cohort of patients with inherited and sporadic forms of prion disease. The model has shown to be effective in the prediction of both inherited CJD (92% of accuracy) and sporadic CJD (95% of accuracy). However the model has shown to be less effective when used to stratify the different stages of the disease, in which the average accuracy is 85%, whilst the recall is 59%. Finally, our framework was extended as a differential diagnosis tool to identify both forms of CJD among another neurodegenerative disease. In summary we have developed a novel method for prion disease diagnosis and prediction of clinical onset using multiple sources of features, which may have use in other disorders with heterogeneous imaging features.