Balneotherapy and quality assessment: Interobserver reliability of the Maastricht criteria list and the need for blinded quality assessment

Arianne P. Verhagen*, Henrica C.W. De Vet, Robert A. De Bie, Alphons G.H. Kessels, Maarten Boers, Paul G. Knipschild

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review


This study investigates aspects of the reliability of the Maastricht criteria list for quality assessment in systematic reviews, and whether blinded reviewing is necessary to prevent review bias. We used the data set of 12 articles from a systematic review concerning the efficacy of balneotherapy in patients with arthritis. Twenty reviewers participated of which two reviewers, who have been involved in developing the Maastricht criteria list, acted as reference standard. Half of all assessments were performed blindly. A high level of agreement was found between the reviewers and a high level of correlation with the reference standard. The quality scores between the blinded and unblinded assessment did not differ much. Based on the results we conclude that the Maastricht criteria list is a reliable instrument in duality assessment of clinical trials. Within the limits of this study we found no evidence that blinding is necessary to prevent review bias.

Original languageEnglish
Pages (from-to)335-341
Number of pages7
JournalJournal of Clinical Epidemiology
Issue number4
Publication statusPublished - 1 Jan 1998

Cite this