Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging

Ralf H.J.M. Kurvers, Annemarie De Zoete, Shelby L. Bachman, Paul R. Algra, Raymond Ostelo

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

Abstract

Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of “abnormalities”, which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.
Original languageEnglish
Title of host publicationPLoS ONE
PublisherPublic Library of Science
ISBN (Print)1111111111
DOIs
Publication statusPublished - 1 Apr 2018

Publication series

NamePLoS ONE
Volume13

Cite this

Kurvers, R. H. J. M., De Zoete, A., Bachman, S. L., Algra, P. R., & Ostelo, R. (2018). Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging. In PLoS ONE (PLoS ONE; Vol. 13). Public Library of Science. https://doi.org/10.1371/journal.pone.0194128
Kurvers, Ralf H.J.M. ; De Zoete, Annemarie ; Bachman, Shelby L. ; Algra, Paul R. ; Ostelo, Raymond. / Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging. PLoS ONE. Public Library of Science, 2018. (PLoS ONE).
@inbook{eddaecea609743d4af84bce1d6a4cf6e,
title = "Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging",
abstract = "Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of “abnormalities”, which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.",
author = "Kurvers, {Ralf H.J.M.} and {De Zoete}, Annemarie and Bachman, {Shelby L.} and Algra, {Paul R.} and Raymond Ostelo",
year = "2018",
month = "4",
day = "1",
doi = "10.1371/journal.pone.0194128",
language = "English",
isbn = "1111111111",
series = "PLoS ONE",
publisher = "Public Library of Science",
booktitle = "PLoS ONE",
address = "United Kingdom",

}

Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging. / Kurvers, Ralf H.J.M.; De Zoete, Annemarie; Bachman, Shelby L.; Algra, Paul R.; Ostelo, Raymond.

PLoS ONE. Public Library of Science, 2018. (PLoS ONE; Vol. 13).

Research output: Chapter in Book/Report/Conference proceedingChapterAcademicpeer-review

TY - CHAP

T1 - Combining independent decisions increases diagnostic accuracy of reading lumbosacral radiographs and magnetic resonance imaging

AU - Kurvers, Ralf H.J.M.

AU - De Zoete, Annemarie

AU - Bachman, Shelby L.

AU - Algra, Paul R.

AU - Ostelo, Raymond

PY - 2018/4/1

Y1 - 2018/4/1

N2 - Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of “abnormalities”, which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.

AB - Diagnosing the causes of low back pain is a challenging task, prone to errors. A novel approach to increase diagnostic accuracy in medical decision making is collective intelligence, which refers to the ability of groups to outperform individual decision makers in solving problems. We investigated whether combining the independent ratings of chiropractors, chiropractic radiologists and medical radiologists can improve diagnostic accuracy when interpreting diagnostic images of the lumbosacral spine. Evaluations were obtained from two previously published studies: study 1 consisted of 13 raters independently rating 300 lumbosacral radiographs; study 2 consisted of 14 raters independently rating 100 lumbosacral magnetic resonance images. In both studies, raters evaluated the presence of “abnormalities”, which are indicators of a serious health risk and warrant immediate further examination. We combined independent decisions of raters using a majority rule which takes as final diagnosis the decision of the majority of the group. We compared the performance of the majority rule to the performance of single raters. Our results show that with increasing group size (i.e., increasing the number of independent decisions) both sensitivity and specificity increased in both data-sets, with groups consistently outperforming single raters. These results were found for radiographs and MR image reading alike. Our findings suggest that combining independent ratings can improve the accuracy of lumbosacral diagnostic image reading.

U2 - 10.1371/journal.pone.0194128

DO - 10.1371/journal.pone.0194128

M3 - Chapter

SN - 1111111111

T3 - PLoS ONE

BT - PLoS ONE

PB - Public Library of Science

ER -