Inter-observer variation in segmenting glioma on MRI before and after resection

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

Longitudinal MR images obtained for treating glioma patients contain valuable diagnostic and prognostic information. One way to extract this information is to delineate tumor related entities and compare these in large cohorts. Reproducible and reliable measurement of volume and location is a necessary condition to obtain valid results. Manual segmentation of glioma by an expert is considered to be the gold standard, and is often provided by a single rater. In this study the agreement between different raters is recorded in both enhancing and non-enhancing glioma before and after surgical treatment, and at progression (pre-op, post-op and progression respectively). A total of 40 patients were included, of which 20 have non-enhancing glioma, usually of WHO grade II or III, and 20 have enhancing glioma, usually glioblastoma. Inter-rater agreement is recorded with the generalized conformity index (CIgen). Three raters of the VUmc neurosurgery department have performed the segmentations. Patients with non-enhancing glioma show no enhancing elements with the exception of three patients in the progression time point and one patient in pre-op. The segmented non-enhancing elements have a median CIgen of 0.64, 0.30, and 0.27 in the pre-op, post-op and progression respectively. For patients with enhancing glioma both enhancing and non-enhancing elements are observed. The segmented enhancing elements have median CIgen scores of 0.86, 0.24, and 0.69 in pre-op, post-op and progression respectively. Median CIgen for the non-enhancing elements is 0.47, 0.07 and 0.20 in pre-op, post-op and progression respectively. A Jaccard-like score for object comparison of small objects is sensitive for small volumes, returning a low score for slight misalignment. When dilating small volume segmentations to 10 mL as compensation for small volume comparison with the CIgen the attained scores are not much improved indicating that different raters not only disagreed about object shape but also about location.

Original languageEnglish
Title of host publicationIFMBE Proceedings
PublisherSpringer Verlag
Pages161-164
Number of pages4
Volume65
ISBN (Print)9789811051210
DOIs
Publication statusPublished - 2017
EventJoint Conference of the European Medical and Biological Engineering Conference, EMBEC 2017 and Nordic-Baltic Conference on Biomedical Engineering and Medical Physics, NBC 2107 - Tampere, Finland
Duration: 11 Jun 201715 Jun 2017

Conference

ConferenceJoint Conference of the European Medical and Biological Engineering Conference, EMBEC 2017 and Nordic-Baltic Conference on Biomedical Engineering and Medical Physics, NBC 2107
CountryFinland
CityTampere
Period11/06/201715/06/2017

Cite this

@inproceedings{c3a3592ffd1e46a3ae794029b45ae35a,
title = "Inter-observer variation in segmenting glioma on MRI before and after resection",
abstract = "Longitudinal MR images obtained for treating glioma patients contain valuable diagnostic and prognostic information. One way to extract this information is to delineate tumor related entities and compare these in large cohorts. Reproducible and reliable measurement of volume and location is a necessary condition to obtain valid results. Manual segmentation of glioma by an expert is considered to be the gold standard, and is often provided by a single rater. In this study the agreement between different raters is recorded in both enhancing and non-enhancing glioma before and after surgical treatment, and at progression (pre-op, post-op and progression respectively). A total of 40 patients were included, of which 20 have non-enhancing glioma, usually of WHO grade II or III, and 20 have enhancing glioma, usually glioblastoma. Inter-rater agreement is recorded with the generalized conformity index (CIgen). Three raters of the VUmc neurosurgery department have performed the segmentations. Patients with non-enhancing glioma show no enhancing elements with the exception of three patients in the progression time point and one patient in pre-op. The segmented non-enhancing elements have a median CIgen of 0.64, 0.30, and 0.27 in the pre-op, post-op and progression respectively. For patients with enhancing glioma both enhancing and non-enhancing elements are observed. The segmented enhancing elements have median CIgen scores of 0.86, 0.24, and 0.69 in pre-op, post-op and progression respectively. Median CIgen for the non-enhancing elements is 0.47, 0.07 and 0.20 in pre-op, post-op and progression respectively. A Jaccard-like score for object comparison of small objects is sensitive for small volumes, returning a low score for slight misalignment. When dilating small volume segmentations to 10 mL as compensation for small volume comparison with the CIgen the attained scores are not much improved indicating that different raters not only disagreed about object shape but also about location.",
keywords = "GBM, Glioma, Inter-rater agreement, LGG, MRI",
author = "M Visser and D. M{\"u}ller and N. Verburg and R. Eijgelaar and M. Witte and F. Barkhof and {de Witt Hamer}, P. and {de Munck}, J.",
year = "2017",
doi = "10.1007/978-981-10-5122-7_41",
language = "English",
isbn = "9789811051210",
volume = "65",
pages = "161--164",
booktitle = "IFMBE Proceedings",
publisher = "Springer Verlag",
address = "Germany",

}

Visser, M, Müller, D, Verburg, N, Eijgelaar, R, Witte, M, Barkhof, F, de Witt Hamer, P & de Munck, J 2017, Inter-observer variation in segmenting glioma on MRI before and after resection. in IFMBE Proceedings. vol. 65, Springer Verlag, pp. 161-164, Joint Conference of the European Medical and Biological Engineering Conference, EMBEC 2017 and Nordic-Baltic Conference on Biomedical Engineering and Medical Physics, NBC 2107, Tampere, Finland, 11/06/2017. https://doi.org/10.1007/978-981-10-5122-7_41

Inter-observer variation in segmenting glioma on MRI before and after resection. / Visser, M; Müller, D.; Verburg, N.; Eijgelaar, R.; Witte, M.; Barkhof, F.; de Witt Hamer, P.; de Munck, J.

IFMBE Proceedings. Vol. 65 Springer Verlag, 2017. p. 161-164.

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

TY - GEN

T1 - Inter-observer variation in segmenting glioma on MRI before and after resection

AU - Visser, M

AU - Müller, D.

AU - Verburg, N.

AU - Eijgelaar, R.

AU - Witte, M.

AU - Barkhof, F.

AU - de Witt Hamer, P.

AU - de Munck, J.

PY - 2017

Y1 - 2017

N2 - Longitudinal MR images obtained for treating glioma patients contain valuable diagnostic and prognostic information. One way to extract this information is to delineate tumor related entities and compare these in large cohorts. Reproducible and reliable measurement of volume and location is a necessary condition to obtain valid results. Manual segmentation of glioma by an expert is considered to be the gold standard, and is often provided by a single rater. In this study the agreement between different raters is recorded in both enhancing and non-enhancing glioma before and after surgical treatment, and at progression (pre-op, post-op and progression respectively). A total of 40 patients were included, of which 20 have non-enhancing glioma, usually of WHO grade II or III, and 20 have enhancing glioma, usually glioblastoma. Inter-rater agreement is recorded with the generalized conformity index (CIgen). Three raters of the VUmc neurosurgery department have performed the segmentations. Patients with non-enhancing glioma show no enhancing elements with the exception of three patients in the progression time point and one patient in pre-op. The segmented non-enhancing elements have a median CIgen of 0.64, 0.30, and 0.27 in the pre-op, post-op and progression respectively. For patients with enhancing glioma both enhancing and non-enhancing elements are observed. The segmented enhancing elements have median CIgen scores of 0.86, 0.24, and 0.69 in pre-op, post-op and progression respectively. Median CIgen for the non-enhancing elements is 0.47, 0.07 and 0.20 in pre-op, post-op and progression respectively. A Jaccard-like score for object comparison of small objects is sensitive for small volumes, returning a low score for slight misalignment. When dilating small volume segmentations to 10 mL as compensation for small volume comparison with the CIgen the attained scores are not much improved indicating that different raters not only disagreed about object shape but also about location.

AB - Longitudinal MR images obtained for treating glioma patients contain valuable diagnostic and prognostic information. One way to extract this information is to delineate tumor related entities and compare these in large cohorts. Reproducible and reliable measurement of volume and location is a necessary condition to obtain valid results. Manual segmentation of glioma by an expert is considered to be the gold standard, and is often provided by a single rater. In this study the agreement between different raters is recorded in both enhancing and non-enhancing glioma before and after surgical treatment, and at progression (pre-op, post-op and progression respectively). A total of 40 patients were included, of which 20 have non-enhancing glioma, usually of WHO grade II or III, and 20 have enhancing glioma, usually glioblastoma. Inter-rater agreement is recorded with the generalized conformity index (CIgen). Three raters of the VUmc neurosurgery department have performed the segmentations. Patients with non-enhancing glioma show no enhancing elements with the exception of three patients in the progression time point and one patient in pre-op. The segmented non-enhancing elements have a median CIgen of 0.64, 0.30, and 0.27 in the pre-op, post-op and progression respectively. For patients with enhancing glioma both enhancing and non-enhancing elements are observed. The segmented enhancing elements have median CIgen scores of 0.86, 0.24, and 0.69 in pre-op, post-op and progression respectively. Median CIgen for the non-enhancing elements is 0.47, 0.07 and 0.20 in pre-op, post-op and progression respectively. A Jaccard-like score for object comparison of small objects is sensitive for small volumes, returning a low score for slight misalignment. When dilating small volume segmentations to 10 mL as compensation for small volume comparison with the CIgen the attained scores are not much improved indicating that different raters not only disagreed about object shape but also about location.

KW - GBM

KW - Glioma

KW - Inter-rater agreement

KW - LGG

KW - MRI

UR - http://www.scopus.com/inward/record.url?scp=85021703667&partnerID=8YFLogxK

U2 - 10.1007/978-981-10-5122-7_41

DO - 10.1007/978-981-10-5122-7_41

M3 - Conference contribution

SN - 9789811051210

VL - 65

SP - 161

EP - 164

BT - IFMBE Proceedings

PB - Springer Verlag

ER -