Effects of noise, image resolution, and ROI definition on the accuracy of standard uptake values: A simulation study

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Semiquantitative standard uptake values (SUVs) are used for tumor diagnosis and response monitoring. However, the accuracy of the SUV and the accuracy of relative change during treatment are not well documented. Therefore, an experimental and simulation study was performed to determine the effects of noise, image resolution, and region-of-interest (ROI) definition on the accuracy of SUVs. Methods: Experiments and simulations are based on thorax phantoms with tumors of 10-, 15-, 20-, and 30-mm diameter and background ratios (TBRs) of 2, 4, and 8. For the simulation study, sinograms were generated by forward projection of the phantoms. For each phantom, 50 sinograms were generated at 3 noise levels. All sinograms were reconstructed using ordered-subset expectation maximization (OSEM) with 2 iterations and 16 subsets, with or without a 6-mm gaussian filter. For each tumor, the maximum pixel value and the average of a 50%, a 70%, and an adaptive isocontour threshold ROI were derived as well as with an ROI of 15 x 15 mm. The accuracy of SUVs was assessed using the average of 50 ROI values. Treatment response was simulated by varying the tumor size or the TBR. Results: For all situations, a strong correlation was found between maximum and isocontour-based ROI values resulting in similar dependencies on image resolution and noise of all studied SUV measures. A strong variation with tumor size of ≥50% was found for all SUV values. For non-smoothed data with high noise levels this variation was primarily due to noise, whereas for smoothed data with low noise levels partial-volume effects were most important. In general, SUVs showed under- and overestimations of ≥50% and depended on all parameters studied. However, SUV ratios, used for response monitoring, were only slightly dependent of ROI definition but were still affected by noise and resolution. Conclusion: The poor accuracy of the SUV under various conditions may hamper its use for diagnosis, especially in multicenter trials. SUV ratios used to measure response to treatment, however, are less dependent on noise, image resolution, and ROI definition. Therefore, the SUV might be more suitable for response-monitoring purposes.

Original languageEnglish
Pages (from-to)1519-1527
Number of pages9
JournalJournal of Nuclear Medicine
Volume45
Issue number9
Publication statusPublished - 1 Sep 2004

Cite this

@article{28724bcc26994034a8219ccdaab5aeba,
title = "Effects of noise, image resolution, and ROI definition on the accuracy of standard uptake values: A simulation study",
abstract = "Semiquantitative standard uptake values (SUVs) are used for tumor diagnosis and response monitoring. However, the accuracy of the SUV and the accuracy of relative change during treatment are not well documented. Therefore, an experimental and simulation study was performed to determine the effects of noise, image resolution, and region-of-interest (ROI) definition on the accuracy of SUVs. Methods: Experiments and simulations are based on thorax phantoms with tumors of 10-, 15-, 20-, and 30-mm diameter and background ratios (TBRs) of 2, 4, and 8. For the simulation study, sinograms were generated by forward projection of the phantoms. For each phantom, 50 sinograms were generated at 3 noise levels. All sinograms were reconstructed using ordered-subset expectation maximization (OSEM) with 2 iterations and 16 subsets, with or without a 6-mm gaussian filter. For each tumor, the maximum pixel value and the average of a 50{\%}, a 70{\%}, and an adaptive isocontour threshold ROI were derived as well as with an ROI of 15 x 15 mm. The accuracy of SUVs was assessed using the average of 50 ROI values. Treatment response was simulated by varying the tumor size or the TBR. Results: For all situations, a strong correlation was found between maximum and isocontour-based ROI values resulting in similar dependencies on image resolution and noise of all studied SUV measures. A strong variation with tumor size of ≥50{\%} was found for all SUV values. For non-smoothed data with high noise levels this variation was primarily due to noise, whereas for smoothed data with low noise levels partial-volume effects were most important. In general, SUVs showed under- and overestimations of ≥50{\%} and depended on all parameters studied. However, SUV ratios, used for response monitoring, were only slightly dependent of ROI definition but were still affected by noise and resolution. Conclusion: The poor accuracy of the SUV under various conditions may hamper its use for diagnosis, especially in multicenter trials. SUV ratios used to measure response to treatment, however, are less dependent on noise, image resolution, and ROI definition. Therefore, the SUV might be more suitable for response-monitoring purposes.",
keywords = "Image resolution, Noise, Region of interest, Response monitoring, Standard uptake value",
author = "Ronald Boellaard and Krak, {Nanda C.} and Hoekstra, {Otto S.} and Lammertsma, {Adriaan A.}",
year = "2004",
month = "9",
day = "1",
language = "English",
volume = "45",
pages = "1519--1527",
journal = "Journal of Nuclear Medicine",
issn = "0161-5505",
publisher = "Society of Nuclear Medicine Inc.",
number = "9",

}

Effects of noise, image resolution, and ROI definition on the accuracy of standard uptake values : A simulation study. / Boellaard, Ronald; Krak, Nanda C.; Hoekstra, Otto S.; Lammertsma, Adriaan A.

In: Journal of Nuclear Medicine, Vol. 45, No. 9, 01.09.2004, p. 1519-1527.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Effects of noise, image resolution, and ROI definition on the accuracy of standard uptake values

T2 - A simulation study

AU - Boellaard, Ronald

AU - Krak, Nanda C.

AU - Hoekstra, Otto S.

AU - Lammertsma, Adriaan A.

PY - 2004/9/1

Y1 - 2004/9/1

N2 - Semiquantitative standard uptake values (SUVs) are used for tumor diagnosis and response monitoring. However, the accuracy of the SUV and the accuracy of relative change during treatment are not well documented. Therefore, an experimental and simulation study was performed to determine the effects of noise, image resolution, and region-of-interest (ROI) definition on the accuracy of SUVs. Methods: Experiments and simulations are based on thorax phantoms with tumors of 10-, 15-, 20-, and 30-mm diameter and background ratios (TBRs) of 2, 4, and 8. For the simulation study, sinograms were generated by forward projection of the phantoms. For each phantom, 50 sinograms were generated at 3 noise levels. All sinograms were reconstructed using ordered-subset expectation maximization (OSEM) with 2 iterations and 16 subsets, with or without a 6-mm gaussian filter. For each tumor, the maximum pixel value and the average of a 50%, a 70%, and an adaptive isocontour threshold ROI were derived as well as with an ROI of 15 x 15 mm. The accuracy of SUVs was assessed using the average of 50 ROI values. Treatment response was simulated by varying the tumor size or the TBR. Results: For all situations, a strong correlation was found between maximum and isocontour-based ROI values resulting in similar dependencies on image resolution and noise of all studied SUV measures. A strong variation with tumor size of ≥50% was found for all SUV values. For non-smoothed data with high noise levels this variation was primarily due to noise, whereas for smoothed data with low noise levels partial-volume effects were most important. In general, SUVs showed under- and overestimations of ≥50% and depended on all parameters studied. However, SUV ratios, used for response monitoring, were only slightly dependent of ROI definition but were still affected by noise and resolution. Conclusion: The poor accuracy of the SUV under various conditions may hamper its use for diagnosis, especially in multicenter trials. SUV ratios used to measure response to treatment, however, are less dependent on noise, image resolution, and ROI definition. Therefore, the SUV might be more suitable for response-monitoring purposes.

AB - Semiquantitative standard uptake values (SUVs) are used for tumor diagnosis and response monitoring. However, the accuracy of the SUV and the accuracy of relative change during treatment are not well documented. Therefore, an experimental and simulation study was performed to determine the effects of noise, image resolution, and region-of-interest (ROI) definition on the accuracy of SUVs. Methods: Experiments and simulations are based on thorax phantoms with tumors of 10-, 15-, 20-, and 30-mm diameter and background ratios (TBRs) of 2, 4, and 8. For the simulation study, sinograms were generated by forward projection of the phantoms. For each phantom, 50 sinograms were generated at 3 noise levels. All sinograms were reconstructed using ordered-subset expectation maximization (OSEM) with 2 iterations and 16 subsets, with or without a 6-mm gaussian filter. For each tumor, the maximum pixel value and the average of a 50%, a 70%, and an adaptive isocontour threshold ROI were derived as well as with an ROI of 15 x 15 mm. The accuracy of SUVs was assessed using the average of 50 ROI values. Treatment response was simulated by varying the tumor size or the TBR. Results: For all situations, a strong correlation was found between maximum and isocontour-based ROI values resulting in similar dependencies on image resolution and noise of all studied SUV measures. A strong variation with tumor size of ≥50% was found for all SUV values. For non-smoothed data with high noise levels this variation was primarily due to noise, whereas for smoothed data with low noise levels partial-volume effects were most important. In general, SUVs showed under- and overestimations of ≥50% and depended on all parameters studied. However, SUV ratios, used for response monitoring, were only slightly dependent of ROI definition but were still affected by noise and resolution. Conclusion: The poor accuracy of the SUV under various conditions may hamper its use for diagnosis, especially in multicenter trials. SUV ratios used to measure response to treatment, however, are less dependent on noise, image resolution, and ROI definition. Therefore, the SUV might be more suitable for response-monitoring purposes.

KW - Image resolution

KW - Noise

KW - Region of interest

KW - Response monitoring

KW - Standard uptake value

UR - http://www.scopus.com/inward/record.url?scp=6944235697&partnerID=8YFLogxK

M3 - Article

VL - 45

SP - 1519

EP - 1527

JO - Journal of Nuclear Medicine

JF - Journal of Nuclear Medicine

SN - 0161-5505

IS - 9

ER -