Methodological quality of systematic reviews of intraoperative neuromonitoring in thyroidectomy: A systematic review

Alvaro Sanabria*, Luiz P. Kowalski, Iain Nixon, Peter Angelos, Ashok Shaha, Randall P. Owen, Carlos Suarez, Alessandra Rinaldo, Alfio Ferlito, International Head and Neck Scientific Group

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review


Importance: Systematic reviews and meta-Analyses are considered the best evidence for clinical decision making. Many reviews of intraoperative neuromonitoring (IONM) in thyroidectomy have conflicting results, owing in large part to methodological quality. Objective: To assess the methodological quality and the causes of heterogeneous results of systematic reviews that compare routine IONM vs visual identification of the recurrent laryngeal nerve (RLN) in patients undergoing thyroidectomy. Data Sources: A systematic search was performed of MEDLINE (PubMed), Embase, the Cochrane Library, LILACS (Literatura Latino Americana e do Caribe em Ciências da Saúde), Web of Science, and Google from January 1, 1968, through June 30, 2018. Data were analyzed from July 17 to November 30, 2018. Study Selection: Studies that mentioned performance of a systematic review/meta-Analysis during the search period. Data Extraction and Synthesis: Data including study characteristics, type of patients, numbers of nerves at risk, and temporary and definitive RLN paralysis by group were extracted. Data about methodological characteristics, type of statistical analysis and summary estimator, endorsement of systematic review/meta-Analysis guidelines, heterogeneity, publication bias, funding, conflict of interest, and statistical analysis were also recorded. The methodological quality was measured with the AMSTAR2 (A Measurement Tool to Assess Systematic Reviews) tool by 2 independent evaluators. Main Outcomes and Measures: Methodological quality. Results: The search identified 13 systematic reviews that included patients who underwent open or minimally invasive thyroidectomy, second operations, and a mixture of low-and high-risk procedures. The mean compliance with the AMSTAR2 overall criteria was 53% (range, 11%-83%); with critical criteria, 71% (range, 50%-94%). The percentage of nerves at risk from RCTs was 4.8%. The mean (SD) crude rate of definitive RLN paralysis was 0.81% (0.22%; median, 0.75% [range, 0.53%-1.30%]) in the monitoring group and 1.14% (0.56%; median, 0.96% [range, 0.57%-2.56%]) in the control group. Conclusions and Relevance: A substantial number of systematic reviews of IONM in thyroidectomy have conflicting results, but their mean methodological quality is critically low. Design of a systematic review should comply with methodological standards and recommendations to offer relevant and practical information for decision making.

Original languageEnglish
Pages (from-to)563-573
Number of pages11
JournalJAMA Otolaryngology - Head and Neck Surgery
Issue number6
Publication statusPublished - 1 Jun 2019

Cite this