Predictive Performance of Cardiovascular Disease Risk Prediction Algorithms in People Living With HIV

Rosan A. Van Zoest*, Matthew Law, Caroline A. Sabin, Ilonca Vaartjes, Marc Van Der Valk, Joop E. Arends, Peter Reiss, Ferdinand W. Wit, on behalf of the ATHENA National Observational HIV Cohort

*Corresponding author for this work

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background: People living with HIV (PLWH) experience a higher cardiovascular disease (CVD) risk. Yet, traditional algorithms are often used to estimate CVD risk. We evaluated the performance of 4 commonly used algorithms. Setting: The Netherlands. Methods: We used data from 16,070 PLWH aged ≥18 years, who were in care between 2000 and 2016, had no pre-existing CVD, had initiated first combination antiretroviral therapy >1 year ago, and had available data on CD4 count, smoking status, cholesterol, and blood pressure. Predictive performance of 4 algorithms [Data Collection on Adverse Effects of Anti-HIV Drugs Study (D:A:D); Systematic COronary Risk Evaluation adjusted for national data (SCORE-NL); Framingham CVD Risk Score (FRS); and American College of Cardiology and American Heart Association Pooled Cohort Equations (PCE)] was evaluated using a Kaplan-Meier approach. Model discrimination was assessed using Harrell's C-statistic. Calibration was assessed using observed-versus-expected ratios, calibration plots, and Greenwood-Nam-D'Agostino goodness-of-fit tests. Results: All algorithms showed acceptable discrimination (Harrell's C-statistic 0.73-0.79). On a population level, D:A:D, SCORE-NL, and PCE slightly underestimated, whereas FRS slightly overestimated CVD risk (observed-versus-expected ratios 1.35, 1.38, 1.14, and 0.92, respectively). D:A:D, FRS, and PCE best fitted our data but still yielded a statistically significant lack of fit (Greenwood-Nam-D'Agostino χ2 ranged from 24.57 to 34.22, P < 0.05). Underestimation of CVD risk was particularly observed in low-predicted CVD risk groups. Conclusions: All algorithms perform reasonably well in PLWH, with SCORE-NL performing poorest. Prediction algorithms are useful for clinical practice, but clinicians should be aware of their limitations (ie, lack of fit and slight underestimation of CVD risk in low-risk groups).

Original languageEnglish
Pages (from-to)562-571
Number of pages10
JournalJournal of Acquired Immune Deficiency Syndromes
Volume81
Issue number5
DOIs
Publication statusPublished - 15 Aug 2019

Cite this

Van Zoest, R. A., Law, M., Sabin, C. A., Vaartjes, I., Van Der Valk, M., Arends, J. E., ... on behalf of the ATHENA National Observational HIV Cohort (2019). Predictive Performance of Cardiovascular Disease Risk Prediction Algorithms in People Living With HIV. Journal of Acquired Immune Deficiency Syndromes, 81(5), 562-571. https://doi.org/10.1097/QAI.0000000000002069