Ability of Caprini and Padua risk-assessment models to predict venous thromboembolism in a nationwide Veterans Affairs study

Abstract: OBJECTIVE: Venous thromboembolism (VTE) is a preventable complication of hospitalization. Risk-stratification is the cornerstone of prevention. The Caprini and Padua are two of the most commonly used risk-assessment models (RAMs) to quantify VTE risk. Both models perform well in select, high-risk cohorts. Although VTE RAMs were designed for use in all hospital admissions, they are mostly tested in select, high-risk cohorts. We aim to evaluate the two RAMs in a large, unselected cohort of patients. METHODS: We analyzed consecutive first hospital admissions of 1,252,460 unique surgical and non-surgical patients to 1298 Veterans Affairs facilities nationwide between January 2016 and December 2021. Caprini and Padua scores were generated using the Veterans Affairs' national data repository. We determined the ability of the two RAMs to predict VTE within 90 days of admission. In secondary analyses, we evaluated prediction at 30 and 60 days, in surgical vs non-surgical patients, after excluding patients with upper extremity deep vein thrombosis, in patients hospitalized ≥72 hours, after including all-cause mortality in a composite outcome, and after accounting for prophylaxis in the predictive model. We used area under the receiver operating characteristic curves (AUCs) as the metric of prediction. RESULTS: A total of 330,388 (26.4%) surgical and 922,072 (73.6%) non-surgical consecutively hospitalized patients (total N = 1,252,460) were analyzed. Caprini scores ranged from 0 to 28 (median, 4; interquartile range [IQR], 3-6); Padua scores ranged from 0-13 (median, 1; IQR, 1-3). The RAMs showed good calibration and higher scores were associated with higher VTE rates. VTE developed in 35,557 patients (2.8%) within 90 days of admission. The ability of both models to predict 90-day VTE was low (AUCs: Caprini, 0.56; 95% confidence interval [CI], 0.56-0.56; Padua, 0.59; 95% CI, 0.58-0.59). Prediction remained low for surgical (Caprini, 0.54; 95% CI, 0.53-0.54; Padua, 0.56; 95% CI, 0.56-0.57) and non-surgical patients (Caprini, 0.59; 95% CI, 0.58-0.59; Padua, 0.59; 95% CI, 0.59-0.60). There was no clinically meaningful change in predictive performance in any of the sensitivity analyses. CONCLUSIONS: Caprini and Padua RAM scores have low ability to predict VTE events in a cohort of unselected consecutive hospitalizations. Improved VTE RAMs must be developed before they can be applied to a general hospital population.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Identifying opioid relapse during COVID-19 using natural language processing of nationwide Veterans Health Administration electronic medical record data

    Abstract: Novel and automated means of opioid use and relapse risk detection are needed. Unstructured electronic medical record data, including written progress notes, can be mined for clinically relevant information, including the presence of substance use and relapse-critical markers of risk and recovery from opioid use disorder (OUD). In this study, we used natural language processing (NLP) to automate the extraction of opioid relapses, and the timing of these occurrences, from veteran patients' electronic medical record. We then demonstrated the utility of our NLP tool via analysis of pre-/post-COVID-19 opioid relapse trends among veterans with OUD. For this demonstration, we analyzed data from 107,606 veterans OUD enrolled in Veterans Health Administration, comparing a pandemic-exposed cohort (n = 53,803; January 2019-March 2021) to a matched prepandemic cohort (n = 53,803; October 2017-December 2019). The recall of our NLP tool was 75% and our precision was 94%, demonstrating moderate sensitivity and excellent specificity. Using the NLP tool, we found that the odds of opioid relapse postpandemic onset were proportionally higher compared to prepandemic trends, despite patients having fewer mental health encounters from which to derive instances of relapse postpandemic onset. In this research application of the tool, and as hypothesized, we found that opioid relapse risk was elevated postpandemic. The application of NLP Methods: to identify and monitor relapse risk holds promise for future surveillance, risk prevention, and clinical outcome research.