Improving explainability of post-separation suicide attempt prediction models for transitioning service members: Insights from the army study to assess risk and resilience in service members - longitudinal study

Abstract: Risk of U.S. Army soldier suicide-related behaviors increases substantially after separation from service. As universal prevention programs have been unable to resolve this problem, a previously reported machine learning model was developed using pre-separation predictors to target high-risk transitioning service members (TSMs) for more intensive interventions. This model is currently being used in a demonstration project. The model is limited, though, in two ways. First, the model was developed and trained in a relatively small cross-validation sample (n = 4044) and would likely be improved if a larger sample was available. Second, the model provides no guidance on subtyping high-risk TSMs. This report presents results of an attempt to refine the model to address these limitations by re-estimating the model in a larger sample (n = 5909) and attempting to develop embedded models for differential risk of post-separation stressful life events (SLEs) known to mediate the association of model predictions with post-separation nonfatal suicide attempts (SAs; n = 4957). Analysis used data from the Army STARRS Longitudinal Surveys. The revised model improved prediction of post-separation SAs in the first year (AUC = 0.85) and second-third years (AUC = 0.77) after separation, but embedded models could not predict post-separation SLEs with enough accuracy to support intervention targeting.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Identifying opioid relapse during COVID-19 using natural language processing of nationwide Veterans Health Administration electronic medical record data

    Abstract: Novel and automated means of opioid use and relapse risk detection are needed. Unstructured electronic medical record data, including written progress notes, can be mined for clinically relevant information, including the presence of substance use and relapse-critical markers of risk and recovery from opioid use disorder (OUD). In this study, we used natural language processing (NLP) to automate the extraction of opioid relapses, and the timing of these occurrences, from veteran patients' electronic medical record. We then demonstrated the utility of our NLP tool via analysis of pre-/post-COVID-19 opioid relapse trends among veterans with OUD. For this demonstration, we analyzed data from 107,606 veterans OUD enrolled in Veterans Health Administration, comparing a pandemic-exposed cohort (n = 53,803; January 2019-March 2021) to a matched prepandemic cohort (n = 53,803; October 2017-December 2019). The recall of our NLP tool was 75% and our precision was 94%, demonstrating moderate sensitivity and excellent specificity. Using the NLP tool, we found that the odds of opioid relapse postpandemic onset were proportionally higher compared to prepandemic trends, despite patients having fewer mental health encounters from which to derive instances of relapse postpandemic onset. In this research application of the tool, and as hypothesized, we found that opioid relapse risk was elevated postpandemic. The application of NLP Methods: to identify and monitor relapse risk holds promise for future surveillance, risk prevention, and clinical outcome research.