Psychometric assessment of scales used to evaluate sexual assault prevention programming in the United States Air Force

Abstract: Background: Preventing sexual assault in the United States (U.S.) military is essential to safeguard the overall well-being of military personnel and support the military to function in alignment with its intended mission and objectives. Valid instruments are needed to accurately and reliably evaluate programming effectiveness. The goal of this research was to psychometrically assess measures used to evaluate the Sexual Communication and Consent (SCC) program within the Air Force Basic Military Training (BMT) context. Methods: We evaluated four measures used to assess the SCC program implemented at Air Force BMT in 2019-2020: Date Rape Attitudes, Self-Efficacy to Resist Unwanted Advances, Risky and Protective Dating Behaviors, and Bystander Intentions. The analytic sample included 7,126 BMT trainees (74% male). We assessed structural validity with exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). We used full information maximum likelihood estimation with robust standard errors in Mplus. We refined each scale based on factor analysis results and assessed internal consistency reliability by computing Cronbach's coefficient alpha for each scale in the overall sample, by sex, and by tailored SCC intervention group. Results: We identified a two-factor structure for the Date Rape Attitudes scale; subscale reliability was moderate within the overall sample and among males, though low among females. We found single-factor structures and excellent reliability for both the Self-Efficacy to Resist Unwanted Advances scale and the Bystander Intentions scale. The Dating Behaviors scale CFA did not confirm the two-factor solution suggested by the EFA, but subscale reliability was acceptable. Conclusion: This research fills a critical gap in the psychometric literature in military settings. Based on our findings, we recommend approaches for using the finalized scales in future evaluations of sexual assault prevention programming in the U.S. Air Force BMT setting.

Read the full article
Report a problem with this article

Related articles

  • More for Researchers

    Identifying opioid relapse during COVID-19 using natural language processing of nationwide Veterans Health Administration electronic medical record data

    Abstract: Novel and automated means of opioid use and relapse risk detection are needed. Unstructured electronic medical record data, including written progress notes, can be mined for clinically relevant information, including the presence of substance use and relapse-critical markers of risk and recovery from opioid use disorder (OUD). In this study, we used natural language processing (NLP) to automate the extraction of opioid relapses, and the timing of these occurrences, from veteran patients' electronic medical record. We then demonstrated the utility of our NLP tool via analysis of pre-/post-COVID-19 opioid relapse trends among veterans with OUD. For this demonstration, we analyzed data from 107,606 veterans OUD enrolled in Veterans Health Administration, comparing a pandemic-exposed cohort (n = 53,803; January 2019-March 2021) to a matched prepandemic cohort (n = 53,803; October 2017-December 2019). The recall of our NLP tool was 75% and our precision was 94%, demonstrating moderate sensitivity and excellent specificity. Using the NLP tool, we found that the odds of opioid relapse postpandemic onset were proportionally higher compared to prepandemic trends, despite patients having fewer mental health encounters from which to derive instances of relapse postpandemic onset. In this research application of the tool, and as hypothesized, we found that opioid relapse risk was elevated postpandemic. The application of NLP Methods: to identify and monitor relapse risk holds promise for future surveillance, risk prevention, and clinical outcome research.

    Mental Health Peer reviewed