Skip to main content

Predicting non-familial major physical violent crime perpetration in the US Army from administrative data

  • A. J. Rosellini (a1), J. Monahan (a2), A. E. Street (a3) (a4), S. G. Heeringa (a5), E. D. Hill (a1), M. Petukhova (a1), B. Y. Reis (a6), N. A. Sampson (a1), P. Bliese (a7), M. Schoenbaum (a8), M. B. Stein (a9) (a10), R. J. Ursano (a11) and R. C. Kessler (a1)...

Although interventions exist to reduce violent crime, optimal implementation requires accurate targeting. We report the results of an attempt to develop an actuarial model using machine learning methods to predict future violent crimes among US Army soldiers.


A consolidated administrative database for all 975 057 soldiers in the US Army in 2004–2009 was created in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Of these soldiers, 5771 committed a first founded major physical violent crime (murder-manslaughter, kidnapping, aggravated arson, aggravated assault, robbery) over that time period. Temporally prior administrative records measuring socio-demographic, Army career, criminal justice, medical/pharmacy, and contextual variables were used to build an actuarial model for these crimes separately among men and women using machine learning methods (cross-validated stepwise regression, random forests, penalized regressions). The model was then validated in an independent 2011–2013 sample.


Key predictors were indicators of disadvantaged social/socioeconomic status, early career stage, prior crime, and mental disorder treatment. Area under the receiver-operating characteristic curve was 0.80–0.82 in 2004–2009 and 0.77 in the 2011–2013 validation sample. Of all administratively recorded crimes, 36.2–33.1% (male-female) were committed by the 5% of soldiers having the highest predicted risk in 2004–2009 and an even higher proportion (50.5%) in the 2011–2013 validation sample.


Although these results suggest that the models could be used to target soldiers at high risk of violent crime perpetration for preventive interventions, final implementation decisions would require further validation and weighing of predicted effectiveness against intervention costs and competing risks.

Corresponding author
* Address for correspondence: R. C. Kessler, Ph.D., Department of Health Care Policy, Harvard Medical School, 180 Longwood Avenue, Boston, MA 02115, USA. (Email:
Hide All
Anderssen E, Dyrstad K, Westad F, Martens H (2006). Reducing over-optimism in variable selection by cross-model validation. Chemometrics and Intelligent Laboratory Systems 84, 6974.
Army Suicide Prevention Task Force (2010). Army Health Promotion, Risk Reduction, Suicide Prevention. Department of Defense: Washington, DC. Accessed March 1, 2015.
Berk RA (2008). Statistical Learning from a Regression Perspective. Springer Verlag: New York, NY.
Berk RA (2009). The role of race in forecasts of violent crime. Race and Social Problems 1, 231242.
Berk RA, Bleich J (2014). Forecasts of violence to inform sentencing decisions. Journal of Quantitative Criminology 30, 7996.
Bliese PD, Halverson RR, Schriesheim CA (2002). Benchmarking multi-level methods in leadership: the articles, the model and the data set. Leadership Quarterly 13, 314.
Department of Defense Instruction (2014). DoD Workplace Violence Prevention and Response Policy ( Accessed 1 March 2015.
Department of the US Army (2012). Army 2020: Generating Health & Discipline in the Force ahead of the Strategic Reset. US Army: Washington, DC ( Accessed 1 March 2015.
Douglas KS, Hart SD, Webster CD, Belfrage H (2013). HCR-20V3 Assessing Risk for Violence-User Guide. Mental Health, Law, and Policy Institute, Simon Fraser University: Burnaby, BC, Canada.
Elbogen EB, Cueva M, Wagner HR, Sreenivasan S, Brancu M, Beckham JC, Van Male L (2014 a). Screening for violence risk in military veterans: predictive validity of a brief clinical tool. American Journal of Psychiatry 171, 749757.
Elbogen EB, Fuller S, Johnson SC, Brooks S, Kinneer P, Calhoun PS, Beckham JC (2010 a). Improving risk assessment of violence among military veterans: an evidence-based approach for clinical decision-making. Clinical Psychology Review 30, 595607.
Elbogen EB, Johnson SC, Newton VM, Fuller S, Wagner HR, Beckham JC (2013). Self-report and longitudinal predictors of violence in Iraq and Afghanistan war era veterans. Journal of Nervous and Mental Disease 201, 872876.
Elbogen EB, Johnson SC, Wagner HR, Newton VM, Timko C, Vasterling JJ, Beckham JC (2012). Protective factors and risk modification of violence in Iraq and Afghanistan War veterans. Journal of Clinical Psychiatry 73, e767e773.
Elbogen EB, Johnson SC, Wagner HR, Sullivan C, Taft CT, Beckham JC (2014 b). Violent behaviour and post-traumatic stress disorder in US Iraq and Afghanistan veterans. British Journal of Psychiatry 204, 368375.
Elbogen EB, Wagner HR, Fuller SR, Calhoun PS, Kinneer PM, Beckham JC (2010 b). Correlates of anger and hostility in Iraq and Afghanistan war veterans. American Journal of Psychiatry 167, 10511058.
Fazel S, Singh JP, Doll H, Grann M (2012). Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24 827 people: systematic review and meta-analysis. British Medical Journal 345, e4692.
Fort Lee Human Resources (2014). Prevention of Workplace Violence Program. US Army: Fort Lee, Virginia ( Accessed 1 March 2015.
Foster EM, Jones D (2006). Can a costly intervention be cost-effective?: an analysis of violence prevention. Archives of General Psychiatry 63, 12841291.
Friedman J, Hastie T, Tibshirani R (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software 33, 122.
Gallaway MS, Fink DS, Millikan AM, Bell MR (2012). Factors associated with physical aggression among US Army soldiers. Aggressive Behavior 38, 357367.
Golubnitschaja O, Costigliola V (2012). General report & recommendations in predictive, preventive and personalised medicine 2012: white paper of the European Association for Predictive, Preventive and Personalised Medicine. EPMA Journal 3, 14.
Hellmuth JC, Stappenbeck CA, Hoerster KD, Jakupcak M (2012). Modeling PTSD symptom clusters, alcohol misuse, anger, and depression as they relate to aggression and suicidality in returning US veterans. Journal of Traumatic Stress 25, 527534.
Higgins N, Watts D, Bindman J, Slade M, Thornicroft G (2005). Assessing violence risk in general adult psychiatry. Psychiatric Bulletin 29, 131133.
Institute of Medicine (IOM) (2010). Returning Home from Iraq and Afghanistan: Preliminary Assessment of Readjustment Needs of Veterans, Service Members, and their Families. The National Academies Press: Washington, DC.
Jakupcak M, Conybeare D, Phelps L, Hunt S, Holmes HA, Felker B, Klevens M, McFall ME (2007). Anger, hostility, and aggression among Iraq and Afghanistan War veterans reporting PTSD and subthreshold PTSD. Journal of Traumatic Stress 20, 945954.
Kessler RC, Colpe LJ, Fullerton CS, Gebler N, Naifeh JA, Nock MK, Sampson NA, Schoenbaum M, Zaslavsky AM, Stein MB, Ursano RJ, Heeringa SG (2013). Design of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research 22, 267275.
Kessler RC, Warner CH, Ivany C, Petukhova MV, Rose S, Bromet EJ, Brown M III, Cai T, Colpe LJ, Cox KL, Fullerton CS, Gilman SE, Gruber MJ, Heeringa SG, Lewandowski-Romps L, Li J, Millikan-Bell AM, Naifeh JA, Nock MK, Rosellini AJ, Sampson NA, Schoenbaum M, Stein MB, Wessely S, Zaslavsky AM, Ursano RJ (2015). Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry 72, 4957.
Killgore WD, Cotting DI, Thomas JL, Cox AL, McGurk D, Vo AH, Castro CA, Hoge CW (2008). Post-combat invincibility: violent combat experiences are associated with increased risk-taking propensity following deployment. Journal of Psychiatric Research 42, 11121121.
Kohavi R (1995). A study of cross-validation and bootstrap for accuracy estimation and model selection. In Proceedings of the 14th International Joint Conference on Artificial Intelligence - Volume 2, pp. 11371143. Morgan Kaufmann Publishers Inc.: Montreal, Quebec, Canada.
Kraemer HC (2009). Events per person-time (incidence rate): a misleading statistic? Statistics in Medicine 28, 10281039.
LeBlanc MM, Kelloway EK (2002). Predictors and outcomes of workplace violence and aggression. Journal of Applied Psychology 87, 444453.
Liaw A, Wiener M (2002). Classification and regression by randomForest. R News 2, 1822.
MacManus D, Dean K, Al Bakir M, Iversen AC, Hull L, Fahy T, Wessely S, Fear NT (2012 a). Violent behaviour in U.K. military personnel returning home after deployment. Psychological Medicine 42, 16631673.
MacManus D, Dean K, Iversen AC, Hull L, Jones N, Fahy T, Wessely S, Fear NT (2012 b). Impact of pre-enlistment antisocial behaviour on behavioural outcomes among U.K. military personnel. Social Psychiatry and Psychiatric Epidemiology 47, 13531358.
MacManus D, Dean K, Jones M, Rona RJ, Greenberg N, Hull L, Fahy T, Wessely S, Fear NT (2013). Violent offending by UK military personnel deployed to Iraq and Afghanistan: a data linkage cohort study. Lancet 381, 907917.
MacManus D, Rona R, Dickson H, Somaini G, Fear N, Wessely S (2015). Aggressive and violent behavior among military personnel deployed to Iraq and Afghanistan: prevalence and link with deployment and combat exposure. Epidemiologic Reviews 37, 196212.
Marshall AD, Panuzio J, Taft CT (2005). Intimate partner violence among military veterans and active duty servicemen. Clinical Psychology Review 25, 862876.
Meloy JR, White SG, Hart S (2013). Workplace assessment of targeted violence risk: the development and reliability of the WAVR-21. Journal of Forensic Sciences 58, 13531358.
Millikan AM, Bell MR, Gallaway MS, Lagana MT, Cox AL, Sweda MG (2012). An epidemiologic investigation of homicides at Fort Carson, Colorado: summary of findings. Military Medicine 177, 404411.
Mohammadkhani P, Forouzan AS, Khooshabi KS, Assari S, Lankarani MM (2009). Are the predictors of sexual violence the same as those of nonsexual violence? A gender analysis. Journal of Sexual Medicine 6, 22152223.
Monahan J, Skeem JL (2014). Risk redux: the resurgence of risk assessment in criminal sanctioning. Federal Sentencing Reporter 26, 158166.
Monahan J, Steadman HJ, Robbins PC, Appelbaum P, Banks S, Grisso T, Heilbrun K, Mulvey EP, Roth L, Silver E (2005). An actuarial model of violence risk assessment for persons with mental disorders. Psychiatric Services 56, 810815.
Naeem F, Clarke I, Kingdon D (2009). A randomized controlled trial to assess an anger management group programme. The Cognitive Behaviour Therapist 2, 2031.
Parmak M, Euwema MC, Mylle JJC (2012). Changes in sensation seeking and need for structure before and after a combat deployment. Military Psychology 24, 551564.
SAS Institute Inc. (2010). SAS/STATR Software. SAS Institute Inc.: Cary, NC.
Schlesselman JJ (1982). Case-control Studies: Design, Conduct, Analysis. Oxford University Press: New York.
Shamir B, Brainin E, Zakay E, Popper M (2000). Perceived combat readiness as collective efficacy: individual-and group-level analysis. Military Psychology 12, 105119.
Shea MT, Lambert J, Reddy MK (2013). A randomized pilot study of anger treatment for Iraq and Afghanistan veterans. Behaviour Research and Therapy 51, 607613.
Skeem JL, Kennealy P, Monahan J, Peterson J, Appelbaum P (2015). Psychosis uncommonly and inconsistently precedes violence among high-risk individuals. Clinical Psychological Science ( Accessed 1 August 2015.
Skeem JL, Monahan J (2011). Current directions in violence risk assessment. Current Directions in Psychological Science 20, 3842.
Steadman HJ, Monahan J, Pinals DA, Vesselinov R, Robbins PC (2015). Gun violence and victimization of strangers by persons with a mental illness: data from the MacArthur violence risk assessment study. Psychiatric Services ( Accessed 1 August 2015.
Stine RA (1995). Graphical interpretation of variance inflation factors. The American Statistician 49, 5356.
Sullivan CP, Elbogen EB (2014). PTSD symptoms and family versus stranger violence in Iraq and Afghanistan veterans. Law and Human Behavior 38, 19.
Sundin J, Herrell RK, Hoge CW, Fear NT, Adler AB, Greenberg N, Riviere LA, Thomas JL, Wessely S, Bliese PD (2014). Mental health outcomes in US and UK military personnel returning from Iraq. British Journal of Psychiatry 204, 200207.
Svetnik V, Liaw A, Tong C, Culberson JC, Sheridan RP, Feuston BP (2003). Random forest: a classification and regression tool for compound classification and QSAR modeling. Journal of Chemical Information and Computer Sciences 43, 19471958.
Thomas JL, Wilk JE, Riviere LA, McGurk D, Castro CA, Hoge CW (2010). Prevalence of mental health problems and functional impairment among active component and National Guard soldiers 3 and 12 months following combat in Iraq. Archives of General Psychiatry 67, 614623.
US Department of Justice (2009). National Corrections Reporting Program, 2009 (ICPSR 30799). National Achive of Criminal Justice Data: Ann Arbor, MI. Accessed 1 March 2015.
Ursano RJ, Colpe LJ, Heeringa SG, Kessler RC, Schoenbaum M, Stein MB (2014). The army study to assess risk and resilience in Servicemembers (Army STARRS). Psychiatry 77, 107119.
Whittington R, Hockenhull JC, McGuire J, Leitner M, Barr W, Cherry MG, Flentje R, Quinn B, Dundar Y, Dickson R (2013). A systematic review of risk assessment strategies for populations at high risk of engaging in violent behaviour: update 2002–8. Health Technology Assessment 17, i-xiv, 1128.
Willett JB, Singer JD (1993). Investigating onset, cessation, relapse, and recovery: why you should, and how you can, use discrete-time survival analysis to examine event occurrence. Journal of Consulting Clinical Psychology 61, 952965.
Zou H, Hastie T (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B 67, 301320.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Psychological Medicine
  • ISSN: 0033-2917
  • EISSN: 1469-8978
  • URL: /core/journals/psychological-medicine
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary Materials

Rosellini supplementary material
Appendix Tables 1-24 and Appendix Figure 1

 Word (267 KB)
267 KB


Altmetric attention score

Full text views

Total number of HTML views: 5
Total number of PDF views: 113 *
Loading metrics...

Abstract views

Total abstract views: 628 *
Loading metrics...

* Views captured on Cambridge Core between September 2016 - 25th November 2017. This data will be updated every 24 hours.