Skip to main content
    • Aa
    • Aa
  • Get access
    Check if you have access via personal or institutional login
  • Cited by 2
  • Cited by
    This article has been cited by the following publications. This list is generated based on data provided by CrossRef.

    Rosellini, Anthony J. Monahan, John Street, Amy E. Hill, Eric D. Petukhova, Maria Reis, Ben Y. Sampson, Nancy A. Benedek, David M. Bliese, Paul Stein, Murray B. Ursano, Robert J. and Kessler, Ronald C. 2016. Using administrative data to identify U.S. Army soldiers at high-risk of perpetrating minor violent crimes. Journal of Psychiatric Research,

    Shin, HyunSoon Yoo, Kwan-Hee and Nasridinov, Aziz 2016. Advanced Multimedia and Ubiquitous Engineering.


Predicting non-familial major physical violent crime perpetration in the US Army from administrative data

  • A. J. Rosellini (a1), J. Monahan (a2), A. E. Street (a3) (a4), S. G. Heeringa (a5), E. D. Hill (a1), M. Petukhova (a1), B. Y. Reis (a6), N. A. Sampson (a1), P. Bliese (a7), M. Schoenbaum (a8), M. B. Stein (a9) (a10), R. J. Ursano (a11) and R. C. Kessler (a1)
  • DOI:
  • Published online: 06 October 2015

Although interventions exist to reduce violent crime, optimal implementation requires accurate targeting. We report the results of an attempt to develop an actuarial model using machine learning methods to predict future violent crimes among US Army soldiers.


A consolidated administrative database for all 975 057 soldiers in the US Army in 2004–2009 was created in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). Of these soldiers, 5771 committed a first founded major physical violent crime (murder-manslaughter, kidnapping, aggravated arson, aggravated assault, robbery) over that time period. Temporally prior administrative records measuring socio-demographic, Army career, criminal justice, medical/pharmacy, and contextual variables were used to build an actuarial model for these crimes separately among men and women using machine learning methods (cross-validated stepwise regression, random forests, penalized regressions). The model was then validated in an independent 2011–2013 sample.


Key predictors were indicators of disadvantaged social/socioeconomic status, early career stage, prior crime, and mental disorder treatment. Area under the receiver-operating characteristic curve was 0.80–0.82 in 2004–2009 and 0.77 in the 2011–2013 validation sample. Of all administratively recorded crimes, 36.2–33.1% (male-female) were committed by the 5% of soldiers having the highest predicted risk in 2004–2009 and an even higher proportion (50.5%) in the 2011–2013 validation sample.


Although these results suggest that the models could be used to target soldiers at high risk of violent crime perpetration for preventive interventions, final implementation decisions would require further validation and weighing of predicted effectiveness against intervention costs and competing risks.

Corresponding author
*Address for correspondence: R. C. Kessler, Ph.D., Department of Health Care Policy, Harvard Medical School, 180 Longwood Avenue, Boston, MA 02115, USA. (Email:
Linked references
Hide All

This list contains references from the content that can be linked to their source. For a full set of references and notes please see the PDF or HTML where available.

E Anderssen , K Dyrstad , F Westad , H Martens (2006). Reducing over-optimism in variable selection by cross-model validation. Chemometrics and Intelligent Laboratory Systems 84, 6974.

RABerk (2008). Statistical Learning from a Regression Perspective. Springer Verlag: New York, NY.

RA Berk (2009). The role of race in forecasts of violent crime. Race and Social Problems 1, 231242.

RA Berk , J Bleich (2014). Forecasts of violence to inform sentencing decisions. Journal of Quantitative Criminology 30, 7996.

PDBliese , RRHalverson , CASchriesheim (2002). Benchmarking multi-level methods in leadership: the articles, the model and the data set. Leadership Quarterly 13, 314.

EBElbogen , MCueva , HRWagner , SSreenivasan , MBrancu , JCBeckham , LVan Male (2014 a). Screening for violence risk in military veterans: predictive validity of a brief clinical tool. American Journal of Psychiatry 171, 749757.

EB Elbogen , S Fuller , SC Johnson , S Brooks , P Kinneer , PS Calhoun , JC Beckham (2010 a). Improving risk assessment of violence among military veterans: an evidence-based approach for clinical decision-making. Clinical Psychology Review 30, 595607.

EBElbogen , SCJohnson , VMNewton , SFuller , HRWagner , JCBeckham (2013). Self-report and longitudinal predictors of violence in Iraq and Afghanistan war era veterans. Journal of Nervous and Mental Disease 201, 872876.

EB Elbogen , SC Johnson , HR Wagner , VM Newton , C Timko , JJ Vasterling , JC Beckham (2012). Protective factors and risk modification of violence in Iraq and Afghanistan War veterans. Journal of Clinical Psychiatry 73, e767e773.

EBElbogen , SCJohnson , HRWagner , CSullivan , CTTaft , JCBeckham (2014 b). Violent behaviour and post-traumatic stress disorder in US Iraq and Afghanistan veterans. British Journal of Psychiatry 204, 368375.

EBElbogen , HRWagner , SRFuller , PSCalhoun , PMKinneer , JCBeckham (2010 b). Correlates of anger and hostility in Iraq and Afghanistan war veterans. American Journal of Psychiatry 167, 10511058.

SFazel , JPSingh , HDoll , MGrann (2012). Use of risk assessment instruments to predict violence and antisocial behaviour in 73 samples involving 24 827 people: systematic review and meta-analysis. British Medical Journal 345, e4692.

EMFoster , DJones (2006). Can a costly intervention be cost-effective?: an analysis of violence prevention. Archives of General Psychiatry 63, 12841291.

J Friedman , T Hastie , R Tibshirani (2010). Regularization paths for generalized linear models via coordinate descent. Journal of Statistical Software 33, 122.

MS Gallaway , DS Fink , AM Millikan , MR Bell (2012). Factors associated with physical aggression among US Army soldiers. Aggressive Behavior 38, 357367.

O Golubnitschaja , V Costigliola (2012). General report & recommendations in predictive, preventive and personalised medicine 2012: white paper of the European Association for Predictive, Preventive and Personalised Medicine. EPMA Journal 3, 14.

JC Hellmuth , CA Stappenbeck , KD Hoerster , M Jakupcak (2012). Modeling PTSD symptom clusters, alcohol misuse, anger, and depression as they relate to aggression and suicidality in returning US veterans. Journal of Traumatic Stress 25, 527534.

NHiggins , DWatts , JBindman , MSlade , GThornicroft (2005). Assessing violence risk in general adult psychiatry. Psychiatric Bulletin 29, 131133.

MJakupcak , DConybeare , LPhelps , SHunt , HAHolmes , BFelker , MKlevens , MEMcFall (2007). Anger, hostility, and aggression among Iraq and Afghanistan War veterans reporting PTSD and subthreshold PTSD. Journal of Traumatic Stress 20, 945954.

RC Kessler , LJ Colpe , CS Fullerton , N Gebler , JA Naifeh , MK Nock , NA Sampson , M Schoenbaum , AM Zaslavsky , MB Stein , RJ Ursano , SG Heeringa (2013). Design of the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). International Journal of Methods in Psychiatric Research 22, 267275.

RCKessler , CHWarner , CIvany , MVPetukhova , SRose , EJBromet , MBrownIII , TCai , LJColpe , KLCox , CSFullerton , SEGilman , MJGruber , SGHeeringa , LLewandowski-Romps , JLi , AMMillikan-Bell , JANaifeh , MKNock , AJRosellini , NASampson , MSchoenbaum , MBStein , SWessely , AMZaslavsky , RJUrsano (2015). Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS). JAMA Psychiatry 72, 4957.

WDKillgore , DICotting , JLThomas , ALCox , DMcGurk , AHVo , CACastro , CWHoge (2008). Post-combat invincibility: violent combat experiences are associated with increased risk-taking propensity following deployment. Journal of Psychiatric Research 42, 11121121.

HC Kraemer (2009). Events per person-time (incidence rate): a misleading statistic? Statistics in Medicine 28, 10281039.

MM LeBlanc , EK Kelloway (2002). Predictors and outcomes of workplace violence and aggression. Journal of Applied Psychology 87, 444453.

DMacManus , KDean , ACIversen , LHull , NJones , TFahy , SWessely , NTFear (2012 b). Impact of pre-enlistment antisocial behaviour on behavioural outcomes among U.K. military personnel. Social Psychiatry and Psychiatric Epidemiology 47, 13531358.

DMacManus , KDean , MJones , RJRona , NGreenberg , LHull , TFahy , SWessely , NTFear (2013). Violent offending by UK military personnel deployed to Iraq and Afghanistan: a data linkage cohort study. Lancet 381, 907917.

DMacManus , RRona , HDickson , GSomaini , NFear , SWessely (2015). Aggressive and violent behavior among military personnel deployed to Iraq and Afghanistan: prevalence and link with deployment and combat exposure. Epidemiologic Reviews 37, 196212.

AD Marshall , J Panuzio , CT Taft (2005). Intimate partner violence among military veterans and active duty servicemen. Clinical Psychology Review 25, 862876.

JR Meloy , SG White , S Hart (2013). Workplace assessment of targeted violence risk: the development and reliability of the WAVR-21. Journal of Forensic Sciences 58, 13531358.

AMMillikan , MRBell , MSGallaway , MTLagana , ALCox , MGSweda (2012). An epidemiologic investigation of homicides at Fort Carson, Colorado: summary of findings. Military Medicine 177, 404411.

P Mohammadkhani , AS Forouzan , KS Khooshabi , S Assari , MM Lankarani (2009). Are the predictors of sexual violence the same as those of nonsexual violence? A gender analysis. Journal of Sexual Medicine 6, 22152223.

J Monahan , JL Skeem (2014). Risk redux: the resurgence of risk assessment in criminal sanctioning. Federal Sentencing Reporter 26, 158166.

JMonahan , HJSteadman , PCRobbins , PAppelbaum , SBanks , TGrisso , KHeilbrun , EPMulvey , LRoth , ESilver (2005). An actuarial model of violence risk assessment for persons with mental disorders. Psychiatric Services 56, 810815.

M Parmak , MC Euwema , JJC Mylle (2012). Changes in sensation seeking and need for structure before and after a combat deployment. Military Psychology 24, 551564.

B Shamir , E Brainin , E Zakay , M Popper (2000). Perceived combat readiness as collective efficacy: individual-and group-level analysis. Military Psychology 12, 105119.

MTShea , JLambert , MKReddy (2013). A randomized pilot study of anger treatment for Iraq and Afghanistan veterans. Behaviour Research and Therapy 51, 607613.

JL Skeem , J Monahan (2011). Current directions in violence risk assessment. Current Directions in Psychological Science 20, 3842.

HJSteadman , JMonahan , DAPinals , RVesselinov , PCRobbins (2015). Gun violence and victimization of strangers by persons with a mental illness: data from the MacArthur violence risk assessment study. Psychiatric Services ( Accessed 1 August 2015.

RA Stine (1995). Graphical interpretation of variance inflation factors. The American Statistician 49, 5356.

CPSullivan , EBElbogen (2014). PTSD symptoms and family versus stranger violence in Iraq and Afghanistan veterans. Law and Human Behavior 38, 19.

JSundin , RKHerrell , CWHoge , NTFear , ABAdler , NGreenberg , LARiviere , JLThomas , SWessely , PDBliese (2014). Mental health outcomes in US and UK military personnel returning from Iraq. British Journal of Psychiatry 204, 200207.

VSvetnik , ALiaw , CTong , JCCulberson , RPSheridan , BPFeuston (2003). Random forest: a classification and regression tool for compound classification and QSAR modeling. Journal of Chemical Information and Computer Sciences 43, 19471958.

JL Thomas , JE Wilk , LA Riviere , D McGurk , CA Castro , CW Hoge (2010). Prevalence of mental health problems and functional impairment among active component and National Guard soldiers 3 and 12 months following combat in Iraq. Archives of General Psychiatry 67, 614623.

RJ Ursano , LJ Colpe , SG Heeringa , RC Kessler , M Schoenbaum , MB Stein (2014). The army study to assess risk and resilience in Servicemembers (Army STARRS). Psychiatry 77, 107119.

RWhittington , JCHockenhull , JMcGuire , MLeitner , WBarr , MGCherry , RFlentje , BQuinn , YDundar , RDickson (2013). A systematic review of risk assessment strategies for populations at high risk of engaging in violent behaviour: update 2002–8. Health Technology Assessment 17, i-xiv, 1128.

JBWillett , JDSinger (1993). Investigating onset, cessation, relapse, and recovery: why you should, and how you can, use discrete-time survival analysis to examine event occurrence. Journal of Consulting Clinical Psychology 61, 952965.

HZou , THastie (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B 67, 301320.

Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

Psychological Medicine
  • ISSN: 0033-2917
  • EISSN: 1469-8978
  • URL: /core/journals/psychological-medicine
Please enter your name
Please enter a valid email address
Who would you like to send this to? *


Type Description Title
Supplementary Materials

Rosellini supplementary material
Appendix Tables 1-24 and Appendix Figure 1

 Unknown (267 KB)
267 KB