The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Brief ReportsFull Access

The Predictive Ability of the Classification of Violence Risk (COVR) in a Forensic Psychiatric Hospital

Published Online:

Abstract

Objective:

Aggression is a common problem in psychiatric and correctional facilities. An actuarial instrument, the Classification of Violence Risk (COVR), has demonstrated utility in predicting community aggression among civilly committed psychiatric patients and, more recently, an ability to predict institutional aggression in a forensic facility. This prospective study aimed to extend validation of the use of the COVR in a forensic facility.

Methods:

The study, conducted at a large U.S. forensic facility, used nursing records to document incidents of physical aggression by 146 patients for 20 weeks after COVR administration. Correlational and chi square analyses were conducted to evaluate the efficacy of the COVR in predicting aggression.

Results:

The COVR showed modest predictive ability for institutional aggression, with a correlation of .331 and an area under the curve of .725.

Conclusions:

Results support use of the COVR in a forensic facility; its ability to predict institutional aggression is similar to that found for community aggression. (Psychiatric Services 62:430–433, 2011)

Aggression is a common problem in both psychiatric and correctional facilities (1,2). Research has indicated that the often robust predictors of community aggression have little utility in identifying individuals who are at an increased risk of aggression while institutionalized (3,4), although this issue is not completely resolved (5).

Because of the questionable utility of instruments developed for assessing the risk of community aggression, there has been a recent proliferation of instruments specifically designed to identify individuals who are more likely to exhibit aggression in an institutional setting. For example, the Dynamic Appraisal of Situational Aggression (DASA) (6) was developed to identify individuals who are likely to exhibit aggression in the short term. It contains seven items from other risk assessment instruments and previous research. Each item is scored as present or absent. Research has shown that the DASA score is related to aggression that occurs within 24 hours of DASA administration. According to the authors, one benefit of the DASA is that it can be administered by nursing staff with very little training, although one potential drawback is that the assessment is not tailored to each patient.

The Classification of Violence Risk (COVR) (7) is an interactive, computerized program designed to estimate the risk of imminent violence in the community by a patient in an acute psychiatric crisis. In this context, imminent is defined as aggression in the weeks after administration, rather than years. One of the primary advantages of the COVR is its ease of administration: the computer program steps the user through various algorithms appropriate for the specific patient. Depending on how one question is answered, the next question may vary. In this way, the COVR individualizes each risk assessment.

Although the COVR was developed to assess risk of aggression in the community by civilly committed psychiatric patients, a study conducted in the United Kingdom examined the utility of the COVR in the prediction of institutional aggression in a sample of hospitalized forensic patients (8). The study reported here, which was conducted in the United States, also examined the effectiveness of the COVR in the prediction of institutional aggression in a forensic sample.

Methods

This research was approved by the appropriate governing bodies of each institution. A Certificate of Confidentiality was obtained from the National Institute of Mental Health, which prevented research documents from being subpoenaed. The study was designed as a prospective evaluation of the patients in a 1,200-bed long-term care psychiatric hospital in northern California. Approximately 80% of the patients hospitalized at this facility are under a forensic commitment. Only patients committed as “not guilty by reason of insanity” (NGRI) or as a “mentally disordered offender” (MDO) were eligible to participate. Patients were asked about their willingness to participate in the research on the basis of their commitment status. The MacArthur Competence Assessment Tool for Clinical Research (9) was administered to ensure that the patient had the capacity to provide informed consent. Those deemed capable were then asked to review and sign an approved consent form. A total of 146 patients were administered the COVR between October 1, 2007, and December 31, 2008, as one component of the study.

The COVR (7) is a computer-administered risk assessment developed from the “clinically feasible” iterative classification tree generated from the MacArthur Violence Risk Assessment Study (10). Administration is based on a brief record review and a ten-minute interview. The COVR is intended to be used as an adjunct to clinical judgment to estimate the short-term risk of aggression (less than six months). It assesses patients on 44 risk factors in estimating violence risk, although for any given patient not all factors are relevant. In our study, the COVR scores were not adjusted.

In addition to the COVR, three widely used instruments found to be associated with community violence were employed as violence risk assessments: the Psychopathy Checklist-Revised (PCL-R) (11), the Historical Clinical Risk Management scale (HCR-20) (12), and the Violence Risk Appraisal Guide (VRAG) (13). The PCL-R includes 20 items measuring various traits associated with psychopathy. The HCR-20 contains three subscales: historical, clinical, and risk management items. Scores from these scales are combined to allow the clinician to estimate an overall risk of low, moderate, or high. The VRAG comprises 12 items that combine to produce a total score. In the validation studies, VRAG scores were shown to be statistically related to risk of violent offending at two time points—seven and ten years after administration.

Violence risk assessments were conducted by four doctoral-level psychologists and a master's-level research associate. Group training was conducted until total scores on all risk instruments did not differ between raters by more than 3 points and scores on single items on either the PCL-R or the HCR-20 did not differ by more than 1 point. Interrater reliability varied on the basis of the instrument used (average intraclass correlations varied from a low of .84 for the risk management subscale of the HCR-20 to .97 for the total PCL-R score). Routine recalibrations were performed regularly to prevent rater drift.

We used two methods to track aggression in the hospital: special incident reports, which nursing staff are required to complete after an unusual incident, and nursing logs, which are maintained for each unit in the hospital. Using these two methods, we captured most of the physical aggression exhibited in our facility. We defined physical aggression as any physical contact initiated by a patient wherein the intent was to do physical harm, such as pushing, kicking, or biting or using a weapon to threaten others. Unlike the MacArthur Violence Risk Assessment Study, in our study acts of physical aggression did not necessarily result in physical injury. We recognize that some aggression occurs outside the view of staff and would be documented only if physical injury resulted. For each participant the study period was defined as the 20-week period after completion of the COVR.

Point biserial correlations were performed to examine bivariate associations between the predictor variables and the dichotomized measure of aggression (0=no aggression, 1=one or more aggressive incidents). Because the modal number of aggressive incidents was zero, we supplemented analyses with receiver operating characteristic (ROC) curve analyses. The accuracy of prediction was examined with chi square analyses to determine the percentage of patients who exhibited an aggressive act in three ranges of COVR scores—low (which included low and very low), average, and high (which included high and very high). All analyses were conducted with SPSS, version 18.

Results

Of the 146 patients in the sample, most were male (N=126, 86%) and Caucasian (N=82, 56%). The modal commitment offense (the most serious offense was coded as the commitment offense) was assault or battery or both (N=58, 40%), followed by homicide offenses (N=34, 23%). Most participants in the study were committed under the NGRI statute (N=109, 75%), and the rest were committed as MDOs. Most participants had a diagnosis of a schizophrenia spectrum disorder (N=107, 73%) or bipolar disorder (N=13, 9%). The others had diagnoses of substance use disorders (N=10, 7%), psychotic disorder not otherwise specified (N=7, 5%), and other disorders (N=9, 6%). The mean±SD age of the participants was 46.1±9.4 (range 24.2–85.9 years). The mean length of hospital stay at the time of the completion of the COVR was 7.1±10.1 days. Although COVR scores were normed for individuals between the ages of 18 and 60, removing data for the six participants who were 61 or older when the COVR was administered did not alter the results in any way. Therefore, all data from these participants were retained.

Nineteen (13%) of the participants scored in the very low range on the COVR, 65 (44%) scored in the low range, 42 (29%) in the average range, 14 (10%) in the high range, and six (4%) in the very high range. For the other risk assessment instruments, the mean±SD total PCL-R score was 16.9±8.5 (possible scores range from 0 to 40, with higher scores indicating more characteristics of psychopathy), the mean total HCR-20 score was 26.1±6.6 (possible scores range from 0 to 40), and the mean VRAG score was 8.2±10.7 (possible scores range from −26 to 28, with higher scores indicating an increased likelihood of future violent offending). The COVR score had a correlation of .535 with the PCL-R score, .461 with the total HCR-20 score, and .392 with the VRAG score.

Overall, 22 patients (15%) exhibited 53 acts of physical aggression in the 20-week period after completion of the COVR. The mean±SD length of time between COVR administration and the act of aggression and was 69.0±48.3 days. Twenty-eight percent of the aggressive acts (N=15) were committed within the first month after the assessment, and 40% (N=21) were committed in months 4 and 5.

No differences in demographic characteristics were found between patients who committed aggressive acts and those who did not. In regard to the clinical assessments, the multivariate analysis of variance was statistically significant (Wilk's λ=.867, F=5.39, df=4 and 141, p<.001).

Univariate analyses indicated that scores on all risk assessments differed between patients who did and did not commit an aggressive act. Chi square analyses indicated that COVR scores were strongly associated with overall aggression: only six of 84 (7%) patients who scored in the low or very low categories committed an act of aggression, whereas nine of 20 (45%) who scored in the high or very high range committed an aggressive act (χ2=18.2, df=2, p<.001).

Table 1 presents the means and standard deviations for all risk instruments for aggressive patients, the bivariate correlations between scores on the risk instruments and patient violence, and the results of the ROC analyses.

Discussion

The most important finding of this study is the strength of the relationship of the COVR to aggression. Our data indicate that the COVR was as effective in predicting aggression as other, lengthier risk assessments. The analyses indicated that all risk measures were associated with overall aggression. No instrument was statistically superior to any other in predicting aggression. The strength of the relationship between the COVR and the standard risk assessments is intriguing. The COVR can be administered in approximately 20 minutes, which includes a brief record review. Scoring the three other risk instruments used in this study requires a much more comprehensive record review, supplemented by a lengthy interview. In long-term care facilities with years of records, this record review can require several hours. These findings are consistent with recent research suggesting that the predictive accuracy of all risk instruments is related to their ability to quantify criminal risk (14). It appears that the COVR is no exception.

In contrast to recent research, our data indicate that standard risk instruments (such as the VRAG) had modest relationships to institutional aggression. All analyses conducted indicated that all measures were modestly associated with institutional aggression; ROC analyses were consistent with results of other published studies of community aggression. These results suggest that aggression seen in institutions may not be substantially different from that found in the community and that any selected risk instrument will likely perform equally well regardless of whether it is applied in the community or in an institution.

Although our data were collected in the United States, the proportion of patients that fell into the five risk categories is strikingly similar to that reported by Snowden and his colleagues in their study in the United Kingdom (8). The majority of our patients scored in the low-risk range, with the next highest percentage in the average-risk range. The reasons for this are fairly clear: the U.K. sample was more comparable to our sample than the sample used to construct the COVR (15) in numerous ways, including type (both were samples of forensic patients rather than civilly committed patients) and gender (both were predominantly male). Although no data were provided for the U.K. sample regarding offense history, presumably most patients were violent felons. In contrast, the construction sample had a much larger percentage of women (41%) and few violent offenders (22%).

Conclusions

Determining which patients are most likely to exhibit aggression in institutions is important for individuals who provide treatment. Our data indicate that the COVR is an effective tool in this regard. The COVR has distinct advantages over other risk instruments: ease of administration with substantially less staff time required and individualized risk estimates for each patient by means of various algorithms. Currently, our hospital is administering the COVR in a real-world setting; all patients admitted are screened for risk, and COVR scores are adjusted on the basis of the clinical judgment of the clinician. We provide immediate feedback to treatment teams when patients score in the high or very high risk category. In this way we are attempting to decrease acts of aggression by identifying individuals at higher risk so that environmental factors can be manipulated. In the future, these estimates may be used to make decisions about unit assignment and specific treatment approaches.

The authors are affiliated with the Division of Psychiatry and the Law, Department of Psychiatry, University of California, Davis, 2230 Stockton Blvd., Sacramento, CA 95817 (e-mail: ).

Acknowledgments and disclosures

This research was conducted as part of a collaborative effort between Napa State Hospital and the Department of Psychiatry and Behavioral Sciences, University of California, Davis, School of Medicine, funded by the California Department of Mental Health.

The authors report no competing interests.

References

1 Silver JM , Yudofsky SC : Documentation of aggression in the assessment of the violent patient. Psychiatric Annals 17:375–384, 1987 CrossrefGoogle Scholar

2 Quintal SA : Violence against psychiatric nurses: an untreated epidemic? Journal of Psychosocial Nursing and Mental Health Services 40:46–53, 2002 MedlineGoogle Scholar

3 Walters GD : Predicting institutional adjustment and recidivism with the Psychopathy Checklist factor scores: a meta-analysis. Law and Human Behavior 27:541–558, 2003 Crossref, MedlineGoogle Scholar

4 Guy LS , Edens JF , Anthony C , et al.: Does psychopathy predict institutional misconduct among adults? A meta-analytic investigation. Journal of Consulting and Clinical Psychology 73:1056–1064, 2005 Crossref, MedlineGoogle Scholar

5 McDermott BE , Edens JF , Quanbeck CD , et al.: Examining the role of static and dynamic risk factors in the prediction of inpatient violence: variable and person-focused analyses. Law and Human Behavior 32:325–338, 2008 Crossref, MedlineGoogle Scholar

6 Barry-Walsh J , Daffern M , Duncan S , et al.: The prediction of imminent aggression in patients with mental illness and/or intellectual disability using the Dynamic Appraisal of Situational Aggression instrument. Australasian Psychiatry 17:493–496, 2009 Crossref, MedlineGoogle Scholar

7 Monahan J , Steadman HJ , Appelbaum PS , et al.: Classification of Violence Risk (COVR). Lutz, Fla, Psychological Assessment Resources, 2005 Google Scholar

8 Snowden RJ , Gray NS , Taylor J , et al.: Assessing risk of future violence among forensic psychiatric inpatients with the Classification of Violence Risk (COVR). Psychiatric Services 60:1522–1526, 2009 LinkGoogle Scholar

9 Appelbaum PS , Grisso T : MacArthur Competence Assessment Tool for Clinical Research (MacCAT-CR). Sarasota, Fla, Professional Resource Press, 2001 Google Scholar

10 Monahan J , Steadman HJ , Silver E , et al.: Rethinking Risk Assessment:The MacArthur Study of Mental Disorder and Violence. New York, Oxford University Press, 2001 Google Scholar

11 Hare RD : The Hare Psychopathy Checklist-Revised (PCL-R), 2nd ed. Toronto, Multi-Health Systems, 2003 Google Scholar

12 Webster CD , Douglas KS , Eaves D , et al.: HCR-20: Assessing Risk for Violence (Version 2). Burnaby, British Columbia, Canada, Simon Fraser University, Mental Health, Law, and Policy Institute, 1997 Google Scholar

13 Quinsey VL , Harris GT , Rice ME , et al.: Violent Offenders: Appraising and Managing Risk, 2nd ed. Washington, DC, American Psychological Association, 2006 CrossrefGoogle Scholar

14 Kroner DG , Mills JF , Reddon JR : A coffee can, factor analysis, and prediction of antisocial behavior: the structure of criminal risk. International Journal of Law and Psychiatry 28:360–374, 2005 Crossref, MedlineGoogle Scholar

15 Monahan J , Steadman HJ , Appelbaum PS , et al.: Developing a clinically useful actuarial tool for assessing violence risk. British Journal of Psychiatry 174:312–319, 2000 CrossrefGoogle Scholar

Figures and Tables

Table 1

Table 1 Scores on risk assessment instruments for 22 forensic patients who committed an act of physical aggression