The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
ArticlesFull Access

Correlation Between Reduction of Seclusion and Restraint and Assaults by Patients in Pennsylvania’s State Hospitals

Abstract

Objective:

This prospective study assessed the use of seclusion and restraint in the Pennsylvania state hospital system from 2001 through 2010. It also examined the correlation between declining use of containment procedures and assaults by patients on other patients and staff.

Methods:

The 12,900 anonymized records involving the 1,801 unique, civilly committed individuals who were physically or mechanically restrained and secluded in the nine civil hospitals during this study period were entered into a database. The data set included demographic and diagnostic information about the patients and the cause and effect of the procedures. These data were compared with rates of patient-to-patient and patient-to-staff assaults to determine any correlation between changes in use of containment and assaults.

Results:

From 2001 to 2010, the use of mechanical restraint significantly declined from .37 to .08 episodes per 1,000 days (p<.018), and the use of seclusion significantly declined from .21 to .01 episodes per 1,000 days (p<.001). Persons with an axis I diagnosis of psychotic disorder accounted for 44% of containment procedures used during this study. Patient-to-patient assaults declined slightly, and patient-to-staff assaults were unaffected.

Conclusions:

Decreasing the use of containment procedures did not increase assaults. Better leadership, data transparency, use of clinical alerts, workforce development, policy changes, enhanced use of response teams, implementation of dialectical behavior therapy, and discontinuation of the psychiatric use of PRN orders contributed to the change in use of containment procedures. A philosophical change to a recovery model of psychiatric care and services was the driving force behind this transformation.

Since 2000, the reported use of containment procedures—seclusion and restraint—within state psychiatric hospitals in the United States has been declining (1). Over the past decade, efforts to limit the use of these procedures and identify best practices for their use have been documented (2). Among these efforts is the Pennsylvania State Hospital Seclusion and Restraint Reduction Program. The program cited the effectiveness of response teams, staff training, data transparency, treatment malls, leadership, and advocacy in helping the hospitals reduce the use of containment measures (3). In addition, the National Association of State Mental Health Program Directors (NASMHPD) issued Six Core Strategies for Reducing Seclusion and Restraint Use (4).

Recent studies and news reports suggest there is a relationship between reductions in seclusion and restraint and increases in patient-related violence (59). There has also been discussion in professional forums questioning the role of the clinician during restraint events (10,11). At the same time, more national attention has been given to patient-related assaults. During the past decade, several states have passed laws criminalizing the assault of health care workers (12,13).

The objective of this prospective study was to assess the use of containment procedures in Pennsylvania state hospitals from 2001 to 2010 and its effect on patient-to-patient and patient-to-staff assaults.

Methods

Study Setting

The Pennsylvania state hospital system, one of the oldest in the country, provides inpatient psychiatric treatment to individuals with severe and persistent mental illness admitted on civil, time-limited, involuntary commitments. Patients come from local psychiatric settings when it has been determined that they require extended psychiatric hospitalization. Throughout this study, the length of residence for half the people served was greater than two years (14).

The system's civil census declined significantly from January 1, 2001, to December 31, 2010—from 2,474 to 1,255 patients—a 49% decrease (N=1,219, p<.001). More than 8,500 people were admitted to the hospitals during this time span (14).

While the hospital system declined in size and scope, the typical hospital unit remained unchanged. On average, a hospital unit supported 30 patients and was staffed by two nurses and three to five psychiatric aides on both the first and second shifts. A psychiatrist served as the treatment team leader for each unit. The midnight shift was staffed with two to four workers. In addition, program services staff worked weekdays between 7 a.m. and 8 p.m.

A central office in Harrisburg provided oversight of the hospital system. Leadership from across the system provided input into hospital policies, particularly those affecting the use of restrictive procedures. The hospital workforce is unionized, and all hospitals were accredited by The Joint Commission throughout the study period.

Data Description and Analyis

The study included all 14,430 containment procedures used during 12,900 events with 1,801 unique, civilly committed patients, ages 18 and older, served at Allentown, Clark Summit, Danville, Harrisburg, Mayview, Norristown, Torrance, Warren, and Wernersville state hospitals between January 1, 2001, and December 31, 2010. Of the 12,900 events reported, 1,530 were complex, requiring the use of two or more procedure types. During this span, three hospitals closed: Harrisburg in January 2006, Mayview in December 2008, and Allentown in December 2010.

Containment procedures were classified as mechanical restraint, physical restraint, and seclusion. Other devices designed to temporarily incapacitate or restrain a person during a crisis through use of electrical current or chemical spray are not permitted for use in the hospital system. All data were anonymized and reviewed to assure uniform classification and coding. Data were structured by using the NASMHPD Research Institutes data dictionary (15). Physical restraint data were not available until 2002. Rates of use for each procedure type were established for comparative analysis and to control for differences in hospital census. The total monthly events for each procedure served as the numerator. The denominator was the number of days of care provided by each hospital for each month. This result was then multiplied by 1,000 to establish rates of use per 1,000 days.

Data were examined for cause of the procedure; effect of the procedure; and age, gender, racial and ethnic characteristics, hospital length of residence, and diagnosis of the patient. Length of residence was determined by comparing the date of the event and the patient’s date of admission.

SPSS, version 22, statistical software was used to perform a linear regression analysis of each containment procedure over time. Statistical significance was indicated by a level of p<.05. A Pearson correlation coefficient analysis was used to assess the relationship between the decreasing use of restrictive procedures and assaults (16).

Results

Containment Procedures

During the last 108 months of this study the total use of physical restraint, mechanical restraint, and seclusion declined significantly from 2.65 events per 1,000 days in 2002 to 1.62 events per 1,000 days in 2010 (p<.01) (Table 1).

Table 1 Use of seclusion, mechanical restraint, and physical restraint at state hospitals in Pennsylvania, 2001 to 2010a

SeclusionMechanical restraintPhysical restraintbAll containment procedures
EventsHoursEventsHoursEventsHoursEventsHours
Per 1,000Per 1,000Per 1,000Per 1,000Per 1,000Per 1,000Per 1,000Per 1,000
YearNdaysNdaysNdaysNdaysNdaysNdaysNdaysNdays
2001185.21202.36.23324.37448.46.52N/AN/AN/AN/A509.59650.82.75
2002148.19196.76.26596.78747.48.971,2881.68120.89.162,0322.651,065.131.39
200354.0744.93.067831.081,036.611.431,6622.28158.08.222,4993.441,239.621.70
200455.0860.58.08413.57526.58.731,2611.74117.38.161,7292.38704.54.97
200523.0328.03.04240.34252.87.361,2561.79144.42.211,5192.16425.32.60
200633.0524.12.04119.19119.29.191,5162.36209.55.331,6682.60352.96.55
200720.0313.59.0296.1697.27.161,3052.14162.02.271,4212.33272.88.45
20082.002.00.0099.18105.30.191,1602.07142.16.251,2612.25249.46.45
20099.029.18.0286.1783.98.179151.8284.02.171,0102.01177.18.35
20103.012.55.0139.0834.14.077401.5482.39.177821.62119.08.25

aAll of the patients were adults who were civilly committed. Significant differences were found for use of seclusion (events per 1,000 days, p<.001; hours per 1,000 days, p<.018) and mechanical restraint (events per 1,000 days, p<.006; hours per 1,000 days, p<.002) between 2001 and 2010. Significant differences were found for use of all containment procedures (events per 1,000 days, p<.01; hours per 1,000 days, p<.001) between 2002 and 2010.

bPhysical restraint data were not reliably reported until January 2002.

Table 1 Use of seclusion, mechanical restraint, and physical restraint at state hospitals in Pennsylvania, 2001 to 2010a

Enlarge table

Mechanical restraint.

In 2001, there were .37 (mean±SD=.35±.23) episodes of mechanical restraint per 1,000 days (N=324) throughout the hospital system. In 2010, use of mechanical restraint significantly declined to .08 (mean=.07±.10) events per 1,000 days (N=39, p<.018). The duration of mechanical restraint events significantly decreased from .52 hours per 1,000 days (N=448) in 2001 to .07 hours per 1,000 days (N=34) in 2010 (p<.015).

Seclusion.

In 2001, there were .21 (mean=.25±.37) episodes of seclusion per 1,000 days (N=185). By 2010, the rate of seclusion events had declined significantly to .01 (mean=.01±.01) events per 1,000 days (N=3, p<.001). Seclusion hours significantly decreased from .23 hours per 1,000 days in 2001 (N=202) to .01 hours per 1,000 days (N=2.55) in 2010 (p<.006).

Physical restraint.

Physical restraint data were not available until 2002. There was a nonsignificant reduction in the use of physical restraint from January 2002 through December 2010. In 2003, there were 2.28 (mean=2.44±1.42) events per 1,000 days (N=1,662). In 2010, the system rate declined to 1.54 (mean=1.43±.61) events per 1,000 days (N=740). During the last two years of the study, consistent with state policy changes limiting physical restraint to a maximum of ten minutes, the average length of physical restraint was .17 hours (ten minutes).

Primary Causes

To understand why containment procedures were used, each incident was assigned a primary cause at the time of the event.

During the study, 34% (N=4,383) of the events were attributed to aggression, defined as verbal threats of bodily harm. Physically assaulting staff, the second most common cause of restraint or seclusion, accounted for 28% (N=3,640) of events, and patient-to-patient assaults accounted for 10% (N=1,279) of events. Physical assaults of staff were more than twice as likely as patient-to-patient assaults to result in the use of a containment procedure.

Self-injurious behavior accounted for 17% (N=2,211) of all events, and suicide threat or attempt was the primary cause for 1% (N=109) of the events. The remaining events (10%, N=1,278) were attributed to elopement attempts, property destruction, and contraband possession.

Effects of Procedures

A physical examination of the patient following any use of a containment procedure was required. During the study period, 83% (N=10,692) of the events resulted in no injury. Abrasions, scratches, or hematomas occurred in 8% (N=1,031), and lacerations requiring sutures occurred in .2% (N=30). Fractures, the most serious of the injuries reported, occurred during ten physical-restraint events.

Differences in Patient Characteristics

Racial and ethnic differences.

Differences in use of containment procedures by race-ethnicity were determined by comparing the race-ethnicity of patients who experienced containment procedures with the diversity of the community in which the hospital was located. No significant racial or ethnic differences were observed in the use of these procedures. Overall, whites accounted for 84% (N=10,857) and blacks accounted for 12% (N=1,587) of all procedures used. All other groups accounted for the remaining 4% (N=456).

Gender differences.

Differences in the duration of restraint and seclusion of men and women were observed. On average, men were held in mechanical restraint nine minutes longer compared with women, and women were held in physical restraint five minutes longer compared with men. Men were secluded eight minutes longer compared with women.

When the gender of individual patients was assessed, gender differences reverted to the expected distribution for each hospital. Overall, of the 1,801 unique individuals involved in containment procedures, 58% (N=1,051) were men and 42% (N=750) were women.

Diagnostic differences.

Throughout this study, persons with axis I diagnoses of schizophrenia and psychotic disorders accounted for 70% of those served in the hospital system (14). However, this group accounted for 44% (N=5,692) of the containment procedures used.

Persons diagnosed as having a mood disorder accounted for 13% of the people served by the system (14). However, 29% (N=3,795) of the containment procedures were used with this group. Persons with impulse control disorders accounted for 10% (N=1,323) of the events reported.

Persons with axis II diagnoses were also part of this cohort. Throughout the study, individuals with early onset disorders, all subgroups, accounted for 7% (N=120) of the hospital population (14). However, people with these diagnoses accounted for 12% (N=1,571) of the containment procedures used.

Age and length-of-residence differences.

Persons between the ages of 18 and 21 accounted for 11% (N=1,413) of the events reported, and those under the age of 30 accounted for 41% (N=5,298).

The results showed that 23% (N=3,023) of the events occurred within the first 90 days of admission and 50% (N=6,483) of events occurred within the first year of hospitalization.

Assaults

Throughout the time span of this study, assaults were defined as any aggressive act by a patient toward another person involving physical contact that may or may not result in injury (17). Beginning in September 2003, data on assaults in the hospital system were reported on a monthly basis in the State Hospital Risk Management Summary Report (18). This information was used to determine the relationship, if any, between declining use of containment procedures and assaults.

Within this report were monthly rates of patient-to-patient assaults and patient-to-staff assaults resulting in injuries per 1,000 days. Over the 88 months for which data were available, there was no significant change in either assault category (Figure 1). Patient-to-patient assaults showed a slight decline, and patient-to-staff assaults were unchanged.

Figure 1

Figure 1 Use of containment procedures and assaults resulting in injury per 1,000 days at state hospitals in Pennsylvania, 2003 to 2010

Correlation analyses showed a positive, weak association between the declining use of all containment procedures and patient-to-patient assaults (r=.377, N=88, p<.001) and patient-to-staff assaults (r=.275, N=88, p<.01) between September 2003 and December 2010 (Figures 2 and 3).

Figure 2

Figure 2 Correlation between rates of patient-to-patient assaults resulting in injury and use of containment procedures per month at state hospitals in Pennsylvania, 2003 to 2010a

aRates are reported as events per 1,000 days for the 88 months between September 2003 and December 2010.

Figure 3

Figure 3 Correlation between rates of patient-to-staff assaults resulting in injury and use of containment procedures per month at state hospitals in Pennsylvania, 2003 to 2010a

aRates are reported as events per 1,000 days for the 88 months between September 2003 and December 2010.

System Changes

The Six Core Strategies for Reducing Seclusion and Restraint Use by the NASMHPD provided structure for many of the changes instituted by Pennsylvania state hospitals during the study period (4).

Leadership.

During this ten-year period, hospital leadership intensified efforts to standardize risk management approaches and to develop strategies for improved patient care and treatment, including goals to reduce and eliminate the utilization of containment procedures. The leaders used hospital data and clinical alerts to monitor use of containment procedures and, if needed, reacted by updating treatment plans, adding staff training, and leading performance improvement projects. They also responded to any crisis by providing support and oversight.

Policy changes.

Policies limiting the types of procedures that could be used and their duration contributed to the decline in use of restrictive procedures in the system. Between 2001 and 2010 state policy changed three times. Starting in 2001, state policy limited the use of seclusion or mechanical restraint to up to one hour and permitted extended use only for increments of one hour. At the time, this policy was one of the most restrictive in the country, falling below the two-hour limit adopted by the Centers for Medicare and Medicaid Services. This policy also required a face-to-face examination by a physician within 30 minutes of ordering the use of a procedure. At the same time, a policy was put in place to structure the debriefing process (19).

In 2005, state policy was revised to limit physical restraint to a maximum of ten minutes and prohibit the use of floor control restraint techniques, prone or supine. At the end of ten minutes staff were required to release the person and reengage only if the individual had not regained control. This release of the policy also limited a physician’s order for the use of seclusion or mechanical restraint to 30 minutes and could only be reordered in 30-minute increments (20).

In 2009, the policy was updated to unify staff training for safe physical management techniques to a single vendor for all facilities (21).

Data transparency and clinical alerts.

Data transparency and the use of clinical alerts by the hospital system contributed to the decline in the use of containment procedures by providing frequent, measureable performance data on patient and staff safety.

Throughout this study, data on the use of seclusion and restraint, along with 40 other measures, were shared monthly with the hospital system and worldwide with interested parties. These summary reports were issued via e-mail and the state Web site (18).

This transparency enabled monitoring of the system by interested groups. Also, according to Charles Curie, Pennsylvania’s Deputy Secretary for Mental Health and Substance Abuse Services from 1995–2001, this effort provided direction to the hospitals regarding their use of these procedures (22).

E-mail messages containing clinical alerts were first introduced in 2005 to identify patients who received high amounts of unscheduled medication (23). By 2006, this process was expanded to include patients who were repeatedly restrained or who engaged in frequent assaults. The alerts were sent to the hospital leadership and to the teams associated with these events. The alerts cautioned the teams about the health and safety issues associated with use of containment procedures and requested that they meet to update treatment plans.

Response teams.

Response teams contributed to the reduction in use of containment procedures by ensuring compliance with hospital policies, identifying conflicts that could lead to the use of seclusion or restraint, and providing a safe and therapeutic response to a crisis.

By 2001, all hospitals had strategies in place that provided a structured response to psychiatric crises and training in use of the procedures. This training—both the initial offering and an annual refresher—prepared all staff to be first responders to any patient crisis they may encounter. Response teams provided added support and direction at the scene of an emergency. However, standing down and waiting for the response team to arrive at the scene of a crisis was considered an unacceptable reaction.

Statewide, response team members were direct care staff, doctors, nurses, psychologists, program services staff, and social workers. They had regular duties to perform and were not compensated for their additional duties as members of the response team.

The Psychiatric Emergency Response Team (PERT) process at Allentown State Hospital (24,25) served as a model for the other hospitals. Its approach was highly structured, was data driven, and involved a cross-section of volunteer staff dedicated to a safe and therapeutic response to a crisis. Teams met frequently to address the needs of new patients and to practice their skills. This approach included a “PERT assist process” used by hospital staff in anticipation of a psychiatric or behavioral crisis, for example, a patient with a history of violence who may become upset after receiving unsettling news about his or her discharge.

Structured response teams, such as PERT, ensured fidelity to state polices and safe responses to psychiatric crises by placing the most experienced staff available at the scene of a crisis (3,24,25).

Workforce development.

From 2001 through 2008, the hospital system used three separate training groups to train staff about positive therapeutic interactions. This training also focused on crisis response skills and team building.

In 2004, a statewide committee was formed to assess this staff training curriculum. The goal was to redesign this instruction to teach skills and techniques that ensure a safe and therapeutic response to a crisis. It was felt that training needed to be proactive and provide greater emphasis on positive approaches. In 2009, a single vendor was selected to provide this unified training to all hospitals. This change involved two days of initial training for all new employees, annual refresher training for experienced staff, and quarterly updates for all direct care staff on issues related to safe and therapeutic responses to a crisis.

Discontinuing use of PRN orders.

The use of medication as a form of restraint is an issue in all psychiatric settings. In 2004, the state hospital system began a 15-month study of the use of 46,913 medication doses administered by PRN or STAT physician order (23). During March 2004, the first month of the study, 87.7 unscheduled medication doses were administered per 1,000 days in the civil hospitals. In May 2005, the last month of the study, the rate of unscheduled medication doses had decreased to 17 per 1,000 days (p<.001).

All use of containment procedures was monitored throughout this study. Hours of mechanical restraint during this time span declined from 79 to 15 per 1,000 days (p<.003). Incidents of patient-to-patient assault and aggression also decreased. On the basis of the results of this study, a decision was made to eliminate the use of PRN orders for psychiatric indications effective March 1, 2005 (26).

Dialectical behavior therapy (DBT).

In 2003, DBT was introduced in the statewide hospital system as a treatment approach for persons diagnosed as having borderline personality disorders. At the time, data showed this group was at high risk of violence resulting in the use of a containment procedure or unscheduled medication. Select hospital staff was certified to provide individual and group therapy to persons with this diagnosis. The desired outcomes included reduction in self-injurious and suicidal behaviors, shorter lengths of stay, better anger control, and improved social functioning (27).

Other strategies.

During this study, an array of other strategies to reduce the use of containment procedures was implemented statewide. They included but were not limited to “do-not-restrain lists” of persons with preexisting conditions, such as brittle bone disorder, or significant trauma histories; development of comfort rooms; and use of peer-to-peer specialists, psychiatric advance directives, and Wellness Recovery Action Plans.

Discussion and Conclusions

This study demonstrated that over the last decade the use of containment procedures in the Pennsylvania state hospitals significantly declined. It also showed that during the last 88 months of this study, this reduction had a positive effect on patient-to-patient assaults and, to a lesser degree, on patient-to-staff assaults.

The study also showed that during the first 90 days of their hospital stay, patients were at greater risk of committing assaultive behaviors requiring the use of restraint. Intensifying treatment for newer patients along with proactively treating the causes of aggression could further decrease the need for a containment procedure.

When the state hospitals first reported success in reducing use of containment procedures, there was concern that the reductions were accomplished, in part, by substituting medication (3). But when PRN orders for psychiatric indications were discontinued in 2005, the use of containment procedures decreased further and other patient safety measures improved (23,26). These improvements continued throughout the end of this study.

Changes in the types of patients treated in Pennsylvania’s state hospitals have been suggested as a possible reason for the reduction in use of containment procedures. However, there is no evidence to support this claim. In fact, efforts to reduce use of restraint and seclusion at the state’s forensic centers for patients with criminal commitments have been equally compelling. A separate study of this change is the subject of ongoing research.

Pennsylvania’s commitment to a recovery approach has transformed its service delivery system to emphasize community services and supports. This commitment is the overall reason for the significant reduction in use of seclusion and restraint.

Mr. Smith is affiliated with the Pennsylvania Department of Public Welfare, Allentown State Hospital, Allentown (e-mail: ). Ms. Ashbridge and Dr. Davis are with the Department of Administration and Mr. Steinmetz is with the Department of Quality Assurance, Pennsylvania State Hospital System, Harrisburg. A version of this article was presented at the European Conference on Violence in Clinical Psychiatry, Ghent, Belgium, October 23–26, 2013, and at the Congress on Seclusion and Restraint Reduction, Emergis Behavioral Health Center, Kloetinge, the Netherlands, October 28, 2013.

The authors thank the direct care staff, nurses, doctors, and program services staff who work in the Pennsylvania state hospital system. Their leadership and support of the nonrestraint approach to psychiatric care and services are sincerely appreciated. The authors also acknowledge the work of the state hospital performance improvement staff for their many contributions to the data reported here and the assistance of Edward Bixler, Ph.D. They gratefully acknowledge the leadership and vision of Richard M. O’Dea, M.S., R.N., and George A. Kopchick, M.S.

The authors report no financial relationships with commercial interests.

References

1 Schacht LM: National Trend in the Use of Seclusion and Restraint Among State Psychiatric Hospitals. Alexandria, Va, National Association of State Mental Health Program Directors Research Institute, 2006Google Scholar

2 O’Hagan M, Divis M, Long J: Best Practice in the Reduction and Elimination of Seclusion and Restraint: Seclusion: Time for Change. Auckland, New Zealand, Te Pou Te Whakaaro Nui: National Centre of Mental Health Research, Information and Workforce Development, 2008Google Scholar

3 Smith GM, Davis RH, Bixler EO, et al.: Pennsylvania state hospital system’s seclusion and restraint reduction program. Psychiatric Services 56:1115–1122, 2005LinkGoogle Scholar

4 Huckshorn K: Six Core Strategies for Reducing Seclusion and Restraint Use. Alexandria, Va, National Association of State Mental Health Program Directors Research Institute, 2006Google Scholar

5 Khadivi AN, Patel RC, Atkinson AR, et al.: Association between seclusion and restraint and patient-related violence. Psychiatric Services 55:1311–1312, 2004LinkGoogle Scholar

6 Moylan LB, Cullinan M: Frequency of assault and severity of injury of psychiatric nurses in relation to the nurses’ decision to restrain. Journal of Psychiatric and Mental Health Nursing 18:526–534, 2011Crossref, MedlineGoogle Scholar

7 Lee S, Gray R, Gournay K, et al.: Views of nursing staff on the use of physical restraint. Journal of Psychiatric and Mental Health Nursing 10:425–430, 2003Crossref, MedlineGoogle Scholar

8 Stokowski L: Violence: not in my job description. Medscape Multispecialty, Aug 23, 2010. Available at www.medscape.com/viewarticle/727144Google Scholar

9 Stuckey A: Why are so many workers being hurt at the Fulton State Hospital? St Louis Post-Dispatch, April 13, 2014Google Scholar

10 James Masters K, Nunno M, Mooney AJ: Should psychiatrists assist in the restraint of children and adolescents in psychiatric facilities? Psychiatric Services 64:173–176, 2013LinkGoogle Scholar

11 Moore N: Restraint is by far the worst thing about working in mental health. Nursing Times, July 3, 2013. Available at www.nursingtimes.net/student-nursing-times/restraint-is-by-far-the-worst-thing-about-working-in-mental-health/5060606.articleGoogle Scholar

12 Bills proposed to stem violence at state mental hospitals. Los Angeles Times, March 1, 2012. Available at latimesblogs.latimes.com/lanow/2012/03/bills-proposed-to-stem-violence-at-state-mental-hospitals.htmlGoogle Scholar

13 Rice S: States increasingly trying to protect healthcare workers from violence. Modern Healthcare, July 14, 2014. Available at www.modernhealthcare.com/article/20140214/NEWS/302149971/states-increasingly-trying-to-protect-healthcare-workers-from#src=serpGoogle Scholar

14 Pennsylvania State Hospital System Length-of-Stay, Demographics, and Diagnostics Report for June 30, 2013. Wernersville, Pa, Wernersville State Hospital, 2013. Available at www.dpw.state.pa.us/cs/groups/webcontent/documents/report/p_035141.pdfGoogle Scholar

15 Hospital Based Psychiatric Inpatient Core Measure Set. Falls Church, Va, National Association of State Mental Health Program Directors Research Institute, 2005. Available at www.nri-inc.org/#!bhpms/c1nxsGoogle Scholar

16 Cohen J, Cohen P, West S, et al.: Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences, 3rd ed. Mahwah, NJ, Erlbaum, 2003Google Scholar

17 Management of incidents: SI-815 incident reporting and risk management policy. SMH-03. Mental Health and Substance Abuse Services Bulletin, Nov 12, 2003. Available at www.dpw.state.pa.us/cs/groups/webcontent/documents/bulletin_admin/d_005682.pdfGoogle Scholar

18 Pennsylvania State Hospital Risk Management Summary Reports. Available at www.dpw.state.pa.us/publications/forproviders/statehospitalriskmanagementsummaryreports/index.htmGoogle Scholar

19 Use of restraints, seclusion, and exclusion in state mental hospital and restoration center. Mental Health and Substance Abuse Services Bulletin, July 1, 2001. Available at www.nasmhpd.org/docs/publications/docs/2008/SRBriefings/I_1_A_PA_SR_OMHSAS.pdfGoogle Scholar

20 Use of restraints: seclusion and exclusion in state mental hospital and restoration center. Mental Health and Substance Abuse Services Bulletin. Wernersville, Pa, Wernersville State Hospital, April 29, 2005Google Scholar

21 Use of restraints: seclusion and exclusion in state mental hospital and restoration center. Mental Health and Substance Abuse Services Bulletin, Nov 30, 2009. Available at www.dpw.state.pa.us/cs/groups/webcontent/documents/bulletin_admin/d_005644.pdfGoogle Scholar

22 Innovations in American Government Award finalist presentation: Pennsylvania's mental hospital seclusion and restraint reduction program. Cambridge, Mass, Harvard Kennedy School, 2000. Available at www.youtube.com/watch?v=zhpsQovmAjg&feature=youtu.beGoogle Scholar

23 Smith GM, Davis RH, Altenor A, et al.: Psychiatric use of unscheduled medications in the Pennsylvania state hospital system: effects of discontinuing the use of PRN orders. Community Mental Health Journal 44:261–270, 2008Crossref, MedlineGoogle Scholar

24 Response Training Programs: 2011 PERT Training. Available at www.youtube.com/watch?v=kRC4W6iGHlgGoogle Scholar

25 Allentown State Hospital Policy Memorandum A-124: Psychiatric Emergency Response Plan. Wernersville, Pa, Wernersville State Hospital, 2001Google Scholar

26 Unscheduled use of medication in the state hospital system: PRN & STAT medication orders. SMR-05-02, 1–2. Mental Health and Substance Abuse Services Bulletin, March 1, 2005. Available at www.dpw.state.pa.us/cs/groups/webcontent/documents/bulletin_admin/d_005874.pdfGoogle Scholar

27 Huffman J, Stern T, Harley R, et al.: The use of DBT skills in the treatment of difficult patients in the general hospital. FOCUS 3:252–260, 2005CrossrefGoogle Scholar