The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

This study assessed whether peer-staffed crisis respite centers implemented in New York City in 2013 as an alternative to hospitalization reduced emergency department (ED) visits, hospitalizations, and Medicaid expenditures for individuals enrolled in Medicaid.

Methods:

This study used Medicaid claims and enrollment data for January 2009 through April 2016 to estimate impacts on ED visits, hospitalizations, and total Medicaid expenditures by using a difference-in-differences model with a matched comparison group. The study sample included 401 respite center clients and 1,796 members of the comparison group.

Results:

In the month of crisis respite use and the 11 subsequent months, Medicaid expenditures were on average $2,138 lower per Medicaid-enrolled month and there were 2.9 fewer hospitalizations for crisis respite clients than would have been expected in the absence of the intervention (p<.01).

Conclusions:

Peer-staffed crisis respite services resulted in lowered rates of Medicaid-funded hospitalizations and health expenditures for participants compared with a comparison group. The findings suggest that peer-staffed crisis respites can achieve system-level impacts.

Behavioral health disorders contribute to about one in eight emergency department (ED) visits in the United States annually, and about 40% of ED visits associated with behavioral health disorders lead to an inpatient admission (1). Peer-staffed crisis respite centers offer a potential alternative to use of ED and inpatient services for psychiatric crises. The environment and services offered in peer-staffed crisis respites are distinct from ED and hospital care. Unlike locked units of hospitals, crisis respites offer a voluntary, safe, and homelike environment where trained peer staff provide 24-hour support to individuals experiencing psychiatric crises (2).

Literature documenting the value of peer-provided services for individuals with severe mental illness goes back centuries (3). Four recent studies have reviewed the research comparing performance of conventional mental health treatment roles by peer and nonpeer staff. Three of these reviews included only randomized controlled trials (RCTs) and concluded that there was little evidence of significant differences between peer and professional staff in the performance of conventional roles. However, all of these reviews cautioned that the evidence for these conclusions was limited. The reviews included only a small number of studies. The attributes of the programs in these studies varied, and many studies had a poor design and incomplete reporting (35). The fourth review included studies with design types other than RCTs, including studies with quasi-experimental designs and a time-series model. This review concluded that peer staff were better able than professional staff to improve a range of recovery outcomes but noted some mixed evidence on the effectiveness of peers in conventional roles (6). Across the four reviews there was agreement that more rigorous research designs and greater specificity and consistency in program attributes are needed to provide a stronger evidence base to guide policy makers and program leaders (36).

Several studies included in the reviews addressed the effect of peer-provided services on hospitalizations and ED visits. Some studies found that the use of peers was associated with reductions in hospital stays, inpatient days, or emergency services (3,5,7). However, other studies found no effect on use of these acute services (4,6). Although other residential alternatives to psychiatric hospitalization have demonstrated promising results (8), we identified only one study that analyzed the effect of access to a crisis respite program staffed with peers trained in intentional peer support. This study used a quasi-experimental design and had a small sample size. It found crisis respite use reduced the odds of inpatient and emergency service use (7). Overall, there is limited evidence on the potential for peer-staffed crisis respites to reduce hospitalizations and lower the overall costs of health care.

To fill this gap in the literature, this study examined whether a peer-staffed crisis respite program implemented in New York City (NYC) through the Parachute NYC program reduced ED visits, hospitalizations, and Medicaid expenditures for individuals enrolled in Medicaid. This study also described the implementation of the program. The Fund for Public Health in New York, a nonprofit organization dedicated to improving the health and well-being of city residents, partnered with the Division of Mental Hygiene in NYC’s Department of Health and Mental Hygiene to implement Parachute NYC with support from a Center for Medicare and Medicaid Innovation Health Care Innovation Award.

Methods

Peer-Staffed Crisis Respites

Parachute NYC introduced the use of peer specialists to NYC’s crisis mental health program. The goal of the program was to improve the quality of care provided to individuals in need of crisis mental health treatment while reducing overall Medicaid expenditures through reductions in hospitalizations and ED visits. Between January 2013 and March 2014, Parachute NYC gradually opened four crisis respites, one in each borough except Staten Island. At these centers, peer specialists provided 24-hour peer support, education in self-advocacy, and training in self-help to individuals experiencing a psychiatric crisis that would otherwise lead to hospitalization. Crisis respites were designed to provide a short-term (≤14 days) alternative to hospitalization.

Eligibility for the program evolved throughout the analysis period for this study—initially only individuals experiencing a psychosis-related crisis that would otherwise require hospitalization were eligible, but when these criteria resulted in low referral rates, the diagnostic criteria were expanded to include any psychiatric crisis otherwise requiring hospitalization. Eligible participants were referred to crisis respite through the NYC crisis support line, mobile crisis teams, federally qualified health centers, hospitals and EDs, primary care clinics, schools, and other community-based organizations providing medical, behavioral, or social services (for example, YMCA and Catholic Charities).

The majority of staff at the crisis respites were peer support specialists. These peers were supervised by nonpeer administrators. Crisis respites were generally staffed by 20 to 30 peers, were supervised by three to five nonpeers, and served approximately five to 20 participants per month. A nurse was on site periodically to ensure that the guests’ clinical treatment needs were met. All crisis respite staff members received training in the need-adapted treatment model and intentional peer support. The need-adapted treatment model is an evidence-based approach that flexibly meets client’s individual needs, provides immediate assistance, and creates a sustained support network (often client family members) for the client. Clients and members of the support network are full participants in treatment decision making (9). Intentional peer support is a trauma-informed approach that integrates peers into treatment and focuses on building relationships between clients and peers (9,10). Parachute NYC contracted with the developers and experts of these models to provide regular supervision to all staff members.

Data Sources

We used Medicaid claims and eligibility data provided by the New York State Department of Health (NYSDOH) that covered July 2009 through April 2016 to examine service utilization and total Medicaid expenditures for crisis respite participants and a matched comparison group. Institutional review board approval was not required for this analysis. Rather, a data use agreement with NYSDOH governed the use of the Medicaid administrative data and ensured the confidentiality of crisis respite clients and comparison group members. The Parachute NYC program provided a list of crisis respite clients to the research team to facilitate the analysis.

Comparison Population Selection

Because eligibility for crisis respite services required that the clients reside in NYC and experience a psychiatric crisis for which a hospital stay was necessary, we selected a potential comparison pool by first identifying all Medicaid beneficiaries in NYC who had a hospital stay between January 2013 and November 2015 with a primary psychiatric diagnosis. Using the list of crisis respite clients provided by the Parachute NYC program, we found that only 5% of individuals in this group had received crisis respite services during this time frame, and they were excluded from the potential comparison pool.

Across the analytic population the first month of the intervention period ranged from January 2013 to November 2015. For crisis respite clients, we designated the month in which they initially used crisis respite services as the first month of the intervention period. For potential comparison group members, we randomly selected a month in which they had an inpatient hospital stay with a psychiatric diagnosis as the first month of the intervention period. The inpatient hospitalization and associated Medicaid expenditures were included in the analysis of outcomes for the intervention period. We then limited the analytic population to include only crisis respite clients and potential comparison group members for whom Medicaid was the first payer and who were continuously enrolled in the full Medicaid benefit package from at least six months before to five months after the first month of their intervention period. This strategy ensured that we were able to observe a minimum of six months of continuous Medicaid claims in the preintervention and intervention periods for each individual in the analytic sample. Individuals with a longer period observable in the Medicaid data were followed for up to 36 months in the preintervention period and 24 months in the intervention period.

The final comparison group was selected from the initial pool by using an optimal-matching model that allowed up to 20 potential comparison pool members to be matched to each crisis respite client. The matching algorithm first required an exact match between crisis respite client and potential comparison members on psychiatric diagnosis and an indicator of whether the individual was enrolled in Medicaid for a full 12 months prior to the first month of the intervention period. Then, within these strata, we used a nearest-neighbor matching approach to select the most similar comparison beneficiaries for each crisis respite client. The matching model used the following characteristics identified as of the first month of the intervention period: calendar month and year of the first month of the person’s intervention period, age group (18–34, 35–44, or 45–64), gender, race, ethnicity, Medicaid disability status, Chronic Illness and Disability Payment System (CDPS) condition indicators derived from Medicaid claims history (11), and total Medicaid expenditures and service use (including number of hospitalizations, ED visits, ambulatory psychiatric services, and physician office visits) in the 12 months prior to the first month of the intervention period.

Outcome Variables

Given the program goals, we examined differences between crisis respite participants and the comparison group in changes in ED visits, hospitalizations, and total Medicaid expenditure. ED visits were defined as ED services that did not lead to a hospitalization, because ED services leading to hospitalization were considered part of the hospital stay. Hospitalizations were defined as an inpatient stay for any diagnosis. Total Medicaid expenditures included all Medicaid-covered health services reported in the claims data. Costs for crisis respite services were not included in total Medicaid expenditures because these costs were not paid through Medicaid.

Statistical Analyses

Impacts associated with crisis respite use were estimated based on regression models conducted by using a difference-in-differences framework. The regressions of ED visits and hospitalizations used a zero-inflated negative binomial model. The regression of total expenditures used a generalized linear model with log link function. All regressions controlled for age (linear and squared), gender, race, ethnicity, whether Medicaid claims for the individual were available for 12 months prior to the intervention period, disability status (as indicated by Medicaid eligibility category), CDPS condition indicators (11), calendar month and year of the person’s first intervention month, and categorical indicators of psychiatric diagnosis at enrollment. Regression coefficients and confidence intervals were estimated by using nonparametric bootstrap methods in Stata 14. In R we used the generalized Tukey method to adjust the confidence intervals to account for multiple testing.

Results

Demographic and Diagnostic Characteristics

There were no statistically significant demographic or diagnostic differences between crisis respite clients and the comparison group, suggesting that the matching algorithm identified comparison group members who were quite similar to crisis respite clients (Table 1). The crisis respite clients were distributed across age categories, with 144 between ages 18 and 34, 88 between 35 and 44, and the remainder between 45 and 64. Forty percent were non-Hispanic African American, 25% were Hispanic, 49% were male, and 60% were eligible for Medicaid because of disability. Most (62%) had a diagnosis of schizophrenia, 26% had a diagnosis of bipolar disorder, and 7% had a diagnosis of depression.

TABLE 1. Demographic characteristics of crisis respite clients and a comparison groupa

Crisis respite (N=401)Comparison (N=1,796)
VariableN%N%
Age group
 18–341443661834
 35–44882238622
 45–641694279244
Male gender1984991751
Race-ethnicity
 Non-Hispanic African American1604069239
 Hispanic1022546826
 Non-Hispanic and non–African American1393563635
Eligible for Medicaid based on disability242601,07660
Psychiatric diagnosis
 Schizophrenia247621,10662
 Bipolar disorder1052647026
 Depression2771217
 Other225995
Continuously enrolled in Medicaid in 12 months prior to program enrollment368921,64892
N of emergency department visits in 12 months prior to program enrollment
 0942342524
 1771935420
 2–3962443724
 ≥41343358032
N of hospital stays in 12 months prior to program enrollment
 02015085848
 1872239222
 2401018510
 ≥3731836120
CDPS conditions identified in 12 months prior to program enrollmentb
 AIDS541327315
 Cardiovascular condition2045193352
 Developmental disability195674
 Diabetes902240423
 Pulmonary condition1463663135
 Gastrointestinal conditional982443324
 Substance use disorder1493769138
Year of enrollment
 2013421021012
 20141403567938
 20152195590851

aData are from the month of enrollment in the study (January 2013–November 2015). For the comparison group, the enrollment date was a randomly chosen month during the study period in which the given comparison group member had an inpatient admission. The groups did not differ significantly on any of the variables.

bCDPS, Chronic Illness and Disability Payment System

TABLE 1. Demographic characteristics of crisis respite clients and a comparison groupa

Enlarge table

Medicaid Utilization and Expenditures

The regression results indicate that the crisis respite program significantly reduced overall Medicaid expenditures and hospitalizations (Table 2). ED visits were similar for crisis respite clients and comparison group members. Reported separately for years 1 and 2, the findings suggest that the reductions in expenditures and hospitalizations were concentrated in the first year of the program. For each month of Medicaid enrollment in the first 12 months of the intervention, expenditures were on average $2,138 lower and there were .24 fewer hospitalizations for crisis respite clients than would have been expected in the absence of the intervention (p<.01). This translated to a reduction of 2.9 hospitalizations per crisis respite client over the first intervention year. Note that a reduction of one hospitalization was expected because in the initial month of the intervention period, all comparison group members had a hospital stay whereas program participants instead received crisis respite services.

TABLE 2. Impact of use of the crisis respite center on monthly health care utilization per Medicaid beneficiarya

Years 1 and 2bYear 1Year 2
MeasureImpact90% CIImpact90% CIImpact90% CI
Total Medicaid expenditures ($)–1,609–$2,095 to –$1,124–$2,138–$2,716 to –$1,561$246–$596 to $1,089
N of hospitalizations–.15–.20 to –.09–.24–.33 to –.16.02–.03 to .08
N of emergency department visits not leading to hospitalization.03–.03 to .08.02–.04 to .08.07–.03 to .18

aStudy participants were observed for 6 to 24 months following enrollment in the crisis respite center or assignment to a comparison group, depending on the number of months they were observable in the Medicaid administrative data used for this analysis. On average, members of the analytic sample were observed for 15 months. Source: Ireys H, Bouchery E, Blyler C, et al: Evaluating the HCIA: Behavioral Health/Substance Abuse Awards: Addendum to the Third Annual Report. Baltimore, Centers for Medicare and Medicaid Services, 2017

bAverage value for years 1 and 2

TABLE 2. Impact of use of the crisis respite center on monthly health care utilization per Medicaid beneficiarya

Enlarge table

To better understand the pattern of the regression-adjusted differences in expenditures, we examined mean expenditures for crisis respite clients and the comparison group during six-month intervals before and after the start of the intervention period (Figure 1). During the three-year baseline period, mean expenditures for crisis respite clients and comparison group members were similar ($15,000 to $21,000 per six-month period). However, in the first six months of the intervention, average expenditures for the comparison group (about $43,000) increased significantly compared with those for crisis respite clients (about $24,000). In contrast, in each of the six-month periods between months 7 and 24 of the intervention, the difference between expenditures for crisis respite clients and the comparison group members was similar to that observed during the baseline period. Differences in hospitalization paralleled those for expenditures, with differences concentrated in the first six months of the intervention (data not shown).

FIGURE 1.

FIGURE 1. Total Medicaid expenditures for participants in peer-staffed crisis respite services or a comparison group, by six-month period before and after the start of the interventiona

aData are regression-adjusted means. The oversized circle with a black outline indicates a significant difference-in-differences estimate between the comparison and intervention groups compared with the average difference between the groups over all baseline periods. Source: Ireys H, Bouchery E, Blyler C, et al: Evaluating the HCIA: Behavioral Health/Substance Abuse Awards: Addendum to the Third Annual Report. Baltimore, Centers for Medicare and Medicaid Services, 2017

Discussion

In the first year following crisis respite services, clients experienced fewer hospitalizations and had lower total Medicaid expenditures compared with individuals with similar characteristics who received inpatient treatment for a psychiatric crisis during the same time period. Previous studies have demonstrated the value of peer services in other contexts, including longer-term residential treatment, outpatient mental health care, and the delivery of services intended to change health-related behaviors (4,7,12). Studies have found that peer services can reduce client depression and increase hope compared with typical care (4,13). They also have shown that peer supports increase rates of engagement in care (4,14). This study extends that literature by using a well-matched comparison group and rigorous methods to quantify the potential impact of peer-staffed crisis respite services on hospitalizations and total Medicaid expenditures.

Although we cannot fully explain the mechanisms by which the crisis respite program achieved reductions in hospitalizations and Medicaid expenditures, certain features of the program—such as targeting patients in need of hospital care, use of intentional peer support, and the training and supervision of peer staff by experts in this model—may have contributed to its success. The Parachute crisis respites also specifically focus on fostering client coping mechanisms and self-advocacy skills. Further research is needed to understand the contribution of each of these program features.

The results have implications for how health care systems may wish to consider positioning peer-staffed services in the continuum of care. In many communities, peers play a role in delivering outpatient mental health care, whereas peer-staffed crisis services may not be available (15). Medicaid programs in particular might want to consider supporting peer-staffed crisis services to reduce hospitalizations. Crisis respite program costs were not included in this analysis. Policy makers considering implementing a similar program should deduct estimated costs for the proposed crisis respite program from estimates of Medicaid savings derived from the findings of this study to project net savings.

It is notable that the crisis respite services did not affect rates of ED visits that were not associated with a hospital stay. It is unclear why ED use was not responsive to the intervention. Although previous studies have found use of peer staff reduced ED service use (3,5,7), these findings have not been consistent (6) and the peers were incorporated into programs with different features. In the Parachute program, crisis respite use is limited to crises that would otherwise require an inpatient stay. As such, peer services may have been less effective for reducing ED visits that were not associated with a need for hospital admission.

Despite the use of a rigorous difference-in-differences model with a well-matched comparison group, this study had several limitations. We limited the analyses to Medicaid enrollees, excluding enrollees who were uninsured or who had Medicare or other insurance. This limited the analysis to 31% of total crisis respite clients. As a result, we have no way of knowing the extent to which the findings generalize to Medicare enrollees or uninsured individuals. However, we also have no reason to think that the intervention would have affected them differently considering that it was implemented consistently for every client.

Another limitation of this study was the low precision in our estimates, particularly for expenditures. There was high variance in the observed payment amounts for crisis respite clients and comparison group members because of the severe mental health treatment needs of the target population. In addition, expenditures were based on the total amount paid to the provider for approved claims. When service-level payment information was not available for services covered by managed care, these payment amounts were estimated on the basis of fee-for-service payment guidelines, introducing the possibility that the amounts differed from the actual managed care payments.

A final limitation was that the matching methods used to select the comparison group for this analysis may not have fully accounted for unobservable differences between the crisis respite clients and comparison group members, such as differences in resources available at different locations within NYC or differences in client characteristics that increased the likelihood of being referred to the crisis respite program rather than receiving an inpatient hospital stay. Use of matching methods to select the comparison group would reduce differences with the crisis respite clients in terms of unobserved characteristics, if those characteristics were correlated with matching variables. Despite these limitations, we selected a comparison group in this way because the program was not implemented with a control sample and we had limited information on factors associated with participation. No information on provider or client awareness of the crisis respite program or of other factors that may have affected program referral patterns was available for this study. Such information would have been useful to improve comparison group selection.

Conclusions

Clients who received peer-staffed crisis respite services demonstrated lower rates of hospitalization and Medicaid expenditures in the month of and immediately following receipt of these services compared with a comparison group. The findings provide evidence that implementing peer-staffed crisis respites to divert individuals from hospitalization can achieve savings in Medicaid expenditures and reduce reliance on hospital services.

The authors are with Mathematica Policy Research, Washington, D.C.
Send correspondence to Ms. Bouchery (e-mail: ).

This project was funded under a contract with the Centers for Medicare and Medicaid Services (HHSM-500-2010-00026I/HHSM-500-T0014).

Parts of this study were previously published (Ireys H, Bouchery E, Blyler C, et al: Evaluating the HCIA: Behavioral Health/Substance Abuse Awards: Addendum to the Third Annual Report. Baltimore, Centers for Medicare and Medicaid Services, 2017; https://downloads.cms.gov/files/cmmi/hcia-bhsa-thirdannrptaddendum.pdf). The contents of this article are solely the responsibility of the authors and do not necessarily represent the official views of the U.S. Department of Health and Human Services or any of its agencies.

The authors report no financial relationships with commercial interests.

This project benefited from support and guidance from Vetisha McClair, programming support from Beny Wu and Rebecca Morris, and statistical analysis by Huihua Lu.

References

1 Owens PL, Mutter R, Stocks C: Mental Health and Substance Abuse-Related Emergency Department Visits Among Adults, 2007. Healthcare Cost and Utilization Project Statistical Brief 92. Rockville, MD, Agency for Healthcare Research and Quality, 2010Google Scholar

2 Ostrow L, Croft B: Peer respites: a research and practice agenda. Psychiatric Services 66:638–640, 2015LinkGoogle Scholar

3 Davidson L, Bellamy C, Guy K, et al.: Peer support among persons with severe mental illnesses: a review of evidence and experience. World Psychiatry 11:123–128, 2012Crossref, MedlineGoogle Scholar

4 Lloyd-Evans B, Mayo-Wilson E, Harrison B, et al.: A systematic review and meta-analysis of randomised controlled trials of peer support for people with severe mental illness. BMC Psychiatry 14:39, 2014Crossref, MedlineGoogle Scholar

5 Pitt V, Lowe D, Hill S, et al.: Consumer-providers of care for adult clients of statutory mental health services. Cochrane Database of Systematic Reviews 3:CD004807, 2013MedlineGoogle Scholar

6 Chinman M, George P, Dougherty RH, et al.: Peer support services for individuals with serious mental illnesses: assessing the evidence. Psychiatric Services 65:429–441, 2014LinkGoogle Scholar

7 Croft B, İsvan N: Impact of the 2nd Story peer respite program on use of inpatient and emergency services. Psychiatric Services 66:632–637, 2015LinkGoogle Scholar

8 Thomas KA, Rickwood D: Clinical and cost-effectiveness of acute and subacute residential mental health services: a systematic review. Psychiatric Services 64:1140–1149, 2013LinkGoogle Scholar

9 Pope LG, Cubellis L, Hopper K: Signing on for dirty work: taking stock of a public psychiatry project from the inside. Transcultural Psychiatry 53:506–526, 2016Crossref, MedlineGoogle Scholar

10 Mead S: Intentional Peer Support: An Alternative Approach. West Chesterfield, NH, Intentional Peer Support, 2014Google Scholar

11 Kronick R, Gilmer T, Dreyfus T, et al.: Improving health-based payment for Medicaid beneficiaries: CDPS. Health Care Financing Review 21:29–64, 2000MedlineGoogle Scholar

12 Sledge WH, Lawless M, Sells D, et al.: Effectiveness of peer support in reducing readmissions of persons with multiple psychiatric hospitalizations. Psychiatric Services 62:541–544, 2011LinkGoogle Scholar

13 Pfeiffer PN, Heisler M, Piette JD, et al.: Efficacy of peer support interventions for depression: a meta-analysis. General Hospital Psychiatry 33:29–36, 2011Crossref, MedlineGoogle Scholar

14 Tracy K, Burton M, Nich C, et al.: Utilizing peer mentorship to engage high recidivism substance-abusing patients in treatment. American Journal of Drug and Alcohol Abuse 37:525–531, 2011Crossref, MedlineGoogle Scholar

15 Peer Support: Making a Difference for People With Mental Illness. Washington, DC, American Psychiatric Association, March 3, 2017. psychiatry.org/news-room/apa-blogs/apa-blog/2017/03/peer-support-making-a-difference-for-people-with-mental-illness. Accessed Jul 24, 2017Google Scholar