The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

This study examined associations of patient, hospital, and service system factors with provision of discharge planning to individuals treated in hospital psychiatric units.

Methods:

This retrospective cohort analysis used 2012–2013 New York State Medicaid claims data of 18,185 patients ages <65 years who were treated in hospital psychiatric units and discharged to the community. The claims data were linked to data from managed behavioral health care organizations indicating whether inpatient staff scheduled a follow-up outpatient appointment with a mental health provider. Additional data regarding hospital and service system characteristics were obtained from the American Hospital Association Annual Survey, the Area Health Resource File, and other state administrative databases. Rates and adjusted odds ratios were assessed for the likelihood of inpatient staff scheduling a follow-up appointment.

Results:

Inpatient staff scheduled outpatient appointments for 79.8% of discharges. The adjusted odds of not having an outpatient appointment scheduled as part of the patient’s discharge plan were significantly associated with several factors, including being homeless on admission, having a diagnosis of a co-occurring substance use disorder, having high levels of medical comorbid conditions, and not being engaged in psychiatric outpatient services in the month prior to admission.

Conclusions:

Patient characteristics were more strongly associated with failure to receive discharge planning than were hospital and service system characteristics.

HIGHLIGHTS

  • In a cohort of 18,185 Medicaid recipients ages <65 years who were treated in hospital psychiatric units and discharged to the community, only 46.3% received comprehensive discharge planning practices recommended to decrease risk for discontinuing mental health treatment after discharge.

  • Inpatient staff scheduled outpatient appointments for 79.8% of discharges.

  • Patient characteristics, including being homeless on admission, having a diagnosis of a co-occurring substance use disorder, having many medical comorbid conditions, and not being engaged in psychiatric outpatient services in the month before admission, were more strongly associated with failure to receive discharge planning than were hospital and service system characteristics.

Discharge planning practices that promote transition from inpatient psychiatric units to community-based care include communicating with outpatient clinicians, scheduling timely appointments for outpatient follow-up care, and forwarding discharge summaries to outpatient clinicians (14). Communication with outpatient clinicians and timely scheduling of outpatient follow-up appointments improve attendance rates at outpatient psychiatric services (59), and continuing care plans convey information that supports continuity of care and lowers the likelihood of relapse and readmission (1016). These practices are widely accepted as standards of care for inpatient treatment (1720).

Limited data exist, however, on the likelihood of patients’ receipt of such discharge planning practices, and available evidence from varied hospital settings suggests that rates at which providers complete these practices are low. One study found that inpatient medical-surgical clinicians communicated directly with outpatient clinicians for only 37% of discharges (21). In another study, one-third of adults reported being discharged from a hospital without any follow-up arrangements (22). Previous research has found that outpatient appointments are scheduled for 41%−67% of patients discharged from inpatient psychiatric units (7, 23), and results from one study indicated that inpatient psychiatric clinicians communicated with outpatient providers for only 66% of discharges (5). A 2007 review found that outpatient primary care clinicians reported receiving a continuing care plan within 1 week of discharge for only 15% of discharged patients (24), although a recent review noted that discharge summaries were available to primary care providers within 48 hours for 55% of discharged patients (25).

Most of these studies had significant methodological flaws that limited their generalizability, including a small sample size, selection biases, and failure to test for reliability of reporting. To better inform targeting of quality improvement efforts, research is needed to understand the prevalence of psychiatric inpatient discharge planning practices and to identify factors associated with low rates of discharge planning in larger and more broadly representative populations.

This study examined a key discharge planning practice: scheduling by inpatient psychiatric providers of outpatient appointments with mental health providers after discharge. We examined data from a large cohort of inpatient psychiatric admissions and report the proportion of patients who received this practice along with patient, hospital, and service system characteristics associated with receipt of the practice. On the basis of a conceptual model (Figure 1), we hypothesized that patients who had short inpatient stays or had diagnoses of less severe psychiatric disorders would be less likely to have an outpatient appointment scheduled, because clinicians would assume that such patients were more likely to follow through with outpatient clinicians who cared for them previously. We further anticipated that smaller or nonteaching hospitals would have fewer staff available to schedule outpatient appointments and that their patients therefore would be less likely to receive this discharge planning activity. Moreover, we expected that patients who resided in areas with greater constraints on economic or mental health resources would also be less likely to have an outpatient appointment scheduled as part of their discharge plan.

FIGURE 1.

FIGURE 1. Conceptual model of factors affecting patients’ attendance at an initial outpatient appointment after psychiatric hospitalization

Methods

Data Sources

Data were obtained from four primary sources: 2012–2013 New York State (NYS) Medicaid claims records, the 2012–2013 American Hospital Association Annual Survey (26), the 2012–2013 Health Resources and Services Administration Area Resource File (27), and a 2012–2013 NYS Managed Behavioral Healthcare Organization (MBHO) discharge file created during a quality assurance program in which NYS contracted with five MBHOs in geographically distinct regions to review discharge planning practices for fee-for-service inpatient psychiatric admissions. NYS hospital providers were required to notify the regional MBHO of every Medicaid psychiatric inpatient admission and provide specific information to the MBHO regarding the patient’s treatment and discharge plans. The MBHOs, which were not applying medical necessity criteria and not paying providers for the hospital care during this period, were required to offer hospital providers the option to submit the information by telephone, fax, or secure Web-based portal.

Patient eligibility criteria included age <65 years, admitted to an inpatient psychiatric unit in the period from January 1, 2012, to December 31, 2013, with a principal diagnosis of a mental disorder, discharged to the community, enrolled in Medicaid for at least 11 of the 12 months prior to admission, no Medicare eligibility, and inpatient length of stay of ≤60 days. For patients with more than one inpatient psychiatric admission during 2012–2013, only the initial admission was included. (A consort diagram describing the creation of the study sample is included in an online supplement to this article.) After matching the MBHO discharge file with NYS Medicaid claims records and applying all eligibility criteria, the final sample included 18,185 inpatient psychiatric discharges. The NYS Psychiatric Institute Institutional Review Board approved the study and granted a waiver of individual consent.

Dependent Variables

Outcome variables were created from the MBHO data file. The MBHOs were required to report whether, for each discharge, the inpatient psychiatric team scheduled a mental health outpatient appointment, communicated with a current or previous outpatient clinician, and forwarded a discharge summary to an outpatient clinician. We also created a composite dichotomous variable defined by provision of all three discharge planning practices. To assess the reliability of the reported data and operationalize definitions of the discharge planning practices, we completed a reliability study in which data from MBHO reports were compared with data extracted from inpatient medical records (N=214) from two hospitals (28). Only one of the three discharge planning practice variables met a level of moderate reliability (κ≥0.4) for inclusion in regression models reported below: scheduling an outpatient appointment with a specified date after discharge.

Independent Variables

Independent variables included patient, hospital, and regional service system characteristics that previous research suggested could affect discharge planning and postdischarge continuity of care for patients with psychiatric disorders (29, 30). Patient-level variables from Medicaid claims included demographic factors, a primary inpatient discharge diagnosis, and a diagnosis of a co-occurring substance use disorder at discharge. Previous engagement in psychiatric outpatient services was assessed with claims data indicating receipt of outpatient services listing a primary mental disorder diagnosis or mental health service code, and service for each patient was categorized as active (at least one service in the 30 days preadmission), recent (at least one service in the 12 months preadmission but no services in the 30 days preadmission), or none (no services in the 12 months preadmission). Additional patient characteristics included homeless at admission and burden of co-occurring medical conditions, assessed with an Elixhauser Comorbidity Index (ECI). We used established algorithms to create an ECI index score for each discharge on the basis of clinical diagnoses reported in inpatient and outpatient claims for all Medicaid services during the 12 months before admission (31, 32).

Hospitals were characterized on the basis of size, provision of outpatient psychiatric services, hospital ownership, percentage of total annual discharges enrolled in Medicaid, and medical resident teaching status. Information from NYS administrative databases, including the NYS Medicaid Program, the NYS Department of Health Statewide Planning and Research Cooperative System, and the NYS Office of Mental Health’s Mental Health Automated Record System, was used to create additional variables characterizing the hospitals. These “case-mix” variables included the percentage of psychiatric discharges with a substance use disorder diagnosis and the percentage of psychiatric patients with two or more psychiatric hospitalizations during the period. Area Health Resource File data characterized counties in which patients resided with respect to regional mental health resources, poverty, and urban-rural classification. An MBHO variable was added to distinguish among the five different MBHOs.

Analysis Plan

The proportion of inpatients not having an appointment scheduled was determined overall and stratified by each patient, hospital, and service system characteristic. Odds ratios (ORs) with 99% confidence intervals (CIs) were calculated for each characteristic. Adjusted ORs (AORs) were calculated by using logistic regression analyses and describe the effect of each variable on the probability of not having an outpatient appointment scheduled, when all other covariates were controlled for. Average marginal effects (AMEs) were also provided as a measure of an effect on the probability scale. Because patients were nested within different hospitals, the observations were nonindependent. Accordingly, generalized estimating equations were used to account for the clustering of observations within hospitals. We considered AORs with 99% CIs that did not include 1.0 and AMEs with 99% CIs that did not include 0.0 to be statistically significant, while also noting AORs and AMEs with p>0.01 and p<0.05. In this large, exploratory study, no adjustments were made to the many CIs and p values, which should therefore be interpreted with caution.

Results

Hospital psychiatric staff scheduled a follow-up outpatient appointment with a mental health provider for 14,503 out of 18,185 discharges (79.8%) for which complete information was available. (Descriptive data related to the other discharge planning practices [i.e., communication with an outpatient clinician and forwarding a discharge summary], along with descriptive data and regression models for the composite variable describing whether the patient received all three discharge planning practices that met our reliability threshold, are reported in the online supplement.)

Table 1 reports the percentages of patients who did not have an outpatient mental health appointment scheduled, stratified by patient, hospital, and service system characteristics. In the adjusted logistic regression model, patient characteristics that were statistically significantly associated with not having an appointment scheduled included being older (reference: ages 4–12) and having short (≤4 days) or long (31–60 days) inpatient lengths of stay (reference: 5–14 days) (Table 1). In unadjusted models, non-Hispanic Black and Puerto Rican–Hispanic patients were more likely than non-Hispanic White patients not to have an appointment scheduled, although these associations were largely eliminated in the adjusted models; in the adjusted model, being Puerto Rican–Hispanic was statistically significantly associated with being more likely to have an appointment scheduled. Other variables associated with not having an outpatient appointment scheduled included being homeless on admission, having a diagnosis of a co-occurring substance use disorder, having high levels of medical comorbid conditions (Elixhauser score ≥4), and not being engaged in psychiatric outpatient services in the month before admission. Patients with bipolar disorder were also more likely than patients with schizophrenia not to have an outpatient appointment scheduled (p=0.02).

TABLE 1. Patient, hospital, and system characteristics associated with the likelihood of not having an outpatient appointment scheduled as part of discharge planning for 18,185 psychiatric inpatients

All patients (N=18,185)No appointment scheduled (N=3,682)Unadjusted modelsAdjusted models (N=17,831)
CharacteristicNN%aOR99% CIAME (%)b99% CIOR99% CIpAME (%)b99% CIp
Patient
 Age
  4–12 (reference)1,79819210.7
  13–172,53749919.72.051.33, 3.168.992.25, 15.732.081.37, 3.16<.0018.673.5, 13.85<.001
  18–355,4881,07519.62.041.21, 3.448.913.18, 14.641.801.23, 2.63<.0016.552.74, 10.36<.001
  36–648,3621,91622.92.491.47, 4.2012.236.22, 18.251.991.37, 2.88<.0017.994.25, 11.73<.001
 Gender
  Female (reference)8,3951,56218.6
  Male9,7902,12021.71.211.06, 1.383.05.94, 5.161.10.97, 1.26.051.36−.42, 3.15.05
 Race-ethnicity
  Non-Hispanic White (reference)7,4491,23916.3
  Non-Hispanic Black6,0561,43523.71.561.24, 1.967.063.40, 10.73.98.84, 1.14.77–.25–2.37, 1.88.77
  Puerto Rican–Hispanic1,98741720.91.331.08, 1.654.351.20, 7.51.84.72, .97.01–2.35–4.35,–.34.01
  Other1,40936125.61.731.32, 2.258.994.38, 13.601.02.85, 1.23.73.34–2.25, 2.93.74
  Unknown1,28423017.91.09.71, 1.691.28–5.09, 7.651.04.76, 1.43.73.61–3.94, 5.16.73
 Length of stay
  5–14 days (reference)9,3091,78419.2
  0–4 days2,69057621.41.15.88, 1.502.25–2.22, 6.721.601.33, 1.92<.0016.963.67, 10.24<.001
  15–30 days4,74097520.61.09.89, 1.341.41–1.84, 4.651.07.94, 1.21.18.86–.82, 2.53.19
  31–60 days1,44634724.01.331.03, 1.724.83.39, 9.271.451.17, 1.8<.0015.361.88, 8.85<.001
 Homeless at admission
  No (reference)16,0462,91418.2
  Yes1,28339931.12.031.52, 2.7212.947.01, 18.871.321.06, 1.65.014.06.67, 7.44.01
 Primary diagnosis at discharge
  Schizophrenia (reference)4,9981,06821.4
  Schizoaffective disorder1,84437920.6.95.75, 1.22–.82–4.86, 3.231.01.82, 1.25.88.16–2.60, 2.93.88
  Bipolar disorder5,9681,27421.41.00.77, 1.30–.02–4.41, 4.371.19.99, 1.42.022.36–.17, 4.91.02
  Depressive disorder3,42464118.7.85.64, 1.12–2.65–7.03, 1.741.02.82, 1.26.84.22–2.62, 3.07.84
  Other disorder1,95132016.4.72.51, 1.05–4.97–10.45, .521.19.90, 1.53.082.37–1.20, 6.03.09
 Diagnosis of a co-occurring substance use disorder at discharge
  No (reference)11,4791,82215.9
  Yes6,7061,86027.72.031.63, 2.5411.867.67, 16.061.761.52, 2.05<.0018.195.79, 10.6<.001
 Medical comorbidity in previous 12 months (No. of general medical diagnoses)
  0 (reference)5,9721,09418.3
  1–38,6451,72219.91.11.93, 1.321.60–1.04, 4.241.05.93, 1.18.33.63–1.02, 2.27.33
  ≥43,38383224.61.451.17, 1.816.272.56, 9.991.261.09, 1.45<.0013.281.13, 5.44<.001
 Prior engagement in psychiatric outpatient services
  Active (past month) (reference)9,1081,43015.7
  Recent (past 12 months but not past month)3,80082321.71.481.18, 1.875.962.39, 9.531.351.06, 1.71.0013.86.72, .71.01
  None (past 12 months)5,2771,42927.11.991.56, 2.5411.387.08, 15.681.901.54, 2.35<.0019.356.27, 12.44<.001
Hospital
 Size (no. of beds)
  Small (<100) (reference)7689612.5
  Medium (100–499)9,6801,75618.11.55.61, 3.945.64–4.96, 16.241.24.59, 2.61.462.71–6.01, 11.43.42
  Large (≥500)7,7371,83023.72.17.84, 5.6111.15–.31, 22.611.35.52, 3.49.423.88–7.90, 15.66.39
 Ownership
  Public (reference)5,0351,13722.6
  Private not for profit11,3342,19819.4.82.48, 1.43–3.19–12.51, 6.131.03.57, 1.83.91.34–7.47. 8.15.91
  Private for profit1,81634719.1.81.39, 1.69–3.47–15.45, 8.501.28.52, 3.14.483.63–10.24, 17.50.50
 Proportion of psychiatric discharges that were Medicaid
  Low (<49%) (reference)3,53765418.5
  Medium (49%–71%)9,2311,50716.3.86.49, 1.51–2.16–10.37, 6.041.11.78, 1.57.461.3–3.11, 5.70.45
  High (>71%)5,4171,52128.11.72.97, 3.069.59–.42, 19.601.38.79, 2.42.144.51–3.33, 12.36.14
 Outpatient psychiatric services provision
  No (reference)2,45933113.5
  Yes15,7263,35121.31.74.86, 3.517.85–.79, 16.491.03.66, 1.61.85.45–5.55, 6.44.85
 Teaching
  No (reference)3,39444013.0
  Yes14,7913,24221.91.88.85, 4.168.95–.46, 18.371.14.62, 2.10.581.75–6.26, 9.76.57
 Proportion of psychiatric discharges with substance use disorder diagnosis
  Low (<34%) (reference)4,26078918.5
  Medium (34%–60%)10,1542,24322.11.25.67, 2.313.57–6.04, 13.17.93.57, 1.50.69–1.03–7.75, 5.70.69
  High (>60%)3,77165017.2.92.44, 1.92–1.28–12.20, 9.63.99.55, 1.78.96–.13–8.46, 8.19.96
 Proportion of psychiatric population with ≥2 psychiatric discharges
  Low (<24.5%) (reference)4,05051112.6
  Medium (24.5%–35%)8,9051,77820.01.73.84, 3.577.35–1.44, 16.14.94.48, 1.82.79–.92–10.37. 8.52.80
  High (>35%)5,2301,39326.62.511.20, 5.2714.024.14, 23.89.93.37, 2.35.84–1.02–13.96, 11.92.84
System
 NYS behavioral health organizationc
  Western (reference)2,5772248.7
  Central2,5341716.6.76.34, 1.71–1.94–7.31, 3.421.30.54, 3.12.441.89–4.70, 8.48.46
  Hudson River4,5941,15125.13.512.19, 5.6416.369.59, 23.145.012.43, 10.32<.00120.2412.27, 28.21<.001
  New York City6,7361,89428.14.112.65, 6.3719.4313.15, 25.73.801.86, 7.77<.00115.147.52, 22.77<.001
  Long Island1,74424213.91.691.07, 2.675.18.63, 9.731.85.89, 3.87.035.19–1.38, 11.75.04
 Proportion of county population in poverty
  Low (<15%) (reference)5,8871,10218.7
  Medium (15%–19%)6,8671,30519.01.02.68, 1.52.28–5.89, 6.46.97.62, 1.53.87−.42–7.15, 6.31.87
  High (≥20%)5,2621,22223.21.31.90–1.924.50–1.71, 10.71.69.36, 1.31.13–4.92–13.41, 3.56.14
 Mental health workers per 100,000 population in county
  Low (<67) (reference)1,3911329.5
  Medium (67 to 166)10,2192,07820.32.431.45, 4.0810.855.05, 16.64.89.54, 1.47.54–1.74–9.26, 5.78.55
  High (≥167)6,4061,41922.22.711.69, 4.3512.667.75, 17.58.81.46, 1.43.33–3.03–11.38, 5.32.35
 Urban-rural classification
  Medium metro (reference)2,12925712.1
  Large central metro9,7972,42724.82.41.30, 4.4412.75.11, 20.292.05.92, 4.56.028.89.45, 17.33.01
  Large fringe metro3,18864620.31.85.99, 3.468.19.74, 15.651.74.89, 3.41.036.43–.60, 13.46.02
  Small metro1,05214213.51.14.45, 2.841.43–8.96, 11.821.36.71, 2.62.233.27–3.53, 10.07.23
  Micropolitan1,4381087.5.59.30, 1.15–4.56–11.01, 1.881.19.59, 2.38.521.76–5.13, 8.65.51
  Noncore4124911.9.98.45, 2.14–.18–8.38, 8.021.16.53, 2.53.631.44–6.35, 9.24.63

aValues are row percentages.

bAME, average marginal effect.

cNYS, New York State.

TABLE 1. Patient, hospital, and system characteristics associated with the likelihood of not having an outpatient appointment scheduled as part of discharge planning for 18,185 psychiatric inpatients

Enlarge table

None of the hospital characteristics were significantly associated with a lower likelihood of having an outpatient appointment scheduled. For system characteristics, the MBHO variable was significant (reference: Western Region MBHO); patients treated in hospitals reviewed by the New York City and Hudson River MBHOs had a higher probability of having aftercare appointments scheduled. A similar tendency was noted for the Long Island MBHO (p=0.03). Patients treated in hospitals located in large metropolitan regions (reference: medium metropolitan regions) also tended not to have an outpatient appointment scheduled (p=0.03).

Discussion

In 2012–2013, more than 20% of Medicaid patients discharged from a hospital psychiatric unit in NYS did not have an appointment with an outpatient mental health provider scheduled at the time of their discharge. This quality-of-care gap is concerning, given the known clinical risks associated with the period immediately after discharge from inpatient psychiatric units, including relapse and hospital readmission (7, 13, 3337), homelessness (38, 39), violent behavior (40, 41), criminal justice involvement (42, 43), and all-cause mortality, including suicide (4446).

We hypothesized that several patient, hospital, and service system characteristics would be associated with the probability of patients not having an outpatient appointment scheduled. Our findings indicated that patient characteristics were more likely than hospital or service system characteristics to predict whether appointments were scheduled: seven patient-level variables were statistically significant in the adjusted models, none of the hospital-level variables were significant, and only one of the service system variables was significant. Patient characteristics appeared to be more critical determinants of whether patients received adequate discharge planning and should be primary areas of focus for activities aimed at improving care quality in the hospital.

We hypothesized that patients who had shorter inpatient stays and primary diagnoses of less severe psychiatric disorders would be less likely to have an outpatient appointment scheduled. These hypotheses were partially supported: no significant differences were detected in discharge planning practices among patients with different primary diagnoses; however, patients with short stays (≤4 days) and those with long stays (31–60 days) were more likely than those with stays of 5–14 days not to have an appointment scheduled. Patients with short stays may be less likely to receive discharge planning because this group includes patients who sign out against medical advice or otherwise do not wish to pursue treatment. Those with longer stays, however, are more likely to have persistent symptoms or complex psychosocial circumstances that require extended inpatient care. These characteristics may also make discharge planning more complex and increase the likelihood that timely follow-up appointments are not scheduled. This finding suggests another important focus for hospital quality improvement activities to ensure high-need patients receive adequate discharge planning.

Patients who had co-occurring substance use, were homeless, or were not engaged in care in the month preadmission were more likely not to have an outpatient appointment scheduled. In previous research, these characteristics were also strong predictors of failed care transitions and poor outcomes in the period immediately after discharge (29, 30, 47). Individuals with a co-occurring substance use disorder were more likely to be discharged without adequate access to community-based treatment for co-occurring disorders, making them vulnerable to relapse, substance use, and further disengagement from care (48). Homeless individuals are similarly at risk because of their lack of stable supports in the community (49), and individuals who previously did not engage in community-based care are more likely to continue to be disengaged without more intensive follow-up (29, 30). Inpatient clinicians should aim to ensure that these patients receive adequate discharge planning, and many will require more intensive care transition interventions, which have been shown to improve continuity of care for high-risk patients (5057).

Inpatient clinicians were less likely to schedule appointments for patients with high levels of comorbid conditions. Because this study included only patients who were discharged to the community, this finding cannot be explained by transfers to other hospital units or residential treatment facilities. Inpatient clinicians may believe that patients with high levels of comorbid conditions have established networks of community-based medical providers who will manage postdischarge care without the need for timely aftercare from psychiatric providers. Nevertheless, this practice should be considered inadequate discharge planning, given the importance of integrating care for these vulnerable patients.

We also hypothesized that patients treated in smaller or nonteaching hospitals or who resided in areas with greater economic or mental health resource constraints would also be less likely to have an outpatient appointment scheduled. Hospitals that served higher proportions of patients with Medicaid had lower rates of scheduling outpatient appointments, although in the adjusted logistic models this variable and none of the other hospital variables were associated with the likelihood of scheduling an appointment. In contrast to what we anticipated, patients treated in teaching hospitals were more likely not to receive complete discharge planning (see table in online supplement). This finding was counterintuitive, given the important educational role and availability of trainees to support care and treatment planning. However, many teaching hospitals are located in urban areas and treat patients with higher rates of poverty and other factors that may complicate clinicians’ discharge planning practices.

Despite known shortages of mental health providers in rural and underserved communities, the service system variables related to poverty and density of mental health workers were not significantly associated with the likelihood of having an outpatient appointment scheduled. The variable denoting the MBHO that reviewed admissions for each defined region of the state was associated with discharge planning practices; the New York City MBHO reported lower rates of scheduling appointments. This finding may reflect the greater numbers of patients in New York City hospitals who did not receive discharge planning because these hospitals also provided outpatient psychiatric services. Anecdotal reports indicate that many New York City hospitals operate walk-in clinics for outpatient follow-up appointments; hospitals with such clinics may have had lower rates of appointments scheduled because these clinics were seen as obviating the need for discharge planning.

The main limitation of this study was related to the reliability of the discharge planning practice variables; we did not model two of the discharge planning practices because of low correlations between MBHO reports and documentation of the specific practices in patients’ medical records from two hospitals in our reliability study (descriptive data regarding these practices are available in the online supplement). Another limitation was the study’s naturalistic design, which limited inferences regarding causality because of the potential for unmeasured confounding factors.

We also did not have discharge planning data for the entire population of Medicaid patients admitted to inpatient psychiatric units during the 2012–2013 study period. The sample comprised 20.8% of NYS Medicaid fee-for-service hospital psychiatric admissions with a mental disorder as the primary diagnosis and included representation from 105 of 106 statewide hospitals that admitted Medicaid fee-for-service patients in 2012–2013. The greatest numbers of excluded cases were patients with diagnoses other than mental disorders, readmissions, cases not reviewed by MBHOs, and cases not meeting the preadmission Medicaid enrollment criteria. Patients with primary diagnoses other than mental disorders represented admissions to substance use disorder treatment programs, which were not the population of interest for this study. Readmissions were excluded to avoid bias associated with data from duplicate patients. Patients with admissions not reviewed by MBHOs, which included admissions for both mental health and substance use treatment, were more likely to have been younger and male and to have had shorter lengths of stay, which may represent a group less likely to receive discharge planning.

Patients were also excluded when they did not meet our requirement of Medicaid enrollment for 11 of the 12 months before the index admission. During the study planning period, a preliminary analysis indicated that this Medicaid enrollment threshold allowed for consideration of 76% of all Medicaid admissions in 2012–2013. We considered lowering the requirement to 8 months, which would have yielded 86% of the original cohort; however, it would have included a significant number of cases with no available data for up to one-third of the period of interest before admission. For this reason, we kept the selection criterion of enrollment for 11 out of 12 months. It is unclear whether cases excluded because of this criterion may have been more or less likely to receive discharge planning.

Conclusions

This study used a unique and large administrative database to examine whether inpatient psychiatric clinicians met an important standard of care for discharge planning and to identify factors that may have been limiting providers’ ability to deliver these practices. The findings identified important opportunities for continuous quality improvement: >20% of discharged patients failed to receive a discharge planning practice identified as the standard of care. This important quality gap should be addressed by hospitals via continuous quality improvement efforts focused on identified subgroups of patients at high risk of failed care transitions.

New York State Psychiatric Institute, New York City (Smith, Haselden, Corbeil, Wall, Essock, Mascayano, Dixon, Olfson); Department of Psychiatry, Columbia University Vagelos College of Physicians and Surgeons, New York City (Smith, Haselden, Wall, Essock, Dixon, Olfson); Office of Performance Measurement and Evaluation, New York State Office of Mental Health, Albany (Tang, Frimpong, Goldman, Wang); Department of Psychiatry, University of California–San Francisco, San Francisco (Radigan); Department of Psychiatry and Behavioral Sciences, Albert Einstein College of Medicine, Montefiore Medical Center, New York City (Schneider). Editor Emeritus Howard H. Goldman, M.D., Ph.D., served as decision editor on the manuscript.
Send correspondence to Dr. Smith ().

This research was supported by grant R01 MH-106558 from the National Institute of Mental Health.

The authors report no financial relationships with commercial interests.

References

1 Vigod SN , Kurdyak PA , Dennis CL , et al. : Transitional interventions to reduce early psychiatric readmissions in adults: systematic review . Br J Psychiatry 2013 ; 202 : 187 – 194 Crossref, MedlineGoogle Scholar

2 Hansen LO , Young RS , Hinami K , et al. : Interventions to reduce 30-day rehospitalization: a systematic review . Ann Intern Med 2011 ; 155 : 520 – 528 Crossref, MedlineGoogle Scholar

3 Shepperd S , Lannin NA , Clemson LM , et al. : Discharge planning from hospital to home . Cochrane Database Syst Rev 2013 ; 1 : CD000313 Google Scholar

4 Cherlin EJ , Curry LA , Thompson JW , et al. : Features of high quality discharge planning for patients following acute myocardial infarction . J Gen Intern Med 2013 ; 28 : 436 – 443 Crossref, MedlineGoogle Scholar

5 Boyer CA , McAlpine DD , Pottick KJ , et al. : Identifying risk factors and key strategies in linkage to outpatient psychiatric care . Am J Psychiatry 2000 ; 157 : 1592 – 1598 LinkGoogle Scholar

6 Pfeiffer PN , Ganoczy D , Zivin K , et al. : Outpatient follow-up after psychiatric hospitalization for depression and later readmission and treatment adequacy . Psychiatr Serv 2012 ; 63 : 1239 – 1242 LinkGoogle Scholar

7 Nelson EA , Maruish ME , Axler JL : Effects of discharge planning and compliance with outpatient appointments on readmission rates . Psychiatr Serv 2000 ; 51 : 885 – 889 LinkGoogle Scholar

8 Steffen S , Kösters M , Becker T , et al. : Discharge planning in mental health care: a systematic review of the recent literature . Acta Psychiatr Scand 2009 ; 120 : 1 – 9 Crossref, MedlineGoogle Scholar

9 Shaw H , Mackie CA , Sharkie I : Evaluation of effect of pharmacy discharge planning on medication problems experienced by discharged acute admission mental health patients . Int J Pharm Pract 2000 ; 8 : 144 – 153 CrossrefGoogle Scholar

10 Zivin K , Pfeiffer PN , McCammon RJ , et al. : “No-shows”: who fails to follow up with initial behavioral health treatment? Am J Manag Care 2009 ; 15 : 105 – 112 MedlineGoogle Scholar

11 Kreyenbuhl J , Nossel IR , Dixon LB : Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: a review of the literature . Schizophr Bull 2009 ; 35 : 696 – 703 Crossref, MedlineGoogle Scholar

12 Smith TE , Burgos J , Dexter V , et al. : Best practices for improving engagement of clients in clinic care . Psychiatr Serv 2010 ; 61 : 343 – 345 LinkGoogle Scholar

13 Bodén R , Brandt L , Kieler H , et al. : Early non-adherence to medication and other risk factors for rehospitalization in schizophrenia and schizoaffective disorder . Schizophr Res 2011 ; 133 : 36 – 41 Crossref, MedlineGoogle Scholar

14 Laan W , van der Does Y , Sezgi B , et al. : Low treatment adherence with antipsychotics is associated with relapse in psychotic disorders within six months after discharge . Pharmacopsychiatry 2010 ; 43 : 221 – 224 Crossref, MedlineGoogle Scholar

15 Morken G , Widen JH , Grawe RW : Non-adherence to antipsychotic medication, relapse and rehospitalisation in recent-onset schizophrenia . BMC Psychiatry 2008 ; 8 : 32 Crossref, MedlineGoogle Scholar

16 Schennach R , Obermeier M , Meyer S , et al. : Predictors of relapse in the year after hospital discharge among patients with schizophrenia . Psychiatr Serv 2012 ; 63 : 87 – 90 LinkGoogle Scholar

17 Bodenheimer T : Coordinating care: a perilous journey through the health care system . N Engl J Med 2008 ; 358 : 1064 – 1071 Crossref, MedlineGoogle Scholar

18 Institute of Medicine : To Err Is Human: Building a Safer Health System . Washington, DC , National Academies Press , 1999 Google Scholar

19 Healthcare Effectiveness Data and Information Set (HEDIS). Washington, DC, National Committee for Quality Assurance. http://www.ncqa.org/tabid/59/default.aspx. Accessed July 18, 2012Google Scholar

20 Hospital-Based Inpatient Psychiatric. Oakbrook Terrace, IL , The Joint Commission , 2020 . https://www.jointcommission.org/measurement/measures/hospital-based-inpatient-psychiatric Google Scholar

21 Oduyebo I , Lehmann CU , Pollack CE , et al. : Association of self-reported hospital discharge handoffs with 30-day readmissions . JAMA Intern Med 2013 ; 173 : 624 – 629 Crossref, MedlineGoogle Scholar

22 Schoen C , Osborn R , Huynh PT , et al. : Taking the pulse of health care systems: experiences of patients with health problems in six countries . Health Aff 2005 ; W5 ( suppl Web exclusives ): 509 – 525 Google Scholar

23 Nakanishi M , Niimura J , Tanoue M , et al. : Association between length of hospital stay and implementation of discharge planning in acute psychiatric inpatients in Japan . Int J Ment Health Syst 2015 ; 9 : 23 Crossref, MedlineGoogle Scholar

24 Kripalani S , LeFevre F , Phillips CO , et al. : Deficits in communication and information transfer between hospital-based and primary care physicians: implications for patient safety and continuity of care . JAMA 2007 ; 297 : 831 – 841 Crossref, MedlineGoogle Scholar

25 Kattel S , Manning DM , Erwin PJ , et al. : Information transfer at hospital discharge: a systematic review . J Patient Saf 2020 ; 16 : e25 – e33 Crossref, MedlineGoogle Scholar

26 AHA Annual Survey Database Fiscal Year: 2012. Chicago, American Hospital Association, 2013. http://www.ahadataviewer.com/book-cd-products/aha-survey. Accessed July 7, 2019Google Scholar

27 Area Health Resources Files. Rockville, MD, Health Resources and Services Administration, 2013. https://data.hrsa.gov/topics/health-workforce/ahrf. Accessed July 7, 2019Google Scholar

28 Haselden M , Corbeil T , Tang F , et al. : Family involvement in psychiatric hospitalizations: associations with discharge planning and prompt follow-up care . Psychiatr Serv 2019 ; 70 : 860 – 866 LinkGoogle Scholar

29 Olfson M , Marcus SC , Doshi JA : Continuity of care after inpatient discharge of patients with schizophrenia in the Medicaid program: a retrospective longitudinal cohort analysis . J Clin Psychiatry 2010 ; 71 : 831 – 838 Crossref, MedlineGoogle Scholar

30 Stein BD , Kogan JN , Sorbero MJ , et al. : Predictors of timely follow-up care among Medicaid-enrolled adults after psychiatric hospitalization . Psychiatr Serv 2007 ; 58 : 1563 – 1569 LinkGoogle Scholar

31 Quan H , Sundararajan V , Halfon P , et al. : Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data . Med Care 2005 ; 43 : 1130 – 1139 Crossref, MedlineGoogle Scholar

32 van Walraven C , Austin PC , Jennings A , et al. : A modification of the Elixhauser comorbidity measures into a point system for hospital death using administrative data . Med Care 2009 ; 47 : 626 – 633 Crossref, MedlineGoogle Scholar

33 Cuffel BJ , Held M , Goldman W : Predictive models and the effectiveness of strategies for improving outpatient follow-up under managed care . Psychiatr Serv 2002 ; 53 : 1438 – 1443 LinkGoogle Scholar

34 Carlisle CE , Mamdani M , Schachar R , et al. : Aftercare, emergency department visits, and readmission in adolescents . J Am Acad Child Adolesc Psychiatry 2012 ; 51 : 283 – 293.e4 Crossref, MedlineGoogle Scholar

35 Mark TL , Tomic KS , Kowlessar N , et al. : Hospital readmission among Medicaid patients with an index hospitalization for mental and/or substance use disorder . J Behav Health Serv Res 2013 ; 40 : 207 – 221 Crossref, MedlineGoogle Scholar

36 Lin HC , Lee HC : The association between timely outpatient visits and the likelihood of rehospitalization for schizophrenia patients . Am J Orthopsychiatry 2008 ; 78 : 494 – 497 Crossref, MedlineGoogle Scholar

37 Valenstein M , Copeland LA , Blow FC , et al. : Pharmacy data identify poorly adherent patients with schizophrenia at increased risk for admission . Med Care 2002 ; 40 : 630 – 639 Crossref, MedlineGoogle Scholar

38 Olfson M , Mechanic D , Hansell S , et al. : Prediction of homelessness within three months of discharge among inpatients with schizophrenia . Psychiatr Serv 1999 ; 50 : 667 – 673 LinkGoogle Scholar

39 Herman DB , Susser ES , Jandorf L , et al. : Homelessness among individuals with psychotic disorders hospitalized for the first time: findings from the Suffolk County Mental Health Project . Am J Psychiatry 1998 ; 155 : 109 – 113 LinkGoogle Scholar

40 Elbogen EB , Van Dorn RA , Swanson JW , et al. : Treatment engagement and violence risk in mental disorders . Br J Psychiatry 2006 ; 189 : 354 – 360 Crossref, MedlineGoogle Scholar

41 Monahan J : The MacArthur studies of violence risk . Crim Behav Ment Health 2002 ; 12 : S67 – S72 CrossrefGoogle Scholar

42 Van Dorn RA , Desmarais SL , Petrila J , et al. : Effects of outpatient treatment on risk of arrest of adults with serious mental illness and associated costs . Psychiatr Serv 2013 ; 64 : 856 – 862 LinkGoogle Scholar

43 Oliver P , Keen J , Rowse G , et al. : The effect of time spent in treatment and dropout status on rates of convictions, cautions and imprisonment over 5 years in a primary care-led methadone maintenance service . Addiction 2010 ; 105 : 732 – 739 Crossref, MedlineGoogle Scholar

44 Katz IR , Peltzman T , Jedele JM , et al. : Critical periods for increased mortality after discharge from inpatient mental health units: opportunities for prevention . Psychiatr Serv 2019 ; 70 : 450 – 456 LinkGoogle Scholar

45 Valenstein M , Kim HM , Ganoczy D , et al. : Higher-risk periods for suicide among VA patients receiving depression treatment: prioritizing suicide prevention efforts . J Affect Disord 2009 ; 112 : 50 – 58 Crossref, MedlineGoogle Scholar

46 Vasiliadis HM , Ngamini-Ngui A , Lesage A : Factors associated with suicide in the month following contact with different types of health services in Quebec . Psychiatr Serv 2015 ; 66 : 121 – 126 LinkGoogle Scholar

47 Smith TE , Haselden M , Corbeil T , et al. : Relationship between continuity of care and discharge planning after hospital psychiatric admission . Psychiatr Serv 2019 ; 71 : 75 – 78 LinkGoogle Scholar

48 Manuel JI , Gandy ME , Rieker D : Trends in hospital discharges and dispositions for episodes of co-occurring severe mental illness and substance use disorders . Adm Policy Ment Health Ment Health Serv Res 2015 ; 42 : 168 – 175 Crossref, MedlineGoogle Scholar

49 Lamanna D , Stergiopoulos V , Durbin J , et al. : Promoting continuity of care for homeless adults with unmet health needs: the role of brief interventions . Health Soc Care Community 2018 ; 26 : 56 – 64 Crossref, MedlineGoogle Scholar

50 Coleman EA , Parry C , Chalmers S , et al. : The care transitions intervention: results of a randomized controlled trial . Arch Intern Med 2006 ; 166 : 1822 – 1828 Crossref, MedlineGoogle Scholar

51 Naylor MD , Aiken LH , Kurtzman ET , et al. : The care span: the importance of transitional care in achieving health reform . Health Aff 2011 ; 30 : 746 – 754 CrossrefGoogle Scholar

52 Snow V , Beck D , Budnitz T , et al. : Transitions of care consensus policy statement American College of Physicians–Society of General Internal Medicine–Society of Hospital Medicine–American Geriatrics Society–American College of Emergency Physicians–Society of Academic Emergency Medicine . J Gen Intern Med 2009 ; 24 : 971 – 976 Crossref, MedlineGoogle Scholar

53 Voss R , Gardner R , Baier R , et al. : The care transitions intervention: translating from efficacy to effectiveness . Arch Intern Med 2011 ; 171 : 1232 – 1237 Crossref, MedlineGoogle Scholar

54 Dixon L , Goldberg R , Iannone V , et al. : Use of a critical time intervention to promote continuity of care after psychiatric inpatient hospitalization . Psychiatr Serv 2009 ; 60 : 451 – 458 LinkGoogle Scholar

55 Orlosky MJ , Caiati D , Hadad J , et al. : Improvement of psychiatric ambulatory follow-up care by use of care coordinators . Am J Med Qual 2007 ; 22 : 95 – 97 Crossref, MedlineGoogle Scholar

56 Reynolds W , Lauder W , Sharkey S , et al. : The effects of a transitional discharge model for psychiatric patients . J Psychiatr Ment Health Nurs 2004 ; 11 : 82 – 88 Crossref, MedlineGoogle Scholar

57 Kasprow WJ , Rosenheck RA : Outcomes of critical time intervention case management of homeless veterans after psychiatric hospitalization . Psychiatr Serv 2007 ; 58 : 929 – 935 LinkGoogle Scholar