The sample consisted of 2,430 patients who were hospitalized during an index period of one year—January through December 1997—at the Harris County Psychiatric Center, a university-affiliated, 250-bed psychiatric hospital that serves the greater Houston metropolitan area. If a patient had multiple admissions during the index period, only the last admission was used in the data analyses.
+Table 1 presents the patients' demographic characteristics, history of hospitalization, and diagnosis and outcome at discharge.
The SPSS (version 10.0) randomization procedure was used to divide the sample into two subsets, a primary sample for derivation of a predictive model and a replication sample to test the stability of the results. Each subset contained a total of 1,215 patients, with an equivalent number of patients who required extended hospitalization (N=198) and patients who were discharged to the community (N=1,017).
The BPRS-A is a clinician-based rating instrument consisting of 18 items that describe dimensions of psychopathology. Items are rated on a 7-point scale ranging from "not present" to "very severe," with anchors in the form of behavior examples provided for each item's rating options. To be consistent with previous research (
+49), item responses were weighted from 1 to 7. The reliability and validity of the BPRS have been well documented across studies (
+50). Similarly, adequate interrater reliability has been demonstrated for BPRS-A total score at admission (
+47,
+48).
A recent psychometric analysis that included interrater reliability and scale validity supported the application of four factor-derived dimensions of the BPRS-A in acute inpatient settings (
+47). The four subscales are resistance, which has as its component items uncooperativeness, hostility, excitement, and grandiosity; positive symptoms, with the component items of unusual thought content, conceptual disorganization, hallucinatory behavior, suspiciousness, and disorientation; negative symptoms, with the component items of blunted affect, emotional withdrawal, and motor retardation; and psychological discomfort, with the component items of depressive mood, anxiety, somatic concern, guilt feelings, and tension.
The BPRS-A was completed by one of 16 attending faculty psychiatrists within 48 hours of a patient's admission. Ratings were not based on a single interview, but rather represented a summary of all the information available after the patient had been admitted to the facility. Because the scale items are fundamental constructs of psychopathology that are assessed through a routine mental status assessment and a comprehensive interview (
+50), the attending psychiatrists received no formal training on the BPRS-A. Adequate reliability estimates for BPRS-A total score and factor scores at admission (Cronbach's alpha range=.68 to .80; N=1,556) and interrater reliability across pairs of attending psychiatrists and the residents assigned to them (range of intraclass correlation coefficients=.57 to .84, N=131) have been demonstrated in research conducted at the Harris County Psychiatric Center (
+47).
BPRS-A scores, demographic information, and hospitalization data for each patient were gathered daily from medical records and entered into a database.
Categorical data were analyzed with chi square analyses. Follow-up Fisher's exact tests were conducted on significant chi square analyses in the case of multiple levels of the independent variable—for example, marital status and ethnicity. For chi square analyses, effect sizes are reported with use of the phi statistic Φ (
+51) (small=.10, medium=.30, large=.50). Continuous dependent variables were examined by using one-way analyses of variance, with discharge placement as the independent variable.
For continuous data, estimated eta-squared (est. η
2) (
+52) is presented as a measure of effect size (small=.01, medium=.06, large=.16). Variables that were demonstrated to be significantly different as a function of discharge status across both the primary and replication samples (conjoint p<.003) were retained for use in stepwise discriminant function analyses. This multivariate procedure was conducted to determine the relative value of variables established through replicated analyses in identifying patients who would subsequently need extended care. For these analyses, the F-to-remove statistic was used to determine the final set of variables. Standardized discriminant weights—that is, discriminant coefficients—are reported to indicate the relative value of variables to the discriminant function. In all stepwise regression analyses, data were tested to ensure that statistical assumptions were not violated. Box's M statistic was used to test the assumption of equal covariance matrices.
Descriptive statistics for the entire sample and the two subsets—the primary sample and the replication sample—are presented in
+Table 2. Sixteen percent of the patients in the entire sample were transferred to extended care.
Demographic variables. Chi square analyses revealed a significant difference for marital status in both the primary sample (χ2=31.6, df=4, p<.001, Φ=.16) and the replication sample (χ2=21.43, df=4, p<.01, Φ=.13). In the primary sample, single patients were more likely to be transferred for extended care (χ2=47.7, df=1, p<.001), whereas those who were married (χ2= 26.5, df=1, p<.001), divorced (χ2=5.08, df=1, p<.05), or separated (χ2=4.45, df=1, p<.05) were more likely to be discharged to the community. Discharge status did not differ among widowed patients.
In the replication sample, the same pattern was evident. Single patients were more likely to be discharged to extended care (χ2=48.58, df=1, p<.001), and those who were married (χ2=23.43, df=1, p<.001), divorced (χ2=4.36, df=1, p<.05), or separated (χ2=4.21, df=1, p<.05) were more likely to be discharged to the community. Again, discharge status did not differ among widowed patients.
Discharge status among individuals in the primary sample differed as a function of gender (χ2=9.1, df=1, p<.01, Φ=.09), ethnicity (χ2=14.5, df=3, p<.05, Φ=.11), and employment history (χ2=11.2, df=1, p<.01, Φ=.10); however, these variables were not significantly associated with discharge status in the replication sample.
Hospitalization variables. In the primary sample, patients who were transferred for extended care had more previous admissions to the Harris County Psychiatric Center than patients who were discharged to the community (F=72.5, df=1, 1,213, p<.001, est. η2=.06). They also had more previous transfers for extended care (F=130.63, df=1, 1,213, p<.001, est. η2=.10). These findings held for the replication sample (F=64.21, df=1, 1,213, p<.001, est. η2=.05, and F=106.37, df=1, 1,213, p<.001, est. η2=.08, respectively).
Clinician ratings. As indicated in
+Table 2, patients in the primary sample who were transferred for extended care had higher BPRS-A total scores (F=54.74, df=1, 1,213, p<.001, est. η
2=.04) and higher scores for resistance (F=155.12, df=1, 1,213, p<.001, est. η
2=.11) and for positive symptoms (F=104.27, df=1, 1,213, p<.001, est. η
2=.08). However, patients who had higher scores for psychological discomfort were more likely to be discharged to the community (F=21.30, df=1, 1,213, p<.001, est. η
2=.02).
Analyses of the replication sample demonstrated the reliability of BPRS-A admission scores in predicting type of patient discharge. Patients who were transferred for extended care had higher total scores (F=81.19, df=1, 1,213, p<.001, est. η2=.06) and higher scores for resistance (F= 153.01, df=1, 1,213, p<.001, est. η2= .11) and positive symptoms (F= 136.97, df=1, 1,213, p<.001, est. η2= .11). Again, patients with higher scores for psychological discomfort were more likely to be discharged to the community (F=8.89, df=1, 1,213, p<.01, est. η2=.01).
The final stage of data analysis involved examining the classificatory power of the three types of predictor variables—BPRS-A scores, demographic characteristics, and history of hospitalization—through stepwise discriminant function analyses. Only the six significant replicated variables were included in these analyses: marital status, dichotomized as single versus marital history; number of previous admissions to the Harris County Psychiatric Center; number of previous transfers for extended care; and scores on the BPRS-A subscales for resistance, positive symptoms, and psychological discomfort. Because of their shared variance with the factor scores, BPRS-A total scores were not included in these analyses.
The first analysis was conducted on the primary sample. All variables except number of previous admissions to the Harris County Psychiatric Center were retained (F= 63.53, df=5, 1,209, p<.001). In descending order of importance, the discriminant coefficients were BPRS-A resistance score (.52), number of previous transfers for extended care (.51), BPRS-A psychological discomfort score (-.37), BPRS-A positive symptoms score (.32), and marital status (-.13).
Four variables were replicated in the identical analysis conducted on the second sample (F=70.08, df=4, 1,210, p<.001). Number of previous admissions to the Harris County Psychiatric Center and marital status were not retained. In descending order of importance, the discriminant coefficients were BPRS-A resistance score (.48), BPRS-A positive symptoms score (.45), previous referrals for extended care (.44), and BPRS-A psychological discomfort score (-.30).
A final discriminant analysis was conducted on the entire sample and included the four variables that had been identified as robust predictors across both the primary and replication samples. These four variables were also found to be significant predictors in this final analysis (F=146.49, df=4, 2,425, p<.001); in descending order of importance, they were BPRS-A resistance score (.50), number of previous referrals for extended care (.49), BPRS-A positive symptoms score (.40), and BPRS-A psychological discomfort score (-.35). When this model was used, classification accuracy was 70 percent for extended hospitalization and 80 percent for community discharge. Overall classification accuracy was 78 percent.
This study focused on outlining the relationship between the demographic, hospitalization history, and clinical variables assessed at patients' admission to a psychiatric hospital and the patients' need for continued hospitalization. The use of four predictor variables in a discriminant function analysis accurately predicted in 78 percent of the cases whether a patient would be discharged to the community or would require extended care. As there are no statistical guidelines to address the magnitude of the proportional chance versus predictive accuracy differential (
+53), the clinical significance of our model must be evaluated.
Eighty-four percent of the patients in the sample were discharged to the community after short-term treatment at the hospital; therefore, on the basis of chance alone, the probability that medical personnel would have predicted this outcome was 84 percent. Our model correctly predicted this outcome in 80 percent of the cases; therefore, the utility of the model for identifying this population was minimal.
However, on the basis of chance alone, the probability of clinicians' correctly predicting that a patient would be transferred for extended care was only 16 percent. In this case, the model's accurate prediction in 70 percent of the cases represents a dramatic improvement in the ability to identify these individuals at admission. The replicability of our findings across two samples, together with an almost fourfold increase over that expected by chance, supported the clinical significance of this model.
In this model, three of the four variables most highly associated with the need for extended care were subscale scores on the BPRS-A. Given that these scores accounted for greater variance in predicting extended care than more traditional predictors, this finding is provocative, and it has several potential implications. First, as researchers have acknowledged, a multitude of variables have been associated with high levels of service use (
+9,
+54). Even though our data were collected from a sizable patient sample, several variables associated with length of stay were found to be unreliable. Thus, in this area of research, the importance of using a replication paradigm has been demonstrated. To further explore the validity of the findings, the potential utility of BPRS-A subscales in predicting use of mental health services should be evaluated at other mental health facilities.
Second, many of the discrepancies among variables associated with extended care found in previous studies may reflect institution-specific differences in staff, treatment strategies, and the nature of aftercare services. The BPRS-A may provide standardized values that can help identify at-risk patients, regardless of treatment facility.
Third, considering the relative ease with which the BPRS-A can be integrated into clinical practice, this rating scale may be a practical and valuable screening tool when patients are admitted for acute care. It may be most valuable as a means of more efficiently targeting patients who need more intensive assessment as well as specialized therapeutic and pharmacological interventions. Fourth, because such patients also are most likely to return to the hospital (
+7), early identification may allow for more appropriate aftercare arrangements—for example, providing family education and ensuring medication compliance. Finally, the BPRS-A may be a particularly valuable predictive and diagnostic measure for patients who are admitted involuntarily or in a psychotic state and are thus unwilling or unable to cooperate in their own evaluation.