The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

A key aspect of psychiatric rehabilitation is supporting individuals with serious mental illness in reaching personal goals. This study aimed to investigate whether various aspects of the working alliance predict successful goal attainment and whether goal attainment improves subjective quality of life, independent of the rehabilitation approach used.

Methods:

Secondary analyses were conducted of data from a Dutch randomized clinical trial on goal attainment by individuals supported with the Boston University approach to psychiatric rehabilitation (N=80) or a generic approach (N=76). Working alliance was measured with the Working Alliance Inventory (WAI) from the practitioner's perspective. Rehabilitation practitioners had backgrounds in social work, nursing, or vocational rehabilitation. Multiple logistic regression and multiple regression analyses explored effects of working alliance on goal attainment and of goal attainment on subjective quality of life at 24 months. Analyses were controlled for client- and process-related predictors, baseline quality of life, and rehabilitation approach.

Results:

The WAI goal subscale predicted goal attainment at 24 months. No effect was found for the bond or task subscale. Goal attainment significantly predicted quality of life at 24 months. These effects were independent of the rehabilitation approach used.

Conclusions:

A good bond between client and practitioner is not enough to attain successful rehabilitation outcomes. Findings suggest that it is important to discuss clients’ wishes and ambitions and form an agreement on goals. Attaining rehabilitation goals directly influenced the subjective quality of life of individuals with serious mental illness, which underscores the importance of investing in these forms of client support.

Psychiatric rehabilitation is designed to help individuals with serious mental illnesses develop the skills and access the resources needed to be successful and satisfied in the living, working, learning, and social environments of their choice (1). An important aspect of psychiatric rehabilitation is supporting these individuals in exploring and achieving personal goals (24). The ability to make decisions about personal goals can be regarded as essential to a high quality of living for all individuals, including those with serious mental illness (5,6). In fact, personal goal attainment is one of the outcomes most highly valued by mental health care consumers (6).

Being able to set and reach personally important goals has been found to increase autonomy, empowerment, well-being, self-confidence, and confidence in achieving future goals among individuals with serious mental illness (68). Goal setting and attainment link elements such as hope, responsibility, personal identity, and meaning in life and are therefore essential to recovery (9,10). It is also assumed that personal goal attainment will improve quality of life, which is often impaired among individuals with serious mental illness (11,12).

Working toward personal goals can be complicated for individuals with long-term mental illnesses, who may experience serious difficulties in retaining control over their lives. These difficulties may be caused by restrictions in the ability to take care of oneself; needs for support regarding housing, work, and social relations; and external factors, such as public stigma and the inability of others to see beyond symptoms. In addition, there is the “why try” effect, which encompasses self-stigmatization and anticipated discrimination and reduces self-esteem and self-efficacy, thus discouraging the pursuit of personally meaningful goals (6,13,14).

As a consequence, psychiatric rehabilitation approaches have been developed that support these individuals in exploring their wishes and achieving personal goals, including individual placement and support (15), which focuses on employment and education; illness management and recovery (16), which focuses on illness self-management and personal goal attainment; and the Boston University approach to psychiatric rehabilitation (BPR) (1). BPR supports individuals with exploring, choosing, and achieving goals related to housing, education, work, and social contacts. BPR was found to have positive effects on the attainment of self-chosen rehabilitation goals; social contacts and societal participation (17,18); personal and social functioning (19); quality of life and symptoms (18,20); and empowerment, psychosocial functioning, and needs for care (18).

Although BPR and other structured psychiatric rehabilitation approaches have been found to increase psychiatric rehabilitation success in terms of goal attainment, it is not clear what mechanisms are responsible for positive outcomes. The question also arises whether it is the specific character and content of each approach or some general factor that underlies rehabilitation success.

In the past decades, working alliance has emerged as a possible general factor explaining psychiatric rehabilitation success (21,22). It was found to have a positive influence on symptoms, level of functioning, social skills, quality of life, medication compliance, days of homelessness, and satisfaction with the care received (2325). The working alliance can be described as a genuine cooperation between client and practitioner characterized by agreement on counseling goals, a shared commitment to the tasks of counseling, and the development of a personal bond between both actors (2628). Previous research showed that working alliance robustly predicts rehabilitation outcome (24,29,30). Gehrs and Goering (31), for instance, found that the quality of the working alliance was positively related to rehabilitation goal attainment. However, the evidence for this specific relationship is sparse, and it remains unclear which aspects of the working alliance might cause this effect. Therefore, the first aim of this study was to investigate which aspects of the working alliance predict goal attainment in rehabilitation for individuals with serious mental illness, independent of the rehabilitation approach used.

The second aim was to investigate whether goal attainment would lead to improvements in the subjective quality of life of individuals with serious mental illness. This aim was to test the implicit assumption that working toward rehabilitation goals not only generates satisfaction with realizing the goals themselves but also improves subjective well-being in a more general sense.

These aims were addressed by conducting a secondary analysis of data from a 24-month randomized clinical trial (RCT) by Swildens and colleagues (17). The RCT studied the effects of rehabilitation on goal attainment, comparing BPR with rehabilitation that was offered by practitioners with a more general background (generic rehabilitation [GR]).

Methods

Participants

Data were from a study that involved 156 individuals who were receiving inpatient and outpatient treatment at four mental health centers in both urban and rural regions in the Netherlands (17; ISRCTN73683215). The study was conducted between June 2005 and June 2009. Inclusion criteria were as follows: a serious mental illness, operationalized as a DSM-IV diagnosis; duration of service contact of at least two years; and enduring psychiatric disabilities. In addition, clients were eligible only if they expressed a desire for change in one of the rehabilitation areas (housing, education, work, and social contacts). Participants were recruited through their mental health care professionals. Individuals who had been in contact with a rehabilitation practitioner in the three months preceding baseline were excluded. Participants gave written informed consent, and the study was approved by the institutional review boards of the participating mental health centers. At 24-month follow-up, 122 participants completed the interview. A detailed description of design and methods used has been published elsewhere (17).

Measures

Working alliance.

The Working Alliance Inventory–practitioner perspective (WAI) was completed by the rehabilitation practitioner after the first three to four sessions and again after 24 months. It consists of 36 items that generate a total score and three subscale scores representing the different components of the working alliance: task (agreement about the tasks of the treatment or therapy and the responsibilities to perform these tasks), bond (between client and practitioner), and goal (agreement about the goals of treatment or therapy) (28,32,33).

Goal attainment.

Goal attainment (yes or no) from the client’s perspective was measured at 24 months by means of a structured interview used in previous studies (34,35). Participants could choose a specific personal rehabilitation goal to work on in the following rehabilitation areas: living situation, work and study, and social contacts. The distinction between attainment and no attainment of this goal was conservative, meaning that partial goal attainment was seen as no goal attainment. If a goal was adjusted during the study period, the adjusted goal was evaluated instead of the original goal. If no information was available, goal attainment was conservatively set to no goal attainment.

Quality of life.

The self-report short version of the World Health Organization Quality of Life instrument (WHOQOL-BREF) was scored at baseline and at 24 months. The WHOQOL-BREF encompasses 26 items and four domains: physical, psychological, social relationships, and environment. It shows good discriminant validity, content validity, and test-retest validity (36). Possible scores on the WHOQOL-BREF range from 1 to 5, with higher scores indicating more satisfaction.

Psychiatric symptoms.

Mental health practitioners or psychiatrists completed the 24-item extended version of the Brief Psychiatric Rating Scale (BPRS) (37,38) at baseline and 24 months. The BPRS uses a 7-point Likert scale and is a reliable and valid instrument (39,40) with good internal consistency (α>.70).

Sociodemographic information.

Client-related predictors were gathered through a structured interview scheme at the start of the study, and checks were performed at 24 months.

Procedure

Structured interviews with participants were administered by trained interviewers and took approximately 75 minutes to complete. Mental health professionals also completed questionnaires. Interviewers were blinded to treatment allocation. Participants and mental health professionals could not be blinded.

Rehabilitation

All participants were offered at least one individual rehabilitation session every three weeks, without a predefined maximum number of sessions. Half the participants (N=80) received these sessions from 39 practitioners experienced in the BPR. These practitioners had backgrounds in social work, nursing, or vocational rehabilitation and had completed additional training in BPR. This approach is designed to support individuals with serious mental illness in all life domains (housing, education, work, and social contacts). In BPR, individuals are aided in exploring their options and in choosing and realizing clearly defined goals. Support is aimed at increasing personal skills as well as learning to make use of other potential sources of help (4143). BPR consists of four phases: exploring, choosing, getting, and keeping rehabilitation goals (43,44). Each phase is accompanied by techniques that can be used by BPR practitioners to optimally support individuals in attaining their goals. Key to BPR is that the pace and direction of the process are directed by the individual. The practitioner facilitates the process and supports when necessary. Fidelity of BPR was measured with a fidelity scale (45) showing that 86% of 39 BPR practitioners worked according to model standards.

The other half of the participants (N=76) received support from 63 mental health practitioners also trained in social work, vocational rehabilitation, and nursing care but without BPR training. These practitioners also supported clients with their personal rehabilitation goals but without using a structured approach or standardized methodology (17). Both BPR and regular care practitioners received monthly supervision by supervisors using either BPR or generic mental health care methodology.

Data Analysis

Data were analyzed with SPSS, version 22.0, by using binary logistic regression for the categorical outcome measure of goal attainment (yes or no) and multiple linear regression for quality of life at 24 months. Student’s t tests were used to check differences in baseline characteristics between the BPR and GR groups and for quality of life at 24 months. Clusters of clients treated by the same practitioner were too small to conduct multilevel modeling. A possible clustering effect was dealt with by conducting a sensitivity analysis on a data set in which each practitioner had only one client (each first client) (46).

Two models were tested: model 1 with goal attainment as the dependent variable and working alliance as the predictor and model 2 with quality of life as the dependent variable and goal attainment as the predictor (Figure 1). Because the choice of control variables was theory driven, the two models contained slightly different variables. Model 1 was controlled for number of rehabilitation sessions and for client-related factors known to predict rehabilitation outcome: psychotic disorder, psychiatric symptoms (4749), duration in the mental health care, living situation (independent versus dependent) (41,50,51), education level (52), and recent work experience (49,50,53). Model 2 was controlled for factors found to influence quality of life, such as age, psychiatric symptoms, psychotic disorder, living situation, having a life partner, and recent work experience (54,55). Working alliance was omitted in this model because of its expected association with goal attainment.

FIGURE 1.

FIGURE 1. Two models of predictors of goal attainment by individuals with serious mental illness and the relationship between goal attainment and subjective quality of lifea

aModel 1: goal attainment as dependent variable and working alliance plus control variables as predictors; model 2: quality of life as dependent variable and goal attainment plus control variables as predictors. Rehabilitation type (Boston University approach or generic approach) was added as a control variable in both models.

Finally, rehabilitation type was added as a control variable in both models because the RCT by Swildens and colleagues (17) showed a significant effect for BPR on goal attainment and the study reported here focused on an effect of working alliance, independent of the effect of rehabilitation type. Variables with correlation coefficients higher than .75 or variance inflation factors >5 were not added to the model to avoid multicollinearity.

A stepwise procedure was applied in which variables were added in three blocks. For goal attainment as the outcome, the main predictors of interest—WAI task, bond, and goal subscales—were added first, and the following client- and process-related predictors were added in the second block: duration in mental health care, psychotic disorder, recent work experience, education level, living situation, psychiatric symptoms, and number of rehabilitation sessions. In the third block, intervention type was added.

For the model with quality of life at 24 months as the outcome, goal attainment was added first, followed by client-related predictors—age, psychotic disorder, recent work experience, living situation, psychiatric symptoms, and having a life partner. In the third block, intervention type was added. This model was controlled for baseline quality of life. Effect sizes were expressed as odds ratios for the logistic regression analysis, and Cohen’s f2 was calculated for the multiple regression analysis (56).

Results

Baseline Characteristics

Baseline characteristics of the participants and intervention are presented in Table 1. There were no significant differences between the two study groups (17).

TABLE 1. Baseline characteristics of 156 persons with serious mental illness receiving psychiatric rehabilitation

CharacteristicN%
Gender
 Male7649
 Female8051
Recent employment experience
 Yes1712
 No12888
Living situation
 Independent8756
 Hospitalized or in sheltered accommodation6944
Education levela
 Low11675
 Medium-high3825
Main diagnosis
 Psychotic disorder6442
 Bipolar disorder128
 Depressive or anxiety disorder2315
 Personality disorder2919
 Other2316
Age (M±SD)42.41±13.94
Psychiatric symptoms (M±SD)b46.27±12.37
Duration in mental health care (M±SD years)12.20±8.63
Baseline quality of life (M±SD)c82.76±13.74
N of rehabilitation sessions attended (M±SD)12.39±9.22
Working alliance (M±SD)d
 Bond subscale48.06±6.07
 Task subscale46.85±6.88
 Goal subscale43.85±7.03

aInternational standard classification of education levels: low, 0–2; medium-high, 3–7 (52)

bMeasured by the Brief Psychiatric Rating Scale. Possible scores range from 1 to 7, with higher scores indicating more severe symptoms.

cMeasured by the short version of the World Health Organization Quality of Life instrument. Possible scores range from 1 to 5, with higher scores indicating more satisfaction.

dMeasured by the Working Alliance Inventory–practitioner perspective. Possible scores on each subscale range from 1 to 7, with higher scores indicating more agreement with the statement about the working alliance.

TABLE 1. Baseline characteristics of 156 persons with serious mental illness receiving psychiatric rehabilitation

Enlarge table

Goal Attainment

During the study, 54% (N=84) of participants switched goals. After 24 months, 39% (N=61) of participants were reported to have fully reached their goals. Table 2 shows that higher scores on the WAI goal subscale and having received BPR predicted goal attainment at 24 months. None of the other predictors were found to have a significant effect.

TABLE 2. Binary logistic regression of predictors of goal attainment by persons with serious mental illness receiving BPR or generic psychiatric rehabilitationa

VariableBSEpOR95% CI
Working Alliance Inventory score
 Bond subscale–.01.06.81.99.88–1.10
 Task subscale–.08.06.18.93.83–1.04
 Goal subscale.12.06.041.131.01–1.27
Duration in mental health care–.04.03.17.96.91–1.02
Psychosis.02.45.961.02.43–2.44
Recent work experience–.31.63.62.74.22–2.50
Education level–.64.52.22.53.19–1.47
Living situation.06.45.891.07.44–2.57
Psychiatric symptoms –.003.02.871.00.97–1.04
N of rehabilitation sessions attended.32.25.201.38.84–2.27
Rehabilitation type.99.42.022.701.19–6.13

aBPR, Boston University approach to psychiatric rehabilitation. N=112, R2=.152

TABLE 2. Binary logistic regression of predictors of goal attainment by persons with serious mental illness receiving BPR or generic psychiatric rehabilitationa

Enlarge table

The sensitivity analysis with only one case per practitioner showed similar results: WAI goal score (B=.16, SE=.08, p=.04) and intervention type (B=1.27, SE=.57, p=.03) significantly predicted goal attainment (R2=.246) (data not in table).

Quality of Life

At 24 months, there was a significant improvement in quality of life compared with baseline for all participants who were interviewed. The mean±SD WHOQOL-BREF scores were 83.95±13.64 at baseline and 88.22±15.09 at 24 months (t=−3.52, df=115, p=.001).

Goal attainment significantly added to a positive change in quality of life at 24 months (Table 3), as did age. The sensitivity analysis yielded the same result for goal attainment (B=7.63, SE=3.15, p=.02; R2=.410, R2adj=.312; Cohen’s f2=.695) (data not in table).

TABLE 3. Predictors of quality of life at 24 months among persons with serious mental illness receiving BPR or generic psychiatric rehabilitationa

VariableBSEp95% CI
Goal attainment6.722.80.021.16 to 12.28
Age.30.11.01.08 to .53
Psychosis2.282.57.38–2.84 to 7.39
Recent work experience6.053.24.07–.38 to 12.48
Living situation3.312.55.20–1.76 to 8.38
Psychiatric symptoms –.18.13.16–.44 to .07
Having a life partner–.402.69.88–5.75 to 4.95
Baseline quality of life.54.10<.001.33 to .74
Rehabilitation type1.792.43.46–3.03 to 6.61

aBPR, Boston University approach to psychiatric rehabilitation. N=101; R2=.397, R2adj=.330; Cohen’s f2=.658. Results are from multiple linear regression.

TABLE 3. Predictors of quality of life at 24 months among persons with serious mental illness receiving BPR or generic psychiatric rehabilitationa

Enlarge table

Discussion

The aim of this study was to explore predictors of successful rehabilitation goal attainment by focusing on working alliance as a possible generic determinant independent of rehabilitation methodology. Furthermore, the assumption underlying the emphasis on goal attainment in state-of-the-art rehabilitation was put to the test: does quality of life improve when rehabilitation goals are attained?

Apart from a significant effect for intervention type in accordance with the findings of Swildens and colleagues (17), the goal component of the working alliance proved to be the main predictor of successful goal attainment, whereas the personal bond between practitioner and client and a shared commitment to the tasks of rehabilitation did not predict goal attainment. This finding suggests that agreeing with the client on goals is more important than simply establishing a personal bond or agreeing on how to achieve these goals.

Furthermore, this study showed a significant effect of goal attainment on improvement in 24-month quality of life, thus supporting the assumption that agreeing on goals helps individuals with serious mental illness to enhance their quality of life. This positive effect provides a wider context for the importance of working on personal goals. Working on goals with individuals with serious mental illness is not only important in itself but also offers a useful tool to help clients gain control and live meaningful lives according to their own wishes.

The predictive effect of working alliance on therapeutic outcome has been reported in meta-analyses on psychotherapeutic interventions and seems to be very consistent (30,57,58). Although it could be argued that a good outcome promotes positive evaluation of the relationship with the therapist instead of the other way around, in this study the relationship was evaluated at the start of the intervention, thus clearly preceding outcome. Gehrs and Goering (31) also found that working alliance was positively related to goal attainment, but, as in most studies, they treated the client-practitioner relationship as a single concept without discerning aspects responsible for its effect on outcome. The findings of the study reported here make clear that agreement on goals is particularly important for goal attainment. This is in line with the concept of shared decision making, which emphasizes the importance of listening to an individual’s goals, thus encouraging empowerment (5961). Our findings stress that this process also plays a central role in successful goal attainment.

A limitation of this study was that working alliance was measured only from the practitioner’s point of view. Working alliance from clients’ point of view was found to be an even stronger predictor of outcome (62,63). However, Martin and colleagues (30) found that practitioner ratings were only slightly less reliable than client ratings, and Ruchlewska and colleagues (64) found that practitioner-rated working alliance was a better predictor of completion of a crisis plan than was the client-rated alliance. It has been suggested that the different views may reflect different but related concepts of the working relationship, because client and practitioner ratings are often associated with different variables (65,66).

Furthermore, the WAI and other frequently used measures of the working alliance were developed from the context of psychotherapy and may lack aspects of the working alliance that are specific to psychiatric rehabilitation settings. Examples of such aspects are the sometimes involuntary nature of the relationship, because clients in long-term care are often not able to freely choose their mental health practitioners, as well as the dual role of practitioners, who need to facilitate their clients’ autonomy but are also responsible for their health and safety (67). Therefore, it would be useful to develop measures that specifically capture the working alliance in rehabilitation settings. A final limitation was the fact that participants were included only if they had a desire for change. Therefore, results may not apply to less motivated individuals.

Agreeing on goals is specific but not exclusive to a BPR-based approach. Our findings suggest that agreement on goals is an important facilitator of goal attainment for rehabilitation practitioners, independent of their background and rehabilitative approach. Nevertheless, the effect of rehabilitation type indicates that methodology-specific aspects also influence the effectiveness of a structured rehabilitation approach such as BPR. This is also supported by the fact that the model explained only 15% of the variance in goal attainment. The rest of the variance could be explained by methodology-specific or other general factors not investigated in this study. Future research directed at uncovering these factors could help further elucidate the mechanisms responsible for goal attainment among individuals with serious mental illness.

Conclusions

It is often stressed that a positive working alliance forms the basis for a fruitful therapeutic process. This study showed that this is true but only to the extent that practitioner and client agree on rehabilitation goals. Just forming a bond or agreeing on the tasks required to achieve the goals did not predict goal attainment. These findings imply that rehabilitation practitioners could improve outcome by discussing clients’ wishes and goals and by setting a goal that is mutually agreed on. This focus will improve rehabilitation as well as the subjective quality of life of those involved. These results are not limited to a specific rehabilitation approach but rather reflect general predictive mechanisms of rehabilitation goal attainment and quality of life, which makes them applicable to rehabilitation practitioners from various backgrounds and perhaps even to other mental health care providers.

Ms. Sanches and Dr. van Weeghel are with the School of Social and Behavioral Sciences, Tilburg University, Tilburg, the Netherlands. Ms. Sanches is also with Altrecht Mental Health Care, Utrecht, the Netherlands, where Dr. Swildens is affiliated. Dr. van Weeghel is also with the Parnassia Group, Dijk en Duin, the Netherlands. Dr. van Busschbach is with the Rob Giel Research Center, University Center of Psychiatry, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands, and with the University of Applied Sciences Windesheim, Zwolle, the Netherlands. Dr. Michon is with the Department of Long-Term Care and Reintegration, Trimbos Institute, Utrecht.
Send correspondence to Ms. Sanches (e-mail: ).

Preliminary analyses of the data were presented at the European Network for Mental Health Service Evaluation conference, Malaga, Spain, October 1–3, 2015, and at the Phrenos Psychosis Conference, Zwolle, Netherlands, December 3, 2015.

This research was funded by a grant from the Netherlands Organisation for Health Research and Development (ZonMw) (100-03-001 and 100-003-007).

The authors report no financial relationships with commercial interests.

References

1 Anthony WA, Farkas MD: The Essential Guide to Psychiatric Rehabilitation Practice. Boston, Boston University, Center for Psychiatric Rehabilitation, 2012Google Scholar

2 Killaspy H, Harden C, Holloway F, et al.: What do mental health rehabilitation services do and what are they for? A national survey in England. Journal of Mental Health 14:157–165, 2005CrossrefGoogle Scholar

3 Rössler W: Psychiatric rehabilitation today: an overview. World Psychiatry 5:151–157, 2006MedlineGoogle Scholar

4 Pratt CW, Gill KJ, Barrett NM, et al.: Psychiatric Rehabilitation. New York, Academic Press, 2013Google Scholar

5 Emmons RA: Personal goals, life meaning, and virtue: wellsprings of a positive life; in Flourishing: Positive Psychology and the Life Well-Lived. Edited by Keyes CLM, Haidt J. Washington, DC, American Psychological Association, 2003CrossrefGoogle Scholar

6 Liberman RP, Kopelowicz A: Teaching persons with severe mental disabilities to be their own case managers. Psychiatric Services 53:1377–1379, 2014LinkGoogle Scholar

7 Hvalsøe B, Josephsson S: Characteristics of meaningful occupations from the perspective of mentally ill people. Scandinavian Journal of Occupational Therapy 10:61–71, 2003CrossrefGoogle Scholar

8 Clarke SP, Oades LG, Crowe TP, et al.: The role of symptom distress and goal attainment in promoting aspects of psychological recovery for consumers with enduring mental illness. Journal of Mental Health 18:389–397, 2009CrossrefGoogle Scholar

9 Andresen R, Oades L, Caputi P: The experience of recovery from schizophrenia: towards an empirically validated stage model. Australian and New Zealand Journal of Psychiatry 37:586–594, 2003Crossref, MedlineGoogle Scholar

10 Noordsy D, Torrey W, Mueser K, et al.: Recovery from severe mental illness: an intrapersonal and functional outcome definition. International Review of Psychiatry 14:318–326, 2002CrossrefGoogle Scholar

11 Pitkänen A, Hätönen H, Kuosmanen L, et al.: Individual quality of life of people with severe mental disorders. Journal of Psychiatric and Mental Health Nursing 16:3–9, 2009Crossref, MedlineGoogle Scholar

12 Gupta S, Kulhara P, Verma SK: Quality of life in schizophrenia and dysthymia. Acta Psychiatrica Scandinavica 97:290–296, 1998Crossref, MedlineGoogle Scholar

13 Rüsch N, Angermeyer MC, Corrigan PW: Mental illness stigma: concepts, consequences, and initiatives to reduce stigma. European Psychiatry 20:529–539, 2005Crossref, MedlineGoogle Scholar

14 Corrigan PW, Larson JE, Rüsch N: Self-stigma and the “why try” effect: impact on life goals and evidence-based practices. World Psychiatry 8:75–81, 2009Crossref, MedlineGoogle Scholar

15 Drake RE, Becker DR: IPS Supported Employment: An Evidence-Based Approach. New York, Oxford University Press, 2013Google Scholar

16 Mueser KT, Meyer PS, Penn DL, et al.: The Illness Management and Recovery program: rationale, development, and preliminary findings. Schizophrenia Bulletin 32(suppl 1):S32–S43, 2006Crossref, MedlineGoogle Scholar

17 Swildens W, van Busschbach JT, Michon H, et al.: Effectively working on rehabilitation goals: 24-month outcome of a randomized controlled trial of the Boston psychiatric rehabilitation approach. Canadian Journal of Psychiatry 56:751–760, 2011Crossref, MedlineGoogle Scholar

18 Svedberg P, Svensson B, Hansson L, et al.: A 2-year follow-up study of people with severe mental illness involved in psychosocial rehabilitation. Nordic Journal of Psychiatry 68:401–408, 2014Crossref, MedlineGoogle Scholar

19 Gigantesco A, Vittorielli M, Pioli R, et al.: The VADO approach in psychiatric rehabilitation: a randomized controlled trial. Psychiatric Services 57:1778–1783, 2006LinkGoogle Scholar

20 Shern DL, Tsemberis S, Anthony W, et al.: Serving street-dwelling individuals with psychiatric disabilities: outcomes of a psychiatric rehabilitation clinical trial. American Journal of Public Health 90:1873–1878, 2000Crossref, MedlineGoogle Scholar

21 Priebe S, Gruyters T: Patients’ assessment of treatment predicting outcome. Schizophrenia Bulletin 21:87–94, 1995Crossref, MedlineGoogle Scholar

22 Priebe S, McCabe R, Bullenkamp J, et al.: Structured patient-clinician communication and 1-year outcome in community mental healthcare: cluster randomised controlled trial. British Journal of Psychiatry 191:420–426, 2007Crossref, MedlineGoogle Scholar

23 de Leeuw M, Van Meijel B, Grypdonck M, et al.: The quality of the working alliance between chronic psychiatric patients and their case managers: process and outcomes. Journal of Psychiatric and Mental Health Nursing 19:1–7, 2012Crossref, MedlineGoogle Scholar

24 Howgego IM, Yellowlees P, Owen C, et al.: The therapeutic alliance: the key to effective patient outcome? A descriptive review of the evidence in community mental health case management. Australian and New Zealand Journal of Psychiatry 37:169–183, 2003Crossref, MedlineGoogle Scholar

25 Chinman MJ, Rosenheck R, Lam JA: The case management relationship and outcomes of homeless persons with serious mental illness. Psychiatric Services 51:1142–1147, 2000LinkGoogle Scholar

26 Lustig DC, Strauser DR, Rice ND, et al.: The relationship between working alliance and rehabilitation outcomes. Rehabilitation Counseling Bulletin 46:24–32, 2002CrossrefGoogle Scholar

27 Andrusyna TP, Tang TZ, DeRubeis RJ, et al.: The factor structure of the Working Alliance Inventory in cognitive-behavioral therapy. Journal of Psychotherapy Practice and Research 10:173–178, 2001MedlineGoogle Scholar

28 Bordin ES: The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy 16:252, 1979CrossrefGoogle Scholar

29 Oades L, Deane F, Crowe T, et al.: Collaborative recovery: an integrative model for working with individuals who experience chronic and recurring mental illness. Australasian Psychiatry 13:279–284, 2005MedlineGoogle Scholar

30 Martin DJ, Garske JP, Davis MK: Relation of the therapeutic alliance with outcome and other variables: a meta-analytic review. Journal of Consulting and Clinical Psychology 68:438–450, 2000Crossref, MedlineGoogle Scholar

31 Gehrs M, Goering P: The relationship between the working alliance and rehabilitation outcomes of schizophrenia. Psychosocial Rehabilitation Journal 18:43, 1994CrossrefGoogle Scholar

32 Horvath AO, Greenberg LS: Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology 36:223, 1989CrossrefGoogle Scholar

33 Vertommen H, Vervaeke G: Work Alliance Questionnaire: Translation for Experimental Use of the WAI [in Dutch]. Brussels, Katholieke Universiteit Leuven, Department of Psychology, 1990Google Scholar

34 van Busschbach J, Wiersma D: Does rehabilitation meet the needs of care and improve the quality of life of patients with schizophrenia or other chronic mental disorders? Community Mental Health Journal 38:61–70, 2002Crossref, MedlineGoogle Scholar

35 Swildens W, Van Keijzerswaard A, Van Wel T, et al.: Individual rehabilitation for chronic psychiatric patients: open research [in Dutch]. Tijdschrift voor Psychiatrie 45:15–26, 2003Google Scholar

36 WHOQOL Group: Development of the World Health Organization WHOQOL-BREF quality of life assessment. Psychological Medicine 28:551–558, 1998Crossref, MedlineGoogle Scholar

37 Ventura J, Lukoff D, Nuechterlein KH, et al.: Manual for the expanded Brief Psychiatric Rating Scale. International Journal of Methods in Psychiatric Research 3:221–224, 1993Google Scholar

38 Ventura J, Lukoff D, Nuechterlein KH, et al.: Brief Psychiatric Rating Scale (BPRS) Expanded Version (4.0): scales, anchor points and administration manual. International Journal of Methods in Psychiatric Research 3:227–244, 1993Google Scholar

39 Ventura J, Nuechterlein KH, Subotnik KL, et al.: Symptom dimensions in recent-onset schizophrenia and mania: a principal components analysis of the 24-item Brief Psychiatric Rating Scale. Psychiatry Research 97:129–135, 2000Crossref, MedlineGoogle Scholar

40 Dingemans PMAJ, Linszen DH, Lenior ME, et al.: Component structure of the expanded Brief Psychiatric Rating Scale (BPRS-E). Psychopharmacology 122:263–267, 1995Crossref, MedlineGoogle Scholar

41 Anthony WA, Cohen MR, Farkas MD, et al.: Psychiatric Rehabilitation. Boston, Boston University, Center for Psychiatric Rehabilitation, 2002Google Scholar

42 Farkas M: Identifying psychiatric rehabilitation interventions: an evidence- and value-based practice. World Psychiatry 5:161–162, 2006MedlineGoogle Scholar

43 Korevaar L, Dröes J, Van Wel T: Manual for the Boston University Approach to Psychiatric Rehabilitation [in Dutch]. Bilthoven, Netherlands, Stichting Rehabilitatie '92, 2010Google Scholar

44 Anthony WA, Farkas MD: A Primer on the Psychiatric Rehabilitation Process. Boston, Boston University, Center for Psychiatric Rehabilitation, 2009Google Scholar

45 Luijten E: Fidelity Measure Process Support Boston Psychiatric Rehabilitation [in Dutch]. Bilthoven, Netherlands, Stichting Rehabilitatie '92, 2004Google Scholar

46 Gillman MW, Rifas-Shiman SL, Frazier AL, et al.: Family dinner and diet quality among older children and adolescents. Archives of Family Medicine 9:235–240, 2000Crossref, MedlineGoogle Scholar

47 Cook JA, Razzano L: Vocational rehabilitation for persons with schizophrenia: recent research and implications for practice. Schizophrenia Bulletin 26:87–103, 2000Crossref, MedlineGoogle Scholar

48 Evans JD, Bond GR, Meyer PS, et al.: Cognitive and clinical predictors of success in vocational rehabilitation in schizophrenia. Schizophrenia Research 70:331–342, 2004Crossref, MedlineGoogle Scholar

49 Tsang HW, Leung AY, Chung RC, et al.: Review on vocational predictors: a systematic review of predictors of vocational outcomes among individuals with schizophrenia: an update since 1998. Australian and New Zealand Journal of Psychiatry 44:495–504, 2010Crossref, MedlineGoogle Scholar

50 Nordt C, Müller B, Rössler W, et al.: Predictors and course of vocational status, income, and quality of life in people with severe mental illness: a naturalistic study. Social Science and Medicine 65:1420–1429, 2007Crossref, MedlineGoogle Scholar

51 Rogers ES, Anthony WA, Cohen M, et al.: Prediction of vocational outcome based on clinical and demographic indicators among vocationally ready clients. Community Mental Health Journal 33:99–112, 1997Crossref, MedlineGoogle Scholar

52 European Union, UNESCO Institute for Statistics (ISCED 2011): Operational Manual: Guidelines for Classifying National Education Programmes and Related Qualifications. Paris, Organisation for Economic Co-operation and Development Publishing, 2015Google Scholar

53 Catty J, Lissouba P, White S, et al.: Predictors of employment for people with severe mental illness: results of an international six-centre randomised controlled trial. British Journal of Psychiatry 192:224–231, 2008Crossref, MedlineGoogle Scholar

54 Priebe S, Reininghaus U, McCabe R, et al.: Factors influencing subjective quality of life in patients with schizophrenia and other mental disorders: a pooled analysis. Schizophrenia Research 121:251–258, 2010Crossref, MedlineGoogle Scholar

55 Holloway F, Carson J: Quality of life in severe mental illness. International Review of Psychiatry 14:175–184, 2002CrossrefGoogle Scholar

56 Cohen J: Statistical Power Analysis for the Behavioral Sciences. Hillside, NJ, Erlbaum, 1988Google Scholar

57 Horvath AO, Del Re A, Flückiger C, et al: Alliance in individual psychotherapy; in Psychotherapy Relationships That Work: Evidence-Based Responsiveness. Edited by Norcross JC. New York, Oxford University Press, 2011Google Scholar

58 Flückiger C, Del Re AC, Wampold BE, et al.: How central is the alliance in psychotherapy? A multilevel longitudinal meta-analysis. Journal of Counseling Psychology 59:10–17, 2012Crossref, MedlineGoogle Scholar

59 Drake RE, Deegan PE, Rapp C: The promise of shared decision making in mental health. Psychiatric Rehabilitation Journal 34:7–13, 2010Crossref, MedlineGoogle Scholar

60 Rudnick A: The goals of psychiatric rehabilitation: an ethical analysis. Psychiatric Rehabilitation Journal 25:310–313, 2002Crossref, MedlineGoogle Scholar

61 Hamann J, Leucht S, Kissling W: Shared decision making in psychiatry. Acta Psychiatrica Scandinavica 107:403–409, 2003Crossref, MedlineGoogle Scholar

62 Horvath AO, Symonds BD: Relation between working alliance and outcome in psychotherapy: a meta-analysis. Journal of Counseling Psychology 38:139–149, 1991CrossrefGoogle Scholar

63 Luborsky L: Therapeutic alliances as predictors of psychotherapy outcomes: factors explaining the predictive success; in The Working Alliance: Theory, Research, and Practice. Oxford, United Kingdom, Wiley, 1994Google Scholar

64 Ruchlewska A, Kamperman AM, Wierdsma AI, et al.: Determinants of completion and use of psychiatric advance statements in mental health care in the Netherlands. Psychiatric Services 67:858–863, 2016LinkGoogle Scholar

65 Reininghaus U, McCabe R, Slade M, et al.: The validity of patient- and clinician-rated measures of needs and the therapeutic relationship in psychosis: a pooled analysis. Psychiatry Research 209:711–720, 2013Crossref, MedlineGoogle Scholar

66 Ruchlewska A, Kamperman AM, van der Gaag M, et al.: Working alliance in patients with severe mental illness who need a crisis intervention plan. Community Mental Health Journal 52:102–108, 2016Crossref, MedlineGoogle Scholar

67 Farrelly S, Brown G, Szmukler G, et al.: Can the therapeutic relationship predict 18 month outcomes for individuals with psychosis? Psychiatry Research 220:585–591, 2014Crossref, MedlineGoogle Scholar