The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.201400405

Abstract

Objective:

The aim was to apply a structured questionnaire, the Inventory of Stigmatizing Experiences (ISE), to study experiences of stigma (associated stigma) among relatives of persons with schizophrenia who attended outpatient clinics, using an approach based on assertive community treatment in a Swedish major city. A second aim was to explore the relationship between associated stigma and overall burden among these relatives.

Methods:

Relatives (N=65) of persons taking oral antipsychotics who attended outpatient clinics completed a mailed questionnaire that included the ISE and the Burden Inventory for Relatives of Persons with Psychotic Disturbances. Associations were analyzed with ordinal logistic regression.

Results:

More than half of the relatives (53%) stated that their ill relative had been stigmatized, but only 18% (N=11) reported that they themselves had been stigmatized (responses of sometimes, often, or always). One-fifth of the relatives (23%) acknowledged that they avoided situations that might elicit stigma. Neither experienced stigma nor anticipated stigma was associated with overall burden level in ordinal logistic regression models. The impact of stigma on both the relative’s personal quality of life and the family’s quality of life were both significantly associated with overall burden after adjustment for patient age and level of functioning.

Conclusions:

Stigma had an impact on quality of life at the personal and family levels, and this was associated with overall burden. Increased awareness among service providers may decrease the impact of stigma on relatives, but associations need to be examined in larger studies in diverse cultures and treatment settings.

Experiences of stigma are common among persons with schizophrenia, which has been shown in varied geographic and cultural settings (1). Relatives of and others with close social connections to a person with schizophrenia may also experience stigma. This phenomenon, first described in the 1960s (2), is known by several terms, including “courtesy stigma,” “stigma by association,” and “associated stigma.” Associated stigma was reported by 16% of relatives in a U.S. study (3). The corresponding percentage in a study in Morocco was 41% (4). Family members sometimes avoid situations that might elicit stigma. This form of stigma, known as “anticipated stigma,” was reported by half of the family members in a U.S. study (5).

Qualitative studies capture the depth and breadth of family experiences of stigma (69). The impact of stigma has been quantified in several family studies. Among Swedish family members, 83% reported that stigma affected at least one psychological domain; proportions of the sample endorsing individual stigma items ranged from 6% to 40% (10). In a U.S. study, family members’ endorsement of items related to stigma impact ranged from 8% to 22% (11). To aid the quantification of the scope and impact of relatives’ experiences, Canadian researchers developed the family version of the Inventory of Stigmatizing Experiences (ISE) (12). In a field test of the ISE family version, 20% of participants often or always felt stigmatized because of the relative’s mental illness, and half stated that experiences of stigma affected the family’s quality of life.

Being part of a well-functioning family is important for recovery in schizophrenia (13), and stigma may contribute to the family’s overall burden. In a study in China, 28% of the participants reported moderate to severe impact of stigma on family life (14). In a Hong Kong study, stigma was shown to lead to social isolation, resulting in lack of support, which generated increased family burden (15). In a U.S. study that focused on Latino caregivers, 40% were at risk of depression, which was related to perceived stigma (16). Both experienced stigma and anticipated stigma generated feelings of burden among relatives of individuals with first-episode schizophrenia in a study in Australia (6). Findings from studies that focus on families of patients experiencing a first episode of psychosis cannot be directly extrapolated to families of persons with long-term illness, because there is evidence that burden may change over time (17). Further, the amount of burden reported by a family member varies across cultures and may be influenced by the availability of mental health services (18).

The aim of this study was to use the structured ISE questionnaire to explore stigma experiences of relatives of persons with schizophrenia in a treatment setting in which outpatient practices include components of assertive community treatment (ACT) (19,20). A second aim was to examine the relationship between relatives’ stigma experiences and overall burden as measured by the Burden Inventory for Relatives of Persons with Psychotic Disturbances (BIRP) (21).

Methods

Participants

Participants were recruited from the larger COAST study (Cognition, Adherence, and Stigma in Schizophrenia), which was conducted to examine adherence to oral antipsychotics (22) and experiences of stigma (23) among outpatients in the Gothenburg, Sweden, area. Inclusion criteria were age 18–65, prescription of unsupervised oral antipsychotics, and a DSM-IV clinical diagnosis of schizophrenia or schizophrenia-like psychosis. Exclusion criteria were treatment with long-acting injectable medications, past-year inpatient care for substance use, acute suicide risk, severe intellectual impairment requiring special education, and the need for an interpreter. At the start of the study, patients (N=131) were asked to identify a family member or close friend who might be willing to respond to a mailed questionnaire. Eighty-five percent of the patients (N=111) provided names and addresses. Questionnaires were returned by 75 persons (68%). Three of these were excluded because the respondent was the patient’s professional caregiver, and another seven were excluded because of incomplete information, leaving a final sample of 65.

Procedure

Data were collected during 2008–2010. After approval by the patient, information about this study, along with consent forms and study questionnaires, was sent to the 65 relatives. Questionnaires were self-administered. Relatives who did not respond were mailed up to two reminders. All participating patients and their relatives provided written consent. The study was approved by the Regional Ethics Committee in Gothenburg.

Instruments

Family version of the ISE.

The family version of the ISE was used to measure stigma. The version employed in this study showed good reliability in a population of relatives of persons with a variety of psychiatric diagnoses (12). The ISE includes 15 sociodemographic items, followed by the Stigma Experience Scale (items 16–32) and the Stigma Impact Scale (items 33 a–d and 34 a–c). The Stigma Experience Scale measures the frequency of personal experiences of stigma, both actual and anticipated stigma, along with thoughts about public views of mental illness and coping strategies. Responses for items 16–20 are ascertained with a 5-point Likert scale (never, rarely, sometimes, often, and always), and items 25–27 and 29–32 have categorical responses (yes, no, and unsure). High internal consistency (Kuder-Richardson coefficient of reliability=.76) was reported by the developers of the scale (12). The scale also includes five items with qualitative free-text answers, but these were not analyzed in the study reported here.

For this study, responses on the Stigma Experience Scale were recoded into binary variables, where 1 reflected high expectation of stigma (sometimes, often, always, or yes) and 0 reflected low expectation (never, rarely, or no). The Stigma Impact Scale quantifies the impact of stigma on quality of life, social contexts, family relations, and self-esteem. Items 33 a–d focus on personal impact and items 34 a–c on familial impact. Responses on the Stigma Impact Scale are rated from 0 to 10, where 0 is the lowest possible impact and 10 is the highest possible negative impact. A high reliability coefficient (Cronbach’s α=.93) was reported for the Stigma Impact Scale (12).

BIRP.

Relatives’ perceived burden was rated with the BIRP. The instrument consists of ten items; items 1 and 2 focus on practical burden, items 3–6 examine emotional burden, and items 7–10 concern the relative’s own health. Each item has four response alternatives (1, no; 2, sometimes; 3, often; and 4, always). Scores are summed to yield a total score (10–40 points); a higher score reflects a higher burden. Regarding internal consistency, the developers of the BIRP reported a Cronbach’s alpha of .73 (21).

Ratings of symptom burden and function.

Patients’ symptom severity was rated by the research psychiatrist with the Positive and Negative Syndrome Scale (PANSS). Psychosocial functioning was rated in accordance with the function scale of the Global Assessment of Functioning (GAF).

Statistical Analysis

Group comparisons were carried out with the Student’s t test for continuous variables. For categorical variables, differences in proportions were tested with the chi square test. To analyze the relationship between associated stigma and overall burden for relatives, we wanted to concentrate specifically on an item that captured the relative’s own experience of stigma. Item 19 (“Have you felt stigmatized because of your relative’s mental illness?”) was deemed to be the item that best captured this phenomenon, and those who responded sometimes, often, or always were considered to have experienced stigma. To analyze the relationship between anticipated stigma and overall burden, item 29 (“Do you try to avoid situations that might be stigmatizing to your family?”) was considered to be the most appropriate, and those who responded sometimes, often, or always were considered to have responded affirmatively. Because frequency but not severity is quantified for both these items, we also wanted to include measures of impact. To this end, items 33 a–d were used to analyze the relationship between stigma impact and overall burden on the individual level, and items 34 a–c were used to explore potential associations on the family level.

Associations between the above-specified ISE items and BIRP total score tertiles (here referred to as mild, moderate, and severe) were analyzed with ordinal logistic regression. This is an extension of binary logistic regression that can handle ordinal outcomes—that is, variables with categories that can be ranked in some order. The resulting odds ratios for the covariates are interpreted as the effect of a 1-unit increase in a given covariate on the odds of reporting a higher category of stigma or burden (24). For example, in our study a 1-unit increase in a given ISE variable led to a corresponding increase in the odds of being in the severe burden category, compared with the mild and moderate burden category—or an increase in the odds of being in the moderate and severe category, compared with the mild burden category. The assumption that odds ratios are proportional across these comparisons, the proportional odds assumption, was tested in all models. In a first step, we analyzed the individual ISE variables listed above in univariate ordinal logistic regression models. In a second step, we analyzed them in separate ordinal logistic regression models, adjusting for confounders. We screened the potential confounders gender, age, symptom burden (PANSS total), and patient functioning (GAF) separately in univariate ordinal logistic regression models, and variables with p values lower than .25 were entered as confounders. SAS 9.3 and IBM SPSS 21.0 were used for all analyses.

Results

Table 1 summarizes data on characteristics of the 65 respondents (henceforth referred to as relatives), as well as data pertaining to the patients. We compared patients in the COAST study whose relatives participated in this study (N=65) and those whose relatives did not participate (N=66) and found no differences in terms of age, gender, or GAF score. However, patients whose relatives did not participate had fewer years of education (χ2=5.6, df=1, p=.028) and higher mean total PANSS scores (63.8 versus 58.7; t=2.1, df=129, p=.037) (higher scores indicate greater psychopathology).

TABLE 1. Characteristics of 65 relatives and their family members with schizophrenia

CharacteristicN%
Relatives
 Age (M±SD)61±14.4
 Male2234
 Education ≤12 years2132
 Relationship to patient
  Parent3452
  Sibling1320
  Child35
  Other relative35
  Other relationship1218
 Lives with patient711
 Time spent together (M±SD hours per week)14.5±14.9
  Practical help (M±SD hours per week)a14.5±5.4
Patients
 Age (M±SD)45.6±10.9
 Male4671
 Education ≤12 years2335
 Employment
  Regular employment1015
  Supported, sheltered, or volunteer1117
  No employment4468
 Independent living3858
 Duration of illness (M±SD years)19.2±12.7
 DSM-IV diagnosis
  Paranoid schizophrenia1015
  Undifferentiated schizophrenia3046
  Residual schizophrenia58
  Delusional disorder46
  Psychotic disorder NOS1625
 Symptom and function ratings (M±SD score)
  PANSSb
   Total58.7±13.7
   Positive13.6±5.0
   Negative15.8±5.5
  GAFc48.1±9.4

aHours spent by relative providing practical support to the patient

bPANSS, Positive and Negative Syndrome Scale. Possible total scores range from 30 to 210, with higher scores indicating more severe psychopathology. Possible scores for positive and negative symptoms range from 7 to 49, with higher scores indicating greater severity of symptoms.

cGAF, Global Assessment of Functioning. Possible scores range from 0 to 100, with higher scores indicating better functioning.

TABLE 1. Characteristics of 65 relatives and their family members with schizophrenia

Enlarge table

Ratings of Stigmatizing Experiences

Results for the Stigma Experience Scale are presented in Table 2 (not all relatives answered all items). Most relatives (93%) believed that people think less of those with a mental illness and that the average person is afraid of someone with a mental disease. More than half (53%) reported that their relative was sometimes, often, or always stigmatized because of illness and that they themselves (18%) were sometimes, often, or always stigmatized. About a quarter (28%) reported that other family members had been stigmatized and that they themselves had experienced anticipated stigma (23%). A quarter (25%) reported that experiences with stigma had stimulated a family member to speak out, and some (15%) had participated in programs to increase public knowledge about stigma.

TABLE 2. Items on the family version of the Stigma Experience Scale endorsed by relatives of patients with schizophrenia

ItemN respondingEndorsed item
N%
Do you think that people think less of those with a mental illness?605693a
Do you think that the average person is afraid of someone with a mental disease?605693a
Has your relative been stigmatized because of his or her mental illness?573053a
Have you felt stigmatized because of your relative’s mental illness?601118a
Have other members of your family been stigmatized because of your relative’s mental illness?581628a
Has stigma affected your family’s ability to make or keep friends?53611b
Has stigma affected your ability to interact with your relatives?591017b
Have your experiences with stigma affected your family’s quality of life?591119b
Do you try to avoid situations that may be stigmatizing to your family?571323b
Have your experiences with stigma motivated a member of your family to speak out about the rights of the mentally ill?591525b
Have your experiences with stigma motivated a member of your family to participate in programs to educate the public about mental illness?59915b

aThe item was considered to be endorsed if the response was sometimes, often, or always.

bThe item was considered to be endorsed if the response was yes.

TABLE 2. Items on the family version of the Stigma Experience Scale endorsed by relatives of patients with schizophrenia

Enlarge table

Ratings on the second part of the ISE are shown in Table 3. In regard to the personal impact of stigma and the impact on the family, the highest impacts were reported for family relations and quality of life.

TABLE 3. Ratings on the Stigma Impact Scale of relatives of patients with schizophreniaa

Item (N responding)MSD
How much has stigma affected you personally? (N=59)
 Quality of life2.342.8
 Social contacts1.852.8
 Family relations2.373.0
 Self-esteem2.033.1
How much has stigma affected your family as a whole? (N=53)
 Quality of life2.432.9
 Social contacts2.113.0
 Family relations2.352.9

aPart 2 of the family version of the Inventory of Stigmatizing Experiences. The possible score on each item ranges from 0 to 10, with higher scores indicating greater negative impact.

TABLE 3. Ratings on the Stigma Impact Scale of relatives of patients with schizophreniaa

Enlarge table

Ratings of Burden

Relatives’ responses to each BIRP item are shown by frequency category in Figure 1. The mean±SD total score (all ten items) was 14.2±4.06. The range was broad (10–30). The highest burden ratings were observed for items 2 (“He/she needs help with occupying himself/herself”; mean=1.72±.85) and 7 (“I feel a strain because of his/her mental problem”; mean=1.83±.90). Relatively few expressed worry that the patient would harm someone (item 5, mean=1.03±.17) or die by suicide (item 6, mean=1.18±.42); none chose the “always” response on these two items.

FIGURE 1.

FIGURE 1. Endorsement of items on the Burden Inventory for Relatives of Persons with Psychotic Disturbances among 65 study participants

Relationships Between ISE Items and Burden

Neither experienced stigma nor anticipated stigma was related to burden level (Table 4). Higher ratings of the personal impact of stigma on quality of life and self-esteem were associated with higher overall burden, as were higher ratings of the family impact of stigma on quality of life, social contacts, and family relations. Table 4 also presents findings from the models that adjusted for the potential confounders of age, GAF score, and PANSS score (all confounders had p values <.25). However, GAF and PANSS scores were strongly correlated (rho=–.60). Because of the small sample, we omitted PANSS score from the adjusted models and included only GAF score and age as confounders. The impact of stigma on both personal and family quality of life remained associated with burden after adjustment for GAF score and age.

TABLE 4. Ordinal logistic regression models predicting relationships between selected ISE variables and levels of burden among relatives of persons with schizophreniaa

Variable (N responding)UnivariateAdjustedb
ORc95% CIWald χ2dpProportional odds peORc95% CIWald χ2dpProportional odds pe
Experienced stigma (N=60)2.71.78–9.392.47.116.161.89.52–6.94.92.337.46
Anticipated stigma (reference: no stigma) (N=57).26.04–1.711.95.162.41.31.04–2.141.43.232.87
Personal impact (N=59)
 Quality of life1.301.08–1.567.58.006.121.241.03–1.505.08.024.48
 Social contacts1.08.91–1.29.86.355.841.03.86–1.24.11.740.98
 Family relations1.14.97–1.352.66.103.831.11.94–1.311.46.226.98
 Self-esteem1.181.00–1.393.90.041.991.13.96–1.342.22.136.99
Family impact (N=53)
 Quality of life1.351.11–1.668.65.003.741.261.03–1.564.92.026.65
 Social contacts1.201.00–1.433.94.047.711.11.92–1.331.18.277.73
 Family relations1.261.04–1.525.71.017.741.16.95–1.422.24.135.86

aISE, Inventory of Stigmatizing Experiences. Burden was measured with the Burden Inventory for Relatives of Persons with Psychotic Disturbances.

bAdjusted for patient age and Global Assessment of Functioning

cFor the covariates, ORs are interpreted as the effect of a 1-unit increase in a given covariate on the odds of reporting a higher category of stigma or burden.

ddf=1

ep value for the proportional odds assumption test

TABLE 4. Ordinal logistic regression models predicting relationships between selected ISE variables and levels of burden among relatives of persons with schizophreniaa

Enlarge table

Discussion

To the best of our knowledge, this is the first study to employ structured instruments to examine the relationship between experiences of both stigma and burden among relatives of persons with schizophrenia. Although over half reported that their ill relative had been stigmatized (sometimes, often, or always), only 18% reported that they themselves had felt stigmatized. In adjusted models, the impact of stigma on the ill relative and on the family was associated with higher overall burden.

The frequency of stigma experiences was relatively low in this study compared with a previous study that tested the family version of the ISE (12). In that study, the target population included parents who attended family-oriented advocacy groups, family network meetings, or family conferences. These individuals may have been more likely to acknowledge stigma than relatives recruited via patients attending an outpatient clinic, as in our study. Another explanation may be that less than one-tenth of the relatives in our study lived with their ill relative, a proportion considerably smaller than in the other study (50%) (12). This difference is important, because relatives who do not live with their ill family member are less likely to be affected by stigma (10). The need to avoid potentially stigmatizing situations would not arise as often in these families, which may explain the relatively low rate of anticipated stigma in our study. No patients in our study were receiving long-acting injectable medications, which are typically given to those with greater psychopathology. Therefore, our results may not generalize to all families of persons with severe mental illness (25). The mean duration of illness among patients in our study was long, almost two decades, which would be expected to influence relatives’ experiences of stigma. However, it was not feasible to test for interactions with patient age or illness duration because of the limited sample size.

Relatives’ own views about stigma may influence their behaviors and interpretations of the questions in an instrument such as the ISE. In recent years, antistigma efforts have been launched in Sweden and elsewhere (26). The large proportion of relatives who believed that the general public looks down on persons with mental illness—93% in our study compared with 43% in a previous study (5)—might be partly related to the fact that stigma issues are now recognized to a greater extent than in the past. A quarter of the relatives stated that stigma experiences motivated family members to speak out for the rights of persons with mental illness, which suggests not only awareness of stigma as a societal issue but also a conviction that stigma is something that can be spoken about openly.

The mean BIRP score (14.2) in our study was similar to that reported for the “moderate burden” group of relatives of persons with psychosis (14.8) in a study conducted by the developers of the scale (27). In our study, burden was related to the impact of stigma on a variety of psychosocial factors, including family relations, social contacts, and self-esteem. The mechanisms of these associations could not be clarified with this study design. The lack of association between experienced stigma and burden was unexpected and might be partly related to the fact that the ISE item measures frequency but not intensity. There is also an issue related to statistical power; data for relatives were available for only half of the patients who took part in the original study, either because of patients’ unwillingness to identify relatives who might be able to participate or relatives’ refusal to participate. Among relatives in our study, the number acknowledging that they themselves had experienced stigma was lower than anticipated, which further reduced the possibility of detecting significant associations. In addition, many patients in our study participated in case management programs, and their relatives were involved in psychoeducation and stress management interventions (28). Case management and ACT have been shown to have positive effects on relatives in terms of burden and satisfaction with care (29,30).

Several methodological issues need to be considered. The sample in the validation study of the ISE family version (12) included persons with various diagnoses; not all persons had psychotic disorders. The BIRP was developed and validated specifically for relatives of persons with psychotic disorders. Although it can be argued that instruments based on recall underestimate relatives’ objective burden (31), an alternative method, such as continuous report by diary, might not be as suited to the quantification of mental strain and other phenomena captured by the BIRP.

Patients whose relatives did not participate in our study had higher PANSS scores. Therefore, the ISE and BIRP scores in our study may not reflect stigma and burden among all relatives of patients with psychotic illness. Symptom severity may affect relatives’ stigma (3) and burden (27,32). In addition, relatives of patients with lower education levels were underrepresented, although it is unclear how this might have affected our results.

Our data were limited to a single relative or close friend who we assumed to be a “key” person. Family members who are not key relatives also can experience significant burden (33), and we can draw no conclusions about them. The limited sample size meant that we could not explore potential gender differences in the association between stigma and burden. Further study is warranted because female and male relatives perceive burden differently (34).

Conclusions

Although levels of stigma and overall burden were relatively low among relatives of persons who were taking oral antipsychotics and who were served in a treatment setting informed by ACT principles, stigma had an impact on the quality of life of the relatives and their families. Both personal and family impact were associated with greater overall burden. It remains to be tested whether increasing service providers’ awareness of relatives’ experiences would decrease the impact of stigma and overall burden. Associations should be examined in diverse cultures and treatment settings.

Ms. Allerby, Ms. Sameby, Dr. Brain, Mr. Quinlan, Dr. Sjöström, and Dr. Waern are with the Psychosis Clinic, Sahlgrenska University Hospital, Gothenburg, Sweden. Dr. Waern is also with the Institute of Neuroscience and Physiology, where Mr. Joas is affiliated, and Dr. Sjöström is with the Institute of Health and Care Sciences, all at the University of Gothenburg, Gothenburg, Sweden. Dr. Burns is with the Department of Psychiatry, Oxford University, Oxford, United Kingdom. Send correspondence to Ms. Sameby (e-mail: ).

Findings were presented at the annual meeting of the American Psychiatric Association, New York, May 3–7, 2014.

The COAST study was supported by grants from the Gothenburg Center for Person-Centered Care, the Swedish Research Council (grant K2009-62X-21079-01-3), and the Söderström-Königska Foundation (2008-21951 and SLS-232731); by the Swedish Mental Health Fund; by ALF funding from Sahlgrenska University Hospital; and by unrestricted investigator-initiated grants from AstraZeneca in Sweden, Eli Lilly, Janssen, and Lundbeck. The authors thank the participating relatives and patients. They also thank Susan Landqvist-Stockman, R.N., Pia Rydell, M.D., and clinical staff at the Psychosis Clinic, Sahlgrenska University Hospital, Gothenburg, Sweden. Heather Stuart, Ph.D., provided helpful guidance in the use of the ISE. The sponsors had no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the manuscript for publication.

Ms. Allerby has received honoraria from AstraZeneca and Eli Lilly. Ms. Sameby has received honoraria from AstraZeneca and Janssen Pharmaceuticals. Dr. Brain has received honoraria from AstraZeneca, Eli Lilly, Janssen Pharmaceuticals, Lundbeck, Medivir, Otsuka Pharmaceuticals, Roche, and Takeda. Dr. Burns has received honoraria from Janssen Pharmaceuticals and Otsuka Pharmaceuticals and unrestricted educational support from Janssen Pharmaceuticals. The other authors report no financial relationships with commercial interests.

References

1 Thornicroft G, Brohan E, Rose D, et al.: Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey. Lancet 373:408–415, 2009Crossref, MedlineGoogle Scholar

2 Goffman E: Stigma: Notes on the Management of Spoiled Identity. Englewood Cliffs, NJ, Prentice-Hall, 1963Google Scholar

3 Phelan JC, Bromet EJ, Link BG: Psychiatric illness and family stigma. Schizophrenia Bulletin 24:115–126, 1998Crossref, MedlineGoogle Scholar

4 Kadri N, Manoudi F, Berrada S, et al.: Stigma impact on Moroccan families of patients with schizophrenia. Canadian Journal of Psychiatry 49:625–629, 2004Crossref, MedlineGoogle Scholar

5 Struening EL, Perlick DA, Link BG, et al.: Stigma as a barrier to recovery: the extent to which caregivers believe most people devalue consumers and their families. Psychiatric Services 52:1633–1638, 2001LinkGoogle Scholar

6 McCann TV, Lubman DI, Clark E: Responding to stigma: first-time caregivers of young people with first-episode psychosis. Psychiatric Services 62:548–550, 2011LinkGoogle Scholar

7 Muhlbauer S: Experience of stigma by families with mentally ill members. Journal of the American Psychiatric Nurses Association 8:76–83, 2002CrossrefGoogle Scholar

8 Angermeyer MC, Schulze B, Dietrich S: Courtesy stigma—a focus group study of relatives of schizophrenia patients. Social Psychiatry and Psychiatric Epidemiology 38:593–602, 2003Crossref, MedlineGoogle Scholar

9 González-Torres MA, Oraa R, Arístegui M, et al.: Stigma and discrimination towards people with schizophrenia and their family members: a qualitative study with focus groups. Social Psychiatry and Psychiatric Epidemiology 42:14–23, 2007Crossref, MedlineGoogle Scholar

10 Ostman M, Kjellin L: Stigma by association: psychological factors in relatives of people with mental illness. British Journal of Psychiatry 181:494–498, 2002Crossref, MedlineGoogle Scholar

11 Wahl OF, Harman CR: Family views of stigma. Schizophrenia Bulletin 15:131–139, 1989Crossref, MedlineGoogle Scholar

12 Stuart H, Koller M, Milev R: Inventories to measure the scope and impact of stigma experiences from the perspective of those who are stigmatized: consumer and family versions; in Understanding the Stigma of Mental Illness. New York, Wiley, 2008CrossrefGoogle Scholar

13 Liberman RP, Kopelowicz A, Ventura J, et al.: Operational criteria and factors related to recovery from schizophrenia. International Review of Psychiatry 14:256–272, 2002CrossrefGoogle Scholar

14 Phillips MR, Pearson V, Li F, et al.: Stigma and expressed emotion: a study of people with schizophrenia and their family members in China. British Journal of Psychiatry 181:488–493, 2002Crossref, MedlineGoogle Scholar

15 Tsang HW, Tam PK, Chan F, et al.: Sources of burdens on families of individuals with mental illness. International Journal of Rehabilitation Research 26:123–130, 2003Crossref, MedlineGoogle Scholar

16 Magaña SM, Ramírez García JI, Hernández MG, et al.: Psychological distress among Latino family caregivers of adults with schizophrenia: the roles of burden and stigma. Psychiatric Services 58:378–384, 2007LinkGoogle Scholar

17 Magliano L, Fadden G, Economou M, et al.: Family burden and coping strategies in schizophrenia: 1-year follow-up data from the BIOMED I study. Social Psychiatry and Psychiatric Epidemiology 35:109–115, 2000Crossref, MedlineGoogle Scholar

18 Roick C, Heider D, Toumi M, et al.: The impact of caregivers’ characteristics, patients’ conditions and regional differences on family burden in schizophrenia: a longitudinal analysis. Acta Psychiatrica Scandinavica 114:363–374, 2006Crossref, MedlineGoogle Scholar

19 Malm U, Ivarsson B, Allebeck P, et al.: Integrated care in schizophrenia: a 2-year randomized controlled study of two community-based treatment programs. Acta Psychiatrica Scandinavica 107:415–423, 2003Crossref, MedlineGoogle Scholar

20 Malm UI, Ivarsson BA, Allebeck P: Durability of the efficacy of integrated care in schizophrenia: a five-year randomized controlled study. Psychiatric Services 65:1054–1057, 2014LinkGoogle Scholar

21 Hjärthag F, Helldin L, Norlander T: Psychometric properties of the burden inventory for relatives of persons with psychotic disturbances. Psychological Reports 103:323–335, 2008Crossref, MedlineGoogle Scholar

22 Brain C, Allerby K, Sameby B, et al.: Drug attitude and other predictors of medication adherence in schizophrenia: 12 months of electronic monitoring (MEMS) in the Swedish COAST study. European Neuropsychopharmacology 23:1754–1762, 2013Crossref, MedlineGoogle Scholar

23 Brain C, Sameby B, Allerby K, et al.: Stigma, discrimination and medication adherence in schizophrenia: results from the Swedish COAST study. Psychiatry Research 220:811–817, 2014Crossref, MedlineGoogle Scholar

24 Hosmer DW, Lemeshow S: Applied Logistic Regression. New York, Wiley, 2004Google Scholar

25 Shi L, Ascher-Svanum H, Zhu B, et al.: Characteristics and use patterns of patients taking first-generation depot antipsychotics or oral antipsychotics for schizophrenia. Psychiatric Services 58:482–488, 2007LinkGoogle Scholar

26 Beldie A, den Boer JA, Brain C, et al.: Fighting stigma of mental illness in midsize European countries. Social Psychiatry and Psychiatric Epidemiology 47(suppl 1):1–38, 2012Crossref, MedlineGoogle Scholar

27 Hjärthag F, Helldin L, Karilampi U, et al.: Illness-related components for the family burden of relatives to patients with psychotic illness. Social Psychiatry and Psychiatric Epidemiology 45:275–283, 2010Crossref, MedlineGoogle Scholar

28 Falloon IR, Held T, Roncone R, et al.: Optimal treatment strategies to enhance recovery from schizophrenia. Australian and New Zealand Journal of Psychiatry 32:43–49, 1998Crossref, MedlineGoogle Scholar

29 Ziguras SJ, Stuart GW: A meta-analysis of the effectiveness of mental health case management over 20 years. Psychiatric Services 51:1410–1421, 2000LinkGoogle Scholar

30 Phillips SD, Burns BJ, Edgar ER, et al.: Moving assertive community treatment into standard practice. Psychiatric Services 52:771–779, 2001LinkGoogle Scholar

31 Flyckt L, Löthman A, Jörgensen L, et al.: Burden of informal care giving to patients with psychoses: a descriptive and methodological study. International Journal of Social Psychiatry 59:137–146, 2013Crossref, MedlineGoogle Scholar

32 Parabiaghi A, Lasalvia A, Bonetto C, et al.: Predictors of changes in caregiving burden in people with schizophrenia: a 3-year follow-up study in a community mental health service. Acta Psychiatrica Scandinavica. Supplementum 437:66–76, 2007Crossref, MedlineGoogle Scholar

33 Magliano L, Fadden G, Fiorillo A, et al.: Family burden and coping strategies in schizophrenia: are key relatives really different to other relatives? Acta Psychiatrica Scandinavica 99:10–15, 1999Crossref, MedlineGoogle Scholar

34 Wancata J, Freidl M, Krautgartner M, et al.: Gender aspects of parents’ needs of schizophrenia patients. Social Psychiatry and Psychiatric Epidemiology 43:968–974, 2008Crossref, MedlineGoogle Scholar