The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

Public stigma is a barrier to care and increases the duration of untreated psychosis among individuals with first-episode psychosis. The authors recently demonstrated the efficacy of a 90-second social contact–based video intervention in reducing such stigma. That proof-of-concept study was the first to employ so brief an antistigma intervention in a sample of young adults. The authors now present a randomized controlled replication study with baseline, postintervention, and 30-day follow-up assessments. The authors aimed to replicate their previous findings and to show a persisting benefit for the video intervention.

Methods:

Using a crowdsourcing platform (Amazon Mechanical Turk), the authors recruited and assigned 1,055 participants ages 18–30 years to a brief video-based intervention, to a written vignette intervention containing the same material, or to a nonintervention control condition. In the 90-second video, a 22-year-old African American woman with schizophrenia humanized the illness through her emotional description of living a meaningful and productive life.

Results:

A three-by-three group-by-time multivariate analysis of variance showed a significant group-by-time interaction for the total scores of all five stigma-related domains: social distance, stereotyping, separateness, social restriction, and perceived recovery. Post hoc pairwise tests showed greater reductions in the video group compared with the vignette and control groups at the postintervention and 30-day follow-up assessments, while the vignette group differed from the control group at the postintervention assessment but not at the 30-day assessment.

Conclusions:

This randomized controlled study replicated and strengthened the authors’ earlier findings, further showing month-long sustained stigma reduction in the social contact–based video intervention arm. A 90-second video sufficed to humanize schizophrenia and reduce stigma. Further research should examine longer-term sustainability, assess changes in behavior, and determine optimal effective video length.

More than two-thirds of people with psychosis worldwide receive no mental health care, at least in part because of stigma embedded in systemic or structural discrimination (1). Stigma stems from negative beliefs and attitudes that trigger people to avoid, fear, and reject individuals with mental illness (2). Young people with first-episode psychosis have identified stigma and how others perceive them as major barriers to care (3). Shorter duration of untreated psychosis among people with first-episode psychosis is associated with better short- and long-term prognosis (4). As public stigma toward individuals with first-episode psychosis has been identified as a barrier to help seeking, reducing stigma among young people may enhance their willingness to seek treatment, if needed (57). Moreover, interventions in the form of informational campaigns for the general public showed efficacy in increasing knowledge about mental illness and in reducing the duration of untreated psychosis of individuals with first-episode psychosis from 16 weeks to 5 weeks (8). To our knowledge, previous studies were aimed at reducing components of public stigma among the general population as opposed to young people.

Existing intervention studies on reducing stigma toward people with mental illness have shown promise. Social contact interventions, defined by interpersonal contact with a representative of the stigmatized group, are the most effective way to lower public stigma and prejudice (913). The mechanism is straightforward: an empowered protagonist with lived experience, who shares characteristics with the audience and is seen as a potential peer, shares his or her personal story, thus following the principle of moderately disconfirming stereotypes by balancing realities of the illness and messages of hope (14). Emphasizing recovery-oriented themes has lowered stigma more than symptom-based content (15). Social contact has shown similar efficacy with in-person and video interventions (16). Relative to in-person interventions, video-based interventions are less expensive, simpler to replicate, and easier to disseminate to large populations.

The current video-based literature has limitations, however. Interventions have focused on immediate change and have lacked long-term follow-up, and research has studied relatively small sample sizes among specific populations, limiting generalizability (17, 18). A recent review (19) found that contact-based interventions yielded small- to medium-sized stigma reductions immediately after the intervention. These effects did not vary by length of contact (10 to 65 minutes; average length, 24 minutes) or by type (in-person compared with video). Most (20 of 22; 91%) of these studies assessed college students, a nonrepresentative sample, as student research participation is often required for school credit. Sample sizes ranged from 20 to 782, with a median of 97 participants. Another meta-analysis found that despite the immediate benefits of antistigma interventions, 74% of the studies had no follow-up (20). Hence, studies utilizing rigorous longitudinal methodology are needed (21, 22).

We recently tested the efficacy of a 90-second social contact–based video intervention in reducing public stigma toward individuals with schizophrenia among 1,203 young adults (23). Our study focused on this age range for several reasons. First, youths are especially sensitive to stigma because of their stage of identity consolidation, characterized by a powerful need for a sense of competence, social acceptance, and autonomy (24). Second, young adults are very concerned with how their peers view them, and we wanted to intercede before attitudes become entrenched (25). Third, our brief online video intervention seemed a better fit for this age range, considering the high use of media among this population. Lastly, young adulthood overlaps with the onset of many mental disorders, including first-episode psychosis, and thus includes the potential peer group of individuals with first-episode psychosis who may hold stigmatizing attitudes toward individuals with the illness. The video presented schizophrenia with a human face rather than as a “brain disease.” As hypothesized, the video-based intervention group yielded lower rates of stigma than the written vignette and control groups, and the written vignette group yielded lower rates of stigma than the control group across all domains. Women showed lower rates of stigma than men solely in the video group, supporting our hypothesis that identification with the video protagonist reduces stigma. This finding coheres with previous studies showing that matching the gender of the respondent with the video protagonist significantly moderated changes from pre- to postintervention assessments across most of the stigma domains assessed (26). This proof-of-concept study was the first to demonstrate such an effect in a young adult sample and the first to employ so brief an antistigma intervention. After initial efforts to create the video, conducting such an intervention requires minimal resources, and it can be easily disseminated and reach a wide audience. However, the study lacked a baseline assessment, precluding direct measurement of actual change, and also lacked follow-up retesting to assess its durability.

To address these limitations, we designed a randomized controlled replication study with assessments at baseline, after the intervention, and at 30-day follow-up. Young participants were randomly assigned to a brief video-based intervention (“video”), to a written vignette intervention containing the same material (“vignette”), or to a nonintervention control condition (“control”). We hypothesized that we would replicate our previous findings by showing a greater reduction in stigma in the video group, with greater reduction among women, and that we would observe a sustained benefit in the video group relative to the other groups.

METHODS

Participants and Recruitment Procedure

We recruited participants using Amazon Mechanical Turk (MTurk) (27), a popular crowdsourcing platform widely used in medical and psychology research to assess treatment efficacy (28). We included only English-speaking U.S. residents ages 18–30 years. We used several methods to exclude invalid participants to ensure the validity of results. First, in designing the study, we added a timer to the “next” button to ensure that participants read instructions (5-second minimum), and we did the same for the written vignette (10 seconds) and for the watching of the video (90 seconds). This timer should have prevented most bots from continuing to the survey itself, as the HTML button did not appear on a page scan and the internal timer interval was too long for any timeout mechanism. Second, we used an open-ended question format requiring the participant’s age as a validity question and allowed only a two-digit number as a valid answer. We then compared that answer with the age data MTurk provided to disqualify fake participants. Third, we scanned the participants to exclude those who answered the survey more than once, who completed the assessment in less than the minimum expected time, who were from locations (coordinates) outside the United States, or who had suspicious IP addresses. Participants were compensated $1.10 for each step of the study, for an overall compensation of $2.20. The New York State Psychiatric Institute institutional review board approved the project. Before initiating the study, participants reviewed an online informed consent form. Those who agreed to participate were directed to complete the study procedures via Qualtrics.com, a secure online data collection platform.

Intervention

The goal of the study was to evaluate the acute change and longer-term efficacy of antistigma interventions using the same brief video as in our first study. A link to the Center for Practice Innovations’ resources is included in the online supplement. These resources include a portal for patients and their relatives that presents video clips of patients and families describing different aspects of coping with their everyday life difficulties. From those materials, we reduced to 90 seconds an approximately 11-minute video of an empowered young woman with schizophrenia who described her first psychotic episode and her struggles with medications and side effects. In the shortened video, she describes her symptoms during illness onset (e.g., “I went four days without sleeping.… I have seen things that weren’t there.”) and her current daily difficulties (e.g., “Every day is a battle.… Every day is hard.”), in which she continues to experience psychotic symptoms in attenuated form, thus still meeting some common psychosis stereotypes. Notably, even while experiencing these symptoms, she remained capable of working and having meaningful relationships. The video concluded with themes of hope and recovery (e.g., “It’s not the end of the world. It is not something that is impossible to live with.”). This highlighted her as a human being, presenting her continuing symptoms in the context of her personal human narrative. The video thus humanized the illness via social contact with an individual perceived at an equal power status (i.e., a peer) who still met some stereotypes of psychosis but who had meaningful relationships and functioned reasonably well in the roles in her life. The vignette segment of our study was a written description of the video content (both symptoms and recovery themes) but lacked the direct social contact with an individual with lived experience.

Instruments

The assessment measured public stigma across five domains, with 19 items derived from five scales that showed good initial reliability and validity in our first study. We analyzed each of the five subscales separately. The social distance domain had six items divided into three casual (e.g., “Would you be willing to have someone with schizophrenia as a neighbor?”) and three intimate types of social distance (e.g., “Would you be willing to allow a child of yours to date a person with schizophrenia?”), derived from Boyd et al. (29). The overall scale has good internal consistency (Cronbach’s alpha=0.92). Four items of the separateness (or “differentness”) domain came from Phelan (30), for example, “When you think of a person with schizophrenia, how different do you think they are from other people?” (alpha=0.69). For the stereotyping domain, we drew four items from the General Social Survey (31) to assess the participant’s perception of the ability of a person with schizophrenia to make decisions about treatment and money, as well as the likelihood that the person would be violent (alpha=0.80). Three social restriction items assessed the participant’s perception of whether a person with schizophrenia should babysit small children, marry, or have children (alpha=0.68). To measure public perception on recovery, we adapted two items from the 41-item Recovery Assessment Scale (32). This newly developed measure showed good reliability and construct validity in our previous study (i.e., the public perceived greater possibility of recovery for the video character after the intervention). One item assessed perceived recovery from a community member’s perspective, and another addressed the perception of the ability of a person with schizophrenia to meet current personal goals and have a plan for staying well. Responses range from 1 (“strongly agree”) to 4 (“strongly disagree”), and the alpha for this study was 0.77. Two items assessed whether participants had a friend or family member with serious mental illness (yes, no, and prefer not to answer), and if so, their level of intimacy with that individual (not intimate/close, somewhat intimate/close, very intimate/close, and prefer not to answer) (33).

Statistical Analysis

Data were analyzed using SPSS, version 26.0 (IBM, Armonk, N.Y.). We used Pearson’s chi-square and one-way analysis of variance (ANOVA) to compare demographic variables among groups. Repeated-measures ANOVAs and multivariate analyses of variance (MANOVA) compared mean stigma scores that were obtained as the sum of each stigma domain across the three groups and three time points; when between-group differences were found, post hoc tests were used to compare each group pair. We then used independent sample t tests to compare changes between time points across groups and gender differences within groups. A Bonferroni correction for multiple comparisons yielded a corrected p value significance threshold of 0.01.

RESULTS

Sample Characteristics

The sample of 1,055 participants was randomly and proportionally assigned to three study groups, after excluding 162 (13%) individuals who failed validity tests. Ninety-eight percent (N=1,029) of participants completed the postintervention assessment, and 78% (N=803) completed the 30-day follow-up (Figure 1). Demographic characteristics did not differ between those who did and did not complete the study. The study sample was evenly divided across gender (women, N=531, 50.3%), and the participants’ mean age was 26.7 years (SD=3.1). The majority (N=769, 73%) identified as White, while 123 (12%) identified as Asian, 107 (10%) as African American, 13 (1%) as Native American, and 43 (4%) as other. One hundred eleven (11%) reported Hispanic ethnicity. Study arms did not significantly differ by gender, age, race, or ethnicity (Table 1).

FIGURE 1. Participant flowchart in a study of the sustained effect of a brief video in reducing public stigma toward individuals with psychosis

TABLE 1. Demographic characteristics of participants in a study of the sustained effect of a brief video in reducing public stigma toward individuals with psychosis

CharacteristicVideo Group (N=367)Vignette Group (N=353)Control Group (N=335)Total (N=1,055)Statistica
MeanSDMeanSDMeanSDMeanSDANOVAp
Age26.73.126.63.126.93.026.73.10.010.99
N%N%N%N%χ2p
Gender (female)177481755017953531503.070.93
Hispanic40112784413111115.400.07
Race
 White271742537224573769739.460.49
 African American4011361031910710
 Asian3494914401212312
 Native American515131131
 Other175103165434
Familiarity with a person with serious mental illness136371313712437391370.061.00

aOne-way analysis of variance (ANOVA) and Pearson’s chi-square were used to compare demographic variables between groups.

TABLE 1. Demographic characteristics of participants in a study of the sustained effect of a brief video in reducing public stigma toward individuals with psychosis

Enlarge table

As hypothesized, study groups significantly differed in outcome. A three-by-three group-by-time MANOVA showed a significant group-by-time interaction for the total scores of all five stigma-related subscales (Wilks’s lambda F=12.6, p<0.001). A three-by-three group-by-time ANOVA also showed that mean stigma scores significantly decreased over time, predominantly in the video group, across all five stigma-related domains: social distance (F=38, p<0.001), stereotyping (F=31, p<0.001), separateness (F=6.9, p=0.001), social restriction (F=10, p<0.001), and perceived recovery (F=17, p<0.001). Figure 2 presents mean score curves of the study groups over time, across all stigma domains. No gender differences in changes between time points were found between study groups.

FIGURE 2. Mean scores on stigma-related domain questionnaires across a video-based intervention, a vignette-based intervention, and a no-intervention control condition to reduce public stigma toward individuals with psychosisa
a Higher scores indicate higher stigma.

To better understand the outcome differences across intervention arms, we compared changes from baseline to postintervention assessment and from baseline to 30-day follow-up between study groups (Table 2). Independent t tests showed a significant difference between the video and vignette groups in changes from baseline to postintervention assessment and from baseline to follow-up across all five stigma domains (social distance, stereotyping, separateness, social restriction, and perceived recovery). Similarly, the video and control groups significantly differed in changes from baseline to postintervention assessment and from baseline to follow-up across all stigma domains. However, while the vignette group differed from the control group in changes between baseline and postintervention assessment across all stigma domains, changes between baseline and 30-day follow-up were observed only in social distance (t=2.0, p=0.042) and stereotyping (t=2.2, p=0.030), whereas there were no differences in the domains of separateness, social restriction, and perceived recovery.

TABLE 2. Comparison of changes in total mean scores across study groups on a questionnaire measuring stigma-related domains

DomainTime PointDifference in Mean ScoresaPairwise Comparisonsb
Video GroupVignette GroupControl GroupVideo and Control ComparisonVideo and Vignette ComparisonVignette and Control Comparison
MeanSDMeanSDMeanSD
Social distance (score range, 6–24)Baseline to postintervention3.43.21.53.10.10.717.9***7.7***7.8***
Baseline to follow-up2.63.60.83.20.22.98.1***6.0***2.0*
Stereotyping (score range, 4–16)Baseline to postintervention2.12.21.31.80.10.615.9***4.8***12.1***
Baseline to follow-up1.62.40.71.60.41.47.0***5.2***2.2*
Separateness (score range, 4–16)Baseline to postintervention1.32.20.71.90.00.310.0***3.5**6.2***
Baseline to follow-up0.92.40.42.30.21.93.9***2.3*n.s.
Social restriction (score range, 3–12)Baseline to postintervention1.11.60.51.30.00.211.9***4.9***6.8***
Baseline to follow-up0.81.70.41.60.21.44.4***3.0**n.s.
Perceived recovery (score range, 2–8)Baseline to postintervention0.81.30.41.10.00.211.2***4.7***6.1***
Baseline to follow-up0.61.30.11.30.11.15.3***4.6***n.s.

aHigher scores indicate higher stigma.

bIndependent t test.

*p<0.05. **p<0.01. ***p<0.001.

TABLE 2. Comparison of changes in total mean scores across study groups on a questionnaire measuring stigma-related domains

Enlarge table

Three hundred seventy six (37%) respondents, evenly distributed across study arms, replied affirmatively to the question, “Do you have a friend or a family member diagnosed with serious mental illness?” (Table 1). Overall, participants of all study groups who knew people with serious mental illness had significantly lower baseline scores on the scales of social distance, stereotyping, social restriction, and perceived recovery. However, this difference in participants familiar with people with serious mental illness having lower stigma disappeared at the postintervention and 30-day follow-up assessments in the video group, whereas in the vignette and control groups, it persisted across all time points. Figure 3 presents the mean scores of the social distance domain, divided by close familiarity to a person diagnosed with serious mental illness, across all time points. We did not find gender differences within groups.

FIGURE 3. Differences in response to, “Do you have a friend or a family member diagnosed with serious mental illness?” across study groups, by total scores on a questionnaire measuring the stigma-related domain of social distancea
a Scores ranged from 6 to 24, with higher scores indicating higher stigma. *p≤0.05. **p<0.01. ***p<0.001.

DISCUSSION

Our randomized controlled replication study tested the efficacy of a brief contact-based video intervention in reducing public stigma toward first-episode psychosis and schizophrenia among 1,055 young adults. In the 90-second video, a 22-year-old woman suffering from schizophrenia directly and candidly portrayed her personal story, describing how she is fulfilling her goal to live a meaningful and productive life. She humanized the illness. As hypothesized, this emotional video-based intervention had significantly greater potency than the vignette and control conditions in reducing stigma across all domains at the postintervention assessment. These findings replicate and extend our previous findings by demonstrating a pre- to postintervention reduction in stigma and not merely differences among study groups. These findings corroborate the literature emphasizing the importance of contact-based interventions (23, 34). Reducing public stigma toward psychosis has the potential to help young people with psychosis overcome barriers to care, enhance detection of psychosis, and shorten duration of untreated psychosis.

Our follow-up findings showed a continuing significant difference between study groups. Despite a slight rebound in stigma reduction at 30-day follow-up compared with postintervention assessment, the video-based intervention group remained significantly different from the vignette and control groups at 30-day follow-up. Differences between the vignette and control groups lost statistical significance by day 30. This finding emphasizes the core difference between social contact video-based interventions and written vignettes and perhaps other interventions—identification with the protagonist is viewed as creating emotional engagement, which in turn generates sustainable effect. Previous studies that tested longer-term effects of video interventions used videos far longer than ours (range=20–85 minutes) and/or included smaller samples of college students (range=43–243 participants), thus limiting generalizability (1719, 35, 36). This is the first study to demonstrate a persisting effect in a relatively large sample of the young general population from such a brief video stimulus. Because of the slight rebound, it is reasonable to assume diluting of the intervention effect. Further studies should examine whether booster videos would enhance the durability of the antistigma effect.

Our finding that having a friend or family member with serious mental illness is associated with lower stigma is consistent with previous studies (33, 37). Although this difference was consistent across groups at baseline, it disappeared only in the video group after the intervention, across all stigma domains. This finding persisted at 30-day follow-up. The absence of such a difference in the video group suggests that identifying with the protagonist, even briefly, imitates close contact with a person with serious mental illness. Further studies should examine whether the video content should be adjusted to account for familiarity with a person with serious mental illness.

Is 90 seconds the ideal length for social contact–based video intervention? Longer videos have not yielded a greater beneficial effect than shorter videos (19), and brevity has advantages: lower cost, use of fewer resources, and greater ease of dissemination to large audiences. Traditionally, social contact interventions for young adults have occurred in educational environments like colleges and schools, and they involve in-person meetings with people with serious mental illness who share their recovery story or a longer workshop that includes formal educational formats like lectures or group discussions (19, 38). An emerging secular trend toward online platforms has been accelerated dramatically by the COVID-19 pandemic, which is changing dissemination of knowledge and increasing the use of remote learning, social media, and the Internet (39, 40). Finally, shorter videos better suit younger audiences who may have limited frustration tolerance or attention span. In an era of very brief knowledge bites, mostly consumed via social media (e.g., Instagram, Twitter, and TikTok), shorter interventions may be better suited to the attention span of the average young viewer. Although the 90-second video, the shortest yet tested, seemed to produce at least the benefit of longer videos, still shorter videos might prove even more suitable to young audiences. Additional research should attempt to define the optimal length for sustainable interventions for stigma reduction.

In our previous study, a secondary analysis found that the video had greater influence on women than did comparison conditions across all scales (23). We assumed that the gender effect reflected identification with the presenter: female viewers identifying with a female presenter. It is unclear why the present study failed to replicate this result, but it may be in part due to a smaller study sample of the video group (367 compared with 596). Previous research has shown that stigma levels differ across sociodemographic groups, but few studies have examined the influence of concordance between video presenter and viewer gender on stigma reduction (26). Other studies should examine whether matching sociodemographic characteristics enhances stigma reduction.

Limitations

Our study has several limitations. First, our findings may be limited to MTurk participants, who may not be fully representative of the general population (27). Seventy-three percent of participants described themselves as White, 10% as African American, and 12% as Asian, and 11% reported Hispanic ethnicity, percentages slightly divergent from the overall U.S. population reporting as 76% White, 13% African American, 6% Asian, and 18% Hispanic, based on the last U.S. census. In addition, MTurk participants may differ in education level. Second, the low number of African American participants gave us insufficient power to evaluate racial differences. Third, our study included only a single video, limiting the ability to test the influence of the gender, race, and ethnicity of multiple video intervention protagonists on stigma reduction. Fourth, we assessed attitudes only, the reporting of which is subject to social desirability bias. Future studies should measure behaviors and/or implicit attitudes. Lastly, as our study evaluated only a 30-day effect, future research should examine longer-term sustainability.

Conclusions

This randomized controlled study replicated and enhanced the findings of our first study, showing a longer-term effect of stigma reduction in the social contact–based video intervention arm. A 90-second video humanized schizophrenia and reduced stigma, suggesting its potential to increase the likelihood of seeking care and, ultimately, to improve access to treatment among young people with first-episode psychosis and schizophrenia. Future research should address gender, race, and ethnic differences and determine whether it is possible to further reduce video length without reducing efficacy.

New York State Psychiatric Institute and Department of Psychiatry, Columbia University Vagelos College of Physicians and Surgeons, New York (Amsalem, Markowitz, Jankowski, Neria, Dixon); Department of Social and Behavioral Sciences, College of Global Public Health, New York University, New York (Yang, Lieff); Department of Epidemiology (Yang) and Department of Biostatistics (Valeri), Columbia University Mailman School of Public Health, New York; Department of Epidemiology, Columbia University Irving Medical Center, New York (Neria)
Send correspondence to Dr. Amsalem ().

The authors thank the video participant, who shared her story and contributed to stigma reduction.

The authors report no financial relationships with commercial interests.

REFERENCES

1. Thornicroft G : Most people with mental illness are not treated . Lancet 2007 ; 370 : 807 – 808 Crossref, MedlineGoogle Scholar

2. Parcesepe AM , Cabassa LJ : Public stigma of mental illness in the United States: a systematic literature review . Adm Policy Ment Health Ment Health Serv Res 2013 ; 40 : 384 – 399 Crossref, MedlineGoogle Scholar

3. Cabassa LJ , Piscitelli S , Haselden M , et al. : Understanding pathways to care of individuals entering a specialized early intervention service for first-episode psychosis . Psychiatr Serv 2018 ; 69 : 648 – 656 LinkGoogle Scholar

4. Correll CU , Galling B , Pawar A , et al. : Comparison of early intervention services vs treatment as usual for early-phase psychosis: a systematic review, meta-analysis, and meta-regression . JAMA Psychiatry 2018 ; 75 : 555 – 565 Crossref, MedlineGoogle Scholar

5. Mueser KT , DeTore NR , Kredlow MA , et al. : Clinical and demographic correlates of stigma in first-episode psychosis: the impact of duration of untreated psychosis . Acta Psychiatr Scand 2020 ; 141 : 157 – 166 Crossref, MedlineGoogle Scholar

6. Mascayano F , van der Ven E , Martinez-Ales G , et al. : Predictors of early discharge from early intervention services for psychosis in New York state . Psychiatr Serv 2020 ; 71 : 1151 – 1157 LinkGoogle Scholar

7. Boydell KM , Gladstone BM , Volpe T : Understanding help seeking delay in the prodrome to first episode psychosis: a secondary analysis of the perspectives of young people . Psychiatr Rehabil J 2006 ; 30 : 54 – 60 Crossref, MedlineGoogle Scholar

8. Joa I , Johannessen JO , Auestad B , et al. : The key to reducing duration of untreated first psychosis: information campaigns . Schizophr Bull 2008 ; 34 : 466 – 472 Crossref, MedlineGoogle Scholar

9. Corrigan PW , Michaels PJ , Vega E , et al. : Key ingredients to contact-based stigma change: a cross-validation . Psychiatr Rehabil J 2014 ; 37 : 62 – 64 Crossref, MedlineGoogle Scholar

10. Corrigan PW , Vega E , Larson J , et al. : The California schedule of key ingredients for contact-based antistigma programs . Psychiatr Rehabil J 2013 ; 36 : 173 – 179 Crossref, MedlineGoogle Scholar

11. Thornicroft G , Mehta N , Clement S , et al. : Evidence for effective interventions to reduce mental-health-related stigma and discrimination . Lancet 2016 ; 387 : 1123 – 1132 Crossref, MedlineGoogle Scholar

12. Corrigan PW : Effect of contact-based interventions on stigma and discrimination (letter). Psychiatr Serv 2020 ; 71 : 1324 – 1325 LinkGoogle Scholar

13. Amsalem D , Gothelf D , Dorman A , et al. : Reducing stigma toward psychiatry among medical students: a multicenter controlled trial . Prim Care Companion CNS Disord 2020 ; 22 : 19m02527 Crossref, MedlineGoogle Scholar

14. Reinke RR , Corrigan PW , Leonhard C , et al. : Examining two aspects of contact on the stigma of mental illness . J Soc Clin Psychol 2004 ; 23 : 377 – 389 CrossrefGoogle Scholar

15. Li Y , Sorrentino R , Norman R , et al. : Effects of symptom versus recovery video, similarity, and uncertainty orientation on the stigmatization of schizophrenia . Pers Individ Dif 2017 ; 106 : 117 – 121 CrossrefGoogle Scholar

16. Hurtado SL , Simon-Arndt CM , Schmied EA , et al. : Use of an educational video to reduce barriers to military mental health care . Psychiatr Serv 2019 ; 70 : 915 – 920 LinkGoogle Scholar

17. Tsoi OYY , Chan SKW , Chui AHC , et al. : Effect of brief social contact video compared with expert information video in changing knowledge and attitude towards psychosis patients among medical students . Early Interv Psychiatry 2021 15 : 278 – 285 Crossref, MedlineGoogle Scholar

18. Brown S : The effectiveness of two potential mass media interventions on stigma: video-recorded social contact and audio/visual simulations . Community Ment Health J 2020 ; 56 : 471 – 477 Crossref, MedlineGoogle Scholar

19. Morgan AJ , Reavley NJ , Ross A , et al. : Interventions to reduce stigma towards people with severe mental illness: systematic review and meta-analysis . J Psychiatr Res 2018 ; 103 : 120 – 133 Crossref, MedlineGoogle Scholar

20. Corrigan P , Michaels PJ , Morris S : Do the effects of antistigma programs persist over time? Findings from a meta-analysis . Psychiatr Serv 2015 ; 66 : 543 – 546 LinkGoogle Scholar

21. Jorm AF : Effect of contact-based interventions on stigma and discrimination: a critical examination of the evidence . Psychiatr Serv 2020 ; 71 : 735 – 737 LinkGoogle Scholar

22. Griffiths KM , Carron-Arthur B , Parsons A , et al. : Effectiveness of programs for reducing the stigma associated with mental disorders. A meta-analysis of randomized controlled trials . World Psychiatry 2014 ; 13 : 161 – 175 Crossref, MedlineGoogle Scholar

23. Amsalem D , Yang LH , Jankowski S , et al. : Reducing stigma toward individuals with schizophrenia using a brief video: a randomized controlled trial of young adults . Schizophr Bull 2021 ; 47 : 7 – 14 Crossref, MedlineGoogle Scholar

24. Moses T : Self-labeling and its effects among adolescents diagnosed with mental disorders . Soc Sci Med 2009 ; 68 : 570 – 578 Crossref, MedlineGoogle Scholar

25. Hopmeyer A , Medovoy T : Emerging adults’ self-identified peer crowd affiliations, risk behavior, and social–emotional adjustment in college . Emerg Adulthood 2017 ; 5 : 143 – 148 CrossrefGoogle Scholar

26. Wong EC , Collins RL , Cerully JL , et al. : Effects of contact-based mental illness stigma reduction programs: age, gender, and Asian, Latino, and White American differences . Soc Psychiatry Psychiatr Epidemiol 2018 ; 53 : 299 – 308 Crossref, MedlineGoogle Scholar

27. Paolacci G , Chandler J , Ipeirotis PG : Running experiments on Amazon Mechanical Turk . Judgm Decis Mak 2010 ; 5 : 411 – 419 Google Scholar

28. Cunningham JA , Godinho A , Kushnir V : Can Amazon’s Mechanical Turk be used to recruit participants for internet intervention trials? A pilot study involving a randomized controlled trial of a brief online intervention for hazardous alcohol use . Internet Interv 2017 ; 10 : 12 – 16 Crossref, MedlineGoogle Scholar

29. Boyd JE , Katz EP , Link BG , et al. : The relationship of multiple aspects of stigma and personal contact with someone hospitalized for mental illness, in a nationally representative sample . Soc Psychiatry Psychiatr Epidemiol 2010 ; 45 : 1063 – 1070 Crossref, MedlineGoogle Scholar

30. Phelan JC : Geneticization of deviant behavior and consequences for stigma: the case of mental illness . J Health Soc Behav 2005 ; 46 : 307 – 322 Crossref, MedlineGoogle Scholar

31. Pescosolido BA , Monahan J , Link BG , et al. : The public’s view of the competence, dangerousness, and need for legal coercion of persons with mental health problems . Am J Public Health 1999 ; 89 : 1339 – 1345 Crossref, MedlineGoogle Scholar

32. Corrigan PW , Salzer M , Ralph RO , et al. : Examining the factor structure of the recovery assessment scale . Schizophr Bull 2004 ; 30 : 1035 – 1041 Crossref, MedlineGoogle Scholar

33. Covarrubias I , Han M : Mental health stigma about serious mental illness among MSW students: social contact and attitude . Soc Work 2011 ; 56 : 317 – 325 Crossref, MedlineGoogle Scholar

34. Thornicroft G , Brohan E , Rose D , et al. : Global pattern of experienced and anticipated discrimination against people with schizophrenia: a cross-sectional survey . Lancet 2009 ; 373 : 408 – 415 Crossref, MedlineGoogle Scholar

35. Kosyluk KA , Al-Khouja M , Bink A , et al. : Challenging the stigma of mental illness among college students . J Adolesc Health 2016 ; 59 : 325 – 331 Crossref, MedlineGoogle Scholar

36. Kerby J , Calton T , DiMambro B , et al. : Anti-stigma films and medical student’s attitudes towards mental illness and psychiatry: randomised controlled trial . Psychiatr Bull 2008 ; 32 : 345 – 349 CrossrefGoogle Scholar

37. Barczyk AN : Relationship between the public’s belief in recovery, level of mental illness stigma, and previous contact . Community Ment Health J 2015 ; 51 : 38 – 47 Crossref, MedlineGoogle Scholar

38. Flanigan LK , Climie EA : A review of school-based interventions to reduce stigma towards schizophrenia . Psychiatr Q 2020 ; 91 : 983 – 1002 Crossref, MedlineGoogle Scholar

39. Amsalem D , Dixon LB , Neria Y : The coronavirus disease 2019 (COVID-19) outbreak and mental health: current risks and recommended actions . JAMA Psychiatry 2021 ; 78 : 9 – 10 Crossref, MedlineGoogle Scholar

40. Barney A , Buckelew S , Mesheriakova V , et al. : The COVID-19 pandemic and rapid implementation of adolescent and young adult telemedicine: challenges and opportunities for innovation . J Adolesc Health 2020 ; 67 : 164 – 171 Crossref, MedlineGoogle Scholar