The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.202000924

Abstract

Objective:

To assess model impact and opportunities for improvement, this study examined collaborative care model (CoCM) engagement and clinical outcomes among low-income patients from racial-ethnic minority groups with depression and anxiety.

Methods:

Starting in 2015, the CoCM was implemented in seven primary care practices of an urban academic medical center serving patients from racial-ethnic minority backgrounds, predominantly Medicaid beneficiaries. Eligible individuals scored positive for depressive or anxiety symptoms (or both) on the Patient Health Questionnaire–2 (PHQ-2) and PHQ-9 and the Generalized Anxiety Disorder Scale–2 (GAD-2) and GAD-7 during systematic screening in primary care settings. Screening rates and yield, patient characteristics, and CoCM engagement and outcomes were examined. Clinical improvement was measured by the difference in PHQ-9 and GAD-7 scores at baseline and at 10-to-14-week follow-up.

Results:

High rates of screening (87%, N=88,236 of 101,091) and identification of individuals with depression or anxiety (13%, N=11,886) were observed, and 58% of 3,957 patients who engaged in minimally adequate CoCM treatment had significant clinical improvement. Nevertheless, only 56% of eligible patients engaged in the model, and 25% of those individuals did not return for at least one follow-up appointment. Being female with clinically significant comorbid anxiety and depressive symptoms and having Medicaid or commercial insurance increased the likelihood of CoCM engagement.

Conclusions:

CoCM can help engage vulnerable patients in behavioral health care and improve clinical symptoms. However, significant opportunity exists to advance the model’s impact in treating depressive and anxiety disorders and decreasing health disparities by addressing engagement barriers.

HIGHLIGHTS

  • The collaborative care model (CoCM) provides an important opportunity to improve access to and engagement in depression and anxiety treatment in primary care for vulnerable populations at risk for health disparities.

  • Implemented in clinics from an urban academic medical center serving low-income patients from racial-ethnic minority groups, the CoCM yielded high screening rates and identified individuals with depression and anxiety, with 58% of patients who received at least minimally adequate CoCM showing significant clinical improvement.

  • Increasing engagement in CoCM treatment is a priority to expand its population impact, given high attrition rates in this study, with only 56% of eligible patients initially engaging in the model.

Advances in integrated models of care that address both general medical and behavioral health needs may offer a more holistic population health strategy to improve care quality and clinical outcomes and reduce health care disparities. The team-based, patient-centered collaborative care model (CoCM) is frequently cited as the integrated care approach with the most evidence-based support (13). Key model elements include a care manager assisting in systematic measurement-informed care facilitated by a patient registry, treating to target with stepped care (e.g., problem-solving therapy, behavioral activation, and medication management), and psychiatric case review and consultation. Improving the engagement of vulnerable patients in integrated models such as the CoCM can enhance receptivity and access to behavioral health treatment, representing key steps toward addressing health care inequity and increasing population impact.

One strength of CoCMs is to increase access to behavioral health care for at-risk patients (e.g., patients who are older, from racial-ethnic minority groups, or socioeconomically challenged) with standardized screening to improve identification of patients in need (47). This CoCM feature is particularly relevant because significant investments of state and federal funds encourage behavioral health integration in primary care, including the Medicare Shared Savings Program (8), Comprehensive Primary Care Plus (9), and Medicaid 1115 Waiver programs (10). Billing codes made available in 2018 also support CoCMs and improve feasibility of model implementation and sustainability pathways. Increased examination of CoCM’s real-world population impact and target areas for improvement—particularly related to increasing engagement of low-income people from racial-ethnic minority groups and medically underserved communities—is essential to informing decisions on future model investments.

Research to date indicates that multiple factors can influence patient engagement in behavioral health treatments, such as age and gender (11, 12), socioeconomic factors (13, 14), race and ethnicity (1517), clinical severity (12), and presence of comorbid behavioral health diagnoses (18). Gender is one factor, for instance, with male patients being less likely to initially engage in behavioral health treatments, including the CoCM, than are female patients (19). Underserved patients from racial-ethnic minority groups also show less engagement and higher attrition rates than White patients (20), although greater engagement has been observed for patients from racial-ethnic minority groups in CoCM treatments compared with usual depression care or enhanced referrals (5, 21). Greater clinical symptom severity may also be associated with lower rates of initiation and engagement in the CoCM (22). Of note, several studies indicate that only 42%−46% of patients who receive integrated treatment have more than one visit (5, 23).

CoCM outcomes are likely also affected by symptom severity and other patient characteristics. For example, patients with greater depressive and anxiety symptom severity have been less likely to achieve adequate clinical improvement in CoCM treatment than those with lower symptom severity (2426). Improvement rates for individuals with co-occurring behavioral health conditions may also be lower than among those without these comorbid conditions (27, 28). Similar CoCM clinical outcomes, however, have been reported across male and female patients (19) and when comparing patients from racial-ethnic minority and nonminority populations (29, 30). Some research indicated better health outcomes for patients from racial-ethnic minority groups compared with outcomes for White patients (25, 31), including when minor sociocultural adjustments were incorporated into the model (32). A better understanding of the factors influencing CoCM engagement and outcomes in vulnerable patients may inform model modifications that improve population impact.

In this study, we examined the impact of the CoCM in seven primary care practices serving low-income patients from racial-ethnic minority groups with depressive and anxiety disorders. Unlike most other large-scale CoCM research published to date, which includes primarily patients from nonminority populations and a focus on depression outcomes (3336), our model implementation included a supermajority of patients from racial-ethnic minority groups (77%) and reported on both depression and anxiety outcomes. We describe the screening rate and yield and examine the impact of patient demographic variables and clinical symptom severity on engagement and outcomes.

Methods

Setting

The analysis in this study was conducted as part of a demonstration project funded by the Center for Medicare and Medicaid Health Care Innovation Awards. Funding supported CoCM implementation in an urban academic medical center serving predominantly low-income patients from racial-ethnic minority groups. The CoCM sites included seven of the medical center’s largest primary care practices in separate and distinct locations in the Bronx and lower Westchester counties of New York State starting in 2015. All practices had level-3 patient-centered medical home designations, and three also had federally qualified health center designations and served as family and general internal medicine teaching sites. The project and analysis were approved by the Einstein Institutional Review Board.

Participants

From 2015 through 2018, eligible patients (≥18 years old) were identified at their primary care appointments with systematic screening for depressive and anxiety symptoms, by using the Patient Health Questionnaire–2 (PHQ-2) and PHQ-9 (37) and the Generalized Anxiety Disorder Scale–2 (GAD-2) and GAD-7 (38), respectively. Before the CoCM, workflows encouraged at least annual depression screens, but they were not performed consistently. Systematic screening was implemented across CoCM sites with administration of the PHQ-2 and PHQ-9 and the GAD-2 and GAD-7, which were completed at visit check-in. Patients were offered treatment if they met the clinical threshold for depressive and anxiety symptoms (i.e., scored ≥10 points on the PHQ-9 or GAD-7) or if they were identified by a primary care physician (PCP) as needing treatment. Higher scores on the PHQ-9 (score range 0–27) or GAD-7 (score range 0–21) indicated greater symptom severity. Patients were excluded from CoCM treatment for depression or anxiety if they had a diagnosis of dementia, cognitive impairment, bipolar disorder, schizophrenia, or any psychotic symptoms.

Intervention

The CoCM intervention used was a variation of the Improving Mood-Promoting Access to Collaborative Treatment (also known as IMPACT) model (39), tailored to better address the health and social service needs of the predominantly Medicaid population served by including a behavioral health clinician on the team (mainly licensed social workers). The clinician provided assessment and short-term psychotherapy as needed (e.g., problem-solving and cognitive-behavioral therapy) and helped address common concrete social service needs such as housing instability, food insecurity, and assistance with legal challenges. As part of the standard protocols in CoCMs, the PCPs provided initial depressive and anxiety disorder diagnoses and basic psychotropic medication management, if indicated. Consulting psychiatrists provided case reviews by using electronic health records and offered treatment recommendations when needed. They also performed in-person consultations for patients with medically or behaviorally complex conditions or for those whose conditions were not adequately improving. Using a patient registry, the onsite behavioral health care manager facilitated collaboration among team members, identified stepped care opportunities for patients whose conditions were not improving, and provided “between-visit” patient self-management support with systematic follow-up and behavioral activation coaching.

Outcome Measures and Data Analyses

Screening rates and yield, patient demographic characteristics and symptom severity, intervention engagement and attrition rates, and reasons for dropping out were collected to better understand the CoCM’s potential population impact. The primary clinical outcome was reduction in depressive and anxiety symptoms as measured by the difference between the baseline PHQ-9 and GAD-7 scores and the last score recorded at a 10-to-14-week follow-up. If a patient did not complete the PHQ-9 or GAD-7 at this follow-up, the last follow-up score obtained was carried forward to the 14-week threshold in a modified intent-to-treat analysis. Adequate treatment response was defined by either a 50% improvement in the PHQ-9 or GAD-7 score from baseline or a score <10 points (indicating normal-to-mild symptoms). Remission was defined as a PHQ-9 or GAD-7 score <5 points (37, 40). Patients with a threshold severity of both depressive and anxiety symptoms at baseline had to have either or both of the PHQ-9 or GAD-7 scores meet improvement or remission criteria.

Individuals who met clinical severity thresholds on the respective scales and had at least one follow-up score were included in the improvement and remission analyses. Logistic regression was used to determine the hypothesized factors associated with improvement. Improvement status (improved vs. not improved) was coded as a dummy variable and served as the outcome variable in the predictive-descriptive model.

The regression model included demographic, clinical, system-level, and patient behavior characteristics. Specific variables were as follows: age, sex, insurance type (commercial, Medicaid, or Medicare), clinical site type (teaching or not), baseline PHQ-9 or GAD-7 score, whether the patient met the baseline clinical thresholds on the PHQ-9 and GAD-7 (comorbid depression and anxiety), and number of days between baseline assessment and first follow-up. The model was used to describe the relationship between these characteristics and PHQ-9 or GAD-7 score improvement at 10–14 weeks. Variables with p≤0.05 were considered statistically significant factors affecting the likelihood of improvement.

Patient satisfaction was measured on a six-item, self-reported experience survey on integrated care (41). The survey assessed patients’ understanding of their providers’ collaborative work, patient health knowledge and patients’ perception of the impact of behavioral health on general medical health, and whether health care experiences improved because of the program. Total scores ranged from 0 to 30, with higher scores in each domain indicating a more positive experience and greater health knowledge.

Results

Baseline Screening for Depression and Anxiety

In total, 87% of patients (N=88,236 of 101,091) attending a primary care visit were administered the PHQ-2 and PHQ-9 and the GAD-2 and GAD-7, with 13% (N=11,886) screening positive for clinically significant depressive or anxiety symptoms. (A flow diagram outlining the impact of CoCM on screening rate and yield, engagement, and clinical outcomes is available as an online online supplement to this article.) Overall, 8% (N=6,849) had clinically significant comorbid anxiety and depression. Of those screening positive, 12% (N=1,393) were already engaged in behavioral health care, and another 10% (N=1,196) were not eligible for the CoCM because of our exclusion criteria (i.e., severe mental illness or cognitive impairment) and were referred for traditional behavioral health care.

Engagement in the CoCM

Of the 9,297 eligible individuals, 56% (N=5,247) engaged in CoCM treatment during the study period. Engagement was defined as a patient completing an initial assessment with a preliminary diagnosis and agreeing to start treatment. Overall, 63% (N=3,293) of these patients had both significant depressive and anxiety symptoms at baseline, 22% (N=1,153) had clinically significant depressive symptoms only, and 15% (N=801) had only clinically significant anxiety symptoms. Mean scores were in the moderately severe range for both conditions. Patients who initially engaged in treatment (i.e., agreed to CoCM and completed the initial assessment) had significantly higher PHQ-9 and GAD-7 scores than those who did not engage (15.6 vs. 14.5 and 14.5 vs. 13.8, respectively, p<0.001). For those who did not engage in the CoCM (N=4,050), 77% (N=3,137) were lost to follow-up after a positive screen, and 23% (N=913) declined behavioral health services.

No significant differences in age, sex, or insurance type were observed between those who engaged and those who did not engage in treatment. However, predictive modeling with logistic regression indicated that being female, having clinically significant comorbid anxiety-depressive symptoms, and having Medicaid or commercial insurance increased the likelihood of initial engagement in the CoCM.

Clinical Contacts and Treatment Outcomes

For those who initially engaged in the CoCM (N=5,247), 75% (N=3,957) had one or more follow-up contacts during which a PHQ-9 or GAD-7 was administered, indicating a minimally adequate “dose” of the CoCM (Tables 1 and 2). The mean±SD for number of weeks in treatment was 16.3±11.5, and 50% (N=1,979) of the patients receiving the minimally adequate CoCM dose were discharged within 13 weeks. In total, 85% of patients saw the behavioral health clinician (clinical social worker or psychologist); 69% had contact with the care manager; and 60% had a psychiatric chart review, in-person consultation, or both (Table 2). No significant differences were observed in PHQ-9 or GAD-7 symptom severity, age, sex, or insurance type between patients who initially engaged in the CoCM but did not return for follow-up and those with one or more follow-ups (i.e., received a minimally adequate CoCM dose).

TABLE 1. Characteristics of patients treated at primary care sites with a minimally adequate dose of the collaborative care model with one or more follow-ups

VariableN (N=3,957)%
Age in years (M±SD)46±16
Female3,14780
Race-ethnicity
 Hispanic1,93949
 Non-Hispanic Black1,06827
 Not available3569
 Other3178
 Non-Hispanic White2376
 Asian401
Insurance payer
 Medicaid2,09753
 Commercial1,02926
 Medicare55414
 None or unknown2777
Diagnosis
 Major depressive disorders only82021
 Anxiety disorders only64516
 Comorbid depression and anxietya2,49263
PHQ-9 score (M±SD)b
 Baseline15.6±4.1
 10- to 14-week follow-up10.5±6.2
GAD-7 score (M±SD)c
 Baseline14.5±3.2
 10- to 14-week follow-up9.8±5.7

aComorbidity refers to patients with positive scores on both the Patient Health Questionnaire–9 (PHQ-9) and the Generalized Anxiety Disorder Scale–7 (GAD-7) at baseline.

bThe PHQ-9 measures presence and severity of depressive symptoms. Possible scores range from 0 to 27, with higher scores indicating more severe depressive symptoms. The standard positive cutoff is a score of 10.

cThe GAD-7 measures presence and severity of anxiety symptoms. Possible scores range from 0 to 21, with higher scores indicating more severe anxiety symptoms. The standard positive cutoff is a score of 10.

TABLE 1. Characteristics of patients treated at primary care sites with a minimally adequate dose of the collaborative care model with one or more follow-ups

Enlarge table

TABLE 2. Care contacts of patients treated at primary care sites with a minimally adequate dose of the collaborative care model (CoCM) with one or more follow-ups

VariableN (N=3,957)%M±SD
Primary care after CoCM engagement2,136541.9±1.6
Psychiatrist (in person and chart review)2,374602.2±1.6
Psychiatrist (in person only)396101.0±.7
Clinical social worker or psychologist (in person only)3,363853.8±3.2
Care manager (in-person and phone contacts)2,730692.2±1.5
All3,9571005.7±5.0

TABLE 2. Care contacts of patients treated at primary care sites with a minimally adequate dose of the collaborative care model (CoCM) with one or more follow-ups

Enlarge table

For patients with at least one follow-up by 10–14 weeks (N=3,957), 58% (N=2,287) had improved scores on the PHQ-9, GAD-7, or both. Of these patients, 49% (N=1,120) had significantly improved scores on the PHQ-9, with 19% (N=435) having remission, and 50% (N=1,143) had improved scores on the GAD-7, with 20% (N=457) having remission. Two logistic regressions were used to determine factors significantly associated with improvement on the PHQ-9 and GAD-7 scores. Patients with Medicaid were less likely to have improved scores on the PHQ-9 at 10–14 weeks (p=0.001), but this lack of improvement was not statistically significant for those with threshold-level anxiety symptoms. Self-insured patients were less likely to have improved scores on the GAD-7 at 10–14 weeks (p<0.001), but this lack of improvement was not statistically significant for those with threshold-level depressive symptoms.

Patient Satisfaction

A subset of the study population (N=428), selected on the basis of convenience sampling, completed at least four of the six questions on the self-reported patient experience survey to assess treatment satisfaction and health knowledge. Overall, 74% (N=317) rated their experience positively, as “agree” or “strongly agree” on most questions. Items that scored highest (mean=82%−83%) related to patient knowledge about how behavioral health affects general medical health, how to be more responsible for health care, and patient belief that the care team valued their opinion.

Discussion

This study is one of the first that has assessed the impact of a large real-world clinical CoCM implementation, examining engagement rates and outcomes for low-income patients from a racial-ethnic minority population with clinically significant depressive and anxiety symptoms. Our screening rate was higher than or comparable to rates for similar large-scale CoCMs (33, 4244), with 87% of patients who attended primary care visits receiving a validated depressive and anxiety symptom screen. Although our program fell short of its 95% screening rate goal, systematic screening helped identify potential behavioral health needs for a large majority of patients who may not have otherwise been assessed. Further, the program’s yield of 13% of patients screening positive for clinically significant depressive or anxiety symptoms was notably higher than the average 6%−7% national prevalence of these disorders (45), with most patients (63%) having comorbid depressive and anxiety symptoms warranting treatment. The screening approach used primarily patients’ self-reports on the PHQ-2 and PHQ-9 and on the GAD-2 and GAD-7, as opposed to clinician interview, which may have improved detection. These findings suggest high prevalence rates in this vulnerable population with most patients on Medicaid or commercial insurance.

Of those patients with clinical threshold symptoms at baseline, 68% received some treatment (56% engaged in CoCM, and 12% were already engaged in other behavioral health treatment). Patients who received a minimally adequate dose of CoCM (75% of those who initially engaged in the model) averaged six contacts with CoCM) averaged six contacts with CoCM team members during treatment (see Table 2), even with the typically higher no-show follow-up rates in this population. Psychiatric chart reviews or consultations, typically reserved for clinically complex cases or those not responding to treatment, were conducted on most (60%) of these CoCM patients.

Of note, clinical outcomes in this real-world implementation were comparable to those in previous large-scale CoCM studies (26, 35, 39, 46), with 58% of patients meeting the clinical symptom improvement threshold when receiving minimally adequate CoCM treatment, including 19% and 20% remission rates for depressive and anxiety symptoms, respectively. These improvement rates may not account for possible patient outcomes related to enhanced functional status (e.g., decreased impairment in work or school, social relationships, or activities of daily living) or outcomes for those who dropped out and may have improved, because measures for these data were not included in the study. Interestingly, the improvement rates and remission responses observed in this study were achieved in a shorter, 3- to 4-month average treatment duration, compared with the more typical ≥6 months reported in previous CoCM research (3, 35, 39).

Taking a more conservative population-level perspective, we note that only 43% of patients who were initially eligible for the CoCM received a minimally adequate treatment dose (i.e., one or more follow-ups with administration of a PHQ-9 or GAD-7). Considerable patient attrition also occurred after initial treatment engagement, with 25% of patients not returning to complete a follow-up contact, although this rate was better than the >50% attrition rate after one visit reported in other studies (5, 23). Retention rates were relatively low, even with the availability of our CoCM behavioral health clinician, who met with most patients early in treatment to assess psychotherapy and concrete service needs, and with the care manager’s flexibility to engage patients between office visits. These findings are sobering and indicate that even with the CoCM, considered a gold-standard behavioral health integration model in primary care, more work is needed to identify and overcome barriers to engaging vulnerable patients and advance the model’s impact.

Several clinical and demographic factors appeared to significantly affect CoCM engagement. Interestingly, although previous research suggested that greater symptom severity is correlated with lower CoCM engagement (23), our findings indicated the opposite, with patients who reported more severe baseline depressive and anxiety symptoms being more likely to initially engage in the model. This observation is in line with our clinical observations that patients with greater symptom severity seemed more willing to work with the CoCM care manager. Flexible contact options for the care manager and patient (e.g., by telephone, in person, or patient preference for contact frequency) may have increased engagement by reducing the burden of scheduling and attending in-person visits. CoCM engagement also increased when patients were female, had clinically significant comorbid depressive and anxiety symptoms, and had Medicaid or commercial insurance.

This program’s engagement results inform potential target areas for CoCM modifications and improvements. For instance, decreasing attrition early in treatment might involve identifying and addressing potential barriers to engagement, starting at the initial contact, especially for at-risk patient groups. Our CoCM teams often reported that cultural and socioeconomic concerns, such as perceived stigma and biases toward behavioral health (particularly among male patients), copay burden, transportation, and appointments imposing on family and employment responsibilities, frequently impeded engagement. These barriers to patient engagement also are supported by previous research (47, 48). Improving efficiency of the model and access to the CoCM team through technology integration (e.g., smartphone applications and patient-facing portals) also may reduce engagement barriers (49). With the current rise of billable telehealth services, which accelerated during the COVID-19 pandemic, use of technology is now more practically and financially feasible.

Focusing on timely follow-up after initial assessment and improving time-sensitive and assertive stepped care may be particularly important target areas for vulnerable patient populations from racial-ethnic minority groups. Given that these groups often have greater clinical severity due to unmet needs and less buy-in of behavioral health treatment than White patients, lengthier times to follow-up or needed treatment adjustments may require particular attention when trying to improve minority groups' engagement in CoCM. For instance, our clinical observations suggest that PCPs were highly variable in making timely adjustments to medications, and it often fell to the psychiatrist to make the adjustments after the care manager or behavioral health clinician reported delays in needed medication changes. These overdue adjustments may have delayed treatment responses among some patients and decreased already tenuous buy-in of behavioral health treatments, leading to nonadherence and premature CoCM treatment dropout.

Conclusions

We are unaware of other CoCM implementation studies—especially studies on both depressive and anxiety symptom outcomes in a low-income, medically underserved population with diverse racial-ethnic minority groups—that have analyzed patient characteristics, engagement and attrition rates, and outcomes data in similar detail as done in this study. Our findings support the potential population-health impact of CoCM, given the improved access and outcomes observed in the at-risk, vulnerable patients who engaged in this model. However, our findings also highlighted a significant need for targeted CoCM modifications to improve initial and ongoing patient engagement for this patient population. Generalizability of this program’s results to other settings and populations may be limited, given that the CoCM was conducted with health clinics from an urban academic medical center. The analyses also did not allow investigators to collect data on several factors that may have contributed to patient engagement (or lack thereof). A broader, more impactful application of the model will require research on factors affecting receptivity and engagement in CoCM and may inform improvements of implementation strategies for diverse populations.

Montefiore Care Management Organization (Blackmore, Ricketts), Einstein College of Medicine (Patel, Chung), and Montefiore Medical Group (Ansari), Montefiore Health System, Yonkers, New York; CareMount Medical, Population Health (Stein), and Mantra Health (Carleton), New York City.
Send correspondence to Dr. Blackmore ().

This article is based on a general session, “Population Health Impact and Sustainability of Behavioral Health Integration in Primary Care: The Role of Psychiatry and Technology,” presented at the American Psychiatric Association’s annual Institute for Psychiatric Services: The Mental Health Services Conference, October 3–6, 2019, New York.

This study was supported by grant 1C1CMS331333 from the Centers for Medicare and Medicaid Services, U.S. Department of Health and Human Services (HHS).

The contents of this publication are solely the responsibility of the authors and do not necessarily represent the official views of the HHS or any of its agencies. The research presented here was conducted by the awardee. Findings may or may not be consistent with or confirmed by the findings of the independent evaluation contractor.

Dr. Chung reports consulting for Otsuka Pharmaceuticals and being an advisor to Valera Health. The other authors report no financial relationships with commercial interests.

The authors thank the primary care physicians, psychiatrists, social workers, and patient educators at the Montefiore Health System who contributed to the implementation of the study’s collaborative care model.

References

1 Archer J, Bower P, Gilbody S, et al.: Collaborative care for depression and anxiety problems. Cochrane Database Syst Rev 2012; 10:CD006525MedlineGoogle Scholar

2 Reed SJ, Shore KK, Tice JA: Effectiveness and value of integrating behavioral health into primary care. JAMA Intern Med 2016; 176:691–692Crossref, MedlineGoogle Scholar

3 Gilbody S, Bower P, Fletcher J, et al.: Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. 2006; 166:2314–2321Google Scholar

4 Gallo JJ, Zubritsky C, Maxwell J, et al.: Primary care clinicians evaluate integrated and referral models of behavioral health care for older adults: results from a multisite effectiveness trial (PRISM-e). Ann Fam Med 2004; 2:305–309Crossref, MedlineGoogle Scholar

5 Bartels SJ, Coakley EH, Zubritsky C, et al.: Improving access to geriatric mental health services: a randomized trial comparing treatment engagement with integrated versus enhanced referral care for depression, anxiety, and at-risk alcohol use. Am J Psychiatry 2004; 161:1455–1462LinkGoogle Scholar

6 Miranda J, Duan N, Sherbourne C, et al.: Improving care for minorities: can quality improvement interventions improve care and outcomes for depressed minorities? Results of a randomized, controlled trial. Health Serv Res 2003; 38:613–630Crossref, MedlineGoogle Scholar

7 Unützer J, Harbin H, Schoenbaum M, et al.: The Collaborative Care Model: An Approach for Integrating Physical and Mental Health Care in Medicaid Health Homes. Hamilton, NJ, Center for Health Care Strategies and Mathematics Policy Research, 2013. https://www.chcs.org/media/HH_IRC_Collaborative_Care_Model__052113_2.pdfGoogle Scholar

8 Medicare Shared Savings Program. Baltimore, Centers for Medicare and Medicaid Services, 2020. https://www.cms.gov/Medicare/Medicare-Fee-for-Service-Payment/sharedsavingsprogramGoogle Scholar

9 Comprehensive Primary Care Plus. Baltimore, Centers for Medicare and Medicaid Services, 2020. https://innovation.cms.gov/innovation-models/comprehensive-primary-care-plusGoogle Scholar

10 1115 Medicaid Waivers: From Care Delivery Innovations to Work Requirements. New York, The Commonwealth Fund, 2018. https://www.commonwealthfund.org/publications/explainer/2018/apr/1115-medicaid-waivers-care-delivery-innovations-work-requirementsGoogle Scholar

11 Mackenzie CS, Gekoski WL, Knox VJ: Age, gender, and the underutilization of mental health services: the influence of help-seeking attitudes. Aging Ment Health 2006; 10:574–582Crossref, MedlineGoogle Scholar

12 Roeg D, van de Goor I, Garretsen H: Predicting initial client engagement with community mental health services by routinely measured data. Community Ment Health J 2015; 51:71–78Crossref, MedlineGoogle Scholar

13 Mental Health: Culture, Race, and Ethnicity—A Supplement to Mental Health: A Report of the Surgeon General. Rockville, MD, Center for Mental Health Services, Substance Abuse and Mental Health Services Administration, 2001. https://www.ncbi.nlm.nih.gov/books/NBK44243Google Scholar

14 Fleming MD, Shim JK, Yen IH, et al.: Patient engagement at the margins: health care providers’ assessments of engagement and the structural determinants of health in the safety-net. Soc Sci Med 2017; 183:11–18Crossref, MedlineGoogle Scholar

15 Fortuna LR, Alegria M, Gao S: Retention in depression treatment among ethnic and racial minority groups in the United States. Depress Anxiety 2010; 27:485–494Crossref, MedlineGoogle Scholar

16 O’Brien A, Fahmy R, Singh SP: Disengagement from mental health services. A literature review. Soc Psychiatry Psychiatr Epidemiol 2009; 44:558–568Crossref, MedlineGoogle Scholar

17 Racial/Ethnic Differences in Mental Health Service Use Among Adults. HHS Publication No. SMA-15-4906. Rockville, MD, Substance Abuse and Mental Health Services Administration, 2015. https://store.samhsa.gov/sites/default/files/d7/priv/sma15-4906.pdfGoogle Scholar

18 Kreyenbuhl J, Nossel IR, Dixon LB: Disengagement from mental health treatment among individuals with schizophrenia and strategies for facilitating connections to care: a review of the literature. Schizophr Bull 2009; 35:696–703Crossref, MedlineGoogle Scholar

19 Sherbourne CD, Weiss R, Duan N, et al.: Do the effects of quality improvement for depression care differ for men and women? Results of a group-level randomized controlled trial. Med Care 2004; 42:1186–1193Crossref, MedlineGoogle Scholar

20 DeJesus RS, Njeru J, Angstman K: Engagement among minority patients in collaborative care management for depression. Chronic Dis Int 2015; 2:1014. https://austinpublishinggroup.com/chronic-diseases/fulltext/chronicdiseases-v2-id1014.phpGoogle Scholar

21 Interian A, Lewis-Fernández R, Dixon LB: Improving treatment engagement of underserved US racial-ethnic groups: a review of recent interventions. Psychiatr Serv 2013; 64:212–222LinkGoogle Scholar

22 Heddaeus D, Steinmann M, Daubmann A, et al.: Treatment selection and treatment initialization in guideline-based stepped and collaborative care for depression. PLoS One 2018; 13:e0208882Crossref, MedlineGoogle Scholar

23 Blackmore MA, Carleton KE, Ricketts SM, et al.: Comparison of collaborative care and colocation treatment for patients with clinically significant depression symptoms in primary care. Psychiatr Serv 2018; 69:1184–1187LinkGoogle Scholar

24 Angstman KB, Pietruszewski P, Rasmussen NH, et al.: Depression remission after six months of collaborative care management: role of initial severity of depression in outcome. Ment Health Fam Med 2012; 9:99–106MedlineGoogle Scholar

25 Bauer AM, Azzone V, Alexander L, et al.: Are patient characteristics associated with quality of depression care and outcomes in collaborative care programs for depression? Gen Hosp Psychiatry 2012; 34:1–8Crossref, MedlineGoogle Scholar

26 Roy-Byrne P, Craske MG, Sullivan G, et al.: Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA 2010; 303:1921–1928Crossref, MedlineGoogle Scholar

27 Fava M, Rush AJ, Alpert JE, et al.: Difference in treatment outcome in outpatients with anxious versus nonanxious depression: a STAR*D report. Am J Psychiatry 2008; 165:342–351LinkGoogle Scholar

28 Howland RH, Rush AJ, Wisniewski SR, et al.: Concurrent anxiety and substance use disorders among outpatients with major depression: clinical features and effect on treatment outcome. Drug Alcohol Depend 2009; 99:248–260Crossref, MedlineGoogle Scholar

29 Areán PA, Ayalon L, Hunkeler E, et al.: Improving depression care for older, minority patients in primary care. Med Care 2005; 43:381–390Crossref, MedlineGoogle Scholar

30 Angstman KB, Phelan S, Myszkowski MR, et al.: Minority primary care patients with depression: outcome disparities improve with collaborative care management. Med Care 2015; 53:32–37Crossref, MedlineGoogle Scholar

31 Davis TD, Deen T, Bryant-Bedell K, et al.: Does minority racial-ethnic status moderate outcomes of collaborative care for depression? Psychiatr Serv 2011; 62:1282–1288LinkGoogle Scholar

32 Ell K, Katon W, Xie B, et al.: Collaborative care management of major depression among low-income, predominantly Hispanic subjects with diabetes: a randomized controlled trial. Diabetes Care 2010; 33:706–713Crossref, MedlineGoogle Scholar

33 Solberg LI, Crain AL, Maciosek MV, et al.: A stepped-wedge evaluation of an initiative to spread the collaborative care model for depression in primary care. Ann Fam Med 2015; 13:412–420Crossref, MedlineGoogle Scholar

34 Reiss-Brennan B, Brunisholz KD, Dredge C, et al.: Association of integrated team-based care with health care quality, utilization, and cost. JAMA 2016; 316:826–834Crossref, MedlineGoogle Scholar

35 Rossom RC, Solberg LI, Magnan S, et al.: Impact of a national collaborative care initiative for patients with depression and diabetes or cardiovascular disease. Gen Hosp Psychiatry 2017; 44:77–85Crossref, MedlineGoogle Scholar

36 Rosenberg D, Lin E, Peterson D, et al.: Integrated medical care management and behavioral risk factor reduction for multicondition patients: behavioral outcomes of the TEAMcare trial. Gen Hosp Psychiatry 2014; 36:129–134Crossref, MedlineGoogle Scholar

37 Kroenke K, Spitzer RL, Williams JBW: The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001; 16:606–613Crossref, MedlineGoogle Scholar

38 Spitzer RL, Kroenke K, Williams JBW, et al.: A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006; 166:1092–1097Crossref, MedlineGoogle Scholar

39 Unützer J, Katon W, Callahan CM, et al.: Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA 2002; 288:2836–2845Crossref, MedlineGoogle Scholar

40 Mitchell J, Trangle M, Degnan B, et al.: Health Care Guideline: Adult Depression in Primary Care. Bloomington, MN, Institute for Clinical Systems Improvement, 2013. https://www.bcbsnm.com/pdf/cpg_depression.pdfGoogle Scholar

41 Chung H, Kim A, Neighbors CJ, et al.: Early experience of a pilot intervention for patients with depression and chronic medical illness in an urban ACO. Gen Hosp Psychiatry 2013; 35:468–471Crossref, MedlineGoogle Scholar

42 Sederer LI, Derman M, Carruthers J, et al.: The New York State collaborative care initiative: 2012–2014. Psychiatr Q 2016; 87:1–23Crossref, MedlineGoogle Scholar

43 Thompson H, Faig W, Gupta N, et al.: Collaborative care for depression of adults and adolescents: measuring the effectiveness of screening and treatment update. Psychiatr Serv 2019; 70:604–607LinkGoogle Scholar

44 Pfoh ER, Janmey I, Anand A, et al.: The impact of systematic depression screening in primary care on depression identification and treatment in a large health care system: a cohort study. J Gen Intern Med 2020; 35:3141–3147Crossref, MedlineGoogle Scholar

45 Major Depression. Bethesda, MD, National Institute of Mental Health, 2021. https://www.nimh.nih.gov/health/statistics/major-depression.shtmlGoogle Scholar

46 Roy-Byrne PP, Katon W, Cowley DS, et al.: A randomized effectiveness trial of collaborative care for patients with panic disorder in primary care. Arch Gen Psychiatry 2001; 58:869–876Crossref, MedlineGoogle Scholar

47 Ofonedu ME, Belcher HME, Budhathoki C, et al.: Understanding barriers to initial treatment engagement among underserved families seeking mental health services. J Child Fam Stud 2017; 26:863–876Crossref, MedlineGoogle Scholar

48 Alang SM: Sociodemographic disparities associated with perceived causes of unmet need for mental health care. Psychiatr Rehabil J 2015; 38:293–299Crossref, MedlineGoogle Scholar

49 Carleton KE, Patel UB, Stein D, et al.: Enhancing the scalability of the collaborative care model for depression using mobile technology. Transl Behav Med 2020; 10:573–579Crossref, MedlineGoogle Scholar