Unpacking Collaborative Care for Depression: Examining Two Essential Tasks for Implementation
Abstract
Objective:
This study examined how two key process-of-care tasks of the collaborative care model (CCM) predict patient depression outcomes.
Methods:
Registry data were from a large implementation of the CCM in Washington State and included 5,439 patient-episodes for patients age 18 or older with a baseline Patient Health Questionnaire-9 (PHQ-9) score of ≥10 and at least one follow-up contact with the CCM care manager within 24 weeks of initial contact. Key CCM tasks examined were at least one care manager follow-up contact within four weeks of initial contact and at least one psychiatric consultation between weeks 8 and 12 for patients not responding to treatment by week 8. Clinically significant improvement in depression symptoms was defined as achieving a PHQ-9 score of <10 or a 50% or more reduction in PHQ-9 score compared with baseline. Bivariate and multivariate (logistic and proportional hazard models) analyses were conducted to examine how fidelity with either task predicted outcomes. All analyses were conducted with the original sample and with a propensity score–matched sample.
Results:
Four-week follow-up was associated with a greater likelihood of achieving improvement in depression (odds ratio [OR]=1.63, 95% confidence interval [CI]=1.23–2.17) and a shorter time to improvement (hazard ratio=2.06, CI=1.67–2.54). Psychiatric consultation was also associated with a greater likelihood of improvement (OR=1.44, CI=1.13–1.84) but not with a shorter time to improvement. Propensity score–matched analysis yielded very similar results.
Conclusions:
Findings support efforts to improve fidelity to the two process-of-care tasks and to include these tasks among quality measures for CCM implementation.
Common mental health conditions seen in primary care, such as depression and anxiety, impose substantial suffering, complicate coexisting general medical conditions (1–3), and lead to enormous loss of productivity (4,5) and increases in total health care costs (6,7). Primary care has long been recognized as the de facto mental health treatment setting (8,9). However, the average quality of mental health care in primary care remains lower than optimal (10,11).
The collaborative care model (CCM) incorporates the core concepts of the chronic care model (12,13) to address the need to integrate high-quality mental health care in primary care. Over 70 randomized controlled trials have provided collective and robust evidence of the effectiveness of CCM to improve depression, processes of care, and quality-of-life outcomes (14,15) and of its potential for reducing long-term health care costs (16). The CCM approaches care with a collaborative team, including the primary care physician, a care manager, and a consulting psychiatrist. The key principles of the model include systematic follow-up of patients by the care manager, measurement-based care that uses symptom rating scales to track clinical improvements or identify patients who are not improving (17), and “stepped care” (18) with which treatment is systematically adjusted or intensified (by the primary care team but with input from the consulting psychiatrist) for patients who are not improving (19). The CCM is increasingly recognized as a best practice to integrate evidence-based mental health care into primary care (20–23).
Wide dissemination of the CCM, however, may be hindered by the complexity of the intervention and a lack of knowledge regarding the relative importance of the different components of the model for patient outcomes. The CCM is defined by a set of core components and tasks (24,25) and has almost always been tested as a package. Provider organizations with limited experience of practice changes may not be able to achieve full fidelity when first implementing CCM (26,27). Knowing the relative contribution of key elements of the model would help provider organizations direct their resources to maximize returns on their implementation. Such knowledge would also inform the selection of quality assurance and performance evaluation measures for CCM implementation.
A limited number of studies have sought to identify “active ingredients” of CCM that disproportionately contribute to its effectiveness (28–31). The ingredients examined were mostly structural aspects of the intervention (for example, use of a clinical information system). Studies of process-of-care elements (for example, intensity and frequency of care manager contacts) are important to guide the operation and quality assurance of the CCM, but such studies have been rare (32). Furthermore, analysis of process-of-care measures aggregated to the provider or site level, as in the work of Bauer and colleagues (32), could be subject to one type of ecological fallacy: average measures that lack variation across studies or implementations could disguise large variation within these units that might have important implications for patient outcomes (33).
In this study, we began to address this knowledge gap by identifying and examining two key process-of-care tasks of CCM and by exploiting variation across patients by using data from a large implementation in Washington State. We tested the hypothesis that practice of either of the two tasks predicts clinically meaningful improvement in depression within six months of CCM initiation.
Methods
Selection of Key Tasks
We first compiled a list of process-of-care components and key tasks of CCM on the basis of expert consensus (25). We focused on tasks that can be reliably measured with the Clinical Management Tracking System, the clinical information system (34) first developed as part of the Improving Mood–Promoting Access to Treatment (IMPACT) study (35) and subsequently used in many CCM implementations (Table 1). We then applied the following criteria to select key tasks to be studied. First, the tasks should embed one or more of the key principles of the CCM, including systematic follow-up, measurement-based care, and stepped care. Second, the tasks should occur in the early stage of CCM (first 12 weeks) when care management is most intensive (36) and likely most influential in shaping patient outcome trajectories (32). Restricting selection to tasks performed in the early stage may also mitigate the selection bias introduced by the stepped-care nature of CCM, in that patients whose depression is resistant to treatment subsequently receive more intensive care management, but because of the nature of their conditions, they are less likely to achieve good outcomes. Third, the tasks should be of significance to all CCM patients regardless of whether they receive medication or psychotherapy (or both). Fourth, substantial variation should exist in the practice of these tasks in our data (<90% in fidelity) to enable reliable estimates.
Core component and task | Operational definition of task |
---|---|
Patient identification and diagnosis | |
Diagnose behavioral health problems and related conditions | ≥1 working diagnoses for common behavioral health conditions checked during episode |
Use valid measurement tools to assess and document baseline severity | ≥1 measures completed at baseline, for example, the Patient Health Questionnaire–9 (PHQ–9) to assess depression severity |
Engagement in integrated care program | |
Initiate patient tracking in population-based registry | Patient has ≥1 follow-up contact with the care manger within 4 weeks of initial contact |
Systematic follow-up, treatment adjustment, and relapse prevention | |
Use population-based registry to systematically follow all patients | No period(s) of ≥60 days between enrollment and discharge in which no contact occurs |
Monitor treatment response at each contact with valid outcome measures | Patient has ≥1 measures based on valid instruments (for example, PHQ-9 for depression) recorded at each follow-up |
Identify patients who are not improving to plan for medication adjustment | If not improving, patient has had medication dosage adjustment, switching, or augmentation within 90 days since initial contact |
Create and support relapse prevention plan when patients are substantially improved | Patient who has achieved improvement during episode receives a relapse prevention plan as documented in the registry |
Systematic psychiatric case review and consultation | |
Conduct regular psychiatric caseload review for patients who are not improving | Patient not improving within 8 weeks of initial contact receives ≥1 psychiatric evaluations as documented in registry |
Two key process-of-care tasks were selected: at least one follow-up contact with the patient by the CCM care manager within four weeks of the initial contact, either at the clinic (in person) or by phone (reflecting the principle of systematic follow-up); and at least one psychiatric consultation on the case between weeks 8 and 12 for patients who do not achieve improvement by week 8 (reflecting measurement-based care and stepped care). Restriction to patients who are not improving for the second task was based on the CCM protocol that recommends psychiatric consultation for cases in which patients do not respond to initial treatment.
Study Population and Data
Our data were from Washington State’s Mental Health Integration Program (MHIP), a publicly funded implementation of the CCM in a network of more than 100 community health centers that are diverse in geographic location, size, and patient populations served (37). First started in 2008, the MHIP has served more than 35,000 patients with mental health, substance abuse, and comorbid general medical conditions who received primary care in participating clinics (38). Eligible patients included enrollees in the state’s Disability Lifeline Program (patients temporarily disabled because of a general medical or mental health condition and expected to be unemployed for 90 days or more), veterans and their family members, uninsured persons, low-income mothers and their children, and low-income older adults (the categories are not mutually exclusive). All participating clinics used a Web-based registry to systematically document care management activities and clinical outcomes on the basis of standard measurement tools (for example, the Patient Health Questionnaire [PHQ-9] to track depressive symptoms [39] and to assist with population management).
In this study, we focused on patients age 18 or older who initiated care in the MHIP between January 1, 2008, and August 15, 2010, in clinics in King and Pierce counties, the two most populous counties in Washington State and where MHIP implementation first started. We further restricted to a subset of patients who had a baseline PHQ-9 score of ≥10, indicating clinically significant depression, and at least one follow-up contact with the MHIP care manager within six months (24 weeks) of the initial contact to ensure at least one chance to measure patient depression outcomes. The resulting sample included 5,439 patient-episodes.
Outcome Measures
Our main outcome measures were a binary outcome of achieving clinically significant improvement in depression, defined as having at least one follow-up PHQ-9 score of <10 or achieving a 50% or more reduction in the PHQ-9 score (39) within 24 weeks of the initial contact with the MHIP care manager (“improvement” hereafter), and time to achieving improvement.
Statistical Analysis
Bivariate analysis.
We compared the probability of achieving improvement in depression by the receipt of either of the two key tasks defined above. We generated Kaplan-Meier survival curves to capture the cumulative percentage of patients achieving improvement over the first 24 weeks after initiation by the receipt of either task.
Multivariate analysis.
We estimated logistic models for achieving clinically significant improvement within 24 weeks and Cox proportional hazard models for time to improvement. Both models controlled for patient age and gender; baseline PHQ-9 scores; comorbid behavioral health conditions other than depression, including anxiety disorders, bipolar disorder, cognitive disorder, psychosis, posttraumatic stress disorder (PTSD), substance use disorders, and suicidal ideation; and categories of eligibility for MHIP. All multivariate analysis included dummy indicators of community health centers and MHIP participating sites (site fixed effects) to control for any between-site differences in quality and outcomes of care; the analysis derived robust standard errors taking into account clustering of patients within sites (40,41).
Propensity score adjustment.
Our initial analysis indicated that patient receipt of either task was associated with greater baseline severity of depression, behavioral health comorbidity, and MHIP eligibility categories. Although such association is consistent with the principle of stepped care, the resulting confounding would likely have biased our estimates. We thus conducted propensity score–adjusted analysis (42) by constructing propensity score–matched control groups for each of the two tasks of interest. Predictors in the propensity score model for each task included all baseline patient demographic and clinical characteristics and MHIP site fixed effects. We used 1:1 nearest-neighbor matching within a defined caliper (.25 of SD of the log-odds of estimated propensity scores) (43,44) with replacement, which allowed patients not receiving the task (the “controls”) to serve as matches in more than one pair. This approach, compared with other methods of matching that we tested (including 1 to k matching with replacement with and without a specified caliper), yielded both the most balanced sample and adequate sample size.
Results
Table 2 summarizes data on sample characteristics by receipt of either of the two CCM tasks. Patients receiving at least one follow-up contact in the first four weeks, compared with patients who received none, had slightly higher PHQ-9 scores, had a greater prevalence of all comorbid behavioral health conditions, and were more likely to be in the eligibility categories of Disability Lifeline clients and uninsured clients than in the other eligibility categories. Similar differences were noted in baseline severity and comorbidities by the receipt of psychiatric consultation in the subsample of patients not achieving improvement by week 8. Overall, 42.8% of patients with at least one follow-up contact in the first four weeks achieved clinically significant improvement in 24 weeks, compared with 34.4% among those who had no follow-up within four weeks. Among patients not improving by week 8, 24.9% of those with at least one psychiatric consultation between weeks 8 and 12 achieved improvement compared with 20.1% among those who did not receive consultation.
Characteristic | Follow-up contact within 4 weeks | Psychiatric consultation between weeks 8 and 12a | ||||||
---|---|---|---|---|---|---|---|---|
0 (N=968) | ≥1 (N=4,471) | 0 (N=3,659) | ≥1 (N=358) | |||||
N | % | N | % | N | % | N | % | |
Demographic | ||||||||
Female | 527 | 55.2 | 2,250 | 51.3 | 1,840 | 51.1 | 178 | 50.4 |
Male | 441 | 44.8 | 2,221 | 48.7 | 1,819 | 48.9 | 180 | 49.6 |
Age | ||||||||
18–29 | 219 | 22.7 | 879 | 19.7 | 696 | 19.1 | 59 | 16.5 |
30–39 | 210 | 21.7 | 967 | 21.7 | 772 | 21.2 | 79 | 22.1 |
40–49 | 272 | 28.3 | 1,318 | 29.6 | 1,105 | 30.3 | 108 | 30.2 |
50–59 | 205 | 21.2 | 1,087 | 24.4 | 900 | 24.7 | 95 | 26.5 |
≥60 | 61 | 6.3 | 209 | 4.7 | 177 | 4.9 | 17 | 4.8 |
Baseline clinical indicator | ||||||||
Patient Health Questionnaire–9 score | ||||||||
10–14 | 258 | 29.9 | 1,101 | 26.2 | 695 | 20.6 | 60 | 17.4 |
15–19 | 298 | 34.5 | 1,343 | 32.0 | 1,133 | 33.6 | 113 | 32.9 |
≥20 | 308 | 35.7 | 154 | 41.8 | 1,547 | 45.8 | 191 | 49.7 |
Comorbid behavioral health condition | ||||||||
Anxiety disorder | 481 | 49.7 | 2,863 | 64.0 | 2,309 | 63.1 | 256 | 71.5 |
Bipolar disorder | 166 | 17.2 | 823 | 18.4 | 669 | 18.3 | 79 | 22.1 |
Cognitive disorder | 9 | .9 | 115 | 2.6 | 79 | 2.2 | 12 | 3.4 |
Psychotic disorder | 15 | 1.5 | 133 | 3.0 | 101 | 2.8 | 18 | 5.0 |
PTSD | 142 | 14.7 | 1,067 | 23.9 | 841 | 23.0 | 103 | 28.8 |
Substance use disorder | 154 | 15.9 | 938 | 21.0 | 717 | 19.6 | 78 | 21.8 |
Suicidal ideation | 468 | 53.2 | 2,504 | 59.0 | 2,096 | 61.2 | 222 | 64.7 |
Patient eligibility categoryb | ||||||||
Disability Lifeline | 649 | 67.1 | 3,213 | 71.9 | 2,698 | 73.7 | 294 | 82.1 |
Low-income mothers | 126 | 13.0 | 443 | 9.9 | 302 | 8.3 | 21 | 5.9 |
Low-income older adults | 112 | 11.6 | 479 | 10.7 | 390 | 10.7 | 36 | 10.1 |
Uninsured | 98 | 10.1 | 590 | 13.2 | 435 | 11.9 | 30 | 8.4 |
Veterans | 53 | 5.5 | 129 | 2.9 | 129 | 3.5 | 11 | 3.1 |
Family members of veterans | 18 | 1.9 | 61 | 1.4 | 63 | 1.7 | 3 | .8 |
Clinically significant improvement in depression within 24 weeks | 333 | 34.4 | 1,915 | 42.8 | 737 | 20.1 | 89 | 24.9 |
Baseline characteristics of patients treated in a collaborative care model, by receipt of two key process-of-care tasks
Figures 1–2 are Kaplan-Meier survival curves for time to first clinically significant improvement in depression within 24 weeks. Having at least one follow-up contact within the first four weeks was significantly associated with a shorter time to improvement (log-rank test, p<.001). The cumulative percentage of patients achieving improvement was 10 to 20 percentage points greater among patients with at least one follow-up than among those without (Figure 1). Having a psychiatric consultation, on the other hand, was not associated with a shorter time to improvement, as shown by largely overlapping survival curves in Figure 2.
On the basis of multivariate logistic analysis, having at least one follow-up contact was associated with greater odds of achieving improvement in 24 weeks (odds ratio [OR]=1.63) (Table 3). Among patients not improving by week 8, having a psychiatric consultation between weeks 8 and 12 was also associated with greater odds of achieving improvement in 24 weeks (OR=1.44). On the basis of estimated Cox proportional hazard models, having one or more follow-up contacts in the first four weeks was associated with a shorter time to improvement (hazard ratio=2.06) (Table 3). The hazard ratio associated with psychiatric consultation was not significant. [Complete estimates for both models are presented in an online supplement to this article.]
Task | Clinically significant improvement in depression | Time to first clinically significant improvement in depression | ||||||
---|---|---|---|---|---|---|---|---|
Original sample | Propensity score–matched sample | Original sample | Propensity score–matched sample | |||||
OR | 95% CI | OR | 95% CI | HRa | 95% CI | HRa | 95% CI | |
≥1 follow-up contacts in weeks 1–4 | 1.63 | 1.23–2.17 | 1.57 | 1.11–2.24 | 2.06 | 1.67–2.54 | 1.96 | 1.52–2.54 |
≥1 psychiatric consultations in weeks 8–12b | 1.44 | 1.13–1.84 | 1.40 | 1.13–1.74 | .99 | .81–1.21 | .90 | .64–1.26 |
Logistic regression of key tasks as predictors of depression outcomes among patients treated in a collaborative care model, with and without propensity score adjustment
Our propensity score–matched samples achieved good balance in all observed baseline characteristics. The propensity score–adjusted analysis generated results very similar to those based on the original samples (Table 3).
Discussion
In this study, we used data from a large implementation of the CCM to examine whether the practice of two key tasks in the early phase of CCM intervention predicted patient depression outcomes. We found that timely care manager follow-up within the first four weeks strongly predicted clinically significant improvement in depression within six months and a shorter time to achieving improvement. For patients not achieving improvement by week 8, we found that psychiatric consultation within the next four weeks (weeks 8–12) strongly predicted improvement within six months but not time to improvement.
Our findings regarding timely follow-up in the first four weeks suggest that patient engagement in the early phase of treatment might have critical implications for patient outcomes. Three pathways are potentially at play. First, as is the case with most CCM protocols, patients were referred to the MHIP program at a time when they were acutely depressed. Timely follow-up at the acute phase provides an opportunity to assess patient response and adjust treatment plans, potentially influencing the trajectory of treatment and patient outcomes. As shown in a previous study of between-site variation in a large CCM demonstration project (32), sites with higher rates of early follow-ups also had better patient depression outcomes that were not explained by patient characteristics. Second, early-stage follow-up enables care managers to conduct patient education and strengthen clinical alliances at a time when patients are at a high risk of becoming nonadherent to antidepressant therapy (45). Third, care manager contact may have therapeutic effects independent of its support of antidepressant or psychotherapy interventions. As seen in several large trials of the CCM, the effect of the intervention on depression outcomes was found as early as three months after the start of the program (35,46), suggesting that increased clinician attention and patient engagement in the early phase of CCM may have had a direct effect before improved antidepressant treatment or psychotherapy could translate into improved patient outcomes.
Our findings also support the value of timely psychiatric consultation when patients do not experience improvement in the early phase of CCM. Patients who did not achieve improvement in the first eight weeks were likely more clinically challenging to treat, as indicated by their substantially lower rate of improvement within six months (about 20%) compared with rates for the entire cohort (30%−40%). Our results suggest that timely psychiatric consultation to adjust treatment could substantially improve the chances of remission and recovery for patients whose depression is resistant to initial treatment. On the other hand, psychiatric consultation did not predict more speedy improvement. Reasons might be the low rate of improvement (about 20%) in this cohort and the fact that it took a much longer time for the majority of this cohort to achieve improvement (around 48 weeks) [see online supplement].
Our findings should not be interpreted to indicate that the two CCM tasks studied were the only tasks primary care teams need to practice to achieve improved patient outcomes. Primary care practices need to first undertake the systematic and organizational changes necessary to implement the CCM (27,47). These include both changes in overall approaches to chronic care (for example, addition of a care manager to perform care management activities outside of primary care visits) and infrastructure building to enable operation (for example, the use of a depression registry). In this study, we chose to focus on process-of-care measures because they are less studied and are likely subject to greater variation in implementation.
By design, different process-of-care tasks of CCM are often practiced together and enable each other. For example, using PHQ-9 to continuously assess patient outcomes (Table 1), a key task of CCM that was not studied here, is an important part of each care manager contact with the patient and provides the basis for psychiatric consultation. This study provides evidence to support two key tasks in the first four to 12 weeks of CCM, without negating the importance of the other key tasks of CCM identified by expert consensus (Table 1).
Several limitations should be noted. First, despite propensity score–adjusted analysis, unobserved and unmeasured differences between patients who received either task and those who did not might be substantial and might have led to biases in our estimates. As discussed above, selection by patient baseline severity and complexity could have biased our estimates toward the null. Selection could also have occurred through patient motivation: patients with greater motivation were more likely to follow through with care management appointments but, at the same time, all else being equal, were more likely to achieve improvement in depression. Thus selection by motivation could have biased the effect of the four-week follow-up away from the null (that is, toward suggesting a positive effect of follow-up), offsetting the selection bias by severity to an unknown extent.
Second, practice of either task may reflect the overall quality or fidelity to CCM at a given implementation site. This concern, however, was alleviated because our adjusted analysis controlled for all time-invariant, between-site differences by inclusion of site fixed effects. Results of our analysis thus reflect how variation in task performance (either over time or across patients) within a given site predicted patient outcomes. Nonetheless, the practice of either task may be correlated with the practice of other related tasks for the same patient. For example, timely follow-up in the early phase may increase the likelihood that patients are continuously engaged and followed up in the rest of the treatment episode. Thus estimated ORs and hazard ratios associated with either of the two tasks may reflect a combination of their direct effects and indirect effects mediated through other tasks and need to be interpreted with caution.
Conclusions
Our study provided strong evidence that timely care manager follow-up in the first four weeks of CCM predicted substantial improvement in patient depression outcomes. Evidence regarding timely psychiatric consultation for cases in which patients did not respond to the initial course of treatment was less consistent but suggestive of the benefits of this task. Our findings support efforts to improve fidelity to these two process-of-care tasks and to include these two tasks among quality measures for CCM implementation. Future studies should seek to assess the relative importance of other key tasks of CCM and test implementation strategies (for example, pay for performance) to encourage and enable high fidelity to tasks found to contribute to good patient outcomes.
1 : Depression, chronic diseases, and decrements in health: results from the World Health Surveys. Lancet 370:851–858, 2007Crossref, Medline, Google Scholar
2 : Mental comorbidity and quality of diabetes care under Medicaid: a 50-state analysis. Medical Care 50:428–433, 2012Crossref, Medline, Google Scholar
3 : Increased medical costs of a population-based sample of depressed elderly patients. Archives of General Psychiatry 60:897–903, 2003Crossref, Medline, Google Scholar
4 : Making the business case for enhanced depression care: the National Institute of Mental Health–Harvard Work Outcomes Research and Cost-Effectiveness Study. Journal of Occupational and Environmental Medicine 50:468–475, 2008Crossref, Medline, Google Scholar
5 : The impact of depression on workplace functioning and disability costs. American Journal of Managed Care 15(suppl):S322–S327, 2009Medline, Google Scholar
6 : Depressive symptoms and the cost of health services in HMO patients aged 65 years and older: a 4-year prospective study. JAMA 277:1618–1623, 1997Crossref, Medline, Google Scholar
7 : Healthcare costs associated with depression in medically ill fee-for-service Medicare participants. Journal of the American Geriatrics Society 57:506–510, 2009Crossref, Medline, Google Scholar
8 : The de facto US mental and addictive disorders service system: epidemiologic catchment area prospective 1-year prevalence rates of disorders and services. Archives of General Psychiatry 50:85–94, 1993Crossref, Medline, Google Scholar
9 : Changing profiles of service sectors used for mental health care in the United States. American Journal of Psychiatry 163:1187–1198, 2006Link, Google Scholar
10 : One-year clinical outcomes of depressed public sector outpatients: a benchmark for subsequent studies. Biological Psychiatry 56:46–53, 2004Crossref, Medline, Google Scholar
11 2014 State of Health Care Quality: Antidepressant Medication Management. Washington, DC, National Committee for Quality Assurance, 2014. Available at www.ncqa.org/ReportCards/HealthPlans/StateofHealthCareQuality/2014TableofContents/Antidepressant.aspx. Accessed April 16, 2015Google Scholar
12 : Collaborative management of chronic illness. Annals of Internal Medicine 127:1097–1102, 1997Crossref, Medline, Google Scholar
13 : Organizing care for patients with chronic illness. Milbank Quarterly 74:511–544, 1996Crossref, Medline, Google Scholar
14 : Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Archives of Internal Medicine 166:2314–2321, 2006Crossref, Medline, Google Scholar
15 : Systematic review of multifaceted interventions to improve depression care. General Hospital Psychiatry 29:91–116, 2007Crossref, Medline, Google Scholar
16 : Long-term cost effects of collaborative care for late-life depression. American Journal of Managed Care 14:95–100, 2008Medline, Google Scholar
17 : Tools and strategies for ongoing assessment of depression: a measurement-based approach to remission. Journal of Clinical Psychiatry 70(suppl 6):26–31, 2009Crossref, Medline, Google Scholar
18 : Individualized stepped care of chronic illness. Western Journal of Medicine 172:133–137, 2000Crossref, Medline, Google Scholar
19 : Collaborative depression care: history, evolution and ways to enhance dissemination and sustainability. General Hospital Psychiatry 32:456–464, 2010Crossref, Medline, Google Scholar
20 : Integration of mental health/substance abuse and primary care. Evidence Report Technology Assessment 173:1–362, 2008Medline, Google Scholar
21 Finch RA, Phillips K: An Employer's Guide to Behavioral Health Services: A Roadway and Recommendations for Evaluating, Designing, and Implementing Behavioral Health Services. Washington, DC, National Business Group on Health, Center for Prevention and Health Services, 2005. Available at www.businessgrouphealth.org/pub/f3139c4c-2354-d714-512d-355c09ddcbc4. Accessed April 16, 2015Google Scholar
22 Mental Health: A Report of the Surgeon General. Rockville, Md, US Department of Health and Human Services, US Public Health Service, 1999Google Scholar
23 Achieving the Promise: Transforming Mental Health Care in America. Pub no SMA-03-3832. Rockville, Md, Department of Health and Human Services, President’s New Freedom Commission on Mental Health, 2003Google Scholar
24 : Steps for implementing collaborative care programs for depression. Population Health Management 12:69–79, 2009Crossref, Medline, Google Scholar
25 Checklist of Collaborative Care Principles and Components. Seattle, University of Washington, AIMS Center, 2014. Available at aims.uw.edu/resource-library/checklist-collaborative-care-principles-and-components. Accessed April 16, 2015Google Scholar
26 : Care managers’ experiences in a collaborative care program for high risk mothers with depression. Psychosomatics 54:272–276, 2013Crossref, Medline, Google Scholar
27 : Implementing a depression improvement intervention in five health care organizations: experience from the RESPECT-Depression trial. Administration and Policy in Mental Health and Mental Health Services Research 34:127–137, 2007Crossref, Medline, Google Scholar
28 : Collaborative care for depression in primary care: making sense of a complex intervention: systematic review and meta-regression. British Journal of Psychiatry 189:484–493, 2006Crossref, Medline, Google Scholar
29 : Collaborative chronic care models for mental health conditions: cumulative meta-analysis and metaregression to guide future research and implementation. Medical Care 51:922–930, 2013Crossref, Medline, Google Scholar
30 : Effective implementation of collaborative care for depression: what is needed? American Journal of Pharmacy Benefits 20:699–707, 2014Google Scholar
31 : Characteristics of effective collaborative care for treatment of depression: a systematic review and meta-regression of 74 randomised controlled trials. PLoS One 9:e108114, 2014Crossref, Medline, Google Scholar
32 : Implementation of collaborative depression management at community-based primary care clinics: an evaluation. Psychiatric Services 62:1047–1053, 2011Link, Google Scholar
33 : How should meta-regression analyses be undertaken and interpreted? Statistics in Medicine 21:1559–1573, 2002Crossref, Medline, Google Scholar
34 : A Web-based data management system to improve care for depression in a multicenter clinical trial. Psychiatric Services 53:671–673, 2002Link, Google Scholar
35 : Collaborative care management of late-life depression in the primary care setting: a randomized controlled trial. JAMA 288:2836–2845, 2002Crossref, Medline, Google Scholar
36 : Designing payment for Collaborative Care for Depression in primary care. Health Services Research 46:1436–1451, 2011Crossref, Medline, Google Scholar
37 MHIP Clinics [map]. Seattle, Washington State Mental Health Integration Program. Accessed April 16, 2015. Available at integratedcare-nw.org/Map.htmlGoogle Scholar
38 Washington State's Mental Health Integration Program (MHIP). Seattle, University of Washington, AIMS Center, 2015. Available at aims.uw.edu/washington-states-mental-health-integration-program-mhip. Accessed April 16, 2015Google Scholar
39 : The PHQ-9: validity of a brief depression severity measure. Journal of General Internal Medicine 16:606–613, 2001Crossref, Medline, Google Scholar
40 : Consistent covariance-matrix estimation with cross-sectional dependence and heteroskedasticity in financial data. Journal of Financial and Quantitative Analysis 24:333–355, 1989Crossref, Google Scholar
41 : A note on robust variance estimation for cluster-correlated data. Biometrics 56:645–646, 2000Crossref, Medline, Google Scholar
42 : Matching using estimated propensity scores: relating theory to practice. Biometrics 52:249–264, 1996Crossref, Medline, Google Scholar
43 : Optimal caliper widths for propensity-score matching when estimating differences in means and differences in proportions in observational studies. Pharmaceutical Statistics 10:150–161, 2011Crossref, Medline, Google Scholar
44 : Methods for constructing and assessing propensity scores. Health Services Research 49:1701–1720, 2014Crossref, Medline, Google Scholar
45 : Generic initiation and antidepressant therapy adherence under Medicare Part D. American Journal of Managed Care 19:989–998, 2013Medline, Google Scholar
46 : Reducing suicidal ideation and depressive symptoms in depressed older primary care patients: a randomized controlled trial. JAMA 291:1081–1091, 2004Crossref, Medline, Google Scholar
47 : The DIAMOND initiative: implementing collaborative care for depression in 75 primary care clinics. Implementation Science 8:135, 2013Crossref, Medline, Google Scholar