The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.202000115

Abstract

Objective:

Using 2019 Centers for Medicare and Medicaid Services data, the authors analyzed performance on behavioral health care quality measures among 168 marketplace insurers offering 185 products and investigated whether performance differed by insurer attributes.

Methods:

The authors considered four quality measures: antidepressant medication management, follow-up care for children prescribed attention-deficit hyperactivity disorder medication, follow-up care within 7 days after hospitalization for mental illness, and initiation and engagement of alcohol and other drug dependence treatment. Multivariate regression was used to determine whether performance varied by insurers’ nonprofit ownership, Blue Cross–Blue Shield affiliation, Medicaid-managed care participation, and preferred provider organization status.

Results:

Performance levels were highest for management with antidepressant medication and lowest for initiation and engagement of drug dependence treatment. Systematic differ‐ences were observed by ownership status and Medicaid-managed care plan status.

Conclusions:

Increasing the transparency of health plan quality information is important for aiding enrollee decision making and encouraging quality improvement among providers and insurers.

HIGHLIGHTS

  • Wide variation exists among insurers with respect to performance on behavioral health care quality measures.

  • Systematic differences in performance were found by nonprofit ownership status and Medicaid-managed care plan status.

  • Medicaid-managed care plans exhibited lower performance, on average, for follow-up after hospitalization for mental illness and initiation and engagement of substance dependence treatment, compared with insurers who did not participate in Medicaid-managed care.

In the United States, an estimated 46.6 million adults ages ≥18 years live with some type of mental, behavioral, or emotional disorder (1). Historically, behavioral health disorders have been undertreated because of barriers related to finances or provider access. Financial barriers are often driven by lack of insurance or by having a health plan that requires high levels of cost-sharing at the point of utilization (e.g., deductibles and coinsurance). Enrollees may also face barriers to high-quality care if the supply of clinical providers in a plan’s network is insufficient for meeting enrollees’ treatment demands.

Federal policies implemented within the past 15 years have sought to improve enrollees’ access to behavioral health care services, including the Mental Health Parity and Addiction Equity Act in 2008 (2) and the major coverage expansion provisions of the Patient Protection and Affordable Care Act (ACA) in 2014. The ACA enhanced access to behavioral health care services by expanding public and private coverage for Americans with lower incomes through Medicaid eligibility expansion (3) and the availability of subsidized individual coverage within newly created insurance marketplaces (4). Additionally, ACA provisions prevent insurers from denying coverage to individuals with preexisting medical conditions and include requirements that insurers cover 10 essential health benefits, including mental health and substance abuse treatment (5).

Within the ACA, Section 1311 directed the Secretary of Health and Human Services to develop a quality-rating system for health plans offered within the federal and state-based marketplaces. Initiated in 2013, system development took several years, with information on clinical quality and patient experience becoming available to most marketplace enrollees for the first time as they shopped for coverage in the fall of 2019 (6). The study reported here took advantage of newly released data from the Centers for Medicare and Medicaid Services (CMS) to analyze performance on behavioral health care quality among marketplace plans for 2019 and to determine whether and to what extent performance systematically differed by insurers’ attributes, including plan type, ownership status, Medicaid-managed care status, and Blue Cross–Blue Shield affiliation. Increasing the transparency of health plan quality information may influence enrollee decision making in choosing a plan. Moreover, it may also encourage quality improvement among clinical providers within a given health plan’s network and influence health plans’ contracting decisions with physicians, hospitals, and other care delivery organizations as well as guide the design of new value-based payment models.

Methods

We obtained publicly available data from the 2019 Health Insurance Marketplace Quality Reporting System of the CMS (7). These data report quality measures based on the Healthcare Effectiveness Data and Information Set measure definitions for 185 of 195 marketplace insurer-product types (e.g., health maintenance organizations [HMOs] and preferred provider organizations [PPOs]) representing 168 marketplace insurers for enrollee populations. We augmented these data with information from a 2016 report of the National Association of Insurance Commissioners and plan participation tracker data from the 2019 Robert Wood Johnson Foundation to classify insurers by whether they were nonprofit insurers, Blue Cross-Blue Shield–affiliated organizations, or Medicaid-managed care insurers, defined as organizations that predominantly served the Medicaid-managed care market segment before 2014 (8). These insurer attributes were selected on the basis of evidence from the scholarly literature highlighting how insurers’ ownership status, group affiliation, and provider network structures may affect their investments in care quality and treatment outcomes (9, 10).

Measures of behavioral health care quality often reflect provider and patient actions for a diverse set of clinical populations, diagnoses, and care settings (11). Four behavioral health care quality measures are reported in the CMS rating system: antidepressant medication management for adults, measured as the average of effective acute and continuation phase treatment rates; follow-up care for children prescribed attention-deficit hyperactivity disorder (ADHD) medication, measured as the average of the initiation and maintenance phase rates; follow-up care within 7 days after hospitalization for mental illness; and adolescents’ and adults’ initiation of and engagement with alcohol and other drug dependence treatment, measured as the average of rates across different treatments and age groups (12).

We generated descriptive statistics to summarize the rate of performance (mean), variation in performance (SD), and relative variation (coefficient of variation). To examine correlations between behavioral health care measures, we estimated Spearman rank–based correlation coefficients. Finally, we estimated four multivariate linear regression models to investigate the independent association between each insurer-product attribute and each outcome of behavioral health care quality performance. Standard errors were clustered by insurer. Statistical significance was defined as a two-tailed test resulting in p<0.05. This study did not constitute human subjects research and was therefore exempt from institutional review.

Results

Table 1 summarizes quality performance rates on the four behavioral health care measures overall and stratified by insurer attributes. Performance among the 185 insurer-product types was strongest with respect to antidepressant medication management for adults, with a mean performance rate of 62.7%. The next highest performance rate was for follow-up within 7 days after hospitalization for mental illness (43.5%), followed by follow-up care for children prescribed ADHD medication (35.8%). The lowest performance was for initiation and engagement of alcohol and other drug dependence treatment by adolescents and adults, with a mean performance rate of 23.3%. Notably, coefficients of variation indicated that follow-up care for children prescribed ADHD medications and follow-up within 7 days after hospitalization for mental illness exhibited larger relative variation than the other two quality measures.

TABLE 1. Quality performance rates on the four behavioral health care measures overall and stratified by insurer attributesa

Model parameter estimatesb
Descriptive statistics
MeasureNMSDCVcRegression coefficient95% CIp
Antidepressant medication managementd
 All18562.78.8.14
 Nonprofit10864.38.4.133.13.50 to 5.76.028
 Medicaid-managed care3458.97.6.13−3.37−6.81 to −.08.049
 Blue Cross affiliate4863.77.5.12.20−2.77 to 3.17.891
 PPO4464.47.6.12.89−2.15 to 3.93.504
Follow-up after hospitalization for mental illness (7 days)e
 All18543.519.5.45
 Nonprofit10846.321.0.454.68−1.12 to 10.48.119
 Medicaid-managed care3432.416.5.51−13.66−21.26 to −6.07<.001
 Blue Cross affiliate4843.114.5.34−3.95−10.49 to 2.60.215
 PPO4444.319.5.44−1.80−8.5 to 4.90.599
Follow-up care for children prescribed ADHD medicationf
 All18535.827.7.77
 Nonprofit10837.128.1.763.08−5.53 to 11.69.463
 Medicaid-managed care3438.230.7.805.20−6.08 to 16.48.401
 Blue Cross affiliate4836.322.1.61.67−9.04 to 10.39.876
 PPO4439.624.4.624.94−5.01 to 14.88.290
Initiation and engagement of alcohol and other drug dependence treatmentg
 All18523.36.4.27
 Nonprofit10823.45.9.25−.61−2.56 to 1.34.591
 Medicaid-managed care3420.74.8.23−3.14−5.69 to −.58.010
 Blue Cross affiliate4824.45.8.24.56−1.65 to 2.76.634
 PPO4424.35.7.23.72−1.53 to 2.97.507

aData are from the Centers for Medicare and Medicaid Services Quality Rating System 2019 database. Insurer types were identified in a 2016 report from the National Association of Insurance Commissioners and 2019 Robert Wood Johnson Foundation data. Preferred provider organization (PPO) and nonprofit are not mutually exclusive; Medicaid-managed care and Blue Cross affiliate are mutually exclusive. Mean and SD of performance rates are percentages.

bLinear multivariate regression models adjusted for all four insurer characteristics, with standard errors clustered by insurer.

cCV, coefficient of variation.

dRefers to the percentage of members ages ≥18 years who were treated with antidepressant medication, had a diagnosis of major depression, and remained on an antidepressant medication treatment.

eRefers to the percentage of discharges for members ages ≥6 years who were hospitalized for management of selected mental illness or intentional self-harm diagnoses and who had a follow-up visit with a mental health practitioner within 7 days after discharge.

fRefers to the percentage of children newly prescribed attention-deficit hyperactivity disorder (ADHD) medication who had at least three follow-up care visits within a 10-month period, one of which was within 30 days of when the first ADHD medication was dispensed.

gRefers to the percentage of adolescent and adult members with a new episode of alcohol or other drug (AOD) abuse or dependence who received initiation of AOD treatment (i.e., the percentage of members who initiated treatment through an inpatient AOD admission, outpatient visit, intensive outpatient encounter or partial hospitalization, or telehealth or medication treatment within 14 days of the diagnosis) and engaged with AOD treatment (i.e., the percentage of members who initiated treatment and who had two or more additional AOD services or had medication treatment within 34 days of the initiation visit).

TABLE 1. Quality performance rates on the four behavioral health care measures overall and stratified by insurer attributesa

Enlarge table

A related question was whether the quality measures exhibited a high degree of correlation for individual insurers. That is, if an insurer performed relatively better on one quality measure, was it also more likely to perform better on another? To this end, we estimated Spearman correlation coefficients for each bivariate pair of quality measures by using our full sample of 185 insurer-product types (see the online supplement to this article). Although the correlation coefficients were positive for all pairs, only four were statistically significant and were moderate in magnitude (r=0.15–0.33, p<0.05). Specifically, correlation coefficients were largest between follow-up after hospitalization for mental illness and antidepressant medication management (r=0.33) and between follow-up after hospitalization for mental illness and initiation and engagement of alcohol or other drug dependence treatment (r=0.27).

Results from multivariate regression analyses revealed that nonprofit insurers were associated with significantly higher-quality management with antidepressant medication (regression coefficient, 3.13; p<0.05 [Table 1]), relative to for-profit insurers, after adjusting for other insurer characteristics (group affiliation, product type, and Medicaid-managed care status). We did not observe systematic associations between ownership status and the other three quality outcomes. Medicaid-managed care plans had lower quality on two measures relative to non–Medicaid-managed care plans, including follow-up within 7 days after hospitalization for mental illness (regression coefficient, −13.66; p<0.001) and alcohol and drug dependence treatment (regression coefficient, −3.14; p<0.05). We did not detect any differences by network type (e.g., PPO or not) or Blue Cross–Blue Shield affiliation for the four quality-rating outcomes.

Discussion and Conclusions

Systematic measurement and public reporting of measures of behavioral health care quality can help identify areas of opportunity for improvement among health plans and the providers with whom they contract to better serve their enrollees. Quality information transparency also helps enrollees evaluate their options more comprehensively when selecting their health care plan. This analysis is the first to document current levels of marketplace plan performance with respect to behavioral health care quality. Although overall plan performance for these measures was within the ranges reported for other insurance market segments (e.g., commercial HMO, commercial PPO, Medicaid HMO, and Medicare HMO) in the National Committee for Quality Assurance’s State of Health Care Quality report (12), wide variation existed across the measures, with performance being highest for antidepressant medication management at 62.7% and lowest for initiation and engagement of alcohol and other drug dependence treatment at 23.3%. Variation also existed across insurer-product attributes. Importantly, Medicaid-managed care plans performed significantly lower on two of the four measures: follow-up after hospitalization for mental illness and initiation and engagement of alcohol and other drug dependence treatment.

As with many health care outcomes, the measures analyzed here may have been influenced by enrollee-driven, provider-driven, and plan-driven factors (13). For example, enrollee preferences may have affected both adherence to antidepressant medications as well as willingness to seek follow-up care from a provider. For some enrollees, decisions to take these medications or make follow-up appointments may have been related to additional financial costs arising from deductibles or coinsurance.

Provider- and plan-driven efforts also have the potential to influence behavioral health care quality performance. Provider-driven tactics may include the use of e-mail or text messaging to remind patients to seek follow-up treatment, use of care coordinators to help patients navigate the system, or adoption of new care delivery options (e.g., walk-in clinics). Health plan administrators can also influence quality. Plan administrators may collaborate with providers to support quality improvement initiatives by providing data feeds or other technical assistance. Plan administrators may also encourage performance improvement by creating explicit incentives through value-based payment arrangements. Importantly, the extent to which insurers are willing to invest in clinical quality improvement depends heavily on return on investment. In the individual market, this metric is likely to be more challenging, given the perceived higher rates of churn within this insurance market segment relative to others (e.g., employer group or Medicare Advantage).

Strategic decision making by health plan administrators around network design may also influence enrollees’ access to behavioral and other types of health care services. Notably, in the individual market, insurers have sought to lower premiums by utilizing narrower provider networks for marketplace plans (14). Although this approach may enable plans to compete more effectively for enrollees on the basis of price, the narrower networks may have provider numbers, compositions, or geographic distributions that are inadequate for meeting enrollees’ care demands. For example, a recent report by the U.S. Department of Health and Human Services noted that provider network size and composition have been important factors affecting enrollees’ ability to seek substance use treatment (15).

Given the novelty of quality information transparency in the individual market, additional research is needed to better understand how key stakeholders use the plan quality information. For example, future studies could investigate how insurers invest in quality improvement activities and how enrollees use this information to choose their health plans.

Division of Health Policy and Management, University of Minnesota, Minneapolis (Abraham); Department of Health Policy and Management, University of Pittsburgh, Pittsburgh (Cai, Drake); Duke University Margolis Center for Health Policy, Durham, North Carolina (Anderson).
Send correspondence to Dr. Abraham ().

Dr. Drake acknowledges support from the National Center for Advancing Translational Sciences (grant KL2-TR-001856).

The views represent the opinions of the authors and not necessarily those of the National Institutes of Health.

The authors report no financial relationships with commercial interests.

References

1 Mental Illness. Bethesda, MD, National Institute of Mental Health, 2019. www.nimh.nih.gov/health/statistics/mental-illness.shtml. Accessed Jan 9, 2020Google Scholar

2 The Mental Health Parity and Addiction Equity Act (MHPAEA). Baltimore, Centers for Medicare and Medicaid Services, n.d. www.cms.gov/CCIIO/Programs-and-Initiatives/Other-Insurance-Protections/mhpaea_factsheet. Accessed Jan 2, 2020Google Scholar

3 Status of State Medicaid Expansion Decisions: Interactive Map. San Francisco, Kaiser Family Foundation, 2020. www.kff.org/medicaid/issue-brief/status-of-state-medicaid-expansion-decisions-interactive-map. Accessed Jan 2, 2020Google Scholar

4 Estimated Total Premium Tax Credits Received by Marketplace Enrollees. San Francisco, Kaiser Family Foundation, 2019. www.kff.org/health-reform/state-indicator/average-monthly-advance-premium-tax-credit-aptc/?currentTimeframe=0&selectedDistributions=number-of-marketplace-enrollees-receiving-advanced-premium-tax-credits&sortModel=%7B%22colId%22:%22Location%22,%22sort%22:%22asc%22%7D. Accessed Jan 9, 2020Google Scholar

5 Mental Health and Substance Abuse Health Coverage Options. Baltimore, Centers for Medicare and Medicaid Services. www.healthcare.gov/coverage/mental-health-substance-abuse-coverage. Accessed Jan 6, 2020Google Scholar

6 Keith, K: CMS to Roll Out Nationwide Marketplace Quality Ratings. Bethesda, MD, Health Affairs, 2019. www.healthaffairs.org/do/10.1377/hblog20190819.604054/abs. Accessed July 10, 2020Google Scholar

7 Health Insurance Marketplace Quality Reporting System: Data Collection Guidelines. Baltimore, Centers for Medicare and Medicaid Services, 2020. www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/QualityInitiativesGenInfo/ACA-MQI/Quality-Rating-System/QRS-General-Data-Collection. Accessed Nov 15, 2019Google Scholar

8 ACA Marketplace Participation Tracker. Princeton, NJ, Robert Wood Johnson Foundation, 2019. www.rwjf.org/en/library/interactives/aca-marketplace-participation-tracker.html. Accessed Dec 28, 2019Google Scholar

9 Schneider EC, Zaslavsky AM, Epstein AM: Quality of care in for-profit and not-for-profit health plans enrolling Medicare beneficiaries. Am J Med 2005; 118:1392–1400Crossref, MedlineGoogle Scholar

10 Dafny L, Duggan M, Ramanarayanan S: Paying a premium on your premium? Consolidation in the US health insurance industry. Am Econ Rev 2012; 102:1161–1185Crossref, MedlineGoogle Scholar

11 Hermann RCR, Palmer RH: Common ground: a framework for selecting core quality measures for mental health and substance abuse care. Psychiatr Serv 2002; 53:281–287LinkGoogle Scholar

12 State of Health Care Quality: A Look at Health Plans’ Collective Improvement Over Time. Washington, DC, National Committee for Quality Assurance, 2020. www.ncqa.org/report-cards/health-plans/state-of-health-care-quality-report. Accessed Jan 2, 2020Google Scholar

13 Polsky D, Cidav Z, Swanson A: Marketplace plans with narrow physician networks feature lower monthly premiums than plans with larger networks. Health Aff 2016; 35:1842–1848CrossrefGoogle Scholar

14 Landon BE, Schneider EC, Normand S-LT, et al.: Quality of care in Medicaid managed care and commercial health plans. JAMA 2007; 298:1674–1681Crossref, MedlineGoogle Scholar

15 Best Practices and Barriers to Engaging People With Substance Use Disorders in Treatment. Washington, DC, Department of Health and Human Services, Office of the Assistant Secretary for Planning and Evaluation, 2019. aspe.hhs.gov/pdf-report/best-practices-and-barriers-engaging-people-substance-use-disorders-treatment. Accessed Jan 10, 2020Google Scholar