The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.202100623

Abstract

Objective:

Provider networks for mental health are narrower than for other medical specialties. Providers’ influence on access to care is potentially greater in Medicaid because enrollees are generally limited to contracted providers, without out-of-network options for nonemergency mental health care. The authors used claims-based metrics to examine variation in specialty mental health provider networks.

Methods:

In a cross-sectional analysis of 2018 Oregon Medicaid claims data, claims from adults ages 18–64 years (N=100,515) with a psychiatric diagnosis were identified. In-network providers were identified as those associated with any medical claims filed for at least five unique Medicaid beneficiaries enrolled in a health plan (coordinated care organization [CCO]) during the study period. Specialty mental health providers were categorized as prescribers (psychiatrists and mental health nurse practitioners) and nonprescribers (therapists, counselors, clinical nurse specialists, psychologists, and social workers). Measures of network composition, provider-to-population ratio, continuity, and concentration of care were calculated at the CCO level; the correlation between these measures was estimated to describe the degree to which they capture unique dimensions of provider networks.

Results:

Across 15 CCOs, the number of prescribing providers per 1,000 patients was relatively stable. CCOs that expanded their networks did so by increasing the number of nonprescribing providers. Moderately negative correlations were found between the nonprescriber provider-to-population ratio and proportions of visits with prescribers as well as with usual provider continuity.

Conclusions:

This analysis advances future research and policy applications by offering a more nuanced view of provider network measurement and describing empirical variation across networks.

HIGHLIGHTS

  • Provider networks for mental health are smaller than for other specialties.

  • Across 15 health plans in Oregon’s Medicaid program, networks had a stable number of mental health prescribers per 1,000 mental health enrollees.

  • As networks became larger, they generally increased by expanding the provider-to-population ratio via an increase in nonprescribing providers.

A provider network is a group of all health care providers and facilities with which a health plan has contracted to provide medical care for its members. The numbers and types of in-network mental health providers with which a health plan contracts may vary, although evidence suggests that provider networks tend to be narrower for mental health than for other specialties (1); this disparity exists, in part, because psychiatrist participation in health plans is the lowest among specialists and continues to decline (2, 3). A chief concern among policy makers is that health plans with only a limited set of in-network providers may affect access to care and treatment outcomes (46). In particular, those who need broader or more integrated networks for care (e.g., individuals with serious mental illness whose symptoms are more complex) may be adversely affected when provider networks are too restrictive (7, 8). Conversely, efficiencies may be improved with certain network designs such as when health plans contract with a set of high-quality, low-cost providers comprising behavioral specialists, therapists, psychologists, advanced nurse practitioners, and social workers rather than psychiatrists (9).

Addressing access to mental health services through the design of adequate provider networks is particularly important in Medicaid. Medicaid is currently the single largest payer for mental health care services in the United States, covering at least one-fifth of all Americans with psychiatric disorders and continuing to increase under Medicaid expansion. The challenges in accessing mental health services are magnified in the Medicaid program for several reasons, including less willingness among psychiatrists to accept Medicaid rather than other forms of insurance (10, 11). Geographic access to mental health providers who accept Medicaid is even more restricted, with more than one-third of counties in the United States (most of them rural) lacking outpatient mental health facilities that accept Medicaid (12). Moreover, social and medical complexities in the patient population contribute to greater care needs and barriers to accessing care. Finally, the influence of provider networks is potentially greater in the Medicaid program because cash pay is often unaffordable; in addition, enrollees are generally limited to contracted providers and do not typically have cost-sharing options for going out of network for nonemergency care (13, 14).

Thus, understanding which provider network strategies lead to increased efficiencies versus suboptimal care is a critical question for Medicaid enrollees, particularly as it relates to mental health care. Several recent policies have been implemented to regulate and monitor provider networks. Medicaid managed care programs, for example, are required to use any of a range of quantitative standards to monitor whether their networks include sufficient numbers and types of mental health providers (15). However, network adequacy remains a vaguely defined concept, and existing standards do not always translate to acceptable levels of access (16). One persistent challenge is a relative dearth of evidence on appropriate metrics to describe network characteristics beyond network breadth (1, 17, 18), which signifies theoretical access (proportion of covered providers within a given geographical area) but may not reflect other important measures of network adequacy or quality. Additionally, regulators often use only a single metric, such as the provider-to-enrollee ratio, that may not take into account additional dimensions of provider networks (15, 19).

Studies of hospital-based and medical specialty provider networks have found that claims-based measures of provider networks represent provider-level coordination and care delivery patterns well (2022). Only one previous study, in Colorado, used claims-based measures to identify connections between providers caring for patients with severe mental illness, finding variation across networks that was not captured by traditional measures of care (23). In this study, we used 2018 Medicaid claims data in Oregon to test several alternative network measures and to describe empirical variation in mental health specialty networks. We described mental health network variation along several claims-based dimensions, including composition of provider types (24), provider-to-population ratio, continuity of care (as operationalized by the usual provider continuity [UPC] index) (25), and concentration of care (via the Herfindahl-Hirschman index [HHI]). We then estimated the correlation between these measures to describe the degree to which they capture specific aspects of provider networks. Taken together, these analyses can advance future research and policy applications by offering a more nuanced view of measuring provider networks and the potential trade-offs associated with different network structures and characteristics.

Methods

Setting

Oregon’s Medicaid managed care program reflects the status of health care delivery in many states. Oregon’s Medicaid program is managed through 15 coordinated care organizations (CCOs), which have substantial variability in provider networks and no variability in patient cost-sharing. Implemented in 2012, CCOs cover distinct geographic regions and combine elements of Medicaid managed care organizations and accountable-care organizations in how they accept financial risk and pay for care (2628). Our focus on a single state allowed us to study these provider networks within a relatively homogenous administrative setting.

Study Population

We identified adults ages 18–64 years enrolled in Oregon’s Medicaid program for ≥9 months between January 1 and December 31, 2018, regardless of whether the enrollment was continuous. We excluded all dual-eligible and fee-for-service beneficiaries because of data availability limitations and differences in population, health care needs, service utilization, claims, and reimbursement (an appendix showing an overview of patient cohort selection is available as an online supplement to this article). We also excluded the 4% of enrollees who switched CCOs during the study period because of a move to a different coverage area. We then restricted our analysis to patients with a psychiatric diagnosis for any encounter during the study year, including those who had primary psychiatric diagnoses listed in the following Clinical Classification System Refined categories: MBD001–MBD013, MBD027, and EXT021.

Provider Network Construction

We empirically constructed a sample of in-network providers by using medical claims data. Providers were considered to be in network for a given CCO if they were associated with any medical claims filed for at least five unique Medicaid beneficiaries enrolled in that CCO during the study period (29). Using information from the National Plan and Provider Enumeration System, we identified the following types of individual specialty mental health providers: mental health prescribers (psychiatrists and mental health nurse practitioners) and nonprescribing mental health specialists (therapists and counselors, clinical nurse specialists, psychologists, and social workers) (see the online supplement).

Other Variables

We identified unique outpatient mental health visits on the basis of member, service date, and performing provider; in addition, we included evaluation and management as well as psychotherapy visits. Patient demographic characteristics included age, sex, self-reported race-ethnicity, and rural or urban residence as defined by the Oregon Office of Rural Health. We also measured total months enrolled in Medicaid during the study year and total number of condition categories from the Chronic Illness and Disability Payment System (30), which is a claims-based model based on 20 diagnosis codes, widely used by Medicaid programs for risk adjustment.

Analyses

We calculated summary measures of mental health visits as well as measures of network composition, provider-to-population ratio, continuity, and concentration of care. First, we measured network composition: the inclusion of different types and specialties of providers (31, 32). Specifically, we computed the percentage of all mental health specialists of different types (prescribers, including psychiatrists and mental health nurse practitioners, and nonprescribing clinicians, including psychologists, counselors and therapists, clinical nurse specialists, and social workers). For example, a provider network could technically be large but offer fewer prescribing versus nonprescribing clinicians. To this end, we also calculated the percentage of mental health visits with prescribers.

Second, the provider-to-population ratio measures how many providers are available in a service area; this ratio is commonly used in the literature (33) as well as by state and federal regulators (34) to assess the sufficiency of a provider network. We defined this measure as the total number of in-network providers per 1,000 enrollees with any mental health condition, as derived from Medicaid claims.

Third, we evaluated continuity of care at the network level via the UPC index, a frequently used continuous measure representing the proportion of all visits that occur with a patient’s usual provider. Greater continuity of care has been associated with better patient outcomes (35), including for those with severe mental illness (36, 37). Using claims data, we identified the “usual in-network provider” for each patient as the provider whom the patient saw the most frequently during the study period. In the case of a tie, we randomly assigned the usual provider. A UPC index score, ranging from 0 (no visits with the same provider) to 1 (all visits with same provider), was calculated for each patient; the median score was calculated at the CCO level.

To describe the concentration of mental health outpatient visits across providers, we computed the share of total mental health outpatient visits within a CCO that was provided by each in-network mental health specialist. A higher concentration of care has been associated with lower costs and higher quality (22); moreover, previous work has shown that mental health provision in Medicaid may be concentrated among specific subsets of providers (38). We therefore computed the HHI, a commonly accepted measure of market concentration that has been applied to assess concentration of care and degree of care coordination (21, 39, 40). The HHI was calculated by squaring the share of visits to each in-network clinician and summing across all in-network clinicians who saw patients within a given CCO. Values range from 0 to 10,000, with larger values representing a more concentrated care delivery pattern (i.e., a smaller set of in-network clinicians offering a higher share of mental health visits).

To assess the level of association between these provider network characteristics, we computed Pearson correlations among the various measures. Finally, using sensitivity analyses, we evaluated additional definitions of care continuity (see the online supplement); we also assessed other measures, including the proportion of patients with one or more prescriber visit and the UPC index, calculated separately for prescribers and nonprescribers (see the online supplement).

We conducted descriptive analyses in R, version 4.0.3, from December 2020 to August 2021. The study protocol was deemed exempt by the Oregon Health & Science University Institutional Review Board (1017760).

Results

Table 1 provides an overview and detailed definitions of the network characteristics analyzed in this study. Our final cohort included 100,515 Medicaid enrollees who had at least one mental health condition. The number of enrollees in each CCO ranged from 933 to 35,994 (see the online supplement). Across the 15 CCOs, the mean age of enrollees ranged from 37.5 to 40.3 years, and most were female (64.0%–68.7%) and White (49.1%–62.3%). The proportion of enrollees living in urban areas varied substantially, ranging from 0% to 94.8%. The average number of health conditions ranged from 2.3 to 2.7, and the proportion of those with psychiatric diagnoses who had a serious mental illness ranged from 9.3% to 14.8%. Across all CCOs, we identified 292 psychiatrists, 259 nurse practitioners specializing in mental health, 285 psychologists, 3,379 counselors and therapists, eight clinical nurse specialists, and 797 social workers as in-network providers in 2018.

TABLE 1. Selected network measures for specialty mental health providersa

Network measureDefinitionJustificationAdvantagesLimitationsInterpretation
CompositionTotal number of in-network mental health providers with a specific specialty, divided by the total number of all in-network mental health providers (we also stratified network composition via measures that relate to prescribing vs. nonprescribing providers)Describes an element of network structure or the resources available to provide access to careEasy to apply and interpretDoes not consider services provided or density of care
Percentage of prescribing providersTotal number of in-network mental health providers with a specialty that allows them to prescribe medications, divided by the total number of all in-network mental health providers
Proportion of mental health visits with prescribersNumber of outpatient mental health visits with an in-network provider who can prescribe medications, divided by the total number of outpatient mental health visits with any in-network provider
Provider-to-population ratioTotal number of in-network providers, divided by the total number of patients with a psychiatric diagnosisProxy measure for network capacity: whether there are enough providers for a patient populationUsed in real-world policy and regulatory settings to assess network adequacyDoes not consider services provided or distribution of careHigher provider-to-population ratio suggests greater capacity for mental health care
Usual provider continuity indexTotal number of outpatient mental health visits with a patient’s usual in-network provider, divided by the total number of outpatient mental health visits with any in-network providerContinuity is associated with higher quality of care, including for those with serious mental illnessValidated measure; reflects the “density” of a networkLower continuity may not directly correlate with poorer quality in team-based mental health delivery; may also reflect a network outcomeRanges from 0 (no visits with the same provider) to 1 (all visits with same provider)
Herfindahl-Hirschman indexThe share of all outpatient mental health visits for a given CCO, for each in-network provider, squared and summed across providersCommon measure of market concentrationValidated measure; has been applied to assess concentration of careOffers limited information on aspects of care coordination; may also reflect a network outcomeRanges from 0 to 10,000; lower HHI values indicate that outpatient mental health visits are spread relatively evenly across many providers, whereas higher HHI values suggest that visits are concentrated among a small set of providers

aAll measures are analyzed at the plan (coordinated care organization [CCO]) level.

TABLE 1. Selected network measures for specialty mental health providersa

Enlarge table

Across CCOs, most specialty mental health networks comprised nonprescribing mental health specialists, such as counselors, therapists, and social workers (Figure 1). Counselors and therapists made up the largest proportion of in-network mental health specialty providers, ranging from 53.9% to 81.7% (mean=69.2%), followed by social workers (8.6%–26.1% of network providers; mean=15.3%) and psychologists (1.6%–11.9%; mean=4.9%). Prescribers composed a consistently small proportion of mental health specialty networks across CCOs, with psychiatrists representing 1.9%–13.0% (mean=5.4%) and psychiatric advanced practice nurses representing 3.5%–6.8% (mean=5.1%) of providers. Figure 2 shows that as networks increased in size, they generally did so by incorporating more nonprescribing providers. Also, higher plan enrollment of individuals with mental health conditions was not associated with higher provider-to-population ratios, which ranged from 27.8 to 92.2 providers per 1,000 mental health enrollees for nonprescribing mental health providers (mean=52.8) and from 3.3 to 8.9 providers per 1,000 mental health enrollees for prescribers (mean=6.0) (Table 2).

FIGURE 1.

FIGURE 1. Composition of specialty mental health provider networks in Oregon’s Medicaid program, by coordinated care organization (CCO) health plana

aMost of the plans’ mental health workforce comprised behavioral health specialists, such as counselors and therapists, ranging from 53.9% to 81.7% of in-network specialty mental health providers, whereas psychiatrists represented between 1.9% and 13.0% of in-network mental health providers. Only psychiatrists and nurse practitioners could prescribe medications.

FIGURE 2.

FIGURE 2. Provider-to-population ratios of prescribing versus nonprescribing mental health providers, by coordinated care organization (CCO) health plan sizea

aThe size of each bubble denotes the size of the Medicaid enrollee population for a given CCO. The 45° dashed parity line indicates where the data points would lie if changes in prescriber and nonprescriber ratios were equal.

TABLE 2. Summary metrics for specialty mental health provider networks, by CCO health plana

CCO IDTotal mental health visits (N)Total prescriber visits (N)Total nonprescriber visits (N)Prescriber visits among mental health patients (M)Nonprescriber visits among mental health patients (M)Prescribing providers (per 1,000 mental health patients)Nonprescribing providers (per 1,000 mental health patients)Prescribing providers (%)Proportion of mental health visits with prescribers (%)UPC index (median)HHI
A128,03116,107111,9241.28.46.154.610.012.6.9823
B11,9571,9649,993.73.78.963.812.216.4.94192
C23,5332,91020,623.64.45.547.010.512.4.93131
D15,3541,95413,400.85.67.171.88.912.7.77245
E28,0903,19424,896.64.95.362.87.811.4.86126
F74,30012,09162,2091.26.24.940.410.916.31.0070
G224,81834,662190,1561.05.37.746.214.215.4.954
H29,7875,17424,613.83.97.838.117.117.41.00126
I23,7492,24821,501.65.96.867.69.29.51.00121
J9,1072,1246,9831.03.33.347.36.623.31.00366
K6,0921,1474,9451.04.25.944.611.718.81.00435
L4,1714543,717.54.07.592.27.510.9.90377
M19,5164,60214,9141.34.14.227.813.023.61.00250
N41,6253,95137,674.76.24.448.78.49.51.00103
O8,9952,2396,7561.02.94.339.89.824.91.00375

aCCO, coordinated care organization (Oregon’s Medicaid managed care organizations); HHI, Herfindahl-Hirschman index, a commonly accepted measure of market concentration, with larger numbers representing more concentrated care of mental health patients among a set of providers; UPC index, usual provider continuity index, a continuous measure representing the proportion of all visits that occur with a patient’s usual provider.

TABLE 2. Summary metrics for specialty mental health provider networks, by CCO health plana

Enlarge table

Table 2 displays summary measures of mental health visits across CCOs as well as network metrics, including variation in the proportion of visits with mental health prescribers, median UPC index, and concentration of care as operationalized by the HHI. The proportion of visits with mental health prescribers ranged from 9.5% to 24.9% (mean=15.7%), suggesting that across CCOs, most visits were conducted with nonprescribing mental health clinicians. The UPC index ranged from 0.77 to 1.00, suggesting that most outpatient mental health visits were made to a regular provider. Although outpatient mental health care appeared to be highly unconcentrated among providers, some CCO networks concentrated care among a smaller group of providers than did others (HHI range 4–435).

We found moderately negative correlations between the nonprescriber provider-to-population ratio and prescriber composition (−0.5) and proportion of visits with prescribers (−0.6) (Figure 3). In other words, networks with fewer prescribing clinicians were characterized by utilization patterns whereby nonprescribing clinicians offered mental health services more frequently. We also observed a moderately negative correlation between nonprescribing provider-to-population ratio and the UPC index (−0.6). Our results were robust to sensitivity analyses (see the online supplement).

FIGURE 3.

FIGURE 3. Correlation matrix for provider network–level metricsa

aHigher numbers indicate a stronger association in either the negative (−1.0) or positive (+1.0) direction. Increasing the amount of nonprescribing specialty mental health clinicians (number of providers per 1,000 mental health enrollees) was negatively correlated with prescriber composition, proportion of visits with prescribers, and usual provider continuity (UPC) index. That is, a greater proportion of nonprescribing providers appears to be associated with relatively lower continuity of care. Asterisks denote a statistically significant correlation. HHI, Herfindahl-Hirschman index.

Discussion

In this cross-sectional study, we used 2018 Oregon Medicaid claims data to study variation in the characteristics of specialty mental health provider networks via several network-based metrics, including the provider-to-population ratio, network composition, continuity, and concentration of care. We found that across CCOs, most of the mental health providers who were actively seeing patients consisted of nonprescribing mental health specialists; in addition, we found considerable variation in the size of these nonprescriber networks. However, the size of networks for prescribing mental health providers remained relatively stable across CCOs.

Provider networks are ultimately limited by workforce supply constraints and provider participation, which may have been driving our finding of relatively stable proportions of in-network mental health prescribers across CCOs. A broad body of literature suggests that low psychiatrist participation within Medicaid is attributable to several factors (41), including relatively low reimbursement rates; administrative burdens and delays; clinical case complexity within Medicaid, which disproportionately serves those with severe mental illness; and an aging workforce and overall shortage in psychiatrists (42). We found evidence that CCOs, to some extent, may make up for prescriber shortages by contracting with variable numbers and types of nonprescribing mental health providers, such as psychologists, nurses, social workers, counselors, and therapists. Although these workforce types may be active complements for prescribers, they may also represent trade-offs; we found that these types of providers may offer lower continuity of care, particularly if patients rely on nonprescribing clinicians who may disproportionately experience burnout, work in fragmented care, and have high turnover (43).

There are additional reasons that may explain the significant correlations we observed between some measures, including between the nonprescribing provider-to-population ratio and the UPC index. For example, because CCOs increase network size primarily by increasing the proportion of nonprescribing clinicians, it is possible that lower continuity of care may be due to greater provider choice or increased access to care because of larger provider networks. We were unable to distinguish these causal mechanisms in this analysis.

It is yet unclear whether the extent to which different mental health provider network characteristics may be associated with quality of care and downstream patient outcomes. For instance, a highly concentrated network structure, in which a few in-network providers are seeing a large share of mental health patients, may reflect greater specialization of care and be associated with higher quality. Alternatively, a loosely concentrated network structure, in which many in-network providers are servicing small shares of mental health visits, may be associated with lower provider burnout and greater continuity. The extent to which there are trade-offs inherent in these network structures is yet unknown. For example, provider network breadth reflects known trade-offs between access and cost containment; Medicaid managed care plans may choose to offer a more selective network to steer enrollees to lower-cost or higher-quality providers by providing enrollees less freedom of choice. Similarly, networks with greater access to mental health prescribers versus nonprescribers could reflect care delivery specialization and population health needs. Care delivery models for those with serious mental illness may rely on different network structures than for those with other mental health conditions (23, 44). Additional research is therefore needed to understand these trade-offs and what might constitute an evidence-based benchmark for high-quality networks.

One chief advantage of this study was the use of administrative claims data to describe realized access to provider networks. Although federal and state regulators lean on provider directories to monitor the adequacy of provider networks for serving a population, previous studies have shown that provider directories are highly inaccurate (45), often listing incorrect contact information or including health care professionals who are inactive, do not accept certain insurance types, or have closed panels (46). Given that provider directories are challenging to validate and maintain in real time, claims data may help policy makers measure more directly how provider networks and access to care intersect.

This study had important limitations. Most notably, we purposefully excluded primary care physicians from our analysis to focus on measures of specialty mental health networks, in line with practices of many states that separately monitor provider networks for primary care and mental health (15). It is possible that including primary care physicians may have altered our network measures. Furthermore, we did not incorporate geographic measures related to provider access, such as travel time and distance, and we were unable to incorporate non–claims-based measures, such as appointment wait times, all of which could reflect additional considerations that distinguish mental health provider networks. Finally, within the scope of this article, we did not assess the relationship between provider network characteristics and quality of care or patient outcomes. However, our findings lay a solid foundation on which to conduct future analyses of these relationships.

Conclusions

Using 2018 Oregon Medicaid claims data, we investigated variation in the characteristics of specialty mental health provider networks via several network-based metrics, including the provider-to-population ratio, network composition, and continuity and concentration of care. Across 15 CCOs, the number of prescribing providers per 1,000 patients was relatively stable. CCOs that expanded their networks did so almost exclusively by increasing the number of nonprescribing providers per 1,000 patients. We found moderately negative correlations between the nonprescriber provider-to-population ratio and proportion of visits with prescribers, as well as the UPC index. Taken together, our analyses advance future research and policy applications by offering a more nuanced view of provider network measurement and empirical variation in network structures and characteristics.

Division of General Internal Medicine (Zhu), Center for Health Systems Effectiveness (Charlesworth, Levy, McConnell), and Department of Psychiatry (Dobscha), Oregon Health & Science University, Portland; Department of Health Policy and Management, Bloomberg School of Public Health, Johns Hopkins University, Baltimore (Polsky); U.S. Department of Veterans Affairs Health Care System, Portland, Oregon (Dobscha).
Send correspondence to Dr. Zhu ().

This work was supported by National Institute of Mental Health grant 1-K08-MH-123624.

Dr. Zhu reports personal consulting fees from Omada Health. Dr. Polsky received consulting fees from Extend Health and Amazon. The other authors report no financial relationships with commercial interests.

The views in this article represent the opinions of the authors and not necessarily those of the National Institute of Mental Health.

REFERENCES

1. Zhu JM, Zhang Y, Polsky D: Networks in ACA marketplaces are narrower for mental health care than for primary care. Health Aff 2017; 36:1624–1631CrossrefGoogle Scholar

2. Bishop TF, Seirup JK, Pincus HA, et al.: Population of US practicing psychiatrists declined, 2003–13, which may help explain poor access to mental health care. Health Aff 2016; 35:1271–1277Crossref, MedlineGoogle Scholar

3. Benson NM, Myong C, Newhouse JP, et al.: Psychiatrist participation in private health insurance markets: paucity in the land of plenty. Psychiatr Serv 2020; 71:1232–1238LinkGoogle Scholar

4. Fleming E, Lien H, Ma C-TA, et al.: Managed care, networks and trends in hospital care for mental health and substance abuse treatment in Massachusetts: 1994–1999. J Ment Health Policy Econ 2003; 6:3–12MedlineGoogle Scholar

5. Dorner SC, Jacobs DB, Sommers BD: Adequacy of outpatient specialty care access in marketplace plans under the Affordable Care Act. JAMA 2015; 314:1749–1750Crossref, MedlineGoogle Scholar

6. Schleicher SM, Mullangi S, Feeley TW: Effects of narrow networks on access to high-quality cancer care. JAMA Oncol 2016; 2:427–428Crossref, MedlineGoogle Scholar

7. Atwood A, Lo Sasso AT: The effect of narrow provider networks on health care use. J Health Econ 2016; 50:86–98Crossref, MedlineGoogle Scholar

8. Yasaitis L, Bekelman JE, Polsky D: Relation between narrow networks and providers of cancer care. J Clin Oncol 2017; 35:3131–3135Crossref, MedlineGoogle Scholar

9. Heisler EJ: The Mental Health Workforce: A Primer. Washington, DC, Congressional Research Service, 2018. https://fas.org/sgp/crs/misc/R43255.pdfGoogle Scholar

10. Wilk JE, West JC, Narrow WE, et al.: Access to psychiatrists in the public sector and in managed health plans. Psychiatr Serv 2005; 56:408–410LinkGoogle Scholar

11. Malowney M, Keltz S, Fischer D, et al.: Availability of outpatient care from psychiatrists: a simulated-patient study in three US cities. Psychiatr Serv 2015; 66:94–96LinkGoogle Scholar

12. Cummings JR, Wen H, Ko M, et al.: Geography and the Medicaid mental health care infrastructure: implications for health care reform. JAMA Psychiatry 2013; 70:1084–1090Crossref, MedlineGoogle Scholar

13. Garfield R, Hinton E, Cornachione E, et al.: Medicaid Managed Care Plans and Access to Care: Results From the Kaiser Family Foundation 2017 Survey of Medicaid Managed Care Plans. San Francisco, Kaiser Family Foundation, 2018. https://www.kff.org/report-section/medicaid-managed-care-plans-and-access-to-care-provider-networks-and-access-to-care. Accessed Sept 11, 2019 Google Scholar

14. Chapter 1. An Overview of Medicaid Managed Care. Washington, DC, National Council on Disability, 2015. https://www.ncd.gov/policy/chapter-1-overview-medicaid-managed-care. Accessed Sept 11, 2019 Google Scholar

15. Zhu JM, Breslau J, McConnell KJ: Medicaid managed care network adequacy standards for mental health care access: balancing flexibility and accountability. JAMA Health Forum 2021; 2:e210280Crossref, MedlineGoogle Scholar

16. Ndumele CD, Cohen MS, Cleary PD: Association of state access standards with accessibility to specialists for Medicaid managed care enrollees. JAMA Intern Med 2017; 177:1445–1451Crossref, MedlineGoogle Scholar

17. Polsky D, Weiner J: The Skinny on Narrow Networks in Health Insurance Marketplace Plans. Philadelphia, University of Pennsylvania, Leonard Davis Institute of Health Economics, 2015. https://www.rwjf.org/en/library/research/2015/06/the-skinny-on-narrow-networks-in-health-insurance-marketplace-pl.html. Accessed May 25, 2022 Google Scholar

18. Graves JA, Nshuti L, Everson J, et al.: Breadth and exclusivity of hospital and physician networks in US insurance markets. JAMA Netw Open 2020; 3:e2029419Crossref, MedlineGoogle Scholar

19. Sommers BD, Kronick R: Measuring Medicaid physician participation rates and implications for policy. J Health Polit Policy Law 2016; 41:211–224Crossref, MedlineGoogle Scholar

20. Trogdon JG, Weir WH, Shai S, et al.: Comparing shared patient networks across payers. J Gen Intern Med 2019; 34:2014–2020Crossref, MedlineGoogle Scholar

21. Pollack CE, Lemke KW, Roberts E, et al.: Patient sharing and quality of care: measuring outcomes of care coordination using claims data. Med Care 2015; 53:317–323Crossref, MedlineGoogle Scholar

22. Barnett ML, Christakis NA, O’Malley J, et al.: Physician patient-sharing networks and the cost and intensity of care in US hospitals. Med Care 2012; 50:152–160Crossref, MedlineGoogle Scholar

23. Breslau J, Dana B, Pincus H, et al.: Empirically identified networks of healthcare providers for adults with mental illness. BMC Health Serv Res 2021; 21:777Crossref, MedlineGoogle Scholar

24. Jacobson G, Rae M, Neuman T, et al.: Medicare Advantage: How Robust Are Plans’ Physician Networks? San Francisco, Kaiser Family Foundation, 2017. https://www.kff.org/report-section/medicare-advantage-how-robust-are-plans-physician-networks-report. Accessed Sept 13, 2021 Google Scholar

25. Rodriguez HP, Marshall RE, Rogers WH, et al.: Primary care physician visit continuity: a comparison of patient-reported and administratively derived measures. J Gen Intern Med 2008; 23:1499–1502Crossref, MedlineGoogle Scholar

26. McConnell KJ: Oregon’s Medicaid coordinated care organizations. JAMA 2016; 315:869–870Crossref, MedlineGoogle Scholar

27. McConnell KJ, Chang AM, Cohen DJ, et al.: Oregon’s Medicaid transformation: an innovative approach to holding a health system accountable for spending growth. Healthc 2014; 2:163–167CrossrefGoogle Scholar

28. McConnell KJ, Renfro S, Lindrooth RC, et al.: Oregon’s Medicaid reform and transition to global budgets were associated with reductions in expenditures. Health Aff 2017; 36:451–459CrossrefGoogle Scholar

29. Charlesworth CJ, Zhu JM, Horvitz-Lennon M, et al.: Use of behavioral health care in Medicaid managed care carve-out versus carve-in arrangements. Health Serv Res 2021; 56:805–816Crossref, MedlineGoogle Scholar

30. Chronic Illness and Disability Payment System (CDPS). San Diego, University of California San Diego, n.d. https://hwsph.ucsd.edu/research/programs-groups/cdps.html. Accessed Oct 5, 2021 Google Scholar

31. Hoge MA, Stuart GW, Morris J, et al.: Mental health and addiction workforce development: federal leadership is needed to address the growing crisis. Health Aff 2013; 32:2005–2012Crossref, MedlineGoogle Scholar

32. Hall MA, Ginsburg PB: A Better Approach to Regulating Provider Network Adequacy. Los Angeles, USC-Brookings Schaeffer Initiative for Health Policy, 2017. https://www.brookings.edu/wp-content/uploads/2017/09/regulatory-options-for-provider-network-adequacy.pdf Google Scholar

33. Andrilla CHA, Patterson DG, Garberson LA, et al.: Geographic variation in the supply of selected behavioral health providers. Am J Prev Med 2018; 54:S199–S207Crossref, MedlineGoogle Scholar

34. Marr M: Fifty-State Survey: Network Adequacy Quantitative Standards. Baltimore, University of Maryland Francis King Carey School of Law, 2016. https://insurance.maryland.gov/Consumer/Documents/agencyhearings/UMD-LawSchool-DrugPolicyClinic-NetAdqSurvey10182016.pdf Google Scholar

35. Maciejewski ML, Wang V, Burgess JF, et al.: The continuity and quality of primary care. Med Care Res Rev 2013; 70:497–513Crossref, MedlineGoogle Scholar

36. Ride J, Kasteridis P, Gutacker N, et al.: Impact of family practice continuity of care on unplanned hospital use for people with serious mental illness. Health Serv Res 2019; 54:1316–1325Crossref, MedlineGoogle Scholar

37. Adair CE, McDougall GM, Mitton CR, et al.: Continuity of care and health outcomes among persons with severe mental illness. Psychiatr Serv 2005; 56:1061–1069LinkGoogle Scholar

38. McConnell KJ, Charlesworth CJ, Zhu JM, et al.: Access to primary, mental health, and specialty care: a comparison of Medicaid and commercially insured populations in Oregon. J Gen Intern Med 2020; 35:247–254Crossref, MedlineGoogle Scholar

39. Liao JM, Konetzka RT, Werner RM: Trends in hospital-SNF relationships in the care of Medicare beneficiaries. Healthc 2018; 6:175–179 CrossrefGoogle Scholar

40. Zhu JM, Navathe A, Yuan Y, et al.: Medicare’s bundled payment model did not change skilled nursing facility discharge patterns. Am J Manag Care 2019; 25:329–334MedlineGoogle Scholar

41. Bishop TF, Press MJ, Keyhani S, et al.: Acceptance of insurance by psychiatrists and the implications for access to mental health care. JAMA Psychiatry 2014; 71:176–181Crossref, MedlineGoogle Scholar

42. Fukui S, Rollins AL, Salyers MP: Characteristics and job stressors associated with turnover and turnover intention among community mental health providers. Psychiatr Serv 2020; 71:289–292LinkGoogle Scholar

43. Busch SH, Kyanko KA: Incorrect provider directories associated with out-of-network mental health care and outpatient surprise bills. Health Aff 2020; 39:975–983CrossrefGoogle Scholar

44. Lorant V, Nazroo J, Nicaise P, et al.: Optimal network for patients with severe mental illness: a social network analysis. Adm Policy Ment Health 2017; 44:877–887Crossref, MedlineGoogle Scholar

45. Adelberg M, Frakt A, Polsky D, et al.: Improving provider directory accuracy: can machine-readable directories help? Am J Manag Care 2019; 25:241–245MedlineGoogle Scholar

46. Zhu JM, Charlesworth CJ, Polsky D, et al.: Phantom networks: discrepancies between reported and realized mental health access. Health Aff 2022; In press. doi: 10.1377/hlthaff.2022.00052 CrossrefGoogle Scholar