We used data that were collected in two waves (1997 to 1998 and 2000 to 2001) of the Healthcare for Communities study (HCC), a collateral study of the Community Tracking Study (CTS) (
+21,
+22). The sample eligible for wave 1 of HCC (HCC-1) was a stratified random sample of persons who completed the first wave of the CTS survey (CTS-1). The CTS drew household samples from 60 randomly selected communities in the continental United States and included an unclustered national sample to improve the precision of national estimates. Responses were obtained for 65 percent of the CTS-1 sample. For HCC-1, which was completed about 14 months after CTS-1, a total of 14,985 of the 30,375 adult CTS-1 respondents were randomly selected. The design called for oversampling of persons with high psychological distress; high use of alcohol, drug, or mental health services; and family income below $20,000. A total of 9,585 respondents (64 percent) completed HCC-1. The weighted HCC-1 sample closely matched the 1997 U.S. household population in demographic characteristics (
+23). A total of 6,659 of the 9,585 HCC-1 respondents (70.9 percent, weighted) completed wave 2 approximately 18 months later. Responders and nonresponders for wave 2 differed significantly on most baseline characteristics (
+Table 1); however, the small to moderate differences suggested that the samples were sociodemographically similar.
All the survey items used to derive the analysis variables can be found on the Web site of the University of California, Los Angeles, Health Services Research Center (www.hsrcenter.ucla.edu/research/hcc.shtml). A list of the variables used to derive the analysis variables can be obtained from the authors.
Probable clinical need. Individuals were deemed to have probable clinical need if they screened positive for major depressive, dysthymia, generalized anxiety, or panic disorder; lifetime mania, psychosis, or schizophrenia; alcohol abuse; or recent use of illicit substances. Major depression, dysthymia, generalized anxiety disorder, and lifetime mania were defined by
DSM-III-R criteria and assessed with use of the Composite International Diagnostic Interview short form (CIDI-SF), which has excellent sensitivity and specificity (90 to 100 percent concordance) compared with the full CIDI (
+24). To reduce potential false-positives for panic disorder on this instrument, we required that the respondent be limited in social or role functioning as measured by two items from the 12-item Short-Form Health Survey and three items from the Sickness Impact Profile (
+25).
Lifetime psychosis was assessed by asking respondents if they had ever stayed overnight in a hospital for psychotic symptoms. Probable schizophrenia was assessed by asking respondents if they had ever been given a diagnosis of schizophrenia or schizoaffective disorder by a physician. Although the psychosis and schizophrenia measures have not been validated, they are adequate for use in a community sample in which one would not expect to find many people with serious mental illness. Alcohol abuse was assessed with use of the Alcohol Use Disorders Identification Test (AUDIT), for which the World Health Organization has reported sensitivities ranging from 92 to 94 percent and specificities ranging from 80 to 89 percent (
+26,
+27). Illicit drug use was assessed by using items from the CIDI (
+28).
Perceived need. Perceived need was indicated by an affirmative response to one or both of the following items: "In the past 12 months, did you think you needed help for emotional or mental health problems, such as feeling sad, blue, anxious, or nervous?" "In the past 12 months did you think you needed help for alcohol or drug problems?" (
+23). Although these items have not been validated, similar items were used in the NCS and other psychiatric epidemiologic studies (
+16,
+29). In the NCS, 32 percent of persons who had disorders perceived a need for help, and perceived need mediated differences in service use (
+29). In the HCC-1 sample, only about 4 percent of respondents perceived a need for treatment without having a probable clinical disorder (
+Table 1).
Any alcohol, drug, or mental health care. HCC collected detailed information on medication use, hospitalizations for mental health and substance use disorders, mental health care from primary care and specialty providers, and substance abuse care from primary and specialty care providers. From these items we developed an indicator that identified respondents who in the previous 12 months had had any contact with a primary or specialty care provider for a mental health problem—including inpatient, day treatment, or residential care for an alcohol, drug, or mental health problem—or who had an emergency department or outpatient visit to a general medical or alcohol, drug, or mental health specialty provider for assessment, monitoring, counseling, referral, or medication (
+30).
To assess the level of transient and persistent need and unmet need, we examined joint distributions of alcohol, drug, and mental health need and care across HCC waves. Using the indicators for perceived and probable clinical need, we categorized the sample according to three levels of need: no perceived or probable clinical need, perceived need only, and probable clinical need (alone as well as accompanied by perceived need). We also categorized the sample according to care patterns: none in either wave, care in wave 1 only, care in wave 2 only, and care in both waves. We used this category design to address some of the problems noted above in using cross-sectional data to assess "clinically significant" need. Because perceived need only (asymptomatic) may be indicative of a potential clinical need (either past or future), this category is useful for identifying respondents with potential need that could develop into persistent unmet clinical need if left untreated.
HCC used a complex multistage sampling design with unequal selection probabilities, clustering, and sampling without replacement. All analyses were performed with SUDAAN software for the statistical analysis of correlated data (
+31), which takes the survey design into account when estimating standard errors. We used multiple imputations for missing items (
+32). Percentages in all tables are weighted to be representative of the wave 1 national sample.
In this study, we explored longitudinal patterns of alcohol, drug, and mental health need and care in order to estimate levels of persistent need and unmet need. We also examined the role that perceptions of need played in these estimates. We found that respondents who received care in wave 2 only or in both waves were more likely than those who received no care in wave 1 only to demonstrate persistent need. We also found high levels of persistent unmet need for care (44 to 52 percent) among wave 1 respondents who had probable clinical need. Although a majority of those with need in both waves were receiving some care, about 30 percent of those with perceived need only and 30 percent of those with probable clinical need did not receive any care, which suggests a substantial level of unmet need.
Furthermore, the substantial portion of need that appears to have resolved without treatment (58 percent of wave 1 respondents with perceived need and 40 percent of those with wave 1 probable clinical need) may suggest high levels of transient need. We found some evidence to suggest that respondents who screen asymptomatic on the basis of diagnostic interviews may be managing their disorder through treatment. For example, a relatively large proportion (about 38 percent) of those with no wave 1 need received care, including monitoring and assessment, at some point. A small proportion received care in both waves (10 percent), and three-quarters of this group had no perceived or probable clinical need in wave 2. Clinical need may not be apparent among those who are receiving treatment and managing their alcohol, drug, or mental health problem successfully as a consequence or among those who have a disorder that is currently inactive who may still require periodic monitoring and assessment. A complete history of alcohol, drug, and mental health problems, including context, symptoms, severity, and persistence, is necessary to accurately determine need. However, inclusion of perceived need in measures of need may be one way to capture the cases missed by diagnostic screens.
Our results also suggest that perceived need that is not accompanied by probable clinical need could be an indicator of a mild or developing disorder. We found that a small proportion of perceived need was persistent across waves (about 13 percent). However, more than half of wave 1 perceived need was resolved by wave 2; and almost one-third of respondents with wave 1 perceived need experienced probable clinical need in wave 2. Among wave 1 respondents with perceived need only who either received no care or received care in wave 1 only, more than one-fourth demonstrated subsequent need and may have benefited from receiving more consistent care—that is, care in both waves. More than 50 percent of probable clinical need was persistent across waves. Almost half of wave 1 probable clinical need appeared to have resolved or to have been met by care in wave 2 or in both waves. Not surprisingly, probable clinical need was less likely than perceived need only to be resolved with no care or with care in wave 1 only.
This study has two important limitations. The first involves the precision of the screening measures used in the analysis. HCC, a study with moderate costs, used an approach to measuring need and care that facilitated a broad and rough estimate of need and unmet need; however, HCC does not have the precision and comprehensiveness of a study such as the NCS. It is likely that some milder forms of need that might merit evaluation but not necessarily treatment were included. Accordingly, we used a broad indicator of care (including monitoring, assessment, and specific treatments) to gauge whether need was met.
The screens used in HCC for the more common disorders have been previously used and validated, but the more serious disorders (psychosis and schizophrenia) were assessed with a single item. These single-item measures are less precise than a full battery of items to assess psychosis and schizophrenia, such as that used by the NCS. In addition, our measure of need did not include some disorders, such as phobia, obsessive-compulsive disorder, and posttraumatic stress disorder. Thus we also report estimates of perceived need (without probable clinical need) using items similar to those used by the NCS for assessing perceived need in order to capture need not assessed by the screens used in HCC. Because no other national longitudinal studies for the U.S. population have been published, we cannot determine how the imprecision of our need measure may have affected our estimates of transient and persistent need. Our results may slightly underestimate the extent of some disorders and overestimate that of others in the noninstitutionalized population.
In fact, when weighted cross-sectional estimates from HCC-1 (N=9,585) of specific 12-month disorders are compared with estimates from NCS (N=8.098) (
+33), HCC rates are slightly lower for major depressive disorder (9.1 percent compared with 10.3 percent) and higher for dysthymia (4.1 percent compared with 2.5 percent), generalized anxiety disorder (3.7 percent compared with 3.1 percent), panic disorder (3.4 percent compared with 2.3 percent), and psychosis (1.1 percent compared with .5 percent). Our 12-month prevalence rate for any disorder (
+Table 2) is slightly lower than 12-month prevalence estimates from the NCS; however, our measure does not include all the disorders (phobias, obsessive-compulsive disorder, and posttraumatic stress disorder) included in the NCS estimates, which could explain this difference.
Conversely, our measure for any care used detailed data (self-report) on medication, counseling, hospitalizations, and similar variables and included care received in primary and specialty care settings as well as emergency departments. This measure was intended to capture a broad range of care, including monitoring and assessment, as well as effective treatments (such as medication and specific counseling techniques) and may have resulted in lower estimates of unmet need. Using NCS data and a narrower definition of treatment, Kessler and colleagues (
+6) reported a treatment rate of 46.2 percent for those with serious mental illness, 18.3 percent for those with other mental disorders, and 6.3 percent for those with no disorders (
+6). Our results suggest that almost 70 percent of respondents with wave 1 probable clinical need (
+Table 3) received some form of care within the HCC data collection time frame (three to four years). Thus it appears that our results may be an underestimate the extent of unmet need in the noninstitutionalized population.
The second limitation is our moderate response rate, especially when multiplied across the two data waves. Responders and nonresponders differed; however, in most cases the statistically significant differences between responders and nonresponders were very small. Furthermore, our analyses incorporated nonresponse weights that accounted for statistically significant demographic differences between responders and nonresponders (technical documentation at www.hsrcenter.ucla.edu/research/hcc.shtml). Because weighted analyses may not correct all bias due to nonresponse, and HCC nonresponders may have been more likely to have alcohol, drug, or mental disorders, our longitudinal estimates of need may be slightly lower than would have been the case had the nonresponders been included. Estimates of any disorder in the past 12 months from the NCS and the ECA study range from 20 to 30 percent of the population, depending on the criteria applied, and our (weighted) estimates for any probable clinical disorder of 19.5 percent for wave 1 and 18.7 percent for wave 2 are only slightly lower. However, our estimates did not include phobias, which the NCS and ECA estimates did, and this may explain some of this difference.
Unmet need for alcohol, drug, and mental health treatment and the associated burden of illness have a substantial impact on both individuals and society in terms of the costs of lost productivity and unmeasured personal suffering. Although national estimates based on cross-sectional data can provide a relatively good basis for policy and service planning, the accuracy and validity of measures of persistent, unmet need could be improved with longitudinal data. This study presented estimates of transient, persistent, and unmet need for alcohol, drug, and mental health problems from a national longitudinal survey of the noninstitutionalized U.S. population. Because of serious data limitations, these results should be considered preliminary until future longitudinal data are available to replicate them. Nevertheless, our estimates are within range of existing estimates based on previous cross-sectional studies (the NCS and the ECA) and thus provide a reasonably good assessment of transient and persistent need and unmet need in the noninstitutionalized U.S. population.
If replicated, our results suggest that a substantial proportion of need may be transient and may not require long-term care. However, some persons who do not screen positive for a disorder may benefit from receiving at least periodic monitoring and assessment. Persistent patterns of unmet need represent important targets for policy and programs that can improve utilization, including outreach, education, and improved insurance coverage. To determine treatment effects under conditions of selectivity bias, future analyses with longitudinal data should explore other methodologic techniques to reduce the effects of bias, such as the use of instrumental variables or propensity scoring techniques. Such analyses would be particularly useful for service planning by predicting levels of transient and persistent need based on population characteristics and patterns of treatment. In addition, such analyses could be used to estimate more precisely what proportion of need is transient and can be resolved quickly with treatment and how much need is persistent, requiring extended treatment.
The authors thank Lingqi Tang, Ph.D., and Cathy Sherbourne, Ph.D., for their contributions to the conceptualization of the analysis variables, technical assistance, and helpful comments. This research was supported by grant 038273 from the Robert Wood Johnson Foundation and grant P30MH068639:01 from the National Institute of Mental Health.