The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/ps.54.3.340

Abstract

OBJECTIVE: The authors analyzed data from 615 depressed primary care patients to determine their willingness to pay for depression treatment. METHODS: A sample of 615 adult patients from four primary care clinics participated in a randomized controlled trial of a disease management program for depression in primary care. Participants were asked at baseline interviews and six-month follow-up interviews how much they would be willing to pay per month for a six-month treatment that would eliminate their symptoms of depression. Multiple regression analyses were used to estimate the association between demographic and clinical factors and willingness to pay for depression treatment and to examine changes. RESULTS: The mean amount that participants were willing to pay for depression treatment at baseline was $270±187 per month, or about 9 percent of the participants' household income. Willingness to pay was significantly associated with household income and with the severity of depressive symptoms. Over six months, the amount that participants were willing to pay decreased along with their severity of depressive symptoms. CONCLUSIONS: The amount that participants were willing to pay was comparable to that reported for the treatment of other chronic medical disorders and higher than the actual cost of depression treatment. Measurements of willingness to pay may be a promising method for assessing the value of treatments for common mental disorders.

Antidepressant medications and psychotherapy can substantially reduce or completely eliminate the symptoms of depression (1), and a number of studies have demonstrated that organized programs of care for depression can deliver those treatments in primary care with resulting improvements in outcomes, both for quality of care and for depression (2,3,4,5,6,7,8). Decisions about investing additional resources in depression treatment depend in part on the balance of improved outcomes and cost of such treatments (9). Cost-effectiveness studies of such programs (5,8,9,10,11) have concluded that providing effective treatment for depression improves health but also requires additional expenditures. Information about the value of such programs will be important for patients, health care providers, and policy makers who have to make decisions about investing additional resources in this area.

Willingness-to-pay methods have been used by health economists as one way to assess the value of a particular treatment or to compare the relative value of different treatments (12,13,14,15,16,17,18,19,20,21,22,23,24,25,26). The willingness-to-pay method is based on welfare economics; one of its advantages is the fact that it allows cost-benefit analyses that compare consumers' willingness to pay with the actual costs of treatment. Information on willingness to pay is well received by health care decision makers and may be a useful alternative to other methods of valuing health care technologies (27,28). This method has been shown to be feasible in studies of patients with depression and schizophrenia (29), but few studies have used the methodology in mental health research (14).

We studied willingness to pay for depression care among a sample of 615 depressed adults who participated in a population-based study of a disease management program for depression in primary care (4,30). We used a contingent-valuation method based on a simple payment-card technique (31) to estimate the amounts that primary care patients with depression would be willing to pay for a six-month course of treatment that would completely eliminate their symptoms of depression. We examined sociodemographic and clinical characteristics associated with willingness to pay and changes in willingness to pay over a six-month period. We hypothesized that depressed patients with higher household incomes and those with higher severity of depressive symptoms would be more willing to pay for depression care. We also hypothesized that willingness to pay would decrease over time as depression improved.

Methods

We used data from a population-based research program that tested two closely related models of depression treatment in primary care (4,30). The study was conducted from June 1996 to February 1998 in four primary care clinics of Group Health Cooperative of Puget Sound (GHC), a staff-model health maintenance organization (HMO) in western Washington. In these clinics, 73 board-certified family physicians cared for a population of 88,000 enrollees. GHC members have an age and income distribution that is generally representative of the population of the area.

Potentially eligible patients were identified with data from automated registration, pharmacy records, and visit records. Patients between the ages of 18 and 80 years who had received a new antidepressant prescription and a diagnosis of depression from a primary care physician in one of the four participating clinics were eligible for an assessment to determine their eligibility for the study. Six to eight weeks after the index prescription, patients received an invitation letter, followed by a phone call that sought verbal informed consent for a screening interview to determine eligibility for a study of two depression treatment programs, the persistent depression program or the relapse prevention program.

For the persistent depression program, patients who were found by the Structured Clinical Interview for DSM-III-R (SCID) (32) to have four or more symptoms of major depression (N=228) were randomly assigned to one of two treatment groups: a collaborative care intervention, in which a psychiatrist worked with the primary care provider to improve antidepressant treatment for depression, or care as usual—the control group (4). In the relapse prevention program, patients who had recovered from depression but were at high risk for relapse (N=387) were identified and also randomly assigned to one of two treatment groups: a relapse-prevention intervention with a depression specialist or care as usual—the control group (30). In this article, "intervention" is the term used for special interventions rather than care as usual.

Exclusion criteria included a score of 2 or more on the CAGE alcohol screening questionnaire, the conditions of pregnancy or breast-feeding, a plan to disenroll from GHC, active treatment by a psychiatrist, limited command of English, and recent use of lithium or antipsychotic medications. The study protocol was approved by the institutional review boards of the University of Washington and GHC, and all participants signed a written consent form.

Patients assigned to care as usual received treatment for depression from their regular primary care physician. This treatment generally involved prescription of an antidepressant by their primary care provider, two to four follow-up visits over six months, and in some cases referral to a GHC mental health specialist. All participants could self-refer to GHC mental health providers.

Measures

Participants were assessed at baseline before randomization and at six-month follow-up by a trained interviewer blinded to the patients' randomization status. Five baseline measures were selected, and a subset of these was included in the follow-up assessments. The baseline measures were demographic information, including age, gender, ethnicity, employment, and household income; a 20-item depression scale derived from the Symptom Checklist-90 (SCL-90) (33), a scale that has been used in a number of studies of primary care and has been found to have high reliability and validity (4,30,34); the current and past depression modules of the SCID (32,34); seven items from the NEO Personality Inventory neuroticism scale (35) that have been found to predict persistence of depressive symptoms in a primary care population (36); and a chronic disease score, a measure of chronic medical illness derived from the patient's use of prescription medications over a six-month period (37).

We assessed patients' willingness to pay for depression treatment in primary care by asking the following question: "Assume for a moment that you had no health insurance but that there was a treatment that would completely eliminate the symptoms of depression. How much money would you be willing to pay each month for a six-month treatment?" Respondents were given continuous response choices from $0 to $400 as well as more than $400 per month.

Interviewers received three hours of training before the first interview, plus individual practice sessions with a supervisor—a master's-level clinician with extensive training in structured interviews. Each interviewer was tested against either the supervisor or the project director during a practice interview, as well as during a study interview; reliability exceeded 80 percent for each interview question.

Analyses

We used t tests and chi square tests to compare baseline differences between study participants from the persistent depression program and those from the relapse prevention program. We used multiple regression analyses to estimate the association of demographic and clinical factors with willingness to pay. We first tested a number of predictor variables, including age, gender, ethnicity, employment status, household income, chronic disease score, score on the NEO Personality Inventory neuroticism scale, baseline depression severity as measured by the SCL-90, depression program (persistent depression or relapse prevention), and intervention status (intervention or care as usual). For the final models, we omitted variables that were not found to be significantly associated with willingness to pay. Age, gender, chronic disease score, household income, and depression program (persistent depression or relapse prevention) were included in the models, regardless of statistical significance, because of their potential confounding effects on willingness to pay.

We used analyses of covariance to determine whether there was a treatment effect at the six-month follow-up on willingness to pay. In this model, we controlled for age, gender, chronic disease score, depression program (persistent depression or relapse prevention), intervention status, household income, baseline willingness to pay, and baseline depression score. Means adjusted for the covariates were examined. We also examined the interaction of intervention status and depression severity on willingness to pay at six-month follow-up.

Results

Participants in the persistent depression program showed significant differences from those in the relapse prevention program. As shown in Table 1, those with persistent depression had a lower level of education and a lower household income and were less likely to be employed or to be Caucasian. They also had higher levels of depression, comorbid medical illness, and neuroticism.

The question about willingness to pay was generally well received by study participants. Only a small number of participants refused to answer the question or answered "do not know." Three percent of the answers to this question were missing at baseline and 10 percent at the six-month follow-up. At baseline, the mean±SD amount that all participants were willing to pay was $270±187 per month for a six-month depression treatment, and the median amount was $200 per month. At baseline, 13 participants (2.2 percent) reported their willingness to pay as zero, and 190 (31.8 percent) reported their willingness to pay as $400 or more. The mean willingness to pay was $273 per month in the persistent depression program and $268 in the relapse prevention program, as shown in Table 1—representing 8.6 percent of the overall sample's mean household income. These amounts represented 7.8 percent of the mean income of the relapse prevention group and 10 percent for the persistent depression group. Baseline difference in willingness to pay between patients in the two depression programs was not statistically significant.

Participants with higher incomes and those with more severe depression symptoms at baseline were willing to pay significantly more, as shown in Table 2. To illustrate the magnitude of these effects, we estimated the willingness to pay of participants at the 25th and 75th percentiles of household income and depression severity at baseline, using average values for all variables in our regression model. The estimated willingness to pay was $246 per month for those at the 25th percentile of depression severity, compared with $292 for those at the 75th percentile. The estimated willingness to pay was $230 per month for those at the 25th percentile of household income, compared with $292 for those at the 75th percentile. The estimates ranged from $222 per month for those with low incomes and low depression scores to $332 for those with high incomes and high depression scores.

For all participants, the mean monthly willingness to pay decreased from $270±186 at baseline to $214± 174 at six months. Neither the type of treatment—intervention or care as usual—nor the interaction between participants' severity of depression and the type of treatment they received was a significant predictor of willingness to pay at six months.

Discussion

At baseline, the participants in our study were willing to pay a mean of $270 per month for depression care; this amount is almost three times greater than that reported for antihypertensive therapy in the same HMO (15) and is roughly comparable to the amount reported for treatment of asthma, estimated to be between $200 and $350 per month (38), and for treatment of psoriasis, estimated to be $150 to $270 per month (39). In our study, the mean amount that participants were willing to pay for depression treatment corresponded to 9 percent of the sample's mean household income. This proportion is somewhat lower than that found for a treatment that would eliminate symptoms of arthritis—17 percent of household income (21). Patients may have greater willingness to pay for treatments of conditions with high symptom burden—such as depression, arthritis, or asthma—than for relatively asymptomatic conditions such as hypertension (15) or for preventive services such as colorectal cancer screening (40).

The amount that our participants were willing to pay was substantially greater than the actual costs of depression treatment provided to the intervention patients in this study, about $120 per month over six months (5). It is also greater than the cost of depression care for adults who are treated for depression in the HMO used in the study (41), greater than cost estimates from previous quality improvement studies for depression in our HMO (11), and higher than the typical cost of antidepressant medications. We used a method developed by Lave and colleagues (42) and Simon and associates (43) to estimate the amount our participants were willing to pay for a depression-free day; the amount was approximately $18. This result is based on calculating that a decrease from our participants' mean SCL-90 depression score at baseline—1.26—to complete remission of depression symptoms—an SCL-90 score of about .5, which corresponds to a score of less than 7 on the Hamilton Depression Rating Scale—would result in a gain of about 91 depression-free days over six months. This estimate is well within the range of cost-effectiveness estimates of $10 to $20 per depression-free day that has been established in quality improvement trials for depression in primary care (43).

A finding consistent with previous research and with our first hypothesis was that willingness to pay was strongly associated with household income. We adjusted for differences in household income in our multivariate analyses, and we want to make it clear that we are not advocating for willingness to pay as a method of allocating resources among individuals. Because psychiatric disorders such as depression may be more severe among those with lower incomes and because there is a strong association between income and willingness to pay, we caution against using consumers' willingness to pay as the only consideration when making decisions about resource allocation.

As we also hypothesized, willingness to pay was significantly associated with the severity of depressive symptoms. Over the six-month study period, willingness to pay decreased along with participants' depression severity (4). The strong association between willingness to pay and the severity of depressive symptoms at baseline and over time suggests that willingness to pay may be a reasonably good proxy for health status preferences, or the value patients place on their health status.

We did not observe significant effects of treatment type (intervention or care as usual) on willingness to pay at six months, and we believe that two factors may have affected, in opposite directions, the willingness to pay of participants in the intervention group. Participants in the intervention group experienced a significantly greater reduction in depression symptoms than did patients in care as usual (4,30), which may have reduced their willingness to pay for depression treatment. On the other hand, those in the intervention group were provided with systematic education about the value of depression care and a more organized model of depression care than were participants in care as usual. Intervention-group participants reported greater satisfaction with depression care at six months (4), and their treatment experience may have increased their perceived value of depression treatment and thus their reported willingness to pay for depression treatment at six months.

In regression models predicting willingness to pay at the six-month follow-up, we did not find a significant interaction between treatment type and depression severity—a finding suggesting that the type of treatment did not alter the relationship between depression severity and willingness to pay and that the two factors described above may operate independently.

Our study of willingness to pay for depression care was exploratory and has a number of limitations: First, the sample consisted of patients who had received new prescriptions for antidepressants in primary care and who agreed to participate in a trial of quality improvement for depression. Second, this sample may not be representative of other depressed primary care patients. In our analyses, we combined patients from two different programs, persistent depression and relapse prevention, who had been randomly assigned to intervention or to care as usual. We believe that this combined sample represents the spectrum of patients in treatment for depression in the four nonacademic primary care clinics; in our regression analyses we adjusted for depression status and for the two types of treatment. Our combined sample included 228 patients with persistent depression and 387 patients with only residual symptoms of depression, with the second group being those in the relapse prevention program. In this study, "baseline" measures were taken after patients had received from six to eight weeks of treatment. The willingness to pay $270 per month at baseline thus reflects the fact that many patients had already experienced a substantial reduction in depressive symptoms. Among the 83 patients in the group with persistent depression who met research diagnostic criteria for major depression (31) after six to eight weeks of treatment in primary care, the mean willingness to pay was slightly higher—$278±$188 per month.

Our study did not use the willingness-to-pay method to assess participants' valuation of the type of depression care they received, either the intervention or care as usual. Rather, we asked a hypothetical question about willingness to pay for a depression treatment that would completely eliminate all symptoms of depression. However, existing treatments for depression generally result in full remission among only about 50 percent of treated patients (1), and our question about willingness to pay did not allow us to estimate willingness to pay for partial treatment results. Other studies have demonstrated that willingness to pay for treatment is associated with the expected reduction in symptoms (24,45). Judging from this finding, our estimates of willingness to pay are probably higher than the actual willingness to pay for the depression treatments we evaluated in this study.

Because of the hypothetical and limited nature of our question about willingness to pay, we do not know whether participants' self-reported willingness to pay is an accurate estimate of their true willingness. Other studies have found that contingent valuation methods to assess willingness to pay may overestimate subjects' real willingness (44). Because willingness to pay was not a primary study outcome, we had to limit the length and complexity of our question to a simple payment-card question. We asked participants "How much would you be willing to pay each month?" but did not specifically inquire about the maximum amount that they would be willing to pay, as recommended by some experts. To give a valid assessment of their willingness to pay, respondents would need perfect information about depression; the quality, effectiveness, risks, and side effects of treatment; and treatment alternatives. More comprehensive assessments of willingness to pay (24,31,46) might result in different and possibly more valid responses than did our simple question.

Despite these limitations, we feel that the assessment of willingness to pay to estimate the value of treatment for common mental disorders appears promising, and we believe that further research in this area is warranted. The willingness-to-pay method may allow consumers to express preferences for treatments that could be important to researchers, clinicians, and health policy makers. Patients may be better able to understand relatively concrete questions about money than questions reflecting utility measurement techniques, such as time trade-off or standard gamble. The vast majority of our patients completed the willingness-to-pay question—97 percent at baseline and 90 percent at six months. This response compares favorably with that in another recent trial of quality improvement for depression treatment in primary care, which had a relatively high rate of nonresponse (about 25 percent) to brief time-trade-off and standard-gamble questions used to assess health status preferences (47,48,49).

Our findings suggest that depressed primary care patients place a high value on treatments that would relieve them of the symptoms of depression. Treatments that can accomplish this goal for a majority of patients are available (1,50), but many depressed primary care patients do not receive such treatments (51,52), and efforts to improve access to effective depression care may be of substantial value. Barriers to effective depression treatment in primary care include limited insurance coverage for such treatments—for example, limited reimbursement for antidepressants, psychotherapy, and depression care management under Medicare. Discrepancies between consumers' and insurers' willingness to pay for effective mental health treatments could result in a growing demand for true parity for mental health treatments.

Conclusions

In this study, the amount that patients were willing to pay for depression care was comparable to the amount reported for the treatment of other chronic medical disorders and was higher than the actual cost of depression treatment. Measurements of willingness to pay may be a promising method for assessing the value of treatments for common mental disorders, but more research is needed on the validity and usefulness of this method in mental health research.

Acknowledgment

This research was supported by grant MH 471739 from the National Institute of Mental Health to Dr. Katon, principal investigator.

Dr. Unützer is affiliated with the Center for Health Services Research of the UCLA Neuropsychiatric Institute at the University of California, Los Angeles. Dr. Katon, Dr. Russo, and Dr. Walker are affiliated with the department of psychiatry at the University of Washington in Seattle. Dr. Simon, Dr. Von Korff, Dr. Lin, Dr. Ludman, and Dr. Bush are affiliated with the Center for Health Studies of the Group Health Cooperative of Puget Sound in Seattle. Send correspondence to Dr. Unützer at Center for Health Services Research, UCLA Neuropsychiatric Institute, 10920 Wilshire Boulevard, Los Angeles, California 90024 (e-mail, ).

Table 1. Differences in demographic characteristics of participants assigned by depression status to one of two treatment programs in a study of participants' willingness to pay for depression treatment

Table 1.

Table 1. Differences in demographic characteristics of participants assigned by depression status to one of two treatment programs in a study of participants' willingness to pay for depression treatment

Enlarge table

Table 2. Predictors of willingness to pay for depression treatment among 615 depressed primary care patientsa

a Statistics for the model: F=6.83, df=6, 5,654; p<.001; R2=.07

Table 2.

Table 2. Predictors of willingness to pay for depression treatment among 615 depressed primary care patientsa

a Statistics for the model: F=6.83, df=6, 5,654; p<.001; R2=.07

Enlarge table

References

1. Agency for Health Care Policy and Research Depression Guidelines Panel: Depression in Primary Care: Clinical Practice Guideline No 5. Rockville, Md, Agency for Health Care Policy and Research, Pub No 93-0550, 1993Google Scholar

2. Katon W, Von Korff M, Lin E, et al: Collaborative management to achieve treatment guidelines: impact on depression in primary care. JAMA 273:1026-1031, 1995Crossref, MedlineGoogle Scholar

3. Katon W, Robinson P, Von Korff M, et al: A multifaceted intervention to improve treatment of depression in primary care. Archives of General Psychiatry 27:932-934, 1996Google Scholar

4. Katon W, Von Korff M, Lin EHB, et al: Stepped collaborative care for primary care patients with persistent symptoms of depression. Archives of General Psychiatry 56:1109-1115, 1999Crossref, MedlineGoogle Scholar

5. Simon GE: Cost-effectiveness of improved depression treatments. Presented at NIMH Conference on Challenges for the 21st Century: Mental Health Services Research, Washington, DC, July 18, 2000Google Scholar

6. Hunkeler EM, Meresman J, Hargreaves WA, et al: Efficacy of nurse telehealth care and peer support in augmenting treatment of depression in primary care. Archives of Family Medicine 9:700-708, 2000Crossref, MedlineGoogle Scholar

7. Schulberg HC, Block MR, Madonia MJ, et al: Treating major depression in primary care practice: eight-month clinical outcomes. Archives of General Psychiatry 53:913-919, 1996Crossref, MedlineGoogle Scholar

8. Katzelnick DJ, Simon GE, Pearson SD, et al: Randomized trial of a depression management program in high utilizers of medical care. Archives of Family Medicine 9:345-351, 2000Crossref, MedlineGoogle Scholar

9. Kroenke K, West SL, Swindle R, et al: Similar effectiveness of paroxetine, fluoxetine, and sertraline in primary care: a randomized trial. JAMA 286:2947-2955, 2001Crossref, MedlineGoogle Scholar

10. Lave JR, Frank RG, Schulberg HC, et al: Cost-effectiveness of treatments for major depression in primary care practice. Archives of General Psychiatry 55:645-651, 1998Crossref, MedlineGoogle Scholar

11. Von Korff M, Katon W, Bush T, et al: Treatment cost, cost-offset, and cost-effectiveness of collaborative management of depression. Psychosomatic Medicine 60:143-149, 1998Crossref, MedlineGoogle Scholar

12. Johannesson M, Johansson PO, Josson B: Economic evaluation of drug therapy: a review of the contingent valuation method. Pharmacoeconomics 1:325-337, 1992Crossref, MedlineGoogle Scholar

13. O'Brien BJ, Viramontes JL: Willingness to pay: a valid and reliable measure of health state preference? Medical Decision Making 14:289-297, 1994Google Scholar

14. O'Brien BJ, Novosel S, Torrance G, et al: Assessing the economic value of a new antidepressant: a willingness to pay approach. Pharmacoeconomics 8:34-45, 1995Crossref, MedlineGoogle Scholar

15. Ramsey S, Sullivan SD, Psaty BM, et al: Willingness to pay for antihypertensive care: evidence from a staff model HMO. Social Science and Medicine 44:1911-1917, 1994CrossrefGoogle Scholar

16. Flowers CR, Garber AM, Bergen MR, et al: Willingness-to-pay utility assessment: feasibility of use in normative patient decision support systems, in The Emergence of Internetable Health Care: Systems that Really Work: Proceedings of the 1997 AMIA Annual Symposium. Edited by Masys DR. Bethesda, Md, American Medical Informatics Association, 1997Google Scholar

17. Frederick AM, Chey WD, Magaret N, et al: Symptom status and the desire for Helicobacter pylori confirmatory testing after eradication therapy in patients with peptic ulcer disease. American Journal of Medicine 107:133-136, 1999Crossref, MedlineGoogle Scholar

18. Golan EH, Shechter M: Contingent valuation of supplemental health care in Israel. Medical Decision Making 13:302-310, 1993Crossref, MedlineGoogle Scholar

19. Gafni A: Willingness to pay as a measure of benefits. Medical Care 29:1246-1252, 1991Crossref, MedlineGoogle Scholar

20. Gafni A: Alternatives to the QALY measure for economic evaluations. Supportive Care in Cancer 5:105-111, 1997Crossref, MedlineGoogle Scholar

21. Thompson MS, Read JL, Liang M: Feasibility of willingness-to-pay measurement in chronic arthritis. Medical Decision Making 4:195-215, 1984Crossref, MedlineGoogle Scholar

22. Johannesson M, Jonsson B: Willingness to pay for antihypersensitive therapy: results of a Swedish pilot study. Journal of Health Economics 10:461-474, 1991Crossref, MedlineGoogle Scholar

23. Olsen JA, Donaldson C: Helicopters, hearts, and hips: using willingness to pay to set priorities for public sector health care programmes. Social Science and Medicine 46:1-12, 1998Crossref, MedlineGoogle Scholar

24. Chestnut LG, Keller LR, Lambert WE, et al: Measuring heart patients' willingness to pay for changes in angina symptoms. Medical Decision Making 16:65-77, 1996Crossref, MedlineGoogle Scholar

25. Taylor SJ, Armour CL: Measurement of consumer preference for treatments used to induce labour: a willingness to pay approach. Health Expectations 3:203-216, 2000Crossref, MedlineGoogle Scholar

26. Olsen JA, Smith RD: Theory versus practice: a review of willingness-to-pay in health and health care. Health Economics 10:39-52, 2001Crossref, MedlineGoogle Scholar

27. Longo CJ: Choices of methodology in pharmacoeconomics studies. Medical Care 37(4 suppl Lilly):32-35, 1999Google Scholar

28. Smith RD: The relative sensitivity of willingness-to-pay and time-trade-off to changes in health status: an empirical investigation. Health Economics 10:487-497, 2001Crossref, MedlineGoogle Scholar

29. Voruganti LN, Awad AG, Oyewumi LK, et al: Assessing health utilities in schizophrenia: a feasibility study. Pharmacoeconomics 17:273-286, 2000Crossref, MedlineGoogle Scholar

30. Katon WJ, Rutter C, Ludman E, et al: A randomized trial of relapse prevention of depression in primary care. Archives of General Psychiatry 56:1109-1115, 1999Crossref, MedlineGoogle Scholar

31. Diener A, O'Brien B, Gafni A: Health care contingent valuation studies: a review and classification of the literature. Health Economist 7:313-326, 1998Crossref, MedlineGoogle Scholar

32. Williams JB, Gibbon M, First MB, et al: The structured clinical interview for DSM-III-R (SCID), part 2: multisite test-retest reliability. Archives of General Psychiatry 49:630-636, 1992Crossref, MedlineGoogle Scholar

33. Derogatis LR, Rickels K, Uhlenhuth EH, et al: The Hopkins symptom checklist: a measure of primary symptom dimensions, in Psychological Measurements in Psychopharmacology: Problems in Pharmacopsychiatry. Edited by Pichot P. Basel, Switzerland, Karger, 1974Google Scholar

34. Simon GE, Revicki D, Von Korff M: Telephone assessment of depression severity. Journal of Psychiatric Research 27:247-252, 1993Crossref, MedlineGoogle Scholar

35. Costa PT, McCrae RR: The NEO Personality Inventory Manual. Odessa, Fla, Psychological Assessment Resources, 1985Google Scholar

36. Katon W, Lin E, Von Korff M, et al: The predictors of persistence of depression in primary care. Journal of Affective Disorders 31:81-90, 1994Crossref, MedlineGoogle Scholar

37. Von Korff M, Wagner EH, Saunders K: A chronic disease score from automated pharmacy data. Journal of Clinical Epidemiology 45:197-203, 1992Crossref, MedlineGoogle Scholar

38. Blumenschein K, Johannesson M: Relationship between quality of life instruments, health state utilities, and willingness to pay in patients with asthma. Annals of Allergy, Asthma, and Immunology 80:189-194, 1998Crossref, MedlineGoogle Scholar

39. Lundberg L, Johanneson M, Silverdahl M, et al: Quality of life, health-state utilities and willingness to pay in patients with psoriasis and atopic eczema. British Journal of Dermatology 141:1067-1075, 1999Crossref, MedlineGoogle Scholar

40. Frew E, Wolstenholme JL, Whynes DK: Willingness-to-pay for colorectal cancer screening. European Journal of Cancer 37:1746-1751, 2001Crossref, MedlineGoogle Scholar

41. Simon GE, Unützer J: Health care utilization by patients treated for bipolar disorder in an insured population. Psychiatric Services 50:1303-1308, 1999LinkGoogle Scholar

42. Lave JR, Frank RG, Schulberg HC, et al: Cost-effectiveness of treatments for major depression in primary care practice. Archives of General Psychiatry 55:645-651, 1998Crossref, MedlineGoogle Scholar

43. Simon GE, Katon WJ, Von Korff M, et al: Cost-effectiveness of a collaborative care program for primary care patients with persistent depression. American Journal of Psychiatry 158:638-644, 2001LinkGoogle Scholar

44. Blumenschein K, Johannesson M, Yokohama KK, et al: Hypothetical versus real willingness to pay in the health care sector: results from a field experiment. Journal of Health Economics 20:441-457, 2001Crossref, MedlineGoogle Scholar

45. O'Connor RM, Johannesson M, Hass SL, et al: Urge incontinence: quality of life and patients' valuation of symptom reduction. Pharmacoeconomics 14:531-539, 1998Crossref, MedlineGoogle Scholar

46. Klose T: The contingent valuation method in health care. Health Policy 47:97-123, 1999Crossref, MedlineGoogle Scholar

47. Sherbourne CD, Keeler E, Unützer J, et al: Relationship between age and patients' current health state preferences. Gerontologist 39:271-278, 1999Crossref, MedlineGoogle Scholar

48. Sherbourne CD, Schoenbaum M, Unützer J, et al: Can utility-weighted HRQOL estimates capture health effects of quality improvement for depression? Medical Care 29:1246-1259, 2001Google Scholar

49. Wells KB, Sherbourne CD: Functioning and utility for current health of patients with depression or chronic medical conditions in managed, primary care practices. Archives of General Psychiatry 56:897-904, 1999Crossref, MedlineGoogle Scholar

50. Schulberg HC: Treating depression in primary care practice: applications of research findings. Journal of Family Practice 50:535-537, 2001MedlineGoogle Scholar

51. Wells KB, Schoenbaum M, Unützer J, et al: Quality of care for depression in managed care. Archives of Family Medicine 8:529-536, 1999Crossref, MedlineGoogle Scholar

52. Young AS, Klap R, Sherbourne CD, et al: The quality of care for depressive and anxiety disorders in the United States. Archives of General Psychiatry 58:55-61, 2001Crossref, MedlineGoogle Scholar