The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×

Abstract

Objective:

Despite the effectiveness of electroconvulsive therapy (ECT), limited epidemiologic research has been conducted to identify rates of ECT use and characteristics of patients who receive ECT. Sociodemographic and clinical characteristics associated with ECT use were examined among patients with mood disorders in the MarketScan commercial insurance claims database.

Methods:

Among individuals with major depressive disorder or bipolar disorder, sociodemographic and clinical characteristics of those who received ECT and those who did not were compared by using bivariate effect size comparisons and multivariate logistic regression.

Results:

Among unique individuals in the 2014 MarketScan database (N=47,258,528), the ECT utilization rate was 5.56 ECT patients per 100,000 in the population. Of the 969,277 patients with a mood disorder, 2,471 (.25%) received ECT. Those who received ECT had substantially higher rates of additional comorbid psychiatric disorders (risk ratio [RR]=5.70 for any additional psychiatric disorder), numbers of prescription fills for any psychotropic medication (Cohen’s d=.77), rates of any substance use disorder (RR=1.97), and total outpatient psychotherapy visits (Cohen’s d=.49). The proportion of patients with a mood disorder who received ECT in the West (.19%) was substantially lower than in other U.S. regions (.28%). This difference was almost entirely accounted for by one western state comprising 59.1% of patients in that region.

Conclusions:

Use of ECT is exceptionally uncommon and limited to patients with extensive multimorbidity and high levels of service use. ECT utilization is most limited in areas of the country where regulatory restrictions are greatest.

Major depressive disorder is the leading cause of disability worldwide (1) and is associated with significant morbidity and mortality (2). Electroconvulsive therapy (ECT) is an effective therapy for severe major depressive disorder and other mood disorders. Especially among adults with treatment-resistant depression, generally defined as depression that does not remit or respond to one or more standard antidepressant pharmacotherapies (3), ECT stands out in its effectiveness. Whereas standard antidepressant therapies achieve response with 16%–17% of patients with treatment-resistant depression (4), ECT achieves response rates of 50%–70% with such patients (5). Recent data show that among psychiatric inpatients, ECT is associated with a 46% lower risk of 30-day readmission compared with a matched group of patients with severe depression who did not receive ECT (6).

ECT is thought to be underutilized despite both its demonstrated effectiveness and the significant reductions in its associated cognitive side-effect profile in recent decades (7,8). Despite evidence that it is more effective than other treatments (5,9) for the most common psychiatric disorder (2), recent data suggest that only approximately one in 10 hospitals that provide inpatient psychiatric care even have the capacity to provide ECT (6,7). The underutilization of ECT is thought to reflect a combination of factors, including stigma, risk of cognitive side effects, and restricted access because of limited availability. However, few published studies have examined rates and correlates of ECT use in U.S. samples. Case et al. (10) reported that the total number of hospitals offering ECT has been declining. In international settings, ECT utilization varies widely across regions, with utilization estimates ranging from 1.1 ECT patients per 100,000 people in Poland (11) to 41 ECT patients per 100,000 people in Sweden (12). The most recent utilization estimates for the procedure in the United States date to 1999 or earlier (13) and vary widely by region, ranging from eight ECT patients per 100,000 people in California (14) in 1995 to 42 ECT patients per 100,000 people in New England in the same year (15).

A recent study characterizing the use of ECT at a large Veterans Affairs medical center in New England found ECT to be provided to .45% of patients in psychiatric specialty care annually; although the ECT sample was small (N=50), receipt of ECT was strongly associated with higher rates of psychotropic prescription fills compared with patients who did not receive ECT (16). We applied the same methods to a far larger and more representative sample of privately insured patients in this study by using deidentified insurance claims data from the 2014 MarketScan Commercial Claims and Encounters database (IBM Watson Health; henceforth, MarketScan). We examined overall rates of ECT use in 2014 among individuals in the MarketScan sample as a whole and among the subgroup who received a diagnosis of a mood disorder (major depressive disorder or bipolar disorder). In this subgroup, we compared those who received ECT with those who did not on sociodemographic characteristics, psychiatric and comorbid general medical diagnoses, service use, psychotropic medication fills, and geographic region.

Methods

Data Source

Data for this study were drawn from the MarketScan database. These data are based on insurance claims and other reimbursement processing submitted by providers. The database contains data from privately insured individuals and their dependents and includes information on inpatient and outpatient service use (by Current Procedural Terminology code), outpatient prescriptions, and diagnoses coded according to the ICD-9.

Sample

In the MarketScan database in 2014 (total N=47,258,528), we first identified all patients older than age 18 who had a psychiatric diagnosis (ICD-9 codes 290–319) and those with a mood disorder (major depressive disorder or bipolar disorder, ICD-9 codes 296.2–296.3 and codes 296.4–296.9, respectively). We further identified the patients who received ECT services (Current Procedural Terminology code 90870) among all patients and among those with a mood disorder.

Measures

Measures addressed sociodemographic characteristics, comorbid general medical and psychiatric diagnoses, service use, and psychotropic medication prescriptions during 2014. Sociodemographic characteristics included gender, age, and whether the patient lived in an urban area during the year. Comorbid diagnoses were based on ICD-9 codes in MarketScan administrative files. Medical comorbidity was measured overall by the Charlson Comorbidity Index (17) and by individual diagnoses when they were available.

Service use was measured by the proportion of patients in each group with any inpatient mental health treatment during 2014 as well as by the number of medical and surgical outpatient visits, emergency room visits, psychiatric and substance use visits, and total outpatient visits. The proportions receiving psychotropic medication prescriptions filled in 2014 were also calculated from individual claims. Psychotropic medications were classified into six groups: antidepressants; antipsychotics; stimulants; anxiolytics, sedatives, and hypnotics; lithium; and mood stabilizers and anticonvulsants. Patients were also classified by state of residence into four Census regions: Northeast, North-Central, South, and West. The data use agreement does not allow us to name specific states.

Analysis

The goal of the analysis was to compare patients who received ECT with those who did not among patients with a mood disorder diagnosis (major depressive disorder or bipolar disorder). Given the large sample size, all comparisons would have been statistically significant, and p values would have been uninformative. Instead, we identified substantial effect size differences between groups who received ECT and those who did not on the basis of Cohen’s d (difference in means divided by the pooled standard deviation) for continuous variables or risk ratios (RRs) for dichotomous variables. Cohen’s d values greater than .20 were considered to represent more than small changes, whereas RR values greater than 2.0 or less than .5 were considered to represent sizeable differences. These values are based on conventional definitions of small and medium effect sizes for Cohen’s d (18) and on a conventional definition of a “practically” significant effect for relative risk (19).

Multivariate logistic regression was then used to identify characteristics independently associated with receipt of ECT. In these analyses, receipt of ECT was the dichotomous dependent variable. Independent variables were chosen to include characteristics substantially differentiating patients who received ECT and those who did not in the bivariate analyses described earlier, which affected a substantial portion of the sample (>5%). These included total psychotropic prescription fills (dichotomized at the median), psychotherapy use (any versus none), and whether patients had comorbid psychiatric and substance use disorder diagnoses. Although mean age did not differ substantially between groups in the bivariate analysis (Cohen’s d=.27), we included it as a dichotomous independent variable (above the median age of 44) on the basis of substantial prior literature indicating that older patients may be more likely to respond to ECT (20,21). Given that rates of ECT utilization were substantially lower in the West than in other U.S. regions, we also included geographic region as a dichotomous independent variable. We did not include inpatient mental health treatment in the logistic regression because patients are often admitted to the hospital for ECT.

Results

Sociodemographic Characteristics

In 2014, there were 47,258,528 individuals in the MarketScan database, of whom 5,525,173 who were older than age 18 had any psychiatric diagnosis (11.7% of all patients). Of these, 2,628 (.05%) received at least one ECT treatment, yielding a rate of 5.56 ECT patients per 100,000 in the general population and .05% of those with psychiatric diagnoses. There were 969,277 individuals (17.5% of those with a psychiatric diagnosis) in the MarketScan database during 2014 who carried a diagnosis of major depressive disorder or bipolar disorder (henceforth, mood disorders). Of these, 2,471 (.25%) received at least one ECT treatment, representing 94.0% of all patients who received ECT. The overall sample of individuals with mood disorders (N=969,277) was predominantly female (67.4%), with a mean±SD age=42.9±13.1 (Table 1). Most (87.7%) individuals resided in urban areas.

TABLE 1. Demographic, clinical, and service use characteristics of privately insured adults with mood disordersa

Non-ECT groupb(N=969,277)ECT group(N=2,471)Effect size
VariableN%N%Risk ratioCohen’s d
Demographic characteristic
 Male315,13232.680632.61.00
 Age (years), M±SD42.9±13.646.3±12.4.27
 Urban area resident850,34787.72,18388.31.01
Comorbid medical condition
 Seizures12,7941.3773.12.36
 Insomnia43,2304.51706.91.54
 Myocardial infarction4,846.517.71.38
 Congestive heart failure8,917.9321.31.41
 Peripheral vascular disease14,2481.5652.61.79
 Cerebrovascular accident22,9722.41074.31.83
 Chronic obstructive airway disease99,35110.332613.21.29
 Hepatic disease30,6293.21054.31.34
 Diabetes mellitus92,7609.633413.51.41
 Renal disease12,6981.3672.72.06
 Cancer32,0833.31104.51.36
 Any pain diagnosis228,65223.665526.51.12
 Musculoskeletal pain346,51735.81,11945.31.27
 Charlson Comorbidity Index (M±SD)c.50±1.18.68±1.26.15
Psychiatric diagnosis
 Other depression (dysthymia)270,42827.91,98680.42.88
 Posttraumatic stress disorder41,1944.328511.52.71
 Anxiety disorder380,53839.31,59564.61.64
 Adjustment disorder85,4908.82379.61.09
 Personality disorders14,5391.527311.17.37
 Schizophrenia13,2791.428311.58.33
 Other psychiatric diagnosis30,4353.144317.95.70
 Alcohol dependence44,2964.62409.72.12
 Cocaine use disorder2,035.27.31.33
 Cannabis use disorder5,525.617.71.21
 Sedative use disorder4,071.4281.12.72
 Amphetamine use disorder1,939.25.21.03
 Hallucinogen use disorder194000
 Any substance use disorder86,4448.943517.61.97
Service use
 Any mental health inpatient treatment90,5309.31,45158.76.29
 Emergency room visits (M±SD).55±1.691.02±2.81.20
 Medical and surgical visits (M±SD)11.78±14.6614.60±15.32.19
 All outpatient visits (M±SD)22.61±21.1651.31±32.111.06
 Psychiatric or substance use outpatient visits (M±SD)10.83±13.4836.71±25.391.27
Psychotropic medication prescriptions (M±SD)
 Antidepressant3.70±5.207.06±7.43.52
 Antipsychotic.89±2.814.13±6.05.69
 Anxiolytic, sedative, or hypnotic 2.36±4.765.38±6.69.52
 Stimulant.57±2.35.75±2.49.07
 Lithium.18±1.24.94±2.66.37
 Anticonvulsant or mood stabilizer1.12±3.112.28±4.09.32
 All psychotropics (M±SD)8.82±11.5620.54±18.08.77
Proportion receiving psychotropic prescriptions
 Antidepressant prescriptions515,75253.21,71669.51.31
 Antipsychotic prescriptions153,92115.91,40556.93.58
 Anxiolytic, sedative, and hypnotic prescriptions354,17436.51,53061.91.69
 Stimulant prescriptions82,8738.634714.01.64
 Lithium31,7923.348919.86.03
 Anticonvulsant and mood stabilizer184,74419.194638.32.01
 All psychotropics635,84665.71,91177.31.18
Proportion receiving psychotherapy
 Psychotherapy as outpatient540,17855.71,87275.81.36
 Psychotherapy as inpatient6,300.71917.711.89
 Family psychotherapy (outpatient)38,6744.02098.52.12
 Group psychotherapy (outpatient)26,5582.734714.05.12
Number of psychotherapy visits (M±SD)
 Psychotherapy, outpatient5.74±10.7012.62±16.51.49
 Psychotherapy, inpatient.02±.44.49±3.89.17
 Family psychotherapy, outpatient.19±1.79.32±2.18.06
 Group psychotherapy, outpatient.26±2.551.49±5.82.27

aECT, electroconvulsive therapy

bThe non-ECT group comprised those in the MarketScan database with a diagnosis of major depressive disorder or bipolar disorder who did not receive ECT.

cPossible scores range from 0 upward, with no theoretical upper limit; higher values indicate a greater number of and more severe medical comorbidities.

TABLE 1. Demographic, clinical, and service use characteristics of privately insured adults with mood disordersa

Enlarge table

Geographic Variation

The proportion of patients with a diagnosis of mood disorder who received ECT in the West (.19%) was substantially lower than the proportion in the Northeast (.28%), North-Central (.27%), and South (.27%), which taken together had an ECT rate of .28% (Table 2). This difference was almost entirely accounted for by one western state, which comprised 59.1% of patients in the west region. The ECT utilization rate in this state was 202 ECT patients out of 126,144 individuals with mood disorders (.16%).

TABLE 2. Geographic variation of ECT utilization rates among privately insured adults with a mood disordera

U.S. regionbNon-ECT groupECT group% receiving ECT
Northeast226,567633.28
North-Central196,311535.27
South306,649842.27
West213,411397.19

aSource: 2014 MarketScan database. ECT, electroconvulsive therapy

bOf the data, 2.5% were missing.

TABLE 2. Geographic variation of ECT utilization rates among privately insured adults with a mood disordera

Enlarge table

Clinical Diagnoses

There were no substantial differences between groups on gender, age, or proportion living in urban areas (Table 1). Compared with patients with mood disorders who did not receive ECT, those who underwent ECT had a higher prevalence of renal disease (2.71% versus 1.31%; RR=2.06) and seizures (3.12% versus 1.32%; RR=2.36). There were no substantial differences in the prevalence of other general medical conditions (RR<2.0), including insomnia, myocardial infarction, congestive heart failure, peripheral vascular disease, cerebrovascular accidents, chronic obstructive airway disease, hepatic disease, diabetes mellitus, cancer, or pain. There was also no substantial difference in overall Charlson Comorbidity Index between the ECT and non-ECT groups (.68 versus .50; Cohen’s d=.15).

Comorbid Psychiatric and Substance Use Disorders

Compared with those who did not receive ECT, the ECT group had substantially higher rates of comorbid alcohol use disorder (9.71% versus 4.57%; RR=2.12). Comorbid psychiatric diagnoses were also substantially higher in the ECT group compared with the non-ECT group, including other depressive disorders (80.37% versus 27.90%; RR=2.88), posttraumatic stress disorder (11.53% versus 4.25%; RR=2.71), personality disorders (11.05% versus 1.50%; RR=7.37), schizophrenia (11.45% versus 1.37%; RR=8.33), and other psychiatric diagnoses (17.93% versus 3.14%; RR=5.70).

Service Use

Compared with those who did not receive ECT, those who did had substantially higher levels of service use on measures of inpatient mental health treatment (58.7% versus 9.3%; RR=6.29) and total number of outpatient psychiatric visits (36.7 versus 10.8; d=1.27). There were no substantial differences in emergency room visits or medical and surgical visits.

Psychotropic Medication Prescriptions

Total psychotropic medication prescription fills were also substantially higher among the ECT group compared with the non-ECT group (Cohen’s d=.77). More specifically, the ECT group had substantially higher numbers of prescriptions for antidepressants (d=.52); antipsychotics (d=.69); and anxiolytics, sedatives, and hypnotics (d=.52). Although the numbers of prescriptions differed substantially, the proportions of individuals receiving any psychotropic medications did not substantially differ between the ECT and non-ECT groups (77.3% versus 65.7%; RR=1.18). However, the proportions of individuals receiving antipsychotics (56.9% versus 15.9%; RR=3.58), anticonvulsants and mood stabilizers (38.3% versus 19.1%; RR=2.01), and lithium (19.8% versus 3.3%; RR=6.03) were substantially higher in the ECT group compared with the non-ECT group.

Psychotherapy Visits

Overall, most individuals in both groups received psychotherapy on an outpatient basis (75.8% of the ECT group versus 55.7% of the non-ECT group; RR=1.36). Compared with the non-ECT group, the ECT group had a substantially higher rate of individuals who received services coded as group (14.0% versus 2.7%; RR=5.12) or family (8.5% versus 4.0%; RR=2.12) psychotherapy. The total number of coded outpatient psychotherapy visits among the ECT group was higher than that for the non-ECT group (12.6 versus 5.7; d=.49).

Logistic Regression Model

Logistic regression showed that ECT recipients were older (above the median of 44; adjusted odds ratio [OR]=1.73, 95% confidence interval [CI]=1.60–1.88), more likely to have a comorbid psychiatric diagnosis (OR=6.98, CI=5.82–8.38) or a substance use diagnosis (OR=1.44, CI=1.30–1.61), more likely to have received any psychotherapy (OR=2.02, CI=1.84–2.21), and more likely to have above the median number of psychotropic medication fills (OR=2.20, CI=2.01–2.41). Living in the west region was associated with a lower rate of ECT (OR=.79, CI=.71–.88). The logistic regression model yielded a c statistic of .76, indicating a good fit.

Discussion

In this study of privately insured patients, .25% of patients with a diagnosis of a mood disorder received ECT in 2014. The overall ECT utilization rate was 5.56 ECT patients per 100,000 in the population. ECT utilization was associated with older age, greater psychiatric and substance use comorbidity, and greater mental health service use, specifically psychotherapy visits and psychotropic prescription fills. ECT utilization rates were also higher among those living outside the west region.

ECT utilization rates may have declined substantially in recent decades in the United States. Our general population–based utilization rate of 5.56 ECT patients per 100,000 is substantially lower than previous estimates of 42 per 100,000 from a sample in New England in 1995 (15) and is even lower than a study reporting eight per 100,000 from California in the same year (14). This trend is consistent with conclusions from a previous study of inpatient ECT, which reported a marked decline from 1993 to 2009 (10). These contrasts are heightened by the fact that the MarketScan database is composed of individuals with private insurance, a group associated with higher rates of ECT compared with patients with public insurance (6,10).

Additional non–mood disorder, psychiatric comorbid conditions were associated with greater use of ECT, most likely reflecting more severe symptoms and impairment. However, ECT patients were comparable with non-ECT patients in terms of general medical comorbidity, with the exception that ECT patients had higher rates of renal disease. This finding could be due to the higher rate of lithium use in the ECT group, a common medication prescribed for bipolar disorder as well as in the specific context of ECT because of its ability to reduce the risk of relapse after ECT (22). Similar to the findings of a recent study conducted in the Veterans Health Administration (16), ECT patients (when compared with non-ECT patients) had substantially higher rates of personality disorders (RR=7.37) and alcohol dependence (RR=2.12); much higher rates of prescription fills for antipsychotics (RR=3.58), mood stabilizers and anticonvulsants (RR=2.01), and lithium (RR=6.03); and higher prescription fill rates of all psychotropics (Cohen’s d=.77). ECT thus appears to be used among patients with multimorbidity who have more complicated psychiatric disorders (23), perhaps as a treatment of last resort when clinicians judge other treatment possibilities to have failed.

Of note, our finding that ECT patients in general have more outpatient psychotherapy visits compared with non-ECT patients (Cohen’s d=.49) belies the traditional belief that ECT patients are too cognitively impaired to engage in psychotherapy. Indeed, with changes over time in stimulus administration, including right unilateral electrode placement and the use of shorter pulse widths, several preliminary studies have suggested that ECT in combination with cognitive-behavioral therapy may be an effective way to improve longer-term outcomes (2426).

The geographic trend seen in our study suggesting that states in the west region had significantly lower rates of ECT among patients with mood disorders was almost entirely accounted for by lower rates of ECT in one western state and is consistent with data from earlier studies (14,15,27). This state has one of the strictest legal consent requirements for ECT, requiring three physicians to agree that the procedure is necessary and that a patient has capacity to consent (28).

The data presented here are also consistent with other suggestions that the rate of ECT utilization is declining and that ECT is limited to patients with multimorbidity and high levels of service and medication use, just as was observed in the Veterans Health Administration study (16). Such a decline and limited use are problematic, given the considerable evidence that ECT is the most effective therapy for treatment-resistant depression (5), can rapidly reduce suicidal ideation (29), and may be associated with a lower rate of 30-day psychiatric hospital readmission (6). Given the marked improvements in the cognitive side-effect profile of ECT in recent decades (right unilateral site and shorter pulse width) (8,30,31), there is much room for improvement in making this effective treatment more widely available to a broad range of appropriate patients. Further research is needed to confirm temporal trends in ECT utilization in the United States and to identify the reasons for underuse of this effective treatment.

Several methodological limitations require comment. Despite the large overall sample from which the ECT patients were selected (N=47,258,528), the MarketScan database is drawn from employees of large companies and health plans and may not be representative of health care utilization patterns of employees from medium and smaller firms; from self-employed, privately insured individuals; or from publicly insured patients. Furthermore, our study was limited to data from 2014. Hence, inferences about temporal trends in ECT utilization, more specifically that ECT usage is declining, are made from comparisons with previously published reports and thus need to be confirmed by future studies that directly compare ECT utilization over time using the same sampling procedures. Additionally, information regarding the type of ECT administered (bitemporal versus right unilateral) is not available in the claims data. Finally, the data are based on an insurance claim–based data set, which does not include important clinical information such as length of depressive episode, clinical response to ECT, psychotic versus nonpsychotic depression, or failed antidepressant trials.

Despite these limitations, these findings extend those seen in a single-site Veterans Health Administration study (16) showing that ECT use is exceptionally rare, with substantial differences between those who use ECT and those who do not among patients with a mood disorder diagnosis. Similar to a recent report on inpatient ECT (10), our findings suggest that ECT utilization may have further decreased since the most recent reports. Further epidemiological research confirming temporal trends and ECT utilization patterns are needed to better understand the apparent underuse of this effective treatment and its restriction to use as a treatment of last resort.

Conclusions

Overall, our data demonstrate that among privately insured individuals, use of ECT is exceptionally uncommon and is limited to patients with extensive multimorbidity and high levels of service use. ECT utilization is also most limited in areas of the country where regulatory restrictions are greatest.

Dr. Wilkinson and Dr. Rosenheck are with the Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut. Dr. Rosenheck is also with the VA New England Mental Illness Research, Education and Clinical Center, West Haven, Connecticut. Ms. Agbese is with the Department of Public Health Sciences, and Dr. Leslie is with the Departments of Public Health Sciences and Psychiatry, all at Pennsylvania State University College of Medicine, Hershey.
Send correspondence to Dr. Wilkinson (e-mail: ).

This work was supported in part by National Institute of Mental Health grant T32-MH-062994-15. Dr. Wilkinson receives research and salary support from Yale–New Haven Hospital, the Department of Psychiatry at Yale University, the Brain and Behavioral Research Foundation (formerly the National Alliance for Research on Schizophrenia and Depression), and the Robert E. Leet and Clara Guthrie Patterson Trust.

Dr. Wilkinson also receives research support through contracts with Janssen Pharmaceuticals for conducting clinical trials, administered through Yale University. The other authors report no financial relationships with commercial interests.

References

1 Depression. Geneva, World Health Organization, 2017. www.who.int/mediacentre/factsheets/fs369/en/. Accessed Aug 1, 2017Google Scholar

2 Kessler RC, Berglund P, Demler O, et al.: The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R). JAMA 289:3095–3105, 2003Crossref, MedlineGoogle Scholar

3 Fava M: Diagnosis and definition of treatment-resistant depression. Biological Psychiatry 53:649–659, 2003Crossref, MedlineGoogle Scholar

4 Zisook S, Ganadjian K, Moutier C, et al.: Sequenced Treatment Alternatives to Relieve Depression (STAR*D): lessons learned. Journal of Clinical Psychiatry 69:1184–1185, 2008Crossref, MedlineGoogle Scholar

5 Weiner RD, Coffey CE, Fochtmann LJ, et al.: The Practice of Electroconvulsive Therapy: Recommendations for Treatment, Training, and Privileging. Arlington, VA, American Psychiatric Publishing, 2001Google Scholar

6 Slade EP, Jahn DR, Regenold WT, et al.: Association of electroconvulsive therapy with psychiatric readmissions in US hospitals. JAMA Psychiatry 74:798–804, 2017Crossref, MedlineGoogle Scholar

7 Sackeim HA: Modern electroconvulsive therapy: vastly improved yet greatly underused. JAMA Psychiatry 74:779–780, 2017Crossref, MedlineGoogle Scholar

8 Sackeim HA, Prudic J, Nobler MS, et al.: Effects of pulse width and electrode placement on the efficacy and cognitive effects of electroconvulsive therapy. Brain Stimulation 1:71–83, 2008Crossref, MedlineGoogle Scholar

9 Greenberg RM, Kellner CH: Electroconvulsive therapy: a selected review. American Journal of Geriatric Psychiatry 13:268–281, 2005Crossref, MedlineGoogle Scholar

10 Case BG, Bertollo DN, Laska EM, et al.: Declining use of electroconvulsive therapy in United States general hospitals. Biological Psychiatry 73:119–126, 2013Crossref, MedlineGoogle Scholar

11 Gazdag G, Palinska D, Kloszewska I, et al.: Electroconvulsive therapy practice in Poland. Journal of ECT 25:34–38, 2009Crossref, MedlineGoogle Scholar

12 Nordanskog P, Hultén M, Landén M, et al.: Electroconvulsive therapy in Sweden 2013: data from the National Quality Register for ECT. Journal of ECT 31:263–267, 2015Crossref, MedlineGoogle Scholar

13 Lesage A, Lemasson M, Medina K, et al.: The prevalence of electroconvulsive therapy use since 1973: a meta-analysis. Journal of ECT 32:236–242, 2016Crossref, MedlineGoogle Scholar

14 Kramer BA: Use of ECT in California, revisited: 1984–1994. Journal of ECT 15:245–251, 1999Crossref, MedlineGoogle Scholar

15 Hermann RC, Ettner SL, Dorwart RA, et al.: Diagnoses of patients treated with ECT: a comparison of evidence-based standards with reported use. Psychiatric Services 50:1059–1065, 1999LinkGoogle Scholar

16 Wilkinson ST, Rosenheck RA: Electroconvulsive therapy at a Veterans Health Administration Medical Center. Journal of ECT (Epub ahead of print, March 8, 2017) Google Scholar

17 Charlson ME, Pompei P, Ales KL, et al.: A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. Journal of Chronic Diseases 40:373–383, 1987Crossref, MedlineGoogle Scholar

18 Cohen J: Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ, Erlbaum, 1988Google Scholar

19 Ferguson CJ: An effect size primer: A guide for clinicians and researchers. Professional Psychology: Research and Practice 40:532–538, 2009CrossrefGoogle Scholar

20 Kellner CH, Greenberg RM, Murrough JW, et al.: ECT in treatment-resistant depression. American Journal of Psychiatry 169:1238–1244, 2012LinkGoogle Scholar

21 O’Connor MK, Knapp R, Husain M, et al.: The influence of age on the response of major depression to electroconvulsive therapy: a CORE report. American Journal of Geriatric Psychiatry 9:382–390, 2001Crossref, MedlineGoogle Scholar

22 Sackeim HA, Haskett RF, Mulsant BH, et al.: Continuation pharmacotherapy in the prevention of relapse following electroconvulsive therapy: a randomized controlled trial. JAMA 285:1299–1307, 2001Crossref, MedlineGoogle Scholar

23 Bhalla IP, Rosenheck RA: A change in perspective: from dual diagnosis to multimorbidity. Psychiatric Services (Epub ahead of print, Oct 16, 2017)Google Scholar

24 Brakemeier EL, Merkl A, Wilbertz G, et al.: Cognitive-behavioral therapy as continuation treatment to sustain response after electroconvulsive therapy in depression: a randomized controlled trial. Biological Psychiatry 76:194–202, 2014Crossref, MedlineGoogle Scholar

25 Fenton L, Fasula M, Ostroff R, et al.: Can cognitive behavioral therapy reduce relapse rates of depression after ECT? A preliminary study. Journal of ECT 22:196–198, 2006Crossref, MedlineGoogle Scholar

26 Wilkinson ST, Ostroff RB, Sanacora G: Computer-assisted cognitive behavior therapy to prevent relapse following electroconvulsive therapy. Journal of ECT 33:52–57, 2017Crossref, MedlineGoogle Scholar

27 Pfeiffer PN, Valenstein M, Hoggatt KJ, et al.: Electroconvulsive therapy for major depression within the Veterans Health Administration. Journal of Affective Disorders 130:21–25, 2011Crossref, MedlineGoogle Scholar

28 Harris V: Electroconvulsive therapy: administrative codes, legislation, and professional recommendations. Journal of the American Academy of Psychiatry and the Law 34:406–411, 2006MedlineGoogle Scholar

29 Kellner CH, Fink M, Knapp R, et al.: Relief of expressed suicidal intent by ECT: a consortium for research in ECT study. American Journal of Psychiatry 162:977–982, 2005LinkGoogle Scholar

30 Loo CK, Katalinic N, Smith DJ, et al.: A randomized controlled trial of brief and ultrabrief pulse right unilateral electroconvulsive therapy. International Journal of Neuropsychopharmacology 18:pyu045, 2014MedlineGoogle Scholar

31 Loo CK, Sainsbury K, Sheehan P, et al.: A comparison of RUL ultrabrief pulse (0.3 ms) ECT and standard RUL ECT. International Journal of Neuropsychopharmacology 11:883–890, 2008Crossref, MedlineGoogle Scholar