The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.201500458

Abstract

Objective:

Injured patients presenting to acute care medical settings have high rates of posttraumatic stress disorder (PTSD) and comorbidities, such as depression and substance use disorders. Integrating behavioral interventions that target symptoms of PTSD and comorbidities into the acute care setting can overcome common barriers to obtaining mental health care. This study examined the feasibility and acceptability of embedding elements of cognitive-behavioral therapy (CBT) in the delivery of routine postinjury care management. The investigation also explored the potential effectiveness of completion of CBT element homework that targeted PTSD symptom reduction.

Methods:

This study was a secondary analysis of data from a U.S. clinical trial of the effectiveness of a stepped collaborative care intervention versus usual care for injured inpatients. The investigation examined patients’ willingness at baseline (prerandomization) to engage in CBT and pre- and postrandomization mental health service utilization among 115 patients enrolled in the clinical trial. Among intervention patients (N=56), the investigation examined acceptability of the intervention and used multiple linear regression to examine the association between homework completion as reported by the care manager and six-month PTSD symptom reduction as assessed by the PTSD Checklist–Civilian DSM-IV Version.

Results:

Patients in the intervention condition reported obtaining significantly more psychotherapy or counseling than patients in the control group during the six-month follow-up, as well as a high degree of intervention acceptability. Completion of CBT element homework assignments was associated with improvement in PTSD symptoms.

Conclusions:

Integrating behavioral interventions into routine acute care service delivery may improve the reach of evidence-based mental health care targeting PTSD.

The integration of mental health and substance use screening and intervention within general medical settings has the potential to overcome barriers to accessing these services and constitutes a long-term public health objective (1,2). Collaborative care intervention models may be optimal approaches for achieving this objective in primary and acute care medical settings (37). Nationwide, over 30 million patients present to trauma care systems each year after sustaining a traumatic injury, and 1.5 to 2.5 million individuals are so severely injured that they require inpatient hospitalization (2,8). Psychiatric and substance-related comorbidities, including alcohol use disorders and posttraumatic stress disorder (PTSD), are common among injured patients in acute care medical settings (7,9).

A body of literature now supports the integrated delivery of depression and anxiety treatments, including cognitive-behavioral therapy (CBT), in primary care settings (10,11). However, less is known about how to effectively integrate CBT approaches into acute care medical settings. Session-based CBT is among the evidence-based treatment modalities for PTSD most consistently recommended by best-practice guidelines (12) and may be an effective early preventive intervention for PTSD for the subpopulation of trauma-exposed patients recruited into efficacy trials.

Emerging literature on early collaborative care and other interventions now informs preliminary American College of Surgeons’ guidelines supporting PTSD screening and intervention at U.S. trauma centers (6,13,14). However, ongoing dialogue in the dissemination research field suggests that multisession CBT can be challenging to implement for trauma survivors in real-world contexts, including acute care medical settings (1517). For instance, in an acute care study of an early CBT intervention, less than 10% of trauma survivors symptomatic for PTSD received multisession CBT offered by the trial (18). Commentary from the dissemination and implementation research field has encouraged hybrid clinical trial approaches that aim to simultaneously test questions related to treatment effectiveness, feasibility, and acceptability of real-world intervention implementation (19,20).

The disassembling of traditional CBT approaches into implementable therapeutic elements (for example, psychoeducation, relaxation strategies, and activity scheduling) with accompanying homework assignments embedded in routine care management may advance the integration of PTSD treatment in acute care medical settings. Informed by the current evidence base for alcohol brief interventions in acute medical care and by public health and dissemination and implementation frameworks prioritizing population reach (21) and intervention feasibility and sustainability, our clinical research team developed CBT elements targeting PTSD and related comorbidities over a series of early collaborative care intervention trials (6,16).

A central feature of CBT is therapeutic assignment and completion of homework that provides opportunities for individuals to practice learned skills and for operant or classical conditioning learning to occur (22). Completion of homework is associated with symptom reduction. A recent meta-analysis demonstrated a small to medium association between homework completion and target symptom reduction (r=.26; 95% confidence interval=.19–.33) (23,24). Homework assignments play an equally important role in the CBT elements designed and integrated by the study team into care management; patients are taught behavioral skills and assigned activities to reduce symptoms of anxiety and depression that are common after traumatic injury. However, unlike patients in more traditional session-based approaches, patients of the care management team more frequently work with their care manager by telephone or at postinjury hospital and aftercare appointments, rather than in the therapist’s office. Whether homework is readily assigned and completed, and whether homework assignment and completion are associated with reduction of symptoms (that is, posttraumatic stress) within this therapeutic context, has not previously been empirically examined.

This study aimed to evaluate the feasibility and acceptability of embedding CBT elements within routine postinjury care management by using data from a clinical trial of stepped collaborative care targeting PTSD (25). The investigation also examined the association between completion of CBT elements homework and PTSD symptom reduction among patients receiving the stepped collaborative care intervention.

Methods

Data for this study were derived from a randomized controlled trial of a stepped collaborative care intervention targeting PTSD and related comorbidities among injured inpatients (Clinicaltrials.gov identifier NCT01625416) (25).

Participants and Procedures

This study included 115 of the original 121 patients enrolled in the larger trial; six patients were excluded because they did not complete any follow-up assessments (25). The University of Washington Institutional Review Board approved all study procedures prior to protocol initiation, and written informed consent was obtained from each participant. Study recruitment occurred from July 1, 2012, through February 28, 2013.

Patients randomly assigned to the intervention were identified as at risk of developing PTSD on the basis of a ten-item electronic medical record screen (26) and as symptomatic for PTSD on the basis of a score of ≥35 on the PTSD Checklist–Civilian DSM-IV Version (PCL-C) (6,27). Patients were randomly assigned to either the stepped care intervention or usual care control condition. Blinded to the study condition, research associates assessed patients at baseline and at one, three, and six months after baseline.

Intervention Condition

Patients randomly assigned to the intervention condition (N=56) received stepped measurement-based care from a trauma center–based mental health team over the course of six months postinjury (25), which included care coordination, pharmacotherapy targeting PTSD and related comorbidity, motivational interviewing (MI) targeting alcohol use and other risk behaviors, and CBT elements with associated homework targeting PTSD and comorbidity (for example, depression and suicidal ideation).

Rationale and approach to CBT element development and implementation.

As with “broad reach” MI interventions that have been successfully implemented in trauma center–based alcohol screening and brief intervention (2), the CBT elements were designed to be brief and readily deliverable within routine care management (that is, at bedside in the hospital or on the emergency department gurney, at outpatient medical follow-up appointments, or via telephone). The elements included principles and skills similar to those taught in session-based CBT targeting anxiety and depression, such as psychoeducation about symptoms and posttraumatic recovery; anxiety and stress reduction techniques, such as training in progressive muscle relaxation and breathing retraining; problem-solving; and activity scheduling consistent with a behavioral activation paradigm (28). The elements were designed to help patients overcome behavioral avoidance patterns consequent to anxious avoidance, withdrawal, or functional impairments related to the injury. Initial investigation has suggested that behavioral activation is efficacious for reducing symptoms of depression and PTSD (18,29,30). Therefore, the elements used emphasized working with patients to identify reinforcing activities that are pleasurable or meaningful or that help patients to build self-efficacy and mastery.

Common relaxation exercises targeting anxiety and hyperarousal included practicing slow breathing and progressive muscle relaxation for a few minutes each day. Examples of activity scheduling included engaging in pleasant events throughout the week, such as spending time outdoors or with friends. Patients were also assigned activities to face feared situations with the aim of increasing contact with enjoyable or meaningful life activities. The care manager documented the amount of time spent during each encounter with a patient, which included the time spent completing intervention activities for the patient (for example, care coordination). On average, the care manager spent 155.5 minutes, or 2.6±1.3 hours, per patient.

The care manager (SO) has a doctoral degree in psychology and completed graduate and fellowship training in CBT and MI. The care manager collaboratively identified appropriate CBT homework assignments with patients on the basis of the elements to target avoidance-withdrawal and anxiety-stress symptoms, according to the patient’s report and standardized measures. The nature and frequency of embedded CBT elements and homework assigned varied by patient depending on the patient’s level of engagement, time available, and treatment preferences and targets. As in previous trials by the study team, outpatient appointments for traditional cognitive-behavioral psychotherapy with the care manager were made available but were rarely utilized (1% of all encounters) (16,18).

Usual care control condition.

Patients in the control group (N=59) received postinjury care as usual, which prior investigation suggests includes routine outpatient surgical, primary care, and emergency department visits, as well as the occasional use of specialty mental health services (6,13,25).

Measures and Variables

Demographic and injury variables.

Demographic variables, including gender, race, ethnicity, and age, were assessed through patient self-report. The investigation determined injury severity at baseline during the index admission from the medical record ICD-9 codes by using the Abbreviated Injury Scale and Injury Severity Score (31).

PTSD symptoms.

PTSD symptoms were assessed with the PCL-C (27), which has established reliability and validity across trauma-exposed populations (32,33). All patients were asked to report their PTSD symptoms since the injury event at baseline and during the previous month at follow-up assessments. A 10-point difference on the PTSD checklist has been identified as clinically meaningful change (34).

Mental health service utilization.

Pre- and postinjury outpatient mental health service utilization among all patients was assessed by using items from the National Study on the Costs and Outcomes of Trauma (35), which were administered at baseline and at the one-, three-, and six-month follow-up interviews. At baseline, patients reported whether in their lifetime prior to their injury they had at least one outpatient visit with a provider about problems with emotions or nerves or about use of alcohol. At the one-month follow-up, patients were asked to respond to the same question in reference to the year prior to their injury, and at all follow-ups, they were asked to respond in reference to the last study interview; they also indicated the type of provider seen (psychiatrist, psychologist, or mental health counselor) since the last study interview. At the three- and six-month follow-ups, patients were asked to indicate whether they received psychotherapy or counseling during the study period targeting any of the following issues: anxiety, depression, alcohol use, drug use, traumatic brain injury, or suicidal ideation.

Patient willingness for treatment.

At baseline, all patients were asked to respond to the questions, “On a scale from 0 to 10, with 0 being not at all willing and 10 being totally willing, how willing would you be to talk to a trauma support counselor in the hospital, at follow-up medical appointments, or over the phone about your physical condition and emotional distress?” On the same 0-to-10 scale they were asked about willingness “to take medications for emotional distress.”

Homework completion.

For intervention patients only, the total number of homework assignments completed over the course of the six-month intervention was determined by reviewing care manager treatment notes, which included whether homework was assigned and whether the patient reported completing prior assignments since the last encounter.

Intervention acceptability.

At the six-month follow-up, intervention patients were asked to respond to three questions to assess intervention acceptability (on a scale from 1, not at all, to 9, very): “How helpful was the trauma support counseling to you?” “How successful do you think the trauma support counseling was at reducing your symptoms?” “How confident would you be in recommending the trauma support counseling to a friend or acquaintance that experiences similar symptoms?”

Data Analyses

We first described and compared baseline demographic, injury, and clinical variables, including PTSD symptom levels, willingness to receive treatments, and preinjury mental health service utilization across patients in the intervention and control group conditions. Next we compared PTSD symptom levels and patterns of health service utilization. Chi-square and independent-sample t test statistics were used to examine statistical significance of differences between groups.

To examine the feasibility and acceptability of CBT element delivery, we descriptively examined intervention patients’ self-report of trauma support counseling helpfulness, the success of the counseling at reducing symptoms, and confidence in recommending the counseling to others.

To examine the potential effectiveness of CBT element homework completion, we examined the association among intervention patients between the total number of homework assignments completed and symptoms of PTSD at the six-month assessment by using multiple linear regression. As in previous analyses of intervention effects, we controlled for age, gender, race-ethnicity, Injury Severity Score, total care manager time spent with the patient, and baseline PTSD symptoms (25). We used SPSS, version 19.0, for all analyses.

Results

On average, at baseline, patients in both the intervention and control groups were highly willing to talk to a trauma support counselor about their physical condition and emotional distress and somewhat willing to take medications for emotional distress (Table 1). Preinjury outpatient mental health service utilization was common, with nearly all patients having sought outpatient services for mental health purposes at some point in their lifetime. There were no significant differences in baseline PTSD symptoms between intervention and control patients.

TABLE 1. Baseline characteristics of 115 patients with traumatic injuries, by treatment conditiona

All (N=115)Intervention (N=56)Usual care (N=59)
CharacteristicN%N%N%
Age (M±SD)43.3±14.743.2±14.543.4±15.0
Female433721382237
Nonwhite race-ethnicity484225452339
Injury Severity Scoreb (M±SD)15.4±11.814.6±10.416.1±13.0
Willingness for counselingc (M±SD)7.9±2.77.6±2.98.0± 2.4
Willingness for psychiatric medicationc (M±SD)6.6±3.66.3±3.86.8±3.4
Prior use of outpatient mental health services
 Lifetime928047844576
 Past year635932623157
PCL-C scored (M±SD)47.2±10.647.2±10.347.2±10.9

aNo between-group comparison was statistically significant.

bAs measured by the Abbreviated Injury Scale and Injury Severity Score. Possible scores range from 0 to 75, with higher scores indicating greater severity.

cRated on a scale from 0, not at all willing, to 10, totally willing

dPTSD Checklist–Civilian DSM-IV Version. Possible scores range from 17 to 85, with higher scores indicating greater PTSD symptom severity. Patients were asked to report on symptoms since the injury event.

TABLE 1. Baseline characteristics of 115 patients with traumatic injuries, by treatment conditiona

Enlarge table

About half of all patients reported accessing outpatient mental health services during the six-month study period. However, few patients in the control group reported receiving psychotherapy or counseling, whereas nearly all intervention patients reported receiving this specific type of service (Table 2). On average, intervention patients had high scores on the measure of intervention acceptability (Table 2). Intervention patients had significantly lower scores on the PCL-C than the control group at the six-month assessment (Table 2).

TABLE 2. Use of mental health services and posttraumatic stress symptoms reported at six-month follow-up by 115 patients with traumatic injuries, by treatment condition

All (N=115)Intervention (N=56)Usual care (N=59)
CharacteristicN%N%N%
Mental health service use (outpatient visits with a nonstudy provider)
 Psychiatrist312716291525
 Psychologist302614251627
 Other mental health counselor322818321424
 Any psychiatrist, psychologist, or other mental health counselor595129523051
Self-reported receipt of psychotherapy or counseling58505293*610
PCL-C (M±SD)a44.5±16.342.1±16.0*46.8±16.3
Intervention acceptability (M±SD)b
 Care manager was helpful7.5±1.9
 Care manager helped reduce symptoms6.9±2.1
 Would recommend the intervention8.0±1.9

aPTSD Checklist–Civilian DSM-IV Version. Possible scores range from 17 to 85, with higher scores indicating greater PTSD symptom severity. Patients were asked to report on symptoms during the previous month.

bItems were measured on a scale from 1, not at all, to 9, very, with higher scores indicating greater acceptability.

*p<.05, for the difference between the treatment conditions

TABLE 2. Use of mental health services and posttraumatic stress symptoms reported at six-month follow-up by 115 patients with traumatic injuries, by treatment condition

Enlarge table

The care manager reported delivering CBT elements to 54 (96%) intervention patients and assigning homework to 52 (92%) patients, with a mean±SD number of assignments of 5.04±2.74; of the 52 patients assigned homework, 81% completed at least one assignment. At follow-up encounters with the care manager over the six-month intervention period, intervention patients reported successful completion of homework assignments on average 2.8±2.5 times.

Adjusted linear regression analysis revealed a statistically significant and clinically meaningful association between CBT element homework completion and PTSD symptom reduction for intervention patients (Table 3). The regression coefficient for homework completion in the final model indicated that for every report patients made of having completed assigned homework at an encounter with the care manager, PCL scores dropped by 2.45 points.

TABLE 3. Multiple regression analysis examining homework completion as a predictor of PTSD symptoms (PCL-C score) at six-month follow-up among patients in the intervention group (N=56)a

Variableβb95% CI for b
Age.04.05–.20 to .30
Female–.05–1.53–9.47 to 6.41
Nonwhite.37*11.894.21 to 19.56
Injury Severity Score.02.03–.33 to .38
Total intervention time.36*.08.01 to .14
PCL-C at baseline.32*.50.15 to .84
Total homework completedb–.38*–2.45–4.16 to –.75

aPCL-C, PTSD Checklist–Civilian DSM-IV Version. Adjusted R2=.39, p<.01

bChange in R2=.09

*p<.05

TABLE 3. Multiple regression analysis examining homework completion as a predictor of PTSD symptoms (PCL-C score) at six-month follow-up among patients in the intervention group (N=56)a

Enlarge table

Discussion

This is the first study to simultaneously assess the feasibility, acceptability, and potential effectiveness of CBT disassembled into elements and integrated in a stepped collaborative care intervention for traumatically injured inpatients, a population for whom engagement in session-based CBT has been consistently challenging (16,18). The CBT elements were feasibly delivered with homework as embedded treatments within routine trauma-focused care management. The care manager was able to engage in CBT elements with nearly all intervention patients, and most patients were able to successfully complete a homework assignment. Patients receiving the intervention generally reported that encounters with the care manager were helpful, that the counseling contributed to reduced symptoms, and that they would recommend the counseling to others.

Consistent with findings from the CBT psychotherapy process literature and the meta-analysis by Mausbach and colleagues (23), completing CBT element homework assignments was associated with a modest (β=–.38) improvement in PTSD symptoms (23,24). Specifically, our results indicate that it would take two completed homework assignments to see a 5-point difference on the PCL-C and four completed homework assignments to see a more substantial 10-point PCL-C difference (34). We acknowledge, however, that additional research is required to better understand clinically meaningful change parameters for commonly used PTSD measures, such as the PCL-C. This finding suggests that embedding elements may be an effective, initial broad-reach CBT implementation approach, with great potential public health–population impact in acute care medical settings (36). However, we acknowledge that a major shortcoming of a stand-alone approach to CBT element delivery is that many patients in the trial remained symptomatic for PTSD at follow-up. A potentially effective strategy to address patients with recalcitrant PTSD symptoms that could be tested in future randomized trials is the delivery of more intensive session-based CBT through stepped-care procedures (6).

Our findings suggest that embedding CBT elements into care management improves patients’ perceptions of having accessed counseling services after traumatic injury. Patients in the control and intervention groups reported an equally high degree of willingness to talk to a trauma support counselor about emotional distress and physical conditions at baseline; however, considerably more patients in the intervention group reported receiving psychotherapy or counseling that targeted noted comorbidities during the study period (93% of intervention patients versus 10% of patients in the control group). Of note, although patients in both groups reported obtaining mental health services during the study period, it appears that only those in the intervention group perceived themselves to have received psychotherapy or counseling for one of the comorbidities targeted by the intervention. However, the disparity and the nature of services patients receive outside the care management intervention team warrants closer examination in future studies.

Prior to enrollment in the trial, patients in our sample appeared to access mental health services at a rate higher than national estimates (37), which may be a reflection of how participants were recruited into the larger trial (that is, patients with prior mental health conditions were more heavily recruited because they were at greater risk of postinjury PTSD). Such prior exposure may increase patients’ willingness to engage in the care management intervention and CBT elements. Populations of patients with less prior mental health service use may respond differently to the intervention as a whole and to CBT elements in particular.

A key limitation is the exclusive use of a Ph.D.-level care manager and the associated limits to the generalizability of the investigative findings to providers with less training, such as frontline trauma center master’s-level social workers and registered nurse practitioners. Another limitation is that our model for homework completion among intervention patients was not causal. It is possible that the association between homework completion and symptom improvement reflected the fact that patients who experienced improvement in symptoms were better able to complete homework or that a third variable, such as engagement with the care manager, accounted for the observed association. Also, the intervention arm of the trial involved multiple components, including information technology enhancements and pharmacotherapy that may also be associated with observed treatment effects. It is not uncommon for studies of CBT service delivery that examine both effectiveness and implementation to employ nonrandomized designs (19,20). Future experimental research could test whether homework completion causes symptom reduction by randomly assigning patients to homework or no homework groups. Careful examination of the nature of homework assignments and association between homework completion and symptom reductions by using DSM-5 PTSD criteria is warranted.

Conclusions

The American College of Surgeons has demonstrated willingness to integrate mental health and substance use service delivery in acute care medical settings through best-practice guidelines and policy requirements (14). The development of readily implementable, MI-informed, brief interventions has catalyzed the college to develop requirements for universal screening and intervention for patients with alcohol use disorders. Similar development of readily deliverable CBT elements targeting PTSD and comorbidity could help facilitate the movement of current college guideline recommendations for PTSD screening and intervention toward nationwide requirements.

Dr. Darnell, Dr. Russo, Dr. Wang, Ms. Ingraham, Ms. Sandgren, and Dr. Zatzick are with the Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle (e-mail: ). Dr. O’Connor is with the Department of Psychiatry and Behavioral Sciences, University of Louisville, Louisville, Kentucky. Dr. Wagner is with the Department of Mental Health, Portland Department of Veterans Affairs Medical Center, Portland, Oregon.

This research was supported by grants 3UH3MH106338-03S1, T32MH082709, and K24MH086814 from the National Institute of Mental Health.

Dr. O'Connor reports receipt of payments as a training consultant for CAMS-Care. The other authors report no financial relationships with commercial interests.

References

1 Services Research and Clinical Epidemiology Workgroup, National Advisory Mental Health Council: The Road Ahead: Research Partnerships to Transform Services. Bethesda, Md, National Institute of Mental Health, 2006Google Scholar

2 Alcohol Screening and Brief Intervention (SBI) for Trauma Patients: Committee on Trauma Quick Guide. Chicago, American College of Surgeons, 2010Google Scholar

3 Katzelnick DJ, Williams MD: Large-scale dissemination of collaborative care and implications for psychiatry. Psychiatric Services 66:904–906, 2015LinkGoogle Scholar

4 Katon W: Health reform, research pave way for collaborative care for mental illness. JAMA 309:2425–2426, 2013Crossref, MedlineGoogle Scholar

5 Unützer J, Chan YF, Hafer E, et al.: Quality improvement with pay-for-performance incentives in integrated behavioral health care. American Journal of Public Health 102:e41–e45, 2012Crossref, MedlineGoogle Scholar

6 Zatzick D, Jurkovich G, Rivara FP, et al.: A randomized stepped care intervention trial targeting posttraumatic stress disorder for surgically hospitalized injury survivors. Annals of Surgery 257:390–399, 2013Crossref, MedlineGoogle Scholar

7 Love J, Zatzick D: Screening and intervention for comorbid substance disorders, PTSD, depression, and suicide: a trauma center survey. Psychiatric Services 65:918–923, 2014LinkGoogle Scholar

8 Injury Prevention and Control: Data and Statistics (WISQARS). Atlanta, Center for Disease Control and Prevention, National Center for Injury Prevention and Control, 2012Google Scholar

9 Cunningham RM, Bernstein SL, Walton M, et al.: Alcohol, tobacco, and other drugs: future directions for screening and intervention in the emergency department. Academic Emergency Medicine 16:1078–1088, 2009Crossref, MedlineGoogle Scholar

10 Gilbody S, Bower P, Fletcher J, et al.: Collaborative care for depression: a cumulative meta-analysis and review of longer-term outcomes. Archives of Internal Medicine 166:2314–2321, 2006Crossref, MedlineGoogle Scholar

11 Roy-Byrne P, Craske MG, Sullivan G, et al.: Delivery of evidence-based treatment for multiple anxiety disorders in primary care: a randomized controlled trial. JAMA 303:1921–1928, 2010Crossref, MedlineGoogle Scholar

12 Forbes D, Creamer M, Bisson JI, et al.: A guide to guidelines for the treatment of PTSD and related conditions. Journal of Traumatic Stress 23:537–552, 2010Crossref, MedlineGoogle Scholar

13 Zatzick D, Roy-Byrne P, Russo J, et al.: A randomized effectiveness trial of stepped collaborative care for acutely injured trauma survivors. Archives of General Psychiatry 61:498–506, 2004Crossref, MedlineGoogle Scholar

14 Resources for Optimal Care of the Injured Patient/2014 Resources Repository. Chicago, American College of Surgeons, 2014Google Scholar

15 Kearns MC, Ressler KJ, Zatzick D, et al.: Early interventions for PTSD: a review. Depression and Anxiety 29:833–842, 2012Crossref, MedlineGoogle Scholar

16 Trusz SG, Wagner AW, Russo J, et al.: Assessing barriers to care and readiness for cognitive behavioral therapy in early acute care PTSD interventions. Psychiatry 74:207–223, 2011Crossref, MedlineGoogle Scholar

17 Ringle VA, Read KL, Edmunds JM, et al.: Barriers to and facilitators in the implementation of cognitive-behavioral therapy for youth anxiety in the community. Psychiatric Services 66:938–945, 2015LinkGoogle Scholar

18 Wagner AW, Zatzick DF, Ghesquiere A, et al.: Behavioral activation as an early intervention for posttraumatic stress disorder and depression among physically injured trauma survivors. Cognitive and Behavioral Practice 14:341–349, 2007CrossrefGoogle Scholar

19 Curran GM, Bauer M, Mittman B, et al.: Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care 50:217–226, 2012Crossref, MedlineGoogle Scholar

20 Titov N, Dear BF, Staples LG, et al.: MindSpot clinic: an accessible, efficient, and effective online treatment service for anxiety and depression. Psychiatric Services 66:1043–1050, 2015LinkGoogle Scholar

21 Glasgow RE, Vogt TM, Boles SM: Evaluating the public health impact of health promotion interventions: the RE-AIM framework. American Journal of Public Health 89:1322–1327, 1999Crossref, MedlineGoogle Scholar

22 McGinn LK, Sanderson WC: What allows cognitive behavioral therapy to be brief? Overview, efficacy, and crucial factors facilitating brief treatment. Clinical Psychology: Science and Practice 8:23–37, 2001CrossrefGoogle Scholar

23 Mausbach BT, Moore R, Roesch S, et al.: The relationship between homework compliance and therapy outcomes: an updated meta-analysis. Cognitive Therapy and Research 34:429–438, 2010Crossref, MedlineGoogle Scholar

24 Kazantzis N: Power to detect homework effects in psychotherapy outcome research. Journal of Consulting and Clinical Psychology 68:166–170, 2000Crossref, MedlineGoogle Scholar

25 Zatzick D, O’Connor SS, Russo J, et al.: Technology‐enhanced stepped collaborative care targeting posttraumatic stress disorder and comorbidity after injury: a randomized controlled trial. Journal of Traumatic Stress 28:391–400, 2015Crossref, MedlineGoogle Scholar

26 Russo J, Katon W, Zatzick D: The development of a population-based automated screening procedure for PTSD in acutely injured hospitalized trauma survivors. General Hospital Psychiatry 35:485–491, 2013Crossref, MedlineGoogle Scholar

27 Weathers FW, Keane TM, Davidson JR: Clinician-administered PTSD scale: a review of the first ten years of research. Depression and Anxiety 13:132–156, 2001Crossref, MedlineGoogle Scholar

28 Jacobson NS, Martell CR, Dimidjian S: Behavioral activation treatment for depression: returning to contextual roots. Clinical Psychology: Science and Practice 8:255–270, 2001CrossrefGoogle Scholar

29 Jakupcak M, Roberts LJ, Martell C, et al.: A pilot study of behavioral activation for veterans with posttraumatic stress disorder. Journal of Traumatic Stress 19:387–391, 2006Crossref, MedlineGoogle Scholar

30 Gros DF, Yoder M, Tuerk PW, et al.: Exposure therapy for PTSD delivered to veterans via telehealth: predictors of treatment completion and outcome and comparison to treatment delivered in person. Behavior Therapy 42:276–283, 2011Crossref, MedlineGoogle Scholar

31 Johns Hopkins Health Services Research and Development Center: Determining Injury Severity From Hospital Discharges: A Program to Map ICD-9DM Diagnoses Into AIS, and ISS Severity Scores. Baltimore, JHU Press, 1989Google Scholar

32 Blanchard EB, Jones-Alexander J, Buckley TC, et al.: Psychometric properties of the PTSD Checklist (PCL). Behaviour Research and Therapy 34:669–673, 1996Crossref, MedlineGoogle Scholar

33 Zatzick DF, Galea S: An epidemiologic approach to the development of early trauma focused intervention. Journal of Traumatic Stress 20:401–412, 2007Crossref, MedlineGoogle Scholar

34 Monson CM, Gradus JL, Young-Xu Y, et al.: Change in posttraumatic stress disorder symptoms: do clinicians and patients agree? Psychological Assessment 20:131–138, 2008Crossref, MedlineGoogle Scholar

35 MacKenzie EJ, Rivara FP, Jurkovich GJ, et al.: A national evaluation of the effect of trauma-center care on mortality. New England Journal of Medicine 354:366–378, 2006Crossref, MedlineGoogle Scholar

36 Koepsell TD, Zatzick DF, Rivara FP: Estimating the population impact of preventive interventions from randomized trials. American Journal of Preventive Medicine 40:191–198, 2011Crossref, MedlineGoogle Scholar

37 Wang PS, Berglund P, Olfson M, et al.: Failure and delay in initial treatment contact after first onset of mental disorders in the National Comorbidity Survey Replication. Archives of General Psychiatry 62:603–613, 2005Crossref, MedlineGoogle Scholar