The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
ArticlesFull Access

Organizational Stress as Moderator of Relationship Between Mental Health Provider Adaptability and Organizational Commitment

Published Online:https://doi.org/10.1176/appi.ps.201500191

Abstract

Objective:

Community mental health providers often operate within stressful work environments and are at high risk of emotional exhaustion, which can negatively affect job performance and client satisfaction with services. This cross-sectional study examined the relationships between organizational stress, provider adaptability, and organizational commitment.

Methods:

Variables were analyzed with moderated multilevel regression in a sample of 311 mental health providers from 49 community mental health programs.

Results:

Stressful organizational climate, characterized by high levels of emotional exhaustion, role conflict, and role overload, was negatively related to organizational commitment. Organizational stress moderated the relationship between provider adaptability and organizational commitment, such that those who were more adaptable had greater levels of organizational commitment when organizational stress was low but were less committed than those who were less adaptable when organizational stress was high.

Conclusions:

Providers higher in adaptability may perceive their organization as a greater fit when the work environment is less stressful; however, highly adaptable providers may also exercise choice that manifests in lower commitment to staying in an overly stressful work environment. Service systems and organizational contexts are becoming increasingly demanding and stressful for direct mental health service providers. Therefore, community mental health organizations should assess and understand their organizational climate and intervene with empirically based organizational strategies when necessary to reduce stressful climates and maintain adaptable employees.

Community mental health organizations face increasing challenges as a function of governmental oversight and accountability associated with funding of services. This scrutiny results in increased burden (such as increased administrative work and productivity requirements) and demands (including following national guidelines and accountability to funders) on mental health organizations and direct service providers (1). Increased burden and demands may contribute to a stressful organizational climate, defined as perceptions of, and emotional responses to, an overwhelming work environment (24), that may in turn result in decreased commitment to an organization and its goals (5,6). Meta-analytic research on stressful organizational climates has demonstrated negative consequences, including lower job satisfaction and service quality (7). The relationship between stressful organizational climates and reduced organizational commitment is one of the most corroborated (6,810). Organizational commitment, defined as a willingness to exert considerable effort on behalf of the organization and a strong desire to remain a member of the organization (11), is correlated with improved workforce stability, job performance, and service quality, as well as lower job burnout and use of sick leave (3,1218), and is one of the strongest predictors of staff turnover (3,14,15). Hence it is imperative to understand how organizational stress and other factors may affect organizational commitment among desirable employees, including those high in adaptability, a trait associated with more positive attitudes toward evidence-based practices among mental health providers (19) and with better work performance (20).

Mental health organizations undergo frequent transformations (21), necessitating a workforce that can be flexible in adapting to change. We define individual adaptability in line with the definition from Baard and colleagues’ review (22) as a tendency to make “cognitive, affective, motivational, and behavioral modifications . . . in response to the demands of a new or changing environment, or situational demands.” Adaptability is related to a number of important personal constructs, such as task orientation, conscientiousness, and satisfaction (23). Further, workers higher in adaptability and psychological flexibility demonstrate better mental health, motivation, job performance, innovation, and creativity, as well as reduced absence rates and reduced turnover intentions (2426). In a study examining the role of emotional competence, personality, and job attitudes as predictors of job performance, the adaptability component of the Emotional Competence Inventory was the single strongest predictor of job performance ratings among public-sector factory workers (20). Hence studies suggest that individual differences in adaptability play an important role in both individual and organizational performance. In addition, the association of individual adaptability with reduced absenteeism and turnover intentions in corporate settings suggests that mental health provider adaptability may increase provider organizational commitment. However, it is unknown how provider adaptability may operate within the context of stressful organizational climates in community mental health settings.

Previous research in the health care field has found a negative relationship between organizational stress and organizational commitment (6,8), such that employees reporting high job stress were more likely to exhibit lower organizational loyalty (8). A stressful organizational climate, as measured by the Organizational Social Context (OSC) scale (11) comprises emotional exhaustion, role conflict, and role overload. Respectively, these factors relate to feeling overwhelmed, experiencing multiple conflicting demands, and having impossible amounts of work to accomplish (11). In meta-analyses, role conflict was positively correlated with both job dissatisfaction and job-related tension (27), and role conflict and role overload were negative antecedents of organizational commitment (9). Although previous research has found adaptability to be a desirable characteristic among workers (examples include increasing positive attitudes toward evidence-based practice and decreasing intentions to switch jobs), it is still unclear how adaptable workers operate within stressful organizational climates. For example, the same characteristics of adaptability that lead to positive employee attributes in a workplace, such as flexibility and ability to manage change well, may also lead to exercising discretion, manifesting as willingness to change jobs in situations where the worker perceives the current work environment to be untenable (28). As such, although workers higher in adaptability may be more likely to accept change and new initiatives, they may also be more likely to engage in active strategies to find other employment and pursue alternatives that are more in line with their career goals when the work environment is overly stressful (28,29).

In this study we examined the relationships between stressful organizational climate, provider adaptability, and organizational commitment. In accordance with previous literature, we hypothesized that higher levels of stressful organizational climate would be negatively related to organizational commitment. We also hypothesized that provider adaptability would be positively associated with organizational commitment. Finally, we hypothesized that organizational stress would moderate the relationship between provider adaptability and organizational commitment such that providers with higher levels of adaptability would have greater levels of organizational commitment when organizational stress is low but be less committed than those who are less adaptable when organizational stress is high.

Methods

Participants

Participants were clinical and case management service providers working in public-sector mental health programs for children and their families in a large California county between November 2000 and September 2001 (30). The county provided the research team with a list of all county-operated and county-contracted mental health programs providing services to children and families (N=54). Managers from each mental health program were contacted and provided with a detailed description of the study, which aimed to examine organizational characteristics among mental health programs for children and families by using survey methods. Forty-nine of the 54 programs (91%) agreed to participate in this study and provided time during work hours for their clinicians and case managers to complete the survey. Program types included outpatient (42%), day treatment (21%), wraparound (19%), case management (17%), and inpatient (2%). A total of 335 clinicians and case managers worked within the 49 programs that agreed to participate, and 96% of clinicians (N=322) consented and participated in the study. Complete data on all variables of interest were available for 311 (93%) of the 335 clinicians and case managers from participating programs.

Chi-square and t test analyses comparing providers who had missing data for at least one variable with those who had complete data revealed no significant differences in demographic variables, work characteristics, or variables examined in the primary analysis. The number of mental health providers at each program ranged from one to 72 full-time-equivalent employees (M±SD=14.6±16.2). Clinicians and case service managers who did not work for a county-operated or county-contracted mental health program serving children and families (out of private practice, military organizations, adult treatment programs) were excluded from participating in this study.

Procedures

Using a county-provided list of all county-operated and county-contracted mental health programs serving children and families, we contacted a program manager at each program and described the study in detail. Survey sessions were scheduled at the program site at a time designated by the program manager, and surveys were administered to groups of direct-service providers without supervisors present. The project coordinator and a trained research assistant administered pen-and-paper surveys, assuring participants of confidentiality and emphasizing the need to answer honestly, and were available during the survey session to answer any questions that arose. Participants received a verbal and written description of the study and provided informed consent prior to the survey administration. The study and procedures were approved by the appropriate institutional review boards.

Measures

Organizational stress.

The OSC scale was used to assess organizational stress. The factor structure of the OSC scale has been confirmed in a large national sample of 100 mental health agencies (11). OSC subscales of role conflict (for example, “Interests of the clients are often replaced by bureaucratic concerns such as paperwork”; seven items, current sample α=.85), role overload (for example, “The amount of work I have to do keeps me from doing a good job”; seven items, current sample α=.84), and emotional exhaustion (for example, “I feel emotionally drained from my work”; six items, current sample α=.90) create the OSC stress measure (current sample α=.93). All 20 items are rated on a 5-point scale ranging from 0, “not at all,” to 4, “to a very great extent,” with the stress score calculated as the average across all items. In addition, we provide the T score for the sample to enable comparison with the national sample.

Adaptability.

The adaptability subscale of the Emotional Competence Inventory (31) was used to measure the extent to which providers are flexible in handling change and new circumstances in the work environment (items include “smoothly juggles multiple demands” and “adapts by changing overall strategy, goals, or project to fit situation”; five items, current sample α=.62). Each item was rated on a 5-point scale ranging from 0, “not at all,” to 4, “to a very great extent,” with provider adaptability scores calculated as the average of all items.

Organizational commitment.

The organizational commitment subscale of the OSC scale was used to assess the extent to which a provider is committed to the agency (examples include “I am proud to tell others that I am a part of this organization” and “For me this is the best of all possible organizations to work for”; eight items, current sample α=.91). The subscale has excellent psychometric properties, has been used in numerous studies in children’s mental health and social services, and has been shown to be related to staff turnover (3). Each item is rated on a 5-point scale ranging from 0, “not at all,” to 4, “to a very great extent,” with the organizational commitment score calculated as the average of all items.

Analyses

Moderated regression analyses were conducted to examine the associations of provider adaptability and organizational stress with organizational commitment as well as the moderating effect of organizational stress on the relationship between provider adaptability and organizational commitment. Aggregation analyses were conducted because organizational stress is believed to represent a team-level construct (11). In order to examine this assumption, we computed the average within-group correlation (awg) and the intraclass correlation coefficients (ICCs) for the stressful climate measure. The awg interrater agreement statistic was used to assess the degree to which members within each program agreed in their responses to the stressful climate scale. In order to facilitate interpretability and comparability to other reliability and consistency measures, we scaled the awg statistic with a range of 0 to 1, where 1 indicates perfect agreement and .70 indicates moderate agreement (32).

Because providers were nested within mental health programs, multilevel hierarchical linear modeling (HLM) analyses were conducted to control for the effects of the nested data structure (3335). Provider age, gender, and months working in the agency were included in the analyses as control variables. HLM analyses were conducted with maximum marginal likelihood estimation for mixed-effects models in IBM SPSS Statistics 22 (36). The final model included participants with no missing data (N=311). An unconditional model including only the intercept was estimated to compute the ICC for organizational commitment.

Results

Descriptive Statistics

Seventy-six percent (N=237) of the sample was female. The race-ethnicity of the sample was non-Hispanic Caucasian (62%, N=193), Hispanic (13%, N=42), African American (7%, N=22), Asian American (6%, N=18), American Indian (1%, N=2), other race-ethnicity (7%, N=22), and not reported (4%, N=12). The mean±SD age for the sample was 35.93±10.68 years, and the mean job tenure was 23.4±37.6 months. Provider education for the sample included those with a master’s degree (57%, N=178), college graduates (19%, N=59), and those with some graduate work (11%, N=33), a doctoral degree (10%, N=30), or some college (3%, N=10). Thirty-two percent of the sample (N=100) reported that their primary discipline was marriage and family therapy, 31% (N=97) social work, 21% (N=65) psychology, 13% (N=39) other (drug or alcohol counseling or psychiatry), and 3% (N=10) not reported.

The average OSC stress score was 1.37±.79. The average T score utilizing the normative national sample was 47.20±9.57. The average provider adaptability score was 2.52±.55, with higher scores signifying higher levels of provider adaptability, and the average level of organizational commitment was 2.57±.76, with higher scores indicating greater commitment to one’s organization.

Multilevel Regression Analyses

The ICC for the unconditional HLM model was .10, indicating that 10% of the variance in organizational commitment was accounted for by mental health program. There was moderate agreement across mental health programs on organizational stress (awg=.73, ICC=.11). The first step in the HLM model examined whether stressful organizational climate was negatively associated with organizational commitment, as well as whether provider adaptability was positively associated with organizational commitment (Table 1). A strong negative relationship was found between stressful climate and organizational commitment (B=–.54, p<.01); however, no significant relationship was found between adaptability and organizational commitment when analyses controlled for the effects of organizational climate, mental health program clustering, age, gender, and tenure at an organization.

TABLE 1. Multilevel regression of adaptability and stressful climate on organizational commitmenta

Variable and regression stepBSEdft
Step 1
 Intercept2.88.293049.84
 Agency tenure.00.00297.61
 Provider age.00.00305.41
 Provider sex.11.092921.23
 Adaptability.11.072891.68
 Stressful climate–.54**.05305–9.94**
Step 2
 Intercept2.26.422985.37
 Agency tenure.00.00296.61
 Provider age.00.00304.41
 Provider sex.10.092911.23
 Adaptability.36**.142912.59**
 Stressful climate–.08.24292–.32
 Adaptability × stressful climate–.17*.08288–2.03*

aIntraclass correlation coefficient (unconditional)=.10

*p<.05, **p<.01

TABLE 1. Multilevel regression of adaptability and stressful climate on organizational commitmenta

Enlarge table

The second step in the model tested the hypothesis that stressful climate would moderate a relationship between provider adaptability and organizational commitment. This analysis revealed a significant positive relationship between provider adaptability and organizational commitment (B=.36, p<.01). However, this effect should be viewed within the context of the significant interaction effect between adaptability and stressful climate (B=–.17, p<.05). Compared with those lower in adaptability, providers with higher levels of adaptability reported reduced organizational commitment when organizational stress was high and increased organizational commitment when organizational stress was low. To examine this interaction graphically, we used a median split on the organizational stress variable, categorizing providers into high (top 50%) and low (bottom 50%) levels of organizational stress. Figure 1 displays the relationship between provider adaptability and the HLM predicted values for organizational commitment by high and low stress.

FIGURE 1.

FIGURE 1. Relationship between provider adaptability and organizational commitment, with level of stress as moderatora

aCommitment and adaptability were averaged on scales ranging from 0 to 4, with higher values indicating greater commitment or higher adaptability.

Discussion

Although significant relationships with organizational commitment were found between provider adaptability and stressful organizational climate in HLM models with and without the interaction term, respectively, the relationship among the variables is best explained by the significant interaction effect rather than main effects. Examining the moderating role of organizational stress revealed that although adaptability was associated with higher organizational commitment at lower levels of organizational stress, it was associated with lower organizational commitment at higher levels of organizational stress. It may be that providers high in adaptability do well at adapting to their work environment when it is more functional, enhancing commitment; however, in line with the work of Fugate and colleagues (29), flexibility and openness to change may allow providers to exercise more discretion regarding employment options when they perceive their work environment as stressful. Alternatively, providers lower in adaptability may be more likely to avoid change, even within the context of a stressful organizational climate. Such findings suggest that organizations characterized by role overload, role conflict, and emotional exhaustion may be in danger of losing providers who are more adaptable.

Implications for Practice

We argue that efforts should be made to retain adaptable providers, in that adaptability is associated with positive worker attributes, such as occupational preparedness, job satisfaction, and organizational performance (23,37). The loss of such individuals is detrimental to community mental health agencies because they are more likely to be open to evidence-based practice implementation (38), they have higher work-team performance and productivity (39), and their loss raises mental health care costs for agencies and consumers (40). Given the moderation effect of stressful climates on the relationship between provider adaptability and organizational commitment, mental health programs should assess and understand their organizational climate and intervene when necessary to reduce stressful climates.

Competing work demands in community mental health service systems often come in the form of increased clerical and administrative duties and productivity demands (41,42). These factors may lead to more stressful climates and may be untenable for providers whose primary training lies in the provision of direct mental health services. Organizational interventions can be implemented to assist providers in using structured methods to streamline record keeping and reporting of data.

Although organizational stress-reduction interventions are understudied compared with individual stress-reduction techniques (43,44), possible strategies that organizations can use to reduce stressful organizational climates include redesigning tasks, redesigning the work environment, establishing flexible work schedules, encouraging participative management, including the employee in career development, analyzing work roles and establishing goals, providing social support and feedback, building cohesive teams, establishing fair employment polies, and sharing the rewards (45). These strategies are often an incentive for organizations to build a more employee-empowered culture (43). A more specific example is the ARC (availability, responsiveness, continuity) organizational intervention (46). The ARC organizational intervention has been shown to improve the organizational climate of human service organizations, resulting in improved staff retention and client outcomes and facilitation of the outcomes of evidence-based practice implementation (4,47).

Limitations

Some limitations of this study should be noted. First, only cross-sectional data were collected; therefore, causality cannot be inferred. Second, all variables were based on respondent self-reports, and therefore common method variance may have influenced the results presented here. However, we attempted to minimize this potential bias by using one of Podsakoff and colleagues’ (48) approaches for increasing procedural control and promoting accurate and unbiased responses, “protecting respondent anonymity and reducing evaluation apprehension.” Surveys were administered in groups without the presence of supervisors, respondents were assured that they would be identified only by a researcher-generated number, and research staff reinforced the importance of honest responding and asking questions. Future research using more objective measures, such as organizational turnover rates, and corroborative methods should be used to confirm results obtained on the basis of self-report data (49,50). Finally, this study took place in one county mental health system, and results may not generalize to other geographic areas or service sectors. However, these results may inform studies in other sectors and service systems, given that workforce issues are often common across service sectors and types.

Conclusions

Service systems are becoming increasingly demanding for mental health service providers. For example, the Affordable Care Act has increased the impetus for integration of mental health, substance abuse treatment, and general medical services. Major initiatives have emerged to increase the implementation and sustainment of evidence-based practices in mental health systems and organizations. Such demands and efforts are fraught with complexity, and it is clear that approaches for decreasing work stress and facilitating the delivery of high-quality mental health services are needed. Organizations can work strategically to develop supportive organizational climates that reduce stressfulness and increase functionality. Such a course of action is needed to reduce emotional exhaustion, role conflicts, and role overload and to retain adaptive providers in the workplace so that they may provide high-quality care and continuity in the delivery of mental health services.

Dr. Green and Dr. Aarons are with the Department of Psychiatry, University of California, San Diego, and the Child and Adolescent Services Research Center, San Diego. Mr. Dishop is with the Department of Psychology, University of San Diego, San Diego. Send correspondence to Dr. Aarons (e-mail: ).

The authors report no financial relationships with commercial interests.

This research was supported by National Institute of Mental Health grants R01MH072961 and K01MH001695 (Dr. Aarons, principal investigator). The authors thank the organizations, supervisors, and service providers who participated in the study and made this work possible.

References

1 Willging CE, Waitzkin H, Lamphere L: Transforming administrative and clinical practice in a public behavioral health system: an ethnographic assessment of the context of change. Journal of Health Care for the Poor and Underserved 20:866–883, 2009Crossref, MedlineGoogle Scholar

2 Aarons GA, Fettes DL, Flores LE Jr, et al.: Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behaviour Research and Therapy 47:954–960, 2009Crossref, MedlineGoogle Scholar

3 Aarons GA, Sawitzky AC: Organizational climate partially mediates the effect of culture on work attitudes and staff turnover in mental health services. Administration and Policy in Mental Health and Mental Health Services Research 33:289–301, 2006Crossref, MedlineGoogle Scholar

4 Glisson C, Green P: Organizational climate, services, and outcomes in child welfare systems. Child Abuse and Neglect 35:582–591, 2011Crossref, MedlineGoogle Scholar

5 Lambert EG, Hogan NL, Paoline EA, et al.: The impact of role stressors on job stress, job satisfaction, and organizational commitment among private prison staff. Security Journal 18:33–50, 2005CrossrefGoogle Scholar

6 Welsch HP, LaVan H: Inter-relationships between organizational commitment and job characteristics, job satisfaction, professional behavior, and organizational climate. Human Relations 34:1079–1089, 1981CrossrefGoogle Scholar

7 Parker C, Baltes B, Young S, et al.: Relationships between psychological climate perceptions and work outcomes: a meta-analytic review. Journal of Organizational Behavior 24:389–416, 2003CrossrefGoogle Scholar

8 Jamal M: Relationship of job stress and Type-A behavior to employees’ job satisfaction, organizational commitment, psychosomatic health problems, and turnover motivation. Human Relations 43:727–738, 1990CrossrefGoogle Scholar

9 Mathieu JE, Zajac DM: A review and meta-analysis of the antecedents, correlates, and consequences of organizational commitment. Psychological Bulletin 108:171–194, 1990CrossrefGoogle Scholar

10 Fried Y, Shirom A, Gilboa S, et al.: The mediating effects of job satisfaction and propensity to leave on role stress–job performance relationships: combining meta-analysis and structural equation modeling. International Journal of Stress Management 15:305–328, 2008CrossrefGoogle Scholar

11 Glisson C, Landsverk J, Schoenwald S, et al.: Assessing the organizational social context (OSC) of mental health services: implications for research and practice. Administration and Policy in Mental Health and Mental Health Services Research 35:98–113, 2008Crossref, MedlineGoogle Scholar

12 Meyer JP, Stanley DJ, Herscovitch L, et al.: Affective, continuance, and normative commitment to the organization: a meta-analysis of antecedents, correlates, and consequences. Journal of Vocational Behavior 61:20–52, 2002CrossrefGoogle Scholar

13 Riketta M: Attitudinal organizational commitment and job performance: a meta‐analysis. Journal of Organizational Behavior 23:257–266, 2002CrossrefGoogle Scholar

14 Steers RM: Antecedents and outcomes of organizational commitment. Administrative Science Quarterly 22:46–56, 1977Crossref, MedlineGoogle Scholar

15 Lambert EG, Griffin ML, Hogan NL, et al.: The ties that bind organizational commitment and its effect on correctional orientation, absenteeism, and turnover intent. Prison Journal 95:135–156, 2015CrossrefGoogle Scholar

16 Meyer J, Allen N: Commitment in the Workplace: Theory, Research, and Application. Newbury Park, NJ, Sage, 1997Google Scholar

17 Lambert E, Hogan N: The importance of job satisfaction and organizational commitment in shaping turnover intent a test of a causal model. Criminal Justice Review 34:96–118, 2009CrossrefGoogle Scholar

18 Zhou Y, Lu J, Liu X, et al.: Effects of core self-evaluations on the job burnout of nurses: the mediator of organizational commitment. PLoS One 9:e95975, 2014Crossref, MedlineGoogle Scholar

19 Aarons GA: Measuring provider attitudes toward evidence-based practice: consideration of organizational context and individual differences. Child and Adolescent Psychiatric Clinics of North America 14:255–271, viii, 2005Crossref, MedlineGoogle Scholar

20 Jayan C: Emotional competence, personality and job attitudes as predictors of job performance. Journal of the Indian Academy of Applied Psychology 32:135–144, 2006Google Scholar

21 Edwards D, Burnard P, Coyle D, et al.: Stress and burnout in community mental health nursing: a review of the literature. Journal of Psychiatric and Mental Health Nursing 7:7–14, 2000Crossref, MedlineGoogle Scholar

22 Baard SK, Rench TA, Kozlowski SW: Performance adaptation: a theoretical integration and review. Journal of Management 40:48–99, 2014CrossrefGoogle Scholar

23 Raelin JA: An examination of deviant/adaptive behaviors in the organizational careers of professionals. Academy of Management Review 9:413–427, 1984CrossrefGoogle Scholar

24 Bond FW, Flaxman PE, Bunce D: The influence of psychological flexibility on work redesign: mediated moderation of a work reorganization intervention. Journal of Applied Psychology 93:645–654, 2008Crossref, MedlineGoogle Scholar

25 Wang M, Zhan Y, McCune E, et al.: Understanding newcomers’ adaptability and work-related outcomes: testing the mediation roles of perceived P-E fit variables. Personnel Psychology 64:163–189, 2011CrossrefGoogle Scholar

26 Parent JD, Levitt K: Manager versus employee perceptions of adaptability and performance. Business Renaissance Quarterly 4:23–48, 2010Google Scholar

27 Van Sell M, Brief AP, Schuler RS: Role conflict and role ambiguity: integration of the literature and directions for future research. Human Relations 34:43–71, 1981CrossrefGoogle Scholar

28 Ashforth BE, Fugate M: Role transitions and the life span; in Role Transitions in Organizational Life: An Identity-Based Perspective. Mahwah, NJ, Erlbaum, 2001Google Scholar

29 Fugate M, Kinicki AJ, Ashforth BE: Employability: a psycho-social construct, its dimensions, and applications. Journal of Vocational Behavior 65:14–38, 2004CrossrefGoogle Scholar

30 Aarons GA: Mental health provider attitudes toward adoption of evidence-based practice: the Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research 6:61–74, 2004Crossref, MedlineGoogle Scholar

31 Boyatzis RE, Sala FG: The Emotional Competence Inventory ECI; in Measuring Emotional Intelligence: Common Ground and Controversy. Edited by Geher G. Hauppauge, NY, Nova Science, 2004Google Scholar

32 Brown RD, Hauenstein NM: Interrater agreement reconsidered: an alternative to the rwg indices. Organizational Research Methods 8:165–184, 2005CrossrefGoogle Scholar

33 Hedeker D, Gibbons RD, Davis JM: Random regression models for multicenter clinical trials data. Psychopharmacology Bulletin 27:73–77, 1991MedlineGoogle Scholar

34 Raudenbush SW, Bryk AS: Hierarchical Linear Models: Applications and Data Analysis Methods. Atlanta, Sage, 2002Google Scholar

35 Snijders T, Bosker R: Multilevel Modeling: An Introduction to Basic and Advanced Multilevel Modeling. Newbury Park, NJ, Sage, 1999Google Scholar

36 Hedeker D, Gibbons RD: MIXOR: a computer program for mixed-effects ordinal regression analysis. Computer Methods and Programs in Biomedicine 49:157–176, 1996Crossref, MedlineGoogle Scholar

37 Pulakos ED, Arad S, Donovan MA, et al.: Adaptability in the workplace: development of a taxonomy of adaptive performance. Journal of Applied Psychology 85:612–624, 2000Crossref, MedlineGoogle Scholar

38 Bonham CA, Sommerfeld D, Willging C, et al.: Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies Psychiatry Journal, 2014. doi 10.1155/2014/802983CrossrefGoogle Scholar

39 Argote L, Insko CA, Yovetich N, et al.: Group learning curves: the effects of turnover and task complexity on group performance. Journal of Applied Social Psychology 25:512–529, 1995CrossrefGoogle Scholar

40 Albizu-García CE, Ríos R, Juarbe D, et al.: Provider turnover in public sector managed mental health care. Journal of Behavioral Health Services and Research 31:255–265, 2004Crossref, MedlineGoogle Scholar

41 Buck JA: Medicaid, health care financing trends, and the future of state-based public mental health services. Psychiatric Services 54:969–975, 2003LinkGoogle Scholar

42 Stroul BA, Pires SA, Armstrong MI, et al.: The impact of managed care on mental health services for children and their families. Future of Children 8:119–133, 1998Crossref, MedlineGoogle Scholar

43 Cooper CL, Cartwright S: Stress-management interventions in the workplace: stress counselling and stress audits. British Journal of Guidance and Counselling 22:65–73, 1994CrossrefGoogle Scholar

44 Cooper CL, Cartwright S: Healthy mind; healthy organization: a proactive approach to occupational stress. Human Relations 47:455–471, 1994CrossrefGoogle Scholar

45 Elkin A, Rosch P: Promoting mental health at work. Occupational Medicine State of the Art Review 5:739–754, 1990MedlineGoogle Scholar

46 Glisson C, Schoenwald SK: The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research 7:243–259, 2005Crossref, MedlineGoogle Scholar

47 Glisson C, Hemmelgarn A, Green P, et al.: Randomized trial of the Availability, Responsiveness, and Continuity (ARC) organizational intervention with community-based mental health programs and clinicians serving youth. Journal of the American Academy of Child and Adolescent Psychiatry 51:780–787, 2012Crossref, MedlineGoogle Scholar

48 Podsakoff PM, MacKenzie SB, Lee J-Y, et al.: Common method biases in behavioral research: a critical review of the literature and recommended remedies. Journal of Applied Psychology 88:879–903, 2003Crossref, MedlineGoogle Scholar

49 Podsakoff PM, Organ DW: Self-reports in organizational research: problems and prospects. Journal of Management 12:531–544, 1986CrossrefGoogle Scholar

50 Spector PE: Method variance in organizational research truth or urban legend? Organizational Research Methods 9:221–232, 2006CrossrefGoogle Scholar