The purpose of this study was to examine rates of use of supports offered to persons with schizophrenia in these two treatments. Given the fact that supports in cognitive adaptation training are individually tailored and set up in the home environment, and their use is reinforced on weekly home visits, we hypothesized that patients in the cognitive adaptation training group would use a greater proportion of the environmental supports than those in the generic environmental supports group.
The study sample comprised 64 participants in an ongoing study, funded by the National Institute of Mental Health, of the use of environmental supports. The sample was recruited from February 2002 to September 2003. Outpatients with schizophrenia or schizoaffective disorder who were receiving medication and routine follow-up care at community clinics were approached about participating in this study at the time of their clinic visit and were asked to sign an informed consent document approved by the university's institutional review board. Participants met the following inclusion criteria: diagnosis of schizophrenia or schizoaffective disorder according to the Structured Clinical Interview for DSM-IV (
+15), age between 18 and 60 years, receipt of a second-generation antipsychotic medication other than clozapine, an absence of hospitalizations in the past three months, ability to provide evidence of a stable living environment for the past three months, and no current plans to move out of the area within the next two years. Individuals were excluded if substance abuse would have interfered with their study participation (for example, with assessment or treatment); if they had a documented history of significant head trauma, seizure disorder, neurologic disorder, or mental retardation; if they were currently being seen by an assertive community treatment team; or if they had engaged in violent behavior in the previous year.
After a baseline assessment, participants who were monitored by community clinics for standard medication management were randomly assigned to one of three additional treatments: cognitive adaptation training, generic environmental supports, or assessment only. Among the first 68 participants who were assigned to either cognitive adaptation training (N=34) or generic environmental supports (N=34), three-month data were available for 29 and 31 patients, respectively. Three patients in the cognitive adaptation training group dropped out of the study, one withdrew after signing the informed consent form, one could not be contacted after completing initial assessments, and one moved out of the area. Of the remaining 31 patients, two could not be contacted by the utilization researcher during the first three months after repeated attempts, leaving 29 for whom utilization data were available in the cognitive adaptation training group. One patient who was receiving generic environmental supports withdrew consent to participate, and two patients could not be contacted by the utilization researcher after repeated attempts, leaving 31 patients for whom utilization data were available in the generic environmental supports group.
Baseline assessments included the Expanded Version of the Brief Psychiatric Rating Scale (
+16), the Negative Symptom Assessment (
+17), and the Social and Occupational Functioning Scale (
+15).
Cognitive adaptation training. Cognitive adaptation training is a manual-driven series of compensatory strategies based on neuropsychological, behavioral, and occupational therapy principals (
+11). Before participating in cognitive adaptation training, patients receive comprehensive behavioral, neuropsychological, functional, and environmental assessments. These assessment procedures are described in detail elsewhere (
+11). Treatment plans are based on two dimensions: level of apathy (poor initiation) versus disinhibition (distracted by irrelevant cues and information in the environment) and level of impairment in executive functions (the ability to plan and carry out goal-directed activities). Behaviors characterized by apathy can be altered by providing prompting and cueing to initiate each step in a sequenced task. For example, therapists may provide checklists for tasks that involve complex behavioral sequencing or place signs and equipment for daily activities directly in front of the patient, such as a checklist for medication placed on the refrigerator. Individuals who exhibit disinhibited behaviors respond well to the removal of distracting stimuli and behavioral triggers and to redirection. For example, a therapist may help to discourage taking of multiple doses of medication at the same time by placing pills in single-dose containers, or remove outdated medications to be stored elsewhere. Individuals with mixed behavior (apathy and disinhibition) are offered a combination of these strategies.
Individuals with greater degrees of executive impairment are provided with a greater level of structure and assistance and more obvious environmental cues (larger and more proximally placed). Individuals who have less impairment in executive functioning can perform instrumental skills adequately with less structure and more subtle cues. These general plans are adapted for individual strengths or limitations in other cognitive areas. Interventions are explained, maintained, and altered as necessary during brief (30-minute) weekly visits from a cognitive adaptation trainer. Detailed progress notes list all supports provided and their intended target behaviors.
Generic environmental supports. Generic environmental supports is a manual-driven series of environmental supports offered to patients at their regular clinic visit. The generic package is composed of the supports that were frequently used and described as helpful by clients in the cognitive adaptation training program on the basis of progress notes and store receipts. Supports selected for the generic package required minimal training and were designed to address three primary problems: medication adherence, orientation and scheduling, and grooming and hygiene. Supports included an alarm clock, a watch, bus passes, a checklist of everyday activities such as taking medication and showering, hygiene products such as shampoo and toothpaste, pill containers, and reminder signs—for example, "Did I take my medication?" or "Did I remember to brush my teeth?" A bookstore gift card is given to participants in an effort to promote leisure activity, and one of the items on the checklist is intended to prompt social behavior. However, these areas of functioning are not well addressed by generic environmental supports.
Therapists offered the same supports to all participants and provided instructions on how to use each item. The therapist discussed with the client where to place signs to get maximum benefit and how to use watches, alarms, and pill containers. The session was audiotaped, and the client was given both the tape and the tape recorder to replay the instructions any time. Once a month, the therapist called the client to ask whether the client needed any replacement supplies. If supplies were needed, the client picked them up from the clinic. For some patients, for the purposes of the study, supports were delivered to the client's home.
Utilization. Each month, a utilization researcher telephoned each client. The utilization reviewer used treatment notes and store receipts to determine all supports provided during the preceding one-month period for patients in cognitive adaptation training. From the therapist notes, the utilization researcher determined the intended function of each support offered. For patients who were receiving generic environmental supports, the utilization researcher used the original item list for the package and the therapist's notes regarding which items were supplied in the previous month. The researcher asked the participant whether he or she had used each support over the past seven days and exactly how the support was used. In an effort to prevent the participant from trying to make his or her therapist "look good," the participant was told at the beginning of each call that the information provided would not be shared with the cognitive adaptation training therapist or the generic environmental supports therapist.
On the basis of the information provided, the utilization researcher calculated a percentage use based on the intended use of the support. For example, if an item was intended to be used daily and it was used four out of seven days, the percentage use would be 57 percent. A mean percentage use for each contact was generated by averaging the percentages for each item, and then the contacts for the three-month period were averaged. Supports provided were also placed into categories, and a mean utilization percentage by category was calculated. Categories common to both treatments included medication adherence, orientation and scheduling, and grooming and hygiene. Categories were not mutually exclusive, and the same support could have been counted in more than one category. For example, a calendar may have been used to keep track of medication appointments as well as to keep oriented to day and date.
The three primary behavioral targets addressed in generic environmental supports—medication adherence, orientation and scheduling, and grooming and hygiene—were examined in both treatment groups. Differences in percentage use between the cognitive adaptation training group and the generic environmental supports group at three months were compared by using t tests for overall use of supports as well as for specific categories. To correct for multiple comparisons, we set the significance level conservatively at .01. Data were also examined by using nonparametric statistics, because the distributions of the individual categories of supports were not always normal. Because nearly identical results were obtained with both approaches, we report the results of the t tests below.
We used the intraclass correlation coefficient to examine whether the individual categories of supports could be combined into a meaningful composite score for overall percentage use.
+
Descriptive and baseline data
Demographic characteristics of the two treatment groups are listed in
+Table 3. No statistically significant baseline differences were observed between groups in terms of age, gender, or ethnicity. Furthermore, clinical variables, such as level of psychotic symptoms, negative symptoms, and social and occupational functioning, did not differ significantly between groups at baseline. Baseline characteristics of participants for whom utilization data were available and those for whom data were not available did not differ significantly.
Mean utilization rates for overall supports and by categories are shown in
+Figure 1. Participants who received cognitive adaptation training had a higher mean percentage use of supports than those who received generic environmental supports. The differences between groups were statistically significant for overall supports (t=5.75, df=58, p<.001) and for each category (orientation and scheduling, t=4.78, df=56, p<.001;medication adherence, t=5.43, df=56, p<.001;and grooming and hygiene, t=3.23, df=46, p<.001). Degrees of freedom differ for specific utilization categories because cognitive adaptation training is customized for the individual, so not all participants in that group received all types of supports.
The intraclass correlation coefficient for the categories was .87, which suggests that the categories of support could be meaningfully combined into a composite score reflecting overall use. We classified participants as high or low utilizers on this overall utilization composite score on the basis of a cutoff of 75 percent. This is a commonly used cutoff in the medication adherence literature for schizophrenia, reflecting the idea that in a negotiated treatment, a person who is taking between 70 percent and 80 percent of the recommended dosage has good adherence to the treatment (
+18,
+19).
We found that more than 66 percent of patients in the cognitive adaptation training group (19 of 29) were high utilizers, compared with less than 13 percent of patients in the generic environmental supports group (four of 31) (Fisher's exact test, p<.001). Thus only a small percentage of patients in the generic supports group actually received a recommended "dose" of the treatment.
Utilization problems in the generic environmental supports group appeared to have several origins. Some clients forgot to use the kit provided. Others did not like the brands or styles of products provided. Moreover, very limited social reinforcement was provided for the use of items. Clients undergoing cognitive adaptation training receive regular praise and other social reinforcement during weekly in-home visits.
Several methodologic limitations should be kept in mind. By necessity, the utilization researchers were aware of participants' treatment group assignment when asking about the use of supports provided. It is possible that participants exaggerated their use in an effort to make their therapist look good. However, store receipts for replacement of environmental supports and progress notes kept by therapists are consistent with the notion that use of supports was high among patients who received cognitive adaptation training. Generic environmental supports target primarily basic activities of daily living. An analysis of utilization or supports for higher-level behaviors for patients receiving cognitive adaptation training will be conducted once the study has been completed. It is also possible that supports may be used less frequently over the course of cognitive adaptation training treatment. This possibility will be investigated in follow-up studies.
High utilization levels in cognitive adaptation training suggest that the use of supports may be the key to the improvements in adaptive functioning that have been observed in previous studies. Future studies will need to examine this process-outcome relationship specifically. Generic supports provided in a clinic setting may improve behavior if the supports are used. Unfortunately, supports are unlikely to be used if they are not individualized, set up, trained, and maintained in the patient's home environment. It is unclear whether the higher rate of use in the cognitive adaptation training group was due to the individualization of supports; the training in the use of the supports in the home environment; the weekly visits that prompt, reinforce, and check the use of supports; or a combination of these procedures.
Future research is needed to tease out each of these factors. It is conceivable that weekly telephone calls in the generic environmental supports group may be enough to stimulate use by providing the social reinforcement and prompting necessary to form habits around the use of supports. In addition, offering a limited range of choice of item brand may prompt higher use. Additional research will be necessary to test these hypotheses.
Although previous studies have suggested that patients participating in cognitive adaptation training improved in terms of adaptive functioning more than those in the control conditions, ours is the first study to formally examine the degree of use of specific supports. Even though findings lend credence to the continued study of supportive environments for persons with schizophrenia, process-outcome relationships between the use of supports and adaptive functioning need to be specifically examined.
This study was funded by grant R01-MH-61775-04 from the National Institute of Mental Health. During manuscript preparation, Dr. Velligan was supported in part by grant R01-MH62850-08 from the National Institute of Mental Health.