The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.201800122

Abstract

Objective:

To assess missed opportunities for reducing fatal opioid overdoses, characteristics of decedents by opioid overdose with and without problematic opioid use who received health care services within one year of death were examined.

Methods:

Of 157 decedents in the Worcester, Massachusetts, area between 2008 and 2012, 112 had contact with the health care system. Electronic medical records were reviewed for clinical characteristics, health service use, universal precautions, and substance use disorder management. Problematic opioid use was defined as individuals having documented opioid use disorders or aberrant drug-related behavior. Data were analyzed with chi-square tests with adjusted residual for categorical variables and t tests for continuous variables.

Results:

Decedents were predominantly Caucasian males with a mean±SD age of 41.0±11.7. Problematic opioid use by definition meant users (N=53) had opioid use disorder as a principal diagnosis and were likely to have a comorbid substance use disorder. Decedents with nonproblematic opioid use had diagnoses of chronic pain and mental illness. They were more likely to have been seen last in surgical and subspecialty settings (29% versus 11%). The proportion with an opioid prescription was higher among those with problematic use (72% versus 37%) who also had a higher total daily morphine equivalent, compared with those with nonproblematic use (165.4±282.7 versus 55.6±117.7 mg per day).

Conclusions:

Persons with problematic opioid use are a recognizable group with a high risk of death by opioid overdose whose therapeutic management needs improvement to reduce fatal outcomes. Different strategies must be developed for identifying and treating nonproblematic opioid use to reduce risk of death.

Opioid use disorder is a global public health problem with an alarming rate of morbidity and mortality, and the disorder has claimed the lives of more than 500,000 Americans since 2000 (1, 2). During this time, the number of opioid prescriptions and subsequent deaths in the United States has quadrupled, and the overall death rate from opioid-related overdoses has tripled (2). National attention to opioid use disorders has increased, with an expansion of overdose prevention initiatives. However, opioid-related overdoses were still responsible for 91 American deaths per day and accounted for 63% of all drug overdose deaths in 2015 (3).

The contribution of health care systems to lessen the impact of this opioid overdose epidemic may be improved by increasing the effectiveness of identification of high-risk cases, providing better interventions, and obtaining feedback from outcomes. However, in medical centers the quality review processes to examine fatal outcomes such as opioid overdose are constrained to incidents in the hospital or to individuals who die in the community and of whom the provider is aware. This constraint excludes review of cases of individuals who drop out of treatment or are unknown to the medical team. Surveying these cases for clinical characteristics, provider practices, the presence of screening procedures, and service use prior to the overdose could help increase knowledge of specific characteristics during clinical management and identify missed opportunities.

Assessment of the timing and type of outpatient providers who had contact with the person prior to fatal prescription opioid overdoses may help identify services with a missed opportunity to intervene. A study with veterans (N=1,813) showed that 62% were seen within the month prior to their death, and 30% had been seen in an ambulatory mental health or substance treatment program (4). Another large study of opioid-related decedents (N=13,089) in the Medicaid program showed that those with chronic pain were more likely than a group without pain to have a prescription for opioid analgesics and benzodiazepines during the last 30 days of life (5). However, although these studies used diagnoses and procedure codes to identify patterns of service use and associations of diagnoses with fatal opioid overdoses in large samples, these types of studies do not manually abstract electronic medical record (EMR)–based charts to obtain relevant details of interactions with providers and treatment services prior to death.

Thus this retrospective study evaluated EMRs and identified all opioid-related deaths that occurred in Worcester between 2008 and 2012 and in which the decedent had any encounter with the UMass Memorial Medical Center (UMMC) system in the year prior to death. UMMC is the largest provider in the metropolitan area of Worcester and a teaching center that has two level-3 hospitals and emergency departments covering 80% of occurrences; it has a full range of medical specialties, and over 70% of persons in the population have their primary care provider in this system. It was expected that most decedents had received most of their care in this health care system.

The overall objective of the study was to identify the demographic and clinical characteristics of decedents from opioid overdose and their clinical management and to describe the health care services received at the UMMC. We were particularly interested in decedents who were identified as having opioid use disorder or who had aberrant drug-related behaviors (6) with chronic pain. Considering that these two groups are highly visible and easier to identify and considered at-risk groups by most providers, we considered them together as having problematic opioid and compared them with opioid overdose decedents who had not had problematic use. This study aimed to characterize the overall population of decedents from opioid overdose who received services at UMMC and to compare decedents with and without problematic opioid use to asses all potential missed opportunities to reduce risk factors for fatal opioid overdose.

Methods

Participants

Eligible cases were Worcester residents (7) deceased by opioid overdose between 2008 and 2012 within the Worcester metropolitan area (population 513,000 in the 2010 census) who received medical services at UMMC during the year prior to their death. All cases in which the confirmed cause of death was opioid overdose were obtained from the Registry of Vital Records and Statistics at Massachusetts Department of Public Health. The following ICD-10 external cause of injury codes were used: X40–X49, X60–X69, X85–X90, Y10–Y19, Y35.2, or *U01 (Unintentional=V01–X59, Y85–Y86) + (Suicide=X60–X84, Y87.0, *U03) + (Undetermined=Y10–Y34, Y87.2, Y89.9). In addition, the following codes were used: T40.2–T40.4 (any opioid analgesic), T40.0 (opium), T40.1 (heroin), T40.2 (other opioid), T40.3 (methadone), T40.4 (other synthetic narcotic), and T40.6 (other and unspecified narcotics). Of the total of 157 decedent cases obtained, 112 (71%) were selected on the basis of any encounter with the emergency department, inpatient admission, or outpatient clinic in the 12 months prior to the date of death as confirmed with UMMC EMR data. This study was approved by the University of Massachusetts Institutional Review Board.

Study Design

This retrospective study reviewed UMMC system EMRs for 112 decedents during the 12 months prior to death by using a data abstraction form developed by the investigators. [A copy of this form is included in an online supplement to this article.] Two chart reviewers (senior medical students [CR and AS]) trained by the study principal investigator (GG), manually abstracted EMR-based charts for all decedents. The first five charts were reviewed by the principal investigator together with the chart reviewers by using the form to ensure accurate and consistent abstraction. Discrepancies after double data entry were resolved by consensus with the PI to create the final data set for analysis.

Data Collection

Demographic characteristics and diagnoses.

Individual characteristics included gender, age, and evidence of insurance coverage. The principal diagnoses for opioid use disorder, chronic pain syndromes with and without aberrant opioid use behaviors, substance use disorders, and psychiatric disorders were determined by clinical judgment, with either evidence of active treatment or evidence of repeated treatment for the same problem or diagnosis at a recent hospital discharge as assessed from free text in medical notes. Problematic opioid use was indicated for persons with a principal diagnosis of opioid use disorder or aberrant drug-related behavior during the 12 months prior to death. Aberrant drug-related behavior included documentation of any concern related to patterns of early refills, multiple calls or visits to request more opioids, lost or stolen prescriptions, use of the emergency department to obtain prescriptions, disruptive behavior associated with opioid treatment, and misuse of opioids (6).

Overdose risk assessment.

The following factors were included in the risk assessment: documented episodes of suicidal ideation, suicide attempts, and opioid overdoses within one year prior to death; number of lifetime episodes of opioid overdose; and prescriptions of opioid analgesics (with total daily morphine equivalents) or benzodiazepines (with total daily dosage).

Universal precautions.

Documented evidence was recorded of screening for substance use disorders, including smoking status; urine toxicology performed; evidence of opioid treatment agreements; patient education regarding risks of opioid treatment; and “high-risk behavior” chart alerts (8).

Medical services received.

Primary and last treating services prior to death for outpatient, inpatient, surgical, emergency department, pain clinics, and psychiatry were recorded.

Substance use management.

Documented use was recorded of treatment resources, such as the consultation-liaison psychiatry service or overdose counseling program; referrals for substance use disorder treatment or self-help group; participation in substance use disorder or medication-assisted treatment for opioid use disorder; and section 35 (Massachusetts court-mandated drug treatment).

Statistical Analyses

Analyses were conducted with the group variable problematic opioid use versus nonproblematic opioid use. Categorical variables were evaluated by chi-square tests with adjusted residual (Z>2.0 for significance, for post hoc comparisons [9]), and continuous variables were evaluated with Student’s t tests. Between-group comparisons of principal medical diagnoses were not performed. All analyses were two-tailed, with statistical significance set at ≤.05. Analyses were performed with IBM SPSS, version 24.

Results

Demographic Characteristics

Overall, most of the 112 decedents were males (64%) and Caucasian (96%). Their mean age was 41. Four decedents had documentation of an intentional overdose (Table 1). The 112 decedents were categorized as having problematic opioid use (N=53, 47%) or nonproblematic opioid use (N=59, 53%). Deaths were not significantly more likely to occur in the community (N=61, 55%) than in the hospital setting (N=47, 42%).

TABLE 1. Characteristics of decedents by opioid overdose, by category of opioid use

Total(N=112)Problematicuse (N=53)Nonproblematicuse (N=59)
CharacteristicN%N%N%Test statisticdfp
Age (M±SD)41.0±11.740.3±12.541.6±11.0t=.34110.55
Genderχ2=.001.98
 Female403619362136
 Male726434643864
Race-ethnicityχ2=5.453.14
 Caucasian1079649925898
 African American11120
 Hispanic33360
 Unknown11012
Marital statusχ2=2.263.52
 Married242110191424
 Divorced1715917814
 Single645729553559
 Other765923
Intentional opioid overdosea443612χ2=1.32.51
Insurance coverage1079651965695χ2=.111.73
Diagnosis
 Principal diagnosisb
  Chronic pain, noncancer464114263254
  Opioid use disorder (dependence)191719360
  Substance use disorder2018183423
  Mental illness1614241424
  Cancer22023
  Other980915
 Any substance use disorder746642793254χ2=7.781.005
  Alcohol363223431322χ2=5.841.01
  Benzodiazepine1312122312χ2=11.941<.001
  Cocaine2220173259χ2=9.851<.001
  Tobacco585134642441χ2=6.161.01
  Marijuana17151019712χ2=1.061.30
 Any chronic pain syndrome706234643661χ2=.111.73
 Any mental illness726439743356χ2=3.781.05
  Depression534729552440χ2=2.201.13
  Anxiety363219361729χ2=.631.42
  Bipolar disorder141391758χ2=1.841.17
  PTSD554812χ2=2.241.13
  Psychotic disorder760712χ2=6.701.009
  Personality disorder22240χ2=2.261.13
Overdose risk factor
 Opioid prescription in last year605738722237χ2=13.291<.001
 Benzodiazepine prescription in last year464123432339χ2=.221.63
 History of opioid overdoses1
  Opioid overdoses last year2220193635χ2=16.71<.001
  Opioid overdoses lifetime3229285347χ2=29.01<.001
 History of suicidality
  Suicidal ideation last year17151121610χ2=2.41.1
  Suicide attempts last year764835χ2=.281.5
 Total daily morphine equivalent (M±SD mg per day)105.2±214.9165.4±282.755.6±117.7t=2.64100.01
  Morphine (M±SD mg per day)111.0±65.0116.2±73.890.0±0t=.103.77
  Oxycodone (M±SD mg per day)87.7±82.186.3±92.089.3±72.5t=.0130.92
  Hydrocodone (M±SD mg per day)27.7±20.228.5±24.926.2±11.0t=.039.86
  Methadone (M±SD mg per day)50.8±34.349.7±36.560.0±0t=.077.79
 Total daily benzodiazepine (M±SD mg per day)2.8±8.91.8±3.43.7±11.9t=1.23105.26
Universal precautions
 Screening for substance use disorders807147893356χ2=14.61<.001
 Urine drug screen performed454031591424χ2=14.41<.001
 Signed treatment agreement985947χ2=.261.60
 Patient education about opioid prescription272417321017χ2=3.491.06
 High-risk behavior chart alert654823χ2=.951.32
Health service use
 Primary treating serviceχ2=4.405.49
  Emergency department403622421831
  Medical inpatient443612
  Pain clinic221212
  Primary care211910191119
  Psychiatry874847
  Surgical or subspecialty setting373313252441
 Last treating serviceχ2=9.615.047
  Emergency department554929552644
  Medical inpatient8761123
  Pain clinic000
  Primary care1513591017
  Psychiatry111071347
  Surgical or subspecialty setting23216111729
Substance use management
 Consultation-liaison or overdose counselingc1614142623χ2=12.11<.001
 Substance use disorder treatment referral1614122347χ2=6.471.03
 Active substance use disorder treatment1715142635χ2=9.861.001
 Medication-assisted treatment for opioid use disorderχ2=13.53.001
  Buprenorphine656110
  Methadone8771312
 Self-help group referral6551012χ2=3.291.06
 Section 35 treatment referrald11120χ2=1.121.28

aData on intentional opioid overdose were from the Registry of Vital Records and Statistics at Massachusetts Department of Public Health.

bPrincipal diagnosis was determined with clinical judgment by evidence of repeated treatment, evidence of active treatment, or hospitalization discharge diagnosis. Statistical comparisons were not performed.

cOverdose counseling was conducted by a licensed social worker for patients evaluated and admitted for opioid overdose on medical-surgical wards.

dSection 35 treatment referral is Massachusetts court-mandated treatment that can be initiated by physicians.

TABLE 1. Characteristics of decedents by opioid overdose, by category of opioid use

Enlarge table

Clinical Characteristics

Diagnoses.

The distribution of the principal diagnoses for the entire sample was as follows: chronic pain with noncancerous condition (41%), substance use disorder (18%), opioid use disorder (17%), mental illness (14%), cancer (2%), and other (8%) (Table 1). Problematic opioid use by definition meant users had opioid use disorder (36% as a principal diagnosis), and the second most common principal diagnosis in this group was substance use disorder (34%). Nonproblematic opioid use involved the following principal diagnoses: chronic pain (54%), mental illness (24%), and other (15%) (Figure 1). However, when any secondary diagnoses were included, 62% of the entire sample had any chronic pain syndrome, 66% had any substance use disorder, and 64% had any mental illness (Table 1). Also, when all cases with any diagnoses were considered, the proportion with any mental illness was larger among the group with versus without problematic opioid use (74% versus 56%, p<.06) (Table 1).

FIGURE 1.

FIGURE 1. Principal medical diagnoses among persons with problematic (N=53) or nonproblematic (N=59) opioid use

Overdose risk assessment.

Overall, 57% of the decedents had a prescription for an opioid analgesic, and 41% had a benzodiazepine prescription within UMMC. Decedents with problematic opioid use were more likely than those with nonproblematic use to have been prescribed opioids in the last year of life (72% versus 37%, p<.001). Also, the mean total daily morphine equivalent was threefold higher for problematic opioid use than for nonproblematic use (165.4 versus 55.6 mg per day, p=.01).

Among the 112 decedents, 22 (20%) had a documented history of opioid overdoses during their last year, 36% of those with problematic opioid use and 5% of those with nonproblematic use (p<.001). Furthermore, 53% of those with problematic opioid use had a documented lifetime history of opioid overdoses, compared with only 7% of the nonproblematic use group (p<.001).

Universal precautions performed.

Including smoking status, 71% of all decedents were screened for substance use disorders, and 40% had a urine drug screen. Decedents with problematic opioid use were significantly more likely than those with nonproblematic use to have had a substance use disorders screening (89% versus 56%, p<.001) and a urine drug screen (59% versus 24%, p<.001) (Table 1). Few decedents had opioid treatment agreements (8%), documented patient education (24%), or a chart alert for high-risk behavior (5%).

Medical services received.

Overall, the mean±SD number of days between the last medical service received and death was 94±93 for emergency department visits, 100±106 for outpatient visits, and 111±93 for inpatient admissions, with no significant difference between groups. The last treating service consulted differed significantly between the two groups (p<.05). Compared with those with problematic opioid use, those with nonproblematic use were significantly more frequently last seen in the surgical and subspecialty settings (29% versus 11%, Z=2.3) and numerically seen more in a primary care setting (17% versus 9%). Compared with the decedents with nonproblematic use, those with problematic use were seen more frequently in the emergency department (55% versus 44%), as a medical inpatient (11% versus 3%), and in psychiatry (13% versus 7%) (Figure 2).

FIGURE 2.

FIGURE 2. Last treating service of decedents with problematic (N=53) or nonproblematic (N=59) opioid use

Substance use management.

In the study sample, few decedents had documented interaction with consultation-liaison psychiatry or overdose counseling (14%), substance use disorder treatment referrals (14%), active treatment for substance use disorders (15%), medication-assisted treatment for opioid use disorder (buprenorphine, 5%; methadone, 7%), referral to self-help groups (5%), or court-mandated substance use disorder treatment via section 35 (1%). Of those who had documented interactions with consultation-liaison psychiatry services, the proportion was larger among those with versus without problematic opioid use (26% versus 3%, p<.001). Similarly, as expected by group definition, significantly greater proportions of those with problematic opioid use received substance use disorder treatment referrals (23% versus 7%, p<.04), were active in substance use disorder treatment (26% versus 5%, p<.001), and had medication-assisted treatment for opioid use disorder with buprenorphine (11% versus 0%) and methadone (13% versus 2%) (p<.001).

Discussion

This retrospective study of 112 decedents from opioid overdose from 2008 to 2012 in the Worcester metropolitan area who were seen in the year before death at the UMMC identified two distinct groups. Those with problematic opioid use, who we anticipated were a high-risk population (that is, those with a principal diagnosis of opioid use disorder or aberrant drug-related behavior), represented only 47% of the deaths. Persons with nonproblematic opioid use appeared more difficult to recognize or to conveniently categorize by their providers as being at risk of dying from opioid overdose, because they had chronic pain or a mental illness as their principal medical diagnosis, without apparent red flags, and they were less likely to have a high-average-dose opioid prescription or a concurrent benzodiazepine prescription. This potentially silent group represented 53% of the deaths.

Persons with problematic opioid use were an at-risk subgroup because they had a principal diagnosis of opioid use disorder or aberrant drug-related behavior. In addition, this group had a comorbid substance use disorder, a prescription for an opioid analgesic with a high total daily morphine equivalent, and a benzodiazepine prescription and were more likely than those with nonproblematic use to have a documented last-year history of opioid overdose. Although identification of this high-risk group was documented, expected interventions (including universal precautions, referral to substance use disorders treatment and self-help groups, and encouragement to enter medication-assisted treatment) were, unfortunately, scarcely implemented. These cases represent missed opportunities; the individuals had already been identified by their providers as high risk. It is expected that treatment measures will continue to improve. These findings are, in part, contrary to those of a recent large study (N=13,089) of opioid-related decedents in the Medicaid program, which found that only 14.8% of decedents had 12-month diagnoses of any opioid use disorder, and even though 61% had a diagnosis of chronic pain, there was no report of aberrant drug-related behaviors (5).

The occurrence of death among persons with nonproblematic opioid use, as described in this study, is much more perplexing and alarming. Although it is possible that these individuals represent a subgroup of patients who were not well identified by their provider, not well documented in the EMR, or not appropriately screened as having problematic opioid use, their overall profile is highly suggestive of a silent group that needs further consideration and study. Compared with the group with problematic opioid use, this group was more likely to have a principal diagnosis of a mental illness or chronic pain without aberrant drug-related behavior, suggesting that the comorbidity of chronic pain and mental illness may alert providers (Table 1). However, nonproblematic use was less likely than problematic use to entail an opioid prescription and total daily morphine equivalents that were not alarming, suggesting a lower risk of opioid overdose. In addition, although some in this group had a concurrent benzodiazepine prescription that might be suggestive of a potential risky interaction, they were also less likely to have a documented opioid overdose in the year before death. Those with nonproblematic opioid use were more likely than those with problematic use to have been seen last in surgical or subspecialty settings, suggesting less acute problems with opioids. It is possible that this group obtained prescription opioids from other providers or from street suppliers, unknown to their providers. Alternatively, these deaths could have been unrecognized intentional self-inflicted opioid overdoses (10). However, of the 17 individuals with documented suicidal thoughts and the seven with suicide attempts in the year before death, the proportions with such thoughts or attempts were smaller among persons with nonproblematic use compared with problematic use, suggesting that this explanation is less likely. Nonproblematic opioid use accounted for the most opioid overdose deaths in our study. We believe that although this group is most at risk of death by opioid overdose, this group is least likely to be identified. Novel guidelines for detection and intervention are needed for this group. Insisting on education and distribution of naloxone kits to all patients treated with opioids may also help this silent group.

Our study had several strengths, including a population-based design, inclusion of only validated cases of decedents who had contact with the health care system during the year prior to their death, and use of a methodology to assist a local health care system in improving identification of at-risk groups and addressing weaknesses in management. Most hospital-based quality improvement efforts are focused on outcomes and incidents that occur during the treatment phase, and public health studies often are limited in their capacity to provide specific information to improve specific institutional performance. In addition, dissemination of these data can help providers in their motivation and commitment to address public health measures.

Limitations included the retrospective nature of the study that limited the predictive information and the limited reliability of the accuracy of information in the EMRs, which we could not ascertain. The EMRs reviewed were exclusively from the UMMC system, and some patients may have had encounters with other hospitals outside Worcester. Also, the prescription data were obtained from medical records and not from pharmacy records, which would have reflected refill data. By definition the sample was selected because of receipt of services, and thus there may have been a bias toward service users, which may have overstated the results of service use. Finally, the evolving nature of the epidemic, with continuing rises in mortality from synthetic opioids such as fentanyl, will likely require more rapid and contemporary feedback on recent decedents to provide pertinent information.

Conclusions

This study found that decedents who had opioid use disorder or aberrant drug-related behavior accounted only for 47% of the deaths by opioid overdose in the metropolitan area of Worcester, Massachusetts. The study found numerous opportunities for improvement in universal precautions and substance use management of this high-risk group. In addition, a harder-to-identify group with chronic pain, mental illness, and low use of prescription opioids accounted for a similar proportion of the deaths by opioid overdose. Surveillance at the population level and further characterization of this group, with specific strategies to identify and design appropriate interventions, are warranted and must be sought.

Division of Addiction Psychiatry, Department of Psychiatry (all but Yarzebski), Department of Quantitative Health Sciences (Yarzebski), and Department of Radiology (DiGirolamo), University of Massachusetts Medical School, Worcester; Department of Family Medicine (Rose) and Department of Psychiatry (Shahanaghi), Boston Medical Center, Boston; MAYU of New England, New Haven, Connecticut (Romero-Gonzalez); Department of Psychology, College of the Holy Cross, Worcester (DiGirolamo); U.S. Department of Veterans Affairs Central Western Massachusetts Healthcare System, Leeds (Gonzalez).
Send correspondence to Dr. Gonzalez ().

Results were presented at the Annual Scientific Meeting of the College of Problems of Drug Dependence, Montreal, June 17–22, 2017.

This study was supported by the Division of Addiction Psychiatry, Department of Psychiatry, University of Massachusetts Medical School.

The authors report no financial relationships with commercial interests.

References

1 Degenhardt L, Charlson F, Mathers B, et al.: The global epidemiology and burden of opioid dependence: results from the Global Burden of Disease 2010 Study. Addiction 2014; 109:1320–1333Crossref, MedlineGoogle Scholar

2 Rudd RA, Aleshire N, Zibbell JE, et al.: Increases in drug and opioid overdose deaths—United States, 2000–2014. MMWR 2016; 64:1378–1382Crossref, MedlineGoogle Scholar

3 Rudd RA, Seth P, David F, et al.: Increases in drug and opioid–involved overdose deaths—United States, 2010–2015. MMWR 2016; 65:1445–1452Crossref, MedlineGoogle Scholar

4 Lin LA, Bohnert AS, Ilgen MA, et al.: Outpatient provider contact prior to unintentional opioid overdose among VHA service users. Psychiatr Serv 2015; 66:1149–1154LinkGoogle Scholar

5 Olfson M, Wall M, Wang S, et al.: Service use preceding opioid-related fatality. Am J Psychiatry 2018; 175:538–544LinkGoogle Scholar

6 Merlin JS, Turan JM, Herbey I, et al.: Aberrant drug-related behaviors: a qualitative analysis of medical record documentation in patients referred to an HIV/chronic pain clinic. Pain Med 2014; 15:1724–1733Crossref, MedlineGoogle Scholar

7 Chen HY, Gore JM, Lapane KL, et al.: A 35-year perspective (1975 to 2009) into the long-term prognosis and hospital management of patients discharged from the hospital after a first acute myocardial infarction. Am J Cardiol 2015; 116:24–29Crossref, MedlineGoogle Scholar

8 Gourlay DL, Heit HA, Almahrezi A: Universal precautions in pain medicine: a rational approach to the treatment of chronic pain. Pain Med 2005; 6:107–112Crossref, MedlineGoogle Scholar

9 Agresti A: Categorical Data Analysis. Hoboken, NJ, Wiley, 2013Google Scholar

10 Austin AE, Proescholdbell SK, Creppage KE, et al.: Characteristics of self-inflicted drug overdose deaths in North Carolina. Drug Alcohol Depend 2017; 181:44–49Crossref, MedlineGoogle Scholar