The American Psychiatric Association (APA) has updated its Privacy Policy and Terms of Use, including with new information specifically addressed to individuals in the European Economic Area. As described in the Privacy Policy and Terms of Use, this website utilizes cookies, including for the purpose of offering an optimal online experience and services tailored to your preferences.

Please read the entire Privacy Policy and Terms of Use. By closing this message, browsing this website, continuing the navigation, or otherwise continuing to use the APA's websites, you confirm that you understand and accept the terms of the Privacy Policy and Terms of Use, including the utilization of cookies.

×
Published Online:https://doi.org/10.1176/appi.ps.201600582

Abstract

Objective:

This study tested whether a mood tracking and alert (MTA) mobile application (app) improved mental health care delivery in a high-risk obstetric population.

Methods:

Pregnant women with depressive symptomatology at <32 weeks gestation were followed for eight weeks after randomization to a control patient portal (PP) app alone or with the MTA app. The MTA app monitored activity, assessed mood, and alerted obstetric providers of signs of worsening mood.

Results:

Seventy-two women enrolled (PP, N=24; MTA, N=48). MTA users had significantly more contacts addressing mental health, and as gestational age increased, they rated ability to manage their own health significantly better than women in the control group. Women who received telephone contact from a provider triggered by an MTA app alert were significantly more likely to receive a mental health specialist referral.

Conclusions:

A mobile MTA app improved service delivery and patient engagement among patients with perinatal depression symptoms.

Mobile health (mHealth) strategies are a potential approach to improve patient engagement and service delivery in health care settings. Mobile phone application (mobile app) self-management tools have been developed for a range of chronic illnesses and have been studied in obstetric settings for physical activity, nutrition, and gestational diabetes. These apps often provide automated feedback or cues to patients (1) but do not generally enable patients to connect directly with their health care team. Thus, such apps may exist in parallel to health care treatment, as opposed to being integrated into health care treatment (2). When integrated into treatment with a health care team, apps have the potential to extend the reach of care between in-person visits, potentially improving health care delivery. Despite the widespread use of mobile apps, there have been few evaluations of the benefits of this technology for improving health care delivery (3), particularly regarding apps focused on mental health.

Common perinatal mental disorders, primarily depression and anxiety, are associated with poor pregnancy outcomes and infant health (4). Depression occurs in up to 20% of pregnant women, with markedly higher rates in low-income populations (5). Given the negative impact on the woman and her offspring, it is critical to address these disorders in the prenatal period. However, attention to mental health in obstetric settings may be inadequate because of limited resources (6), even though women may be open to discussing mental health concerns with obstetric providers (7). Mobile apps that alert the health care team when mood symptoms worsen between prenatal visits could enhance the ability of prenatal care sites to deliver effective, targeted care of perinatal mental health concerns, particularly in resource-limited settings.

This randomized controlled trial (RCT) aimed to assess the impact of a mood tracking and alert (MTA) mobile app on patient engagement and health care delivery in an obstetric setting among women from racial-ethnic minority groups with low incomes who were experiencing depressive symptoms. The main hypotheses were that eight weeks of MTA app use would improve patient engagement (particularly patients’ perceived ability to manage their own health), improve prenatal care satisfaction (particularly sense of connectedness with providers), and enhance mental health service delivery by facilitating clinical contact when mood symptoms worsened.

Methods

This study was an RCT drawing from a convenience sample. Pregnant women were recruited from March to September 2015 from an urban ambulatory prenatal clinic within an academic medical center serving a predominantly low-income and racial-ethnic minority population. Women at least 18 years old and 32 weeks gestation or less, per electronic health record (EHR), were approached by a research coordinator at a routine prenatal appointment. Enrollment was offered to English-speaking women with depressive symptoms (≥5 on the Patient Health Questionnaire–9 [PHQ-9]) who owned a smartphone with an iOS or Android operating system (8).

Participants were randomly assigned to one of three conditions: a mobile app allowing access to a patient portal (PP), the standard of care available to all patients at the health center, that enabled e-mail-like communication with providers; PP with the addition of an MTA app (Ginger.io; San Francisco, California) that alerted providers when participant mood symptoms worsened, prompting the provider to contact the participant; or the PP app and MTA app with a lottery incentive to encourage MTA app use. Additional description of the apps is available as an online supplement to this brief report. Research staff assisted participants with the app(s) download, provided information packets explaining the assigned mobile app(s), and administered a baseline interview (demographic information, prenatal care engagement, and satisfaction). After eight weeks, care engagement and satisfaction were reassessed. Service delivery data on patient-provider contacts during the eight-week period were extracted from the EHR of each participant. As an exploratory outcome, depressive and anxiety symptoms were assessed after eight weeks within the MTA group. A priori sample size calculations were based on a moderate effect size and a power of .8. This study was approved by the University of Pennsylvania Institutional Review Board, conducted according to the guidelines of the Declaration of Helsinki, and registered on ClinicalTrials.gov.

Patient engagement and care satisfaction questions addressed confidence in ability to manage one’s own health, feeling that prenatal providers understand and respond to one’s unique needs as a patient, feeling connected with providers, ability to communicate with prenatal providers, whether one was left with unanswered questions after prenatal visits, and general satisfaction with prenatal care; items were rated on a Likert scale. To assess service delivery, data on patient-provider interactions were abstracted from the EHR for all encounters dated within the participant’s eight-week study period. Information obtained included medical history, office visit frequency, telephone contact, secure messages sent and received via PP, mental health specialist referrals and visits, and encounters that mentioned mental health or the MTA app. To assess app acceptability, participants in the MTA group were asked eight Likert-scale questions about the perceived acceptability and utility of the mobile app [see online supplement]. As exploratory measures, depressive and anxiety symptoms were assessed after eight weeks in the MTA group by using the PHQ-9 and the Generalized Anxiety Disorder–7 (GAD-7) (9).

Descriptive statistics were generated and examined for normality. Student’s t and chi-square tests assessed group differences in demographic characteristics. Patient engagement, care satisfaction, and service delivery outcomes were treated as continuous variables and were analyzed with analysis of covariance (ANCOVA) by using baseline levels as covariates. Because prenatal visits are more frequent in the later stages of pregnancy, ANCOVAs were adjusted for gestational age. A p value was considered significant at p<.05; values presented were not corrected for multiple comparisons. Analyses were performed with IBM SPSS Statistics for Macintosh, version 23.

Results

The sample included 72 participants (PP control app, N=24; PP plus MTA, N=25; PP plus MTA with lottery, N=23) of 91 screened. One participant did not receive the allocated intervention because of incomplete app download, one participant withdrew, and five participants were lost to follow-up. Randomization created generally equivalent groups; the only significant difference among the three groups in demographic characteristics, health, or psychiatric history was gestational age, which was included as a covariate in ANCOVAs (Table 1). There was no difference in utilization or outcomes for the two MTA groups related to the presence of the lottery; therefore, the groups (with and without lottery) were combined for all additional analyses.

TABLE 1. Demographic characteristics, care satisfaction, and service delivery outcomes among pregnant women randomly assigned to a patient portal (PP) app or mood tracking and alert (MTA) mobile app

PP app (N=24)MTA app (N=48)
VariableN%N%p
Demographic characteristic
 Age (M±SD)26.3±4.926.5±6.2.93
 Gestational age at enrollment (M±SD weeks)17.0±6.021.3±6.7.02
 African American22963995.92
 Hispanic211410.90
 Married14410.44
 Employed10562563.62
 Some college or more10561845.46
 Medicaid or Medicare insurance17743688.16
 Gravida (M±SD)3.3±1.93.6±2.5.61
 Para (M±SD).9±1.01.1±1.5.70
 PHQ-9 at enrollment (M±SD)a12.1±5.211.0±4.6.37
 Psychiatric diagnosis13542561.49
 Prescribed psychiatric medication2912.26
Engagement and care satisfaction at week 8 (M±SD)
 I am confident that I am able to manage my own healthb6.1 ±.86.1±1.0.07c
 My care team understands and responds to my unique needsb6.2±1.46.1±1.2.71c
 I feel connected to my care teamb5.5±1.55.8±1.4.39c
 How would you rate the ability to reach your prenatal provider by phone?d4.1±1.33.9±1.4.69c
 How often do you leave a prenatal appointment with unanswered questions?e5.6 ±.75.7 ±.7.77c
 How satisfied are you with your prenatal care?f5.8±1.36.1±1.0.71c
Service delivery
Prenatal careg
  N of OB office visits (M±SD)4.5±2.64.7±2.1.89c
  N of OB visits in which mental health was mentioned (M±SD).83±1.5.85±1.3.82c
  N of OB telephone encounters mentioning mental health (M±SD).1±4.7.98±1.3.02c
Mental health care
  N of prenatal mental health specialist visits (M±SD).22±.6.30±.5.69c
  Patient had OB visit that addressed mental health8351742.60h
  Patient referred to mental health specialist5221127.65h
  Patient attended mental health specialist visit120327.76h
  Patient had MTA app triggered contact1741

aPHQ-9, Patient Health Questionnaire–9. Possible scores range from 0 to 27, with higher scores indicating greater depressive symptomatology.

bItems were rated on a Likert scale ranging from 1, completely disagree, to 7, completely agree.

cRepresents the p value from analysis of covariance, main effect of group, with gestational age as a covariate

dItems were rated on a Likert scale ranging from 1, very poor, to 6, excellent.

eItems were rated on a Likert scale ranging from 1, always, to 6, never.

fItems were rated on a Likert scale ranging from 1, completely dissatisfied, to 7, completely satisfied.

gOB, obstetrician

hRepresents the p value for chi-square

TABLE 1. Demographic characteristics, care satisfaction, and service delivery outcomes among pregnant women randomly assigned to a patient portal (PP) app or mood tracking and alert (MTA) mobile app

Enlarge table

Regarding patient engagement and care satisfaction, as gestational age increased, women in the MTA group rated their ability to manage their own health significantly higher than the control group after eight weeks (F=4.03, df=4 and 49, p=.007; pinteraction=.04). At week 8, controlling for baseline care satisfaction scores, there were no significant differences in care satisfaction between the PP and MTA groups.

In terms of service delivery, compared with the PP group, the MTA group had significantly more telephone encounters with providers that mentioned mental health (F=6.0, df=1 and 55, p=.02), but this group did not have significantly more participants with mental health referrals or significantly better referral adherence than the PP group (Table 1). Within the MTA group, 17 women (41%) received a phone call from a provider that was triggered by an alert from the app. Those women who received a provider contact triggered by the MTA app had a significantly higher rate of referral to a mental health provider compared with women who did not receive an MTA app–triggered contact (t=−2.3, df=15, p=.03). Exploratory analysis of depressive and anxiety symptoms revealed that mean daily mood score was significantly positively correlated with number of calls that a participant received in weeks 1–4 (p<.05 for both comparisons). Participants who received an MTA-triggered call had consistently higher PHQ-9 and GAD-7 scores across the eight weeks compared with those who did not receive an MTA-triggered call. These differences were significant at weeks 1–4 for the PHQ-9 and at Weeks 3–4 for the GAD-7 (p<.05 for both comparisons).

Among participants randomly assigned to the MTA app, the minimum number of days that a participant used the app was 10. The most frequent users (N=3) used the app daily. Mean use frequency was 42.49 (±13.32) days, or 75.9% of days (about 5.3 days per week). In terms of acceptability, after eight weeks, at least half of MTA users said that the app helped them to feel open and honest about their feelings or helped them to manage their mental health. Less than 50% felt that the app helped their prenatal team to understand and respond to their unique needs, or to feel more connected to their care team [see online supplement].

Among MTA users, PHQ-9 (F=7.87, df=2.5 and 47.3, p=.001), GAD-7 (F=6.32, df=2.2 and 42.1, p=.003), and self-reported daily mood scores (F=2.62, df=4.2 and 139.9, p=.03) significantly improved over eight weeks.

Discussion

The aim of this study was to assess whether an MTA mobile app used in a high-risk obstetric population would improve patient engagement and mental health care delivery, over and above a standard app that connected patients to providers through a PP. Participants had a high rate of mental health concerns, including moderate depressive symptoms and a psychiatric diagnosis in more than half. Participants were largely African American, unmarried, young, relatively early in pregnancy, and receiving Medicaid or Medicare, representing a highly vulnerable population.

After the eight-week trial, women in the third trimester in the MTA group experienced a significant improvement in their perceived ability to manage their own health, whereas those in the PP control group did not. Previous research has suggested that mHealth interventions can help patients to self-manage certain health conditions (10).

Because the MTA app alerted providers when a patient was experiencing worsening mood symptoms, triggering telephone contact from the provider, it follows that the MTA users had more phone contact with their providers regarding mental health. Furthermore, women who received an MTA app-triggered call from a provider had significantly higher mean PHQ-9 and GAD-7 scores early in the study, indicating that the app was correctly identifying women in distress. Finally, women who received an MTA app-triggered telephone contact had significantly more referrals to a mental health provider than users who did not have a triggered contact from a provider. This finding indicates that an app such as MTA is a feasible option to improve mental health service delivery via monitoring at-risk patients between visits; this app also facilitated patient-provider contact when needed rather than relying on the patient to decide to send an electronic message to her provider through a PP.

Although a comparison group was not available, measures of depressive and anxiety symptoms and self-reported daily mood improved over eight weeks among MTA app users. However, patients with depressive symptoms tend to improve over time (11), so we cannot make any causal claims that symptom improvement was due to app use.

This study’s strengths included randomization to the MTA app or a control app and an extended (eight-week) period of app use. Although greater than 90% of women in this clinic had smartphones, less than 10% of all patients seen in this clinic had activated the PP app. Limitations included restricting participation to smartphone users actively seeking prenatal care and unblind status of the research staff. We were also underpowered to adjust our assessment of statistical significance for multiple comparisons. Also, the study was focused on care delivery rather than on clinical outcomes; future studies should assess depressive and anxiety symptoms in both app and control groups to assess the role of these apps in improving these outcomes.

Conclusions

A mobile app that monitored patients between routine obstetric visits with targeted provider contact when needed was well accepted, and it improved mental health service delivery in a high-need obstetric practice. Tools such as this app may help monitor and treat women at high risk of developing psychiatric symptoms during pregnancy.

Dr. Hantsoo, Ms. Criniti, and Dr. Epperson are with the Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia. Ms. Khan is with the Department of Family Medicine and Community Health and Ms. Moseley is with the Department of Obstetrics and Gynecology, both at the Hospital of the University of Pennsylvania, Philadelphia. Ms. Kincler is with Ginger.io, San Francisco. Dr. Faherty is with the RAND Corporation, Boston. Dr. Bennett is with the Department of Family Medicine and the Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle.
Send correspondence to Dr. Hantsoo (e-mail: ).

This report is based on a panel talk at the National Institutes of Health Mental Health Services Research conference, August 1–3, 2016, Bethesda, Maryland.

The study was funded by an Innovation Accelerator Program grant from the Penn Center for Healthcare Innovation (Dr. Bennett), by the Agency for Healthcare Research and Quality (K18 HS022441 [Dr. Bennett], P50 MH099910 [Dr. Epperson], and K23MH107831 [Dr. Hantsoo]), and by the Robert Wood Johnson Foundation Clinical Scholars Program (Dr. Faherty).

Ms. Kincler is currently employed at Ginger.io, the company that provided the technology for this study. Dr. Epperson reports that she or her spouse hold stock investments in Abbott, Abbvie, Johnson and Johnson, Merck, and Pfizer. Dr. Epperson also consults to Sage Therapeutics and Shire Pharmaceuticals and gives continuing medical education lectures for Global Medical Education. The other authors report no financial relationships with commercial interests.

The authors thank the members of the “Stress in Pregnancy: Improving Results With Interactive Technology (SPIRIT)” group at the University of Pennsylvania for their assistance in carrying out the study; research coordinators Rebecca Henderson and Alicia Lo; Dina Appleby, M.S., and Mary Sammel, Sc.D., for guidance on statistical analysis; the staff of the University of Pennsylvania Helen O. Dickens Center for Women's Health for providing study-related clinical services; Katy Mahraj, M.S.I., and Roy Rosin, M.B.A., from the University of Pennsylvania School of Medicine Center for Healthcare Innovation for technical guidance; and Lucy Edwards and Leanne Kaye at Ginger.io for technical guidance.

References

1 Choi J, Lee JH, Vittinghoff E, et al.: mHealth physical activity intervention: a randomized pilot study in physically inactive pregnant women. Maternal and Child Health Journal 20:1091–1101, 2016Crossref, MedlineGoogle Scholar

2 Willcox JC, Campbell KJ, McCarthy EA, et al.: Testing the feasibility of a mobile technology intervention promoting healthy gestational weight gain in pregnant women (txt4two)—study protocol for a randomised controlled trial. Trials 16:209, 2015Crossref, MedlineGoogle Scholar

3 Noordam AC, Kuepper BM, Stekelenburg J, et al.: Improvement of maternal health services through the use of mobile phones. Tropical Medicine and International Health 16:622–626, 2011Crossref, MedlineGoogle Scholar

4 Grote NK, Bridge JA, Gavin AR, et al.: A meta-analysis of depression during pregnancy and the risk of preterm birth, low birth weight, and intrauterine growth restriction. Archives of General Psychiatry 67:1012–1024, 2010Crossref, MedlineGoogle Scholar

5 Kim DR, Sockol LE, Sammel MD, et al.: Elevated risk of adverse obstetric outcomes in pregnant women with depression. Archives of Women’s Mental Health 16:475–482, 2013Crossref, MedlineGoogle Scholar

6 LaRocco-Cockburn A, Melville J, Bell M, et al.: Depression screening attitudes and practices among obstetrician-gynecologists. Obstetrics and Gynecology 101:892–898, 2003Crossref, MedlineGoogle Scholar

7 Bennett IM, Palmer S, Marcus S, et al.: “One end has nothing to do with the other:” patient attitudes regarding help seeking intention for depression in gynecologic and obstetric settings. Archives of Women’s Mental Health 12:301–308, 2009Crossref, MedlineGoogle Scholar

8 Kroenke K, Spitzer RL, Williams JB: The PHQ-9: validity of a brief depression severity measure. Journal of General Internal Medicine 16:606–613, 2001Crossref, MedlineGoogle Scholar

9 Zhong Q-Y, Gelaye B, Zaslavsky AM, et al.: Diagnostic validity of the Generalized Anxiety Disorder–7 (GAD-7) among pregnant women. PLoS One 10:e0125096, 2015Crossref, MedlineGoogle Scholar

10 de Jongh T, Gurol-Urganci I, Vodopivec-Jamsek V, et al.: Mobile phone messaging for facilitating self-management of long-term illnesses. Cochrane Database of Systematic Reviews 12:CD007459, 2012MedlineGoogle Scholar

11 Mora PA, Bennett IM, Elo IT, et al.: Distinct trajectories of perinatal depressive symptomatology: evidence from growth mixture modeling. American Journal of Epidemiology 169:24–32, 2009Crossref, MedlineGoogle Scholar