Diabetes Engagement and Activation Platform for Implementation and Effectiveness of Automated Virtual Type 2 Diabetes Self-Management Education: Randomized Controlled Trial

Introduction

Background

Type 2 diabetes (T2D) affects an estimated 34 million people in the United States [1], costing US $327 billion annually [2]. T2D prevalence in the United States is expected to increase, whereas costs are expected to double over the next 25 years [3,4]. T2D self-management education and support (DSMES) provides individuals with the information and problem-solving skills needed to self-manage T2D and has been shown to improve medication adherence, self-blood glucose monitoring, glycemic control, and dietary behaviors [5,6] and reduce complications from uncontrolled T2D [7,8]. The American Diabetes Association (ADA) recommends the provision of DSMES for every patient at 4 points: at diagnosis, annually thereafter, when complicating factors arise, and when transitioning to new care teams [9].

Despite its proven effectiveness, many patients do not receive DSMES. Of the patients referred, only 23%-66% follow through to receive DSMES [10] because of barriers such as time commitments, schedule conflicts, or transportation difficulties [7]. Innovative DSMES delivery methods are needed to better meet patients’ needs and leverage limited resources.

Health information technology, specifically personal health records (PHRs) integrated into electronic health records (EHRs), has the potential to increase patient access to DSMES by automating the provision of educational content and allowing patients to review and complete programs at convenient times and locations [11]. Integrated PHRs can help automate identifying patients needing additional help, allow patients to initiate requests for support, and alert team members to initiate care or direct patients to existing community resources [12,13].

Objectives

To help leverage the benefits of health information technology in providing DSMES, we created the Diabetes Engagement and Activation Platform (DEAP), which is an automated patient educational tool integrated directly into the primary care workflow. DEAP is accessed from the patient portal, consists of 9 modules that address the recommended ADA domains of diabetes education, assesses patients’ knowledge and confidence in managing each domain, and alerts care team members of patient needs. We aim to conduct a randomized controlled trial (RCT) to evaluate the implementation of DEAP and its effectiveness relative to usual care for improving patient T2D outcomes.

Methods

Overview

We conducted a patient-level RCT evaluating the implementation and effectiveness of DEAP with respect to changes in glycated hemoglobin (HbA_1c; primary outcome), BMI, and blood pressure (BP) from baseline to 3 and 6 months. The study was conducted between November 1, 2017, and May 7, 2018, to achieve 6 months of patient tracking. This study was approved by the Virginia Commonwealth University Institutional Review Board and registered at ClinicalTrials.gov (identifier NCT02957721).

Setting

A total of 21 practices spanning 5 states from the Privia Health, LLC (Privia), a technology-enabled, physician enablement company that collaborates with medical groups, health plans, and health systems, were recruited to participate in this study. The practices predominantly serve commercially insured populations and those covered by Medicare.

Patient Sampling

All patients aged between 18 and 85 years with a T2D diagnosis, HbA_1c ≥8.0%, and practice portal account were sent an email to participate by their primary care clinician. Identification was automated in the practices’ EHR, and the email was sent 2 days after a laboratory result with an elevated HbA_1c level. The automated email, addressed by the primary care clinician, asked the patient to log in to the portal, which alerted the patient that their diabetes seemed poorly controlled. The system randomized patients in a 1:1 manner to receive either DEAP (intervention) or 1 page of information about diabetes (usual care control). No blinding or allocation concealment was used in this study.

Intervention and Control Conditions

DEAP was integrated into the practices’ EHR, patient portal, and data warehouse. DEAP consisted of 9 self-directed DSMES modules for patients and care team alerts for clinicians to assist patients requesting additional help. The DEAP modules covered the Standard 6: Curriculum from the National Standards for Diabetes Self-Management Education and Support [14]. The 9 modules included: (1) diabetes disease process and general treatment, (2) nutritional management, (3) physical activity, (4) medications, (5) monitoring blood glucose, (6) acute complications, (7) chronic complications, (8) mental health, and (9) goal setting. Patients were sent modules in order and received biweekly reminders until they completed the modules. The next module was sent when a patient completed a module or after 7 days of noncompletion, which allowed patients to skip or ignore the modules.

Each module included 1 to 3 handouts and 1 to 3 videos for patients to review (Multimedia Appendix 1). Content was selected from existing publicly available and validated material from the ADA, National Diabetes Education Program, American Association of Diabetes Educators, Mayo Clinic, MedlinePlus, and other sources. Content was selected by the research team with support from 2 certified diabetic educators, a lay community educator, and 2 patients with T2D. Inclusion criteria for content consisted of being clear and understandable, evidence based, and engaging. Upon completion of a module, patients were asked 4 questions to assess their knowledge, 1 question to assess their confidence in managing the module’s domain, and 1 question to understand if the patient wanted additional help from the care team related to the content in the module. DEAP sent a summary of the patient’s responses to the primary clinician and provided an alert for patients reporting low confidence or requesting help in managing a domain.

Patients randomized to the usual care control group received 1 page of general diabetes information, which was equivalent to the handout information in the first DEAP module. They did not have access to the structured DEAP curriculum, knowledge or confidence assessments, or care team alerts.

Measurements and Informatics

The patient portal and Privia electronic data warehouse were used to track patient progress through the curriculum, indicate whether modules were accessed and completed (completion was measured as a patient answering all postmodule questions), and record responses to end-module questions. The EHR was used to determine patient eligibility, measure patient characteristics (gender, age, race, ethnicity, preferred language, and insurance type), and capture health outcomes (HbA_1c, BMI, and BP). Health outcomes for measuring effectiveness included HbA_1c (primary outcome) and BMI and BP (secondary outcomes), captured at baseline, 3 months, and 6 months. Implementation measures consisted of knowledge, confidence, adoption, and reach. Confidence was assessed using a Likert scale ranging from not confident at all to completely confident. Adoption was defined as the number of practices that were willing to participate in the study. We defined reach as the percentage of patients who agreed to participate in the study, the percentage of patients who started the DEAP curriculum within the intervention group, the percentage of patients who completed the DEAP curriculum, and the total number of DEAP modules that were accessed.

Statistical Analysis and Sample Size Justification

We conducted both an intent-to-treat analysis of all intervention versus usual care control patients and a per-protocol analysis of intervention patients who completed at least one module (representing minimal intervention exposure) versus control patients. For both models, we made baseline-adjusted comparisons of 3- and 6-month means for HbA_1c, BMI, and systolic BP (SBP) and diastolic BP (DBP) between the study groups. Using linear mixed models, health outcomes (HbA_1c, BMI, and BP) at 3 and 6 months were modeled against a 2-level fixed group effect (intervention or control), the baseline value of that health outcome measurement, and a group-baseline interaction effect; the interaction term was removed if it was not significant at the 10% level and the Bayesian Information Criterion was lower in the no-interaction model. As an additional sensitivity analysis, unadjusted comparisons of the change in mean HbA_1c, BMI, and BP over time and between the study groups were made using linear mixed models, including continuous health outcomes (HbA_1c, BMI, and BP), a 2-level fixed group effect (intervention or control), a 3-level fixed time effect (baseline, 3 months, and 6 months), a fixed group-time interaction effect, and a patient-level random effect to account for within-participant dependence because of repeated measurements over time. The MEANS, FREQ, and GLIMMIX procedures in SAS statistical software (version 9.4 were used for analysis.

Sample size calculations were based on the assumption that 50% of participants would either decline to participate or not complete the study; therefore, recruiting 320 eligible participants would help ensure that 80 patients would participate and finish the study in each group (160 in total). Assuming a 5% type I error rate and an HbA_1c SD of 2 [4,15], we estimated over 80% power to declare mean HbA_1c for the intervention group to be significantly lower than in the usual care control group at either 3 or 6 months by at least 1 unit.

Results

Implementation Analyses

Adoption

The original plan was to recruit 4 practices from Privia’s network. However, we encountered significant practice enthusiasm across the organization, and a total of 21 practices across 5 states participated in the study. After the study was completed, Privia’s network extended DEAP to all practices as part of their standard operations.

Reach

The frequencies and percentages of intervention patients who accessed each of the training modules (and the numbers and percentages of those patients answering at least one question in each module and completing each module) are reported in Tables 1 and 2. Of the 189 intervention patients accessing at least the first module, the vast majority (140/189, 74.1%) eventually accessed all 9 modules, whereas only a few (8/189, 4.2%) failed to continue. Between 14% (21/151) and 28% (54/189) of the patients starting each module answered at least one of the corresponding postmodule questions. Of the 63 patients who answered at least one question in any module, 53 (84%) completed the questions to at least one module, with the majority answering at least one question completing all questions in each module.

Patient Knowledge, Confidence, and Help Seeking

Patients answered a majority of knowledge questions correctly for each module (Table 3). The 4 most commonly missed questions included understanding what the HbA_1c measured, causes of low blood sugar, recommended number of daily servings of fruits and vegetables, and strategies for reducing cardiovascular risk. Upon completion of a module, most patients reported being very or completely confident of the module’s content. Only 18 patients asked for additional help from the care team after completing a module, most commonly after completing the introduction module (9/54, 17%), nutrition module (4/33, 12%), and exercise module (2/35, 6%).

Effectiveness Analyses

A total of 680 patients met the eligibility criteria and were emailed the portal invitation (Figure 1). Of those, 343 either never opened the portal message or after opening the message decided not to proceed with participation. Of the remaining 337 patients, 189 were randomly allocated to the intervention group and 148 to the control group. We identified 327 of the allocated patients in the EHR group (183 patients in the intervention group and 144 patients in the control group). All intervention patients (100%) accessed the first training module, with a percentage decrease for each successive module, and 74% (140/189) accessed the ninth module. Between 14% (21/151) and 28% (54/189) of the patients accessing the modules answered at least one of the corresponding postmodule questions, and 53 completed at least one module. A summary of patient characteristics and demographics are presented in Table 4. The average patient was just above 60 years, had an HbA_1c level >9, had a BMI in the obese range (>30), and had controlled BP (SBP<140). Both groups had similar rates of men and women, whereas the majority of participants were non-Hispanic, White, with English as their preferred language. Most participants had commercial health insurance or Medicare.

‎View this figure

Intent-to-Treat Analysis

Table 5 contains summaries of the comparisons of mean health outcomes between intervention and control groups. There was no evidence that the mean for the primary outcome (HbA_1c) was lower in the intervention group than in the control group at 3 months (8.0% vs 8.2%; P=.38) or at 6 months (8.2% vs 8.4%; P=.27). The mean BMI was significantly reduced in intervention group patients relative to control group patients at 3 months (31.7 kg/m² vs 32.1 kg/m²; P=.04) and at 6 months (32.5 kg/m² vs 33.0 kg/m²; P=.02). There was no evidence of improved SBP or DBP in the intervention group patients compared with the controls. Results were similar in the changes comparison analyses (Table 6), with no evidence of differences in baseline and 3-month changes between groups for any measures, and with only the change in BMI between baseline and 6 months for intervention group patients (–0.4 kg/m² decrease vs 0.1 kg/m² increase; P=.02).

Per-Protocol Analyses

Comparisons among intervention group patients completing at least one DEAP module and controls are also provided in Table 5. Those who completed at least one module had a lower mean HbA_1c at 3 months compared with controls (7.6% vs 8.2%; P=.03), whereas there was no significant difference at 6 months (7.9% vs 8.4%; P=.17). Completers had significantly lower mean BMI at 3 months than controls (31.3 kg/m² vs 32.1 kg/m²; P<.001) and at 6 months (31.6 kg/m² vs 33.0 kg/m²; P<.001). There were no differences in SBP between completers and controls at 3 months (P=.25) and 6 months (P=.85). The intervention patients completing at least one module also had a larger mean DBP at 3 months than controls (72.3 mm Hg vs 75.9 mm Hg; P=.01), although there was no significant difference at 6 months (P=.37). Results from the comparison of change analyses (Table 6) were nearly identical, with the exception being that there was no evidence of different changes between groups in HbA_1c at 3 months (P=.29) or 6 months (P=.54). The change in BMI was significantly larger in those who completed at least one module compared with controls between baseline and 3 months (–0.9 kg/m² vs 0.1 kg/m²; P<.01) and 6 months (–0.8 kg/m² vs 0.1 kg/m²; P<.01), and with the change in DBP significantly larger in those intervention group patients completing at least one module than in controls (–5.2 mm Hg vs –1.3 mm Hg; P=.03).

Discussion

Principal Findings

DEAP uses publicly available material in a systematic manner to automatically provide virtual diabetes education and support through pre-existing patient portals. DEAP Adoption exceeded what was expected to meet the study objectives, indicating that clinicians recognize the need for innovative, structured, accessible DSMES to optimize patient care and outcomes. With regard to reach, more patients accessed and used DEAP modules (74%) and then would access other simple educational messages sent to patients (about 20% of general Privia educational messages were opened by patients). This uptake of the automated DEAP content is similar to that of traditional in person DSMES classes [16]. DEAP facilitated high levels of confidence, knowledge, and help-seeking behaviors.

Although knowledge does not always correlate with improved self-management [17], the DEAP intervention group demonstrated improved BMI relative to controls, whereas our per-protocol analysis also showed evidence of improvement in HbA_1c and DBP at 3 months postintervention for those completing modules. The lack of change in HbA_1c and BP may be because of dilution from non-DEAP users, who did not change. Nonetheless, the improved BMI in the intent-to-treat analysis is particularly impressive, given that most interventions to help patients lose weight must be fairly intensive, often including 25 or more hours of contact over 6 months [18].

DEAP leverages the existing use of patient portals [19] and compiles existing patient educational materials and videos into an easily accessible and understandable format. A key element of DEAP’s success is the automatic identification of patients with elevated HbA_1c within 2 days of the abnormal result, which removes the burden of identifying and engaging patients from the clinician and engages patients when they may be more amenable to making self-management changes. Another key element is that DEAP assembles publicly available information into a defined curriculum, making the material more acceptable and accessible to patients. Integrating DEAP into the clinician’s portal also comes with the imprimatur and credibility of the patient’s personal clinician.

Although we did observe benefits in this study comparing, we suspect that the benefits could have been greater if the automated self-directed learning was better coupled with support from the care team. How clinicians and care team members addressed the alerts was left to their discretion. Future implementations of DEAP could focus on alerting specific care team members when patients completed modules that could contact patients and offer additional ancillary services. For example, DEAP could notify a nutritionist when a patient expressed low confidence in managing their diet or missed a knowledge question [20] or a pharmacist about their medication management [21].

Limitations

A limitation of this study is the short time frame, as 6 months of follow-up may not be enough for DSMES to lead to substantial and sustainable behavioral or health changes. However, the shorter time frame resulted in a greater improvement in BMI observed in the intervention group compared with the control and the improved HbA_1c, BMI, and DBP observed among DEAP users compared with nonusers. The generalization of these results may be limited by the predominantly White, English-speaking, and non-Hispanic study sample, although the use of multiple practices and the focus on patients seen in primary care are strengths. Another factor limiting generalization was requiring a patient portal account for inclusion; investigations of approaches to encourage portal uptake or delivery of DEAP through other mechanisms are warranted.

Conclusions

This low-intensity intervention to provide virtual diabetes self-management education proved both feasible and effective. The model is scalable, builds on existing infrastructures in many practices and health systems, and can be extended to other settings or conditions. Studying how automated self-directed approaches could be better linked with alerting care team members for additional directed care could have even greater benefits.