This paper is in the following e-collection/theme issue:

Diabetes Self-Management (463) Web-based and Mobile Health Interventions (3113) User-centred Design Case Studies (564) Engagement with and Adherence to Digital Health Interventions, Law of Attrition (459) Diabetes (151) Diabetes Education and Elearning for Patients (105)

Published on in Vol 8 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/44943, first published .
User Retention and Engagement in the Digital-Based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (myDESMOND) Program: Descriptive Longitudinal Study

User Retention and Engagement in the Digital-Based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (myDESMOND) Program: Descriptive Longitudinal Study

User Retention and Engagement in the Digital-Based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (myDESMOND) Program: Descriptive Longitudinal Study

Authors of this article:

Mary M Barker1, 2 Author Orcid Image ;   Radhika Chauhan1 Author Orcid Image ;   Melanie J Davies1 Author Orcid Image ;   Christopher Brough3 Author Orcid Image ;   Alison Northern3 Author Orcid Image ;   Bernie Stribling3 Author Orcid Image ;   Sally Schreder3 Author Orcid Image ;   Kamlesh Khunti1 Author Orcid Image ;   Michelle Hadjiconstantinou1 Author Orcid Image
Article Authors Cited by Tweetations (15) Metrics

    Original Paper

    1Diabetes Research Centre, University of Leicester, NIHR Leicester Biomedical Research Centre, Leicester, United Kingdom

    2Institute of Environmental Medicine, karolinska institutet, Stockholm, Sweden

    3Leicester Diabetes Centre, University Leicester Hospitals Trust, Leicester, United Kingdom

    *these authors contributed equally

    Corresponding Author:

    Michelle Hadjiconstantinou, BSc, MSc, PhD, CPsychol

    Diabetes Research Centre

    University of Leicester

    NIHR Leicester Biomedical Research Centre

    Leicester Diabetes Centre

    Leicester, LE4 5PW

    United Kingdom

    Phone: 44 116 2584320

    Email: mh333@le.ac.uk


    Background: Digital health interventions have the potential to improve the physical and psychosocial health of people living with type 2 diabetes. However, research investigating the long-term (≥1 year) retention and engagement of users within these programs is limited.

    Objective: The aim of this study was to evaluate long-term user retention and engagement in the digital-based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (myDESMOND) program, using real-world data.

    Methods: Anonymized data from all myDESMOND users who registered with the program on or before November 16, 2020, were included in the analyses. User retention was defined as the period between the day a user registered with the myDESMOND program and their last day of access. The primary engagement outcome was defined as the total number of log-ins to the program per user. The associations between retention, engagement, and sociodemographic factors (age, sex, and ethnicity) were tested using Cox regression models and Wilcoxon rank sum tests.

    Results: A total of 9522 myDESMOND users were included in this analysis. Of the 9522 users, 5360 (56.29%) remained on the program for at least a month, whereas 1676 (17.6%) remained on the program for at least 1 year. Retention was significantly higher among older users; the adjusted hazard ratio (representing the risk of users leaving the program within the first year) among users aged ≥50 years, compared with those aged <50 years, was 0.79 (95% CI 0.75-0.84; P<.001). The median number of myDESMOND log-ins per user was 8 (IQR 4-8); however, this was significantly lower among users aged <50 years (P<.001). Engagement metrics also differed according to sociodemographic characteristics; the estimated time spent per log-in was 5.35 (IQR 2.22-11.80) minutes among all users; however, this was significantly higher among female users (P<.001), users aged ≥50 years (P<.001), and users of White ethnicity (P=.02).

    Conclusions: Although retention and engagement of users within myDESMOND were found to be high, these findings highlight the need for age- and culture-specific implementation strategies and content adaptations to improve retention and engagement among all users of self-management programs.

    JMIR Diabetes 2023;8:e44943

    doi:10.2196/44943

    Keywords

    retention; engagement; digital self-management; type 2 diabetes; mobile phone 


    Background

    Recent figures published by the International Diabetes Federation reported that an estimated 463 million individuals were affected by diabetes in 2019, with 90% of them constituting people with type 2 diabetes (T2D) [1]. It is anticipated that this global prevalence will increase to 578 million by 2030 and 700 million by 2045 [1]. T2D often leads to serious microvascular (neuropathy, nephropathy, and retinopathy) and cardiovascular complications, with the latter representing a major cause of comorbidity and mortality among this population [2-4]. Globally recognized as an essential component of T2D care [5], diabetes self-management education and support (DSMES) has been found to be highly cost-effective, reduce the developmental risk of health complications, and increase the well-being of individuals with T2D [6-8].

    Despite significant clinical, psychological, and behavioral benefits, DSMES programs remain largely underused, with a significant proportion of the population with diabetes opting not to attend [9]. In 2020, data published by the National Diabetes Audit revealed that only 5.6% of the adults living with T2D in the United Kingdom attended a structured DSMES program within 12 months of their diagnosis [10]. Qualitative studies have identified several barriers contributing to the low uptake of traditional face-to-face structured DSMES programs, including physical and psychosocial comorbidities, a lack of accessibility, competing priorities (family and work), and diabetes-related shame and stigma [11-13]. Digital DSMES programs have the potential to overcome many of these barriers [14] and, in recent years, have become increasingly integrated into T2D care [6].

    Digital-based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (myDESMOND) [6], HeLP-Diabetes [15], the Low Carb Program [16], Patient-Centered Smartphone-Based Diabetes Care System [17], GlycoLeap [18], and GlucoNote [19] are some of the many digital or smartphone-based programs that have been tested for people living with T2D. Many of these programs, including myDESMOND [6], Healthy Living [20], the Low Carb Program [16], and GlycoLeap [18], have now become available to the wider public. Such DSMES programs have shown favorable results [5], with a meta-analysis of 14 randomized controlled trials evaluating digital self-management apps reporting a pooled mean reduction of −0.49% in glycated hemoglobin levels among T2D participants [21].

    Despite promising outcomes, digital DSMES programs can suffer from low user retention and engagement [22-24], meaning that users are not able to fully experience the clinical and psychosocial benefits [25]. The evaluation of user retention and engagement as well as factors affecting retention (eg, participant demographics) [26] has the potential to highlight important indicators of real-world implementation barriers with regard to digital health programs [27], thus facilitating the development of informed and targeted retention strategies [26]. Nonetheless, few digital DSMES programs have evaluated such data, with the findings focusing predominantly on clinical and cognitive impact as well as usability [28].

    Objectives

    Current evidence surrounding user retention and engagement for people with T2D is limited to the following digital self-management programs: HeLP-Diabetes [15], My Care Hub [29], and GlucoNote [19]. These studies have reported conflicting findings, with 1-month retention rates varying from 9% (HeLP-Diabetes) [15] to 35.3% (GlucoNote) [19]. Furthermore, with both HeLP-Diabetes [15] and My Care Hub [29] evaluating data after short-term intervention periods of 4 weeks and 3 weeks, respectively, there is scarce information available regarding long-term retention and engagement in the existing digital literature. Long-term retention data are limited to a study in Japan by Yamaguchi et al [19], who analyzed retention rates across a 1-year period for 357 participants with access to GlucoNote. The findings from this study revealed an overall decrease in long-term retention, with rates reducing from 35.3% (at 1 month) to 22% (at 3 months) [19]. With Yamaguchi et al [19] focusing on user retention in a predominantly male (79.9%) participant group, it is clear that there is need for a better understanding of both long-term (≥1 year) user retention and engagement across a larger population-based sample of people living with T2D. Thus, this paper aimed to investigate long-term retention and engagement, in addition to associated factors, among >9000 users of myDESMOND.


    The myDESMOND Program

    The myDESMOND program, developed by a multidisciplinary team at the Leicester Diabetes Centre in Leicester, United Kingdom, and launched in 2018, is a digital self-management education program based on Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (DESMOND), an evidence- and theory-based group education program for people living with T2D [30-32]. myDESMOND can be freely accessed via smartphones, tablet devices, laptops, and desktop computers and was developed using an iterative approach based on optimizing the learning and engagement of users [6]. Multiple core functions are available in the myDESMOND program, including interactive learning sessions; weekly booster sessions building on the topics covered in the learning sessions; health and activity trackers; and the Decision Maker tool, which allows users to set goals to improve their health. myDESMOND also offers other social features, such as the Ask the Expert function that allows users to seek advice and guidance from Leicester Diabetes Centre’s multidisciplinary team, a chat feature whereby users can interact with other users in the myDESMOND community, and an innovative Buddies function that allows users to invite up to 5 family members or friends to join them in their myDESMOND journey and compete with them in weekly or daily activity challenges. myDESMOND is part of routine care at 90 health care organizations across the United Kingdom and Ireland, and individuals participating in DESMOND are usually signposted to the program as an ad hoc resource. myDESMOND users have access to 10 weeks of booster sessions, but they can also have access for life if they want.

    Data

    With users’ consent, demographic and use data are collected for all users and stored on an encrypted server. Anonymized data can subsequently be downloaded for analysis.

    Ethical Considerations

    As this study presents a service evaluation, no specific ethics approval was needed; however, all users of myDESMOND have agreed to the terms and conditions of the privacy policy before they use the program. This policy includes a statement regarding use of their anonymized data for service evaluations.

    Study Population

    Since myDESMOND was launched in 2018, a total of 21,285 users have registered with the program. Data were extracted on November 16, 2021. For user retention to be analyzed over a full year, only users registered with the program on or before November 16, 2020, were included in the analysis, meaning that all included users had at least 1 full year of data.

    Variables

    User retention was defined as the duration of time between the day a user registered with the myDESMOND program and the last day that they accessed the program. The primary user engagement outcome was the total number of log-ins per user. The following secondary user engagement outcomes were also analyzed:

    • Total time spent using the program per user
    • Estimated time spent per log-in (calculated as the total time spent in the program divided by the total number of log-ins, per user)
    • Log-ins per week (calculated as the total number of log-ins divided by the number of weeks spent using the program, per user)

    Data were also available for users’ sex, age, and ethnicity.

    Statistical Analysis

    Sociodemographic variables (sex, age, and ethnicity) were summarized using median (IQR) or frequency (percentage), as appropriate. Age was used as a categorical variable (<50 years or ≥50 years). The effect of an alternative categorization of age (<40 years or ≥40 years) on the findings was explored in a supplementary analysis. Ethnicity was categorized as White, Black, Asian, other, or mixed. Because of the small number of users categorized as other or mixed ethnicity, only the White and Black or Asian ethnic groups were included in the analysis. Survival analysis was conducted to investigate the retention of users in the myDESMOND program during their first year of registration. Kaplan-Meier curves were generated for all users and stratified by age, sex, and ethnicity. As the assumption of proportional hazards was not violated, Cox regression models were subsequently run to estimate the hazard ratios of users leaving the myDESMOND program by sex, age group, and ethnicity. Both univariate and multivariable models were run, adjusted for sex, age group, and ethnicity, as appropriate. Complete case analysis was used throughout. Previous research has shown a substantial difference in overall program retention when users who left the program after <1 day were excluded from the analysis compared with analysis undertaken using data from all users [26]. Therefore, a further supplementary analysis was conducted that excluded users who spent <1 day on the program.

    The primary and secondary user engagement variables were evaluated over the total duration of program use, which could range from <1 day to >1 year. The total number of log-ins and total time spent in the program were first summarized by calculating the median (IQR) of these metrics, stratified by duration in the program. All engagement metrics were then summarized, stratified by sex, age group, and ethnicity. As the data did not follow a normal distribution, Wilcoxon rank sum tests were conducted to investigate any differences in the engagement metrics by sex, age group, or ethnicity. The analysis was conducted in Stata (version 17.0; StataCorp LLC). Statistical significance was set at P<.05 throughout.


    Sociodemographic Characteristics of Users

    This analysis included 9522 users of the myDESMOND program, of whom 3974 (41.73%) were male and 3843 (40.36%) were female. The median age of these users was 59 (IQR 51-68) years. Of the 9522 users, 532 (5.59%) were aged <40 years, whereas 1697 (17.82%) were aged <50 years, and 6135 (64.43%) were aged ≥50 years. The majority of the users (6478/9522, 68.03%) were White, whereas 11.96% (1139/9522) were Black or Asian, 1.79% (171/9522) reported an ethnicity classified as other or mixed, and 18.21% (1734/9522) had missing ethnicity data (Table 1). These sociodemographic characteristics were similar when users who spent <1 day using the myDESMOND program were excluded (Table S1 in Multimedia Appendix 1). Stratification of the age and sex variables by ethnicity showed that the median age in the Black or Asian ethnicity group (51, IQR 43-59, years) was far lower than that observed in the White ethnicity group (61, IQR 53-69, years; Table S2 in Multimedia Appendix 1).

    Table 1. Sociodemographic characteristics (N=9522).

    		Values
    Sex, n (%)

    		Male3974 (41.73)

    		Female3843 (40.36)

    		Missing1705 (17.91)
    Age (years; n=7832), median (IQR)59 (51-68)
    Age (categorization: <40 years or ≥40 years), n (%)

    		<40532 (5.59)

    		≥407300 (76.66)

    		Missing1690 (17.75)
    Age (categorization: <50 years or ≥50 years), n (%)

    		<501697 (17.82)

    		≥506135 (64.43)

    		Missing1690 (17.75)
    Ethnicity, n (%)

    		White6478 (68.03)

    		Black or Asian1139 (11.96)

    		Other or mixed171 (1.79)

    		Missing 1734 (18.21)

    User Retention

    The duration that users remained on the myDESMOND program ranged from <1 day to 40.4 months (3.4 years), with a median of 7.57 (IQR 0.00-36.43) weeks. Of the 9522 users, 5360 (56.29%) used the myDESMOND program for at least 1 month, 2914 (30.6%) used the program for at least 6 months, and 1676 (17.6%) remained on the program for at least 1 year (Figure 1).

    ‎
    Figure 1. Kaplan-Meier curves showing the time to users stopping use of the digital-based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed app after the course of a year for all users, stratified by sex, age, and ethnicity.

    When users who spent <1 day using myDESMOND were excluded from the analysis, 75.5% (5360/7099) of the users spent at least 1 month using the program (Figure S1 in Multimedia Appendix 1). Figure 1 displays survival curves stratified by sex, age group, and ethnicity. In both the univariate and multivariable analyses, older age was significantly associated with a lower likelihood of leaving the program during the analysis period. Corresponding adjusted hazard ratios were 0.79 (95% CI 0.75-0.84; P<.001) for users aged ≥50 years compared with those aged <50 years, and 0.77 (95% CI 0.70-0.85; P<.001) for users aged ≥40 years compared with those aged <40 years (Table 2; Table S3 and Figure S2 in Multimedia Appendix 1). Although the median duration of time spent in the program was slightly longer for female users compared with male users, female users had a significantly higher likelihood of leaving the program within the year in both the univariate (P=.003) and multivariable analyses (P=.03). No significant associations were observed between ethnicity and the likelihood of users leaving the program (Table 2). Similar results were observed when users who spent <1 day using the program were excluded from the analysis (Table S4 in Multimedia Appendix 1).

    Table 2. Results from Cox proportional hazard models reporting associations between sex, age, ethnicity, and survival time in the program.

    		Unadjusted modelAdjusted model

    		Hazard ratio (95% CI)P valueHazard ratio (95% CI)P value
    Sex

    		Male1.00 (reference)N/Aa1.00 (reference)N/A

    		Female1.08 (1.03-1.13).0031.06 (1.01-1.11).03
    Age

    		<50 years1.00 (reference)N/A1.00 (reference)N/A

    		≥50 years0.79 (0.75-0.84)b<.0010.80 (0.75-0.85)<.001
    Ethnicity

    		White1.00 (reference)N/A1.00 (reference)N/A

    		Black or Asian1.08 (1.01-1.15)c.031.01 (0.94-1.09).72

    aN/A: not applicable.

    bSex, age, and ethnicity (as appropriate) included as confounders to generate adjusted hazard ratios.

    cIncludes users with nonmissing age and sex data, as well as users classified as White, Black, or Asian.

    User Engagement: Primary Outcome

    On average, users logged into the myDESMOND program 8 (IQR 4-18) times during their duration of myDESMOND use, which ranged from <1 day to 40.4 months. However, the total number of log-ins per user was significantly lower among younger users (P<.001), as well as among those from a Black or Asian ethnic background (P=.01; Table 3; Table S5 in Multimedia Appendix 1).

    Table 3. Retention and engagement metrics by sex, age, and ethnicitya.

    		Duration in the program (weeks)Total number of log-insTotal time spent using program (minutes)Estimated time spent per log-in (minutes)Log-ins per week
    Total, median (IQR)7.57 (0.00-36.43)8 (4-18)63.74 (20.87-191.80)5.35 (2.22-11.80)0.77 (0.32-1.84)
    Sex

    		Male, median (IQR)7.00 (0.00-36.86)8 (4-20)75.74 (24.45-221.17)5.82 (2.60-12.57)0.80 (0.35-1.89)

    		Female, median (IQR)7.14 (0.14-28.57)8 (5-18)82.55 (28.80-232.43)6.82 (3.07-14.00)0.89 (0.41-1.93)

    		P valueb.37.76.02<.001.06
    Age

    		<50 years, median (IQR)4.00 (0.00-22.14)7 (4-15)62.33 (20.33-161.58)5.53 (2.35-12.38)0.88 (0.36-2.17)

    		≥50 years, median (IQR)8.00 (0.29-36.29)9 (5-20)86.10 (28.53-245.23)6.53 (2.98-13.64)0.84 (0.38-1.87)

    		P value<.001<.001<.001<.001.13
    Ethnicity

    		White, median (IQR)7.14 (0.14-33.43)9 (5-19)81.75 (28.0-227.85)6.40 (2.88-13.53)0.86 (0.38-1.97)

    		Black or Asian, median (IQR)6.86 (0.00-28.14)7 (4-17)70.40 (20.85-223.33)5.80 (2.50-13.28)0.80 (0.35-1.75)

    		P value.07.005.01.02.05

    aExcludes users who spent <1 week using the web-based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed program.

    bP values were calculated using Wilcoxon rank sum tests.

    User Engagement: Secondary Outcomes

    Users spent a median total of 63.74 (IQR 20.87-191.80) minutes using the program. Younger users (P<.001), male users (P=.02), and Black or Asian users (P=.01) spent significantly less time, in total, using the program. On average, users spent 5.35 (IQR 2.22-11.80) minutes in the program per log-in. However, this metric was significantly lower for male users (P<.001), younger users (P<.001), and Black or Asian users (P=.02). The median number of log-ins per week was 0.77 (IQR 0.32-1.84) for all users included in the analysis (Table 3; Table S5 in Multimedia Appendix 1).

    Users who spent ≤3 months using the myDESMOND program had an average of 5 (IQR 4-8) log-ins and spent a total of 39.40 (IQR 14.68-97.57) minutes using the program. These engagement metrics increased to 15 (IQR 8-30) log-ins and 152.17 (95% CI 64.79-355.93) minutes using the program among users who spent >9 months using myDESMOND (Table 4).

    Table 4. Total number of log-ins and total time spent in the program, stratified by duration in the program.
    Duration in the program (months)Total number of log-ins, median (IQR)Total time spent in the program (minutes), median (IQR)
    ≤35 (4-8)39.40 (14.68-97.57)
    >3 to 611 (6-19)105.67 (36.05-252.27)
    >6 to 914 (7-26)132.68 (48.80-307.66)
    >9 to 1215 (8-30)152.17 (64.79-355.93)

    Overview

    To date, research evaluating long-term user retention and engagement with digital DSMES programs among adults with T2D has been limited, with long-term data focusing exclusively on retention in a small non–population-based sample of people with both T2D and prediabetes [19]. This is the first study to investigate both long-term retention and engagement (and associated factors) for a digital diabetes self-management program across a large and ethnically diverse sample of adults living with T2D. Our findings demonstrated high levels of user retention and engagement, which differed significantly according to sociodemographic characteristics.

    User Retention

    In comparison with previously reported 1-month retention rates of 9% (HeLP-Diabetes) [15] and 35.3% (GlucoNote) [19], our findings showed a favorable retention rate of 56% at 1 month among myDESMOND users. Furthermore, in contrast to the 3-month retention rate of 22% after 1 year’s access to GlucoNote in the study by Yamaguchi et al [19], our retention rate of 31% over 6 months compares much more favorably, thus highlighting the potential of the myDESMOND program at sustaining long-term retention among users. myDESMOND offers quality educational content that is accompanied by a wide breadth of functionalities (booster sessions, health and activity trackers, Ask the Expert, chat feature, etc), meaning that the program has potential to accommodate a variety of user-specific needs. Further research looking at ways to investigate program-specific functionalities associated with higher retention rates would be useful to facilitate the design of future digital self-management programs. Furthermore, it is important to note that some of the myDESMOND users would have attended the DESMOND group self-management program before registering, meaning that they already had an insight into the quality of the educational content and functionalities available. This suggests that information provision and supplementary group self-management programs may be a suitable way to encourage user retention across digital self-management programs.

    Despite promising user retention rates, discrepancies in the existing definitions of retention make direct comparisons of our findings challenging. As our study was conducted using real-world data, we defined retention as the duration of time between the day a user registered with the myDESMOND program and their last day accessing the program; however, other studies have largely defined retention as the completion of a postintervention assessment [15,29]. It is clear that there is need for a standardized definition of retention that also takes into account the real-world application of digital self-management programs.

    Our analysis also showed a median retention duration of 7.57 weeks, which is substantially greater than the 8-day median retention reported by Yamaguchi et al [19]. Furthermore, our findings also revealed both categorizations of age (40 years and 50 years) to be significantly associated with program retention in both the univariate and multivariable analyses (adjusting for sex and ethnicity), with younger users showing a significantly higher likelihood of leaving myDESMOND and significantly lower duration of use of the program than older users. Similar findings have also been reported by other digital health studies exploring retention indicators in long-term health conditions in addition to diabetes [26]. The 2 categorizations of age were used to observe whether retention differed in users with early-onset T2D versus those with usual-onset T2D. However, as the proportion of users aged <40 years was very low, the categorization of <50 years was used in the main analysis to maintain power, with the alternative categorization of <40 years being explored in the supplementary analysis.

    Our study is not the first to report low retention among young users of a digital diabetes self-management program. A randomized controlled trial evaluating use of the Young with Diabetes app among young people with type 1 diabetes in Denmark also reported poor retention, with app use decreasing rapidly to a retention rate of 5% at 12 months [33]. According to Klasnja et al [34], after the initial diagnosis period, people with diabetes develop flexible self-management routines, with their focus shifting to quality of life; hence, their use of diabetes health technology may fluctuate accordingly with periods of infrequent use. On the basis of our findings and the existing literature [33,34], it is feasible to suggest that, for young people with diabetes, maintaining a high quality of life may involve focusing on other aspects of their lives, such as education, employment, independent living, and families, thus reducing their regular use of a digital self-management program that may not adequately address their presenting need or concern. Further research exploring how to adapt digital self-management programs to address these periods of infrequent or intermittent use by young people with diabetes may be a crucial step toward the development of age-specific retention strategies for this cohort.

    User Engagement

    Our findings revealed that myDESMOND users spent an average total of 63.74 minutes on the program, with an average of 5.35 minutes spent in the program per log-in. From a behavioral perspective, engagement with digital behavior change interventions has largely been defined as use, with a focus on rate, duration, and depth of use, in addition to associated factors [35,36]. Consistent with this definition, our study reported the number of user log-ins and time spent in the program per log-in (and associated factors) to evaluate user engagement. However, unlike our study, the studies conducted by Glasgow et al [37] and Adu et al [29] reported a wider range of use metrics to capture the multidimensional nature of user engagement [36,38]. Adu et al [29] explored user engagement using a modified version of the frequency, intensity, time, and type (FITT) principle, thus acknowledging the frequency (how often the user visits the app or intervention), intensity (depth of engagement; eg, number of app or intervention features used out of those available), time (length of use during a single visit to the app or intervention), and type (eg, reflective [self-reporting of behavior or health outcomes] or didactic [reading posts and completing quizzes or challenges] engagement) of engagement with the My Care Hub app [29,38,39]. The FITT principle has the potential to effectively capture all domains of use data relating to the behavioral conceptualization of engagement [38]. Therefore, further evaluation of engagement with the myDESMOND program and other digital programs using the FITT principle is recommended because this may allow investigation of the intensity and type of engagement across programs. Such evaluations may provide new insights into the appropriateness of this principle in the analysis of real-world use data, hence contributing to the development of an all-encompassing universal measure of engagement.

    Our findings revealed age to be significantly associated with engagement with the myDESMOND program. In comparison with older users, younger users had a significantly lower median number of log-ins and average time spent in the program per log-in. The observed age-related differences in engagement may be attributable to the lack of age-appropriate content and functionality for younger users. Previous research has emphasized the need for the provision of tailored age-specific education, information, and peer support for young people with T2D to promote effective self-management of their condition [40-42]. Despite this, few age-appropriate digital self-management programs for T2D currently exist. Previous studies investigating the effectiveness of digital self-management programs tailored for young people with type 1 diabetes have shown potential for enhancing daily self-management through the emotional and social support benefits associated with the provision of an age-specific online peer support element [43,44]. More specifically, having a web-based platform to share and discuss personal experiences with other individuals of a similar age was found to reduce feelings of loneliness and isolation, thus motivating individuals to implement daily self-management behaviors [43,44]. Furthermore, in both studies, the peer support element remained the most consistently and frequently used functionality across both self-management programs [43,44]. Therefore, it is possible that adapting the existing myDESMOND chat function to allow age-specific interactions may facilitate increased engagement with the program among younger users, as observed in the previously mentioned studies [43,44].

    In line with previous research [45], our analysis also showed reduced engagement with the myDESMOND program among ethnic minority groups with T2D, with users of Black or Asian ethnicity showing significantly lower average number of log-ins and time spent in the program per log-in. Previous studies investigating the effectiveness of culturally tailored diabetes self-management education programs for ethnic minority groups have reported multifaceted benefits, with significant improvements shown across a range of clinical, knowledge, and psychobehavioral outcomes [46-48]. Although predominantly exploring face-to-face and telecommunication interventions or programs, these studies emphasize the importance of considering cultural and linguistic differences to promote increased uptake and overall health benefits among ethnic minority groups. Furthermore, Yardley et al [35] highlighted that a user’s engagement with a digital behavior change intervention can be sustained, reduced, or molded by sociocontextual influences, including their wider cultural setting. Therefore, it is feasible to suggest that cultural adaptation of myDESMOND to meet the needs of ethnic minority groups with T2D may promote their increased engagement with the program. In addition, addressing existing ethnic disparities in digital health care [49,50], including accessibility to digital platforms such as myDESMOND, may also promote increased engagement among this cohort.

    It is important to note, however, that the associations observed between ethnicity and user engagement may be confounded by age; users of Black or Asian ethnicity were substantially younger than users of White ethnicity.

    Similar to age and ethnicity, sex was also revealed by our findings to be significantly associated with engagement with the myDESMOND program, with male users spending significantly less time in the program per log-in compared with female users. This is consistent with previous literature reporting significantly greater engagement in digital health care among female users [51]. Although limited literature exists regarding sex differences in engagement with digital diabetes self-management programs, it is well known that sex is a crucial characteristic affecting optimal diabetes self-management [52], with male individuals and female individuals living with T2D experiencing differing biological, psychological, and physical needs and challenges [53]. Female individuals with T2D have been found to experience less favorable long-term physical and mental health outcomes; yet, they have been known to exhibit better self-management behaviors than their male counterparts [54]. Consequently, it is unsurprising that research has frequently emphasized the need for sex-specific diabetes care and support to improve long-term health outcomes among both cohorts [54,55]. Although most research pertaining to sex-specific diabetes support has focused on female individuals and looked at routine self-management [52], our findings highlight the need for research exploring the unique sex-related barriers and challenges contributing to long-term engagement with digital diabetes self-management programs. Such research has the potential to highlight important aspects of sex-specific content and functionality that may enhance engagement with programs such as myDESMOND in both male and female users, thereby contributing to long-term improvements in health outcomes among both male and female individuals with T2D.

    Strengths and Limitations

    This analysis has many strengths; namely, it used real-world data from >9000 users, thereby capturing a highly valid picture of the retention and engagement of myDESMOND users. The analysis was limited by the inability to differentiate between changes in use over the time spent in the program and different types of myDESMOND use (eg, learning sessions vs social features), which would have allowed for a better understanding of the differences in retention and engagement in specific program features across users. However, the analysis of retention, various engagement metrics, and multiple potentially associated sociodemographic factors provided a comprehensive understanding of the differing retention and engagement levels observed among myDESMOND users. Future research should investigate the impact of increased engagement and retention on clinical outcomes, such as glycated hemoglobin levels. Finally, although the multiethnic nature of the sample allowed for a thorough investigation of the association between ethnicity and retention or engagement, a relatively high proportion of users had missing data for ethnicity and other sociodemographic variables, meaning that not all participants could be included in this analysis, potentially resulting in a lack of power in some supplementary analyses.

    Conclusions

    This study explored long-term retention and engagement among >9000 users of the myDESMOND program, finding a higher retention rate than has previously been reported from analyses of other digital T2D self-management programs. The levels of engagement with myDESMOND were also promising. Further analysis investigating engagement by type of use is required. In addition, the myDESMOND program would benefit from age- and culture-specific adaptations to improve the engagement of all users.

    Acknowledgments

    The authors would like to acknowledge support from the National Institute for Health and Care Research (NIHR) Collaboration for Leadership in Applied Health Research and Care East Midlands and the NIHR Leicester Biomedical Research Centre, which is a partnership between University Hospitals of Leicester National Health Service Trust and the University of Leicester. The program was funded by the Leicester Diabetes Centre.

    Data Availability

    The data that support the findings of this study are available from the Leicester Diabetes Centre, but restrictions apply to the availability of these data, which were used under license for this study; therefore, the data are not publicly available.

    Authors' Contributions

    MMB and RC are joint primary authors. MJD, KK, CB, MMB, and MH were involved in the discussions around the concept. MMB and CB carried out the analysis. RC and MMB drafted the manuscript with support from MH. MJD, MH, SS, AN, BS, and KK contributed to the review of the analysis. MJD, SS, AN, BS, KK, and CB reviewed the draft of the manuscript.

    Conflicts of Interest

    The authors do not hold any conflicts of interest; however, for transparency we provide the following statement of conflict: MJD is the principal investigator on the Diabetes Education and Self-Management for Ongoing and Newly Diagnosed (DESMOND) program. SS, AN, CB, BS, MJD, and KK are employed by the University Hospitals of Leicester National Health Service (NHS) Trust, which receives not-for-profit income for DESMOND. All authors are actively engaged in research and have previously received grants for DESMOND from the National Institute for Health and Care Research, Medical Research Council, and Diabetes UK to develop and test diabetes self-management education and support programs such as DESMOND. The University Hospitals of Leicester NHS Trust receives licensing fees to support implementation of the DESMOND program in clinical commissioning groups in the United Kingdom, Ireland, and Australia.

    Multimedia Appendix 1

    Sociodemographic characteristics, association between variables, and retention and engagement metrics by age.

    DOCX File , 153 KB
    1. Saeedi P, Petersohn I, Salpea P, Malanda B, Karuranga S, Unwin N, et al. IDF Diabetes Atlas Committee. Global and regional diabetes prevalence estimates for 2019 and projections for 2030 and 2045: results from the International Diabetes Federation Diabetes Atlas, 9 edition. Diabetes Res Clin Pract. Nov 2019;157:107843. [CrossRef] [Medline]
    2. Zheng Y, Ley SH, Hu FB. Global aetiology and epidemiology of type 2 diabetes mellitus and its complications. Nat Rev Endocrinol. Feb 2018;14(2):88-98. [CrossRef] [Medline]
    3. Chatterjee S, Khunti K, Davies MJ. Type 2 diabetes. Lancet. Jun 2017;389(10085):2239-2251. [CrossRef]
    4. Einarson TR, Acs A, Ludwig C, Panton UH. Prevalence of cardiovascular disease in type 2 diabetes: a systematic literature review of scientific evidence from across the world in 2007-2017. Cardiovasc Diabetol. Jun 08, 2018;17(1):83. [FREE Full text] [CrossRef] [Medline]
    5. Hermanns N, Ehrmann D, Finke-Groene K, Kulzer B. Trends in diabetes self-management education: where are we coming from and where are we going? A narrative review. Diabet Med. Mar 04, 2020;37(3):436-447. [CrossRef] [Medline]
    6. Hadjiconstantinou M, Schreder S, Brough C, Northern A, Stribling B, Khunti K, et al. Using intervention mapping to develop a digital self-management program for people with type 2 diabetes: tutorial on MyDESMOND. J Med Internet Res. May 11, 2020;22(5):e17316. [FREE Full text] [CrossRef] [Medline]
    7. Powers M, Bardsley J, Cypress M, Funnell MM, Harms D, Hess-Fischl A, et al. Diabetes self-management education and support in adults with type 2 diabetes: a consensus report of the American Diabetes Association, the Association of Diabetes Care and Education Specialists, the Academy of Nutrition and Dietetics, the American Academy of Family Physicians, the American Academy of PAs, the American Association of Nurse Practitioners, and the American Pharmacists Association. Diabetes Care. Jul 2020;43(7):1636-1649. [CrossRef] [Medline]
    8. Davies MJ, D'Alessio DA, Fradkin J, Kernan WN, Mathieu C, Mingrone G, et al. Management of hyperglycemia in type 2 diabetes, 2018. A consensus report by the American Diabetes Association (ADA) and the European Association for the Study of Diabetes (EASD). Diabetes Care. Dec 2018;41(12):2669-2701. [FREE Full text] [CrossRef] [Medline]
    9. Horigan G, Davies M, Findlay-White F, Chaney D, Coates V. Reasons why patients referred to diabetes education programmes choose not to attend: a systematic review. Diabet Med. Jan 2017;34(1):14-26. [CrossRef] [Medline]
    10. National Diabetes Audit (NDA) 2021-22 quarterly report for England, Clinical Commissioning Groups and GP practices. NHS Digital. Jan 13, 2022. URL: https:/​/digital.​nhs.uk/​data-and-information/​publications/​statistical/​national-diabetes-audit/​core-q2-21-22/​content-copy [accessed 2023-05-05]
    11. Schäfer I, Pawels M, Küver C, Pohontsch NJ, Scherer M, van den Bussche H, et al. Strategies for improving participation in diabetes education. A qualitative study. PLoS One. Apr 14, 2014;9(4):e95035. [FREE Full text] [CrossRef] [Medline]
    12. Schwennesen N, Henriksen JE, Willaing I. Patient explanations for non-attendance at type 2 diabetes self-management education: a qualitative study. Scand J Caring Sci. Mar 2016;30(1):187-192. [CrossRef] [Medline]
    13. Winkley K, Evwierhoma C, Amiel SA, Lempp HK, Ismail K, Forbes A. Patient explanations for non-attendance at structured diabetes education sessions for newly diagnosed Type 2 diabetes: a qualitative study. Diabet Med. Jan 26, 2015;32(1):120-128. [CrossRef] [Medline]
    14. Pal K, Dack C, Ross J, Michie S, May C, Stevenson F, et al. Digital health interventions for adults with type 2 diabetes: qualitative study of patient perspectives on diabetes self-management education and support. J Med Internet Res. Jan 29, 2018;20(2):e40. [FREE Full text] [CrossRef] [Medline]
    15. Poduval S, Marston L, Hamilton F, Stevenson F, Murray E. Feasibility, acceptability, and impact of a web-based structured education program for type 2 diabetes: real-world study. JMIR Diabetes. Jan 06, 2020;5(1):e15744. [FREE Full text] [CrossRef] [Medline]
    16. Summers C, Tobin S, Unwin D. Evaluation of the low carb program digital intervention for the self-management of type 2 diabetes and prediabetes in an NHS England general practice: single-arm prospective study. JMIR Diabetes. Sep 09, 2021;6(3):e25751. [FREE Full text] [CrossRef] [Medline]
    17. Kim EK, Kwak SH, Baek S, Lee SL, Jang HC, Park KS, et al. Feasibility of a patient-centered, smartphone-based, diabetes care system: a pilot study. Diabetes Metab J. Jun 2016;40(3):192-201. [FREE Full text] [CrossRef] [Medline]
    18. Koot D, Goh PS, Lim RS, Tian Y, Yau TY, Tan NC, et al. A mobile lifestyle management program (GlycoLeap) for people with type 2 diabetes: single-arm feasibility study. JMIR Mhealth Uhealth. May 24, 2019;7(5):e12965. [FREE Full text] [CrossRef] [Medline]
    19. Yamaguchi S, Waki K, Nannya Y, Nangaku M, Kadowaki T, Ohe K. Usage patterns of GlucoNote, a self-management smartphone app, based on ResearchKit for patients with type 2 diabetes and prediabetes. JMIR Mhealth Uhealth. Apr 24, 2019;7(4):e13204. [FREE Full text] [CrossRef] [Medline]
    20. Healthy Living for people with type 2 diabetes. NHS England. URL: https://healthyliving.nhs.uk/ [accessed 2023-05-05]
    21. Hou C, Carter B, Hewitt J, Francisa T, Mayor S. Do mobile phone applications improve glycemic control (HbA1c) in the self-management of diabetes? A systematic review, meta-analysis, and grade of 14 randomized trials. Diabetes Care. Nov 2016;39(11):2089-2095. [CrossRef] [Medline]
    22. Adu MD, Malabu UH, Malau-Aduli AE, Malau-Aduli BS. Users' preferences and design recommendations to promote engagements with mobile apps for diabetes self-management: multi-national perspectives. PLoS One. Dec 10, 2018;13(12):e0208942. [FREE Full text] [CrossRef] [Medline]
    23. El-Gayar O, Timsina P, Nawar N, Eid W. Mobile applications for diabetes self-management: status and potential. J Diabetes Sci Technol. Jan 01, 2013;7(1):247-262. [FREE Full text] [CrossRef] [Medline]
    24. Kayyali R, Peletidi A, Ismail M, Hashim Z, Bandeira P, Bonnah J. Awareness and use of mHealth apps: a study from England. Pharmacy (Basel). Jun 14, 2017;5(2):33. [FREE Full text] [CrossRef] [Medline]
    25. He Q, Zhao X, Wang Y, Xie Q, Cheng L. Effectiveness of smartphone application-based self-management interventions in patients with type 2 diabetes: a systematic review and meta-analysis of randomized controlled trials. J Adv Nurs. Feb 29, 2022;78(2):348-362. [CrossRef] [Medline]
    26. Pratap A, Neto EC, Snyder P, Stepnowsky C, Elhadad N, Grant D, et al. Indicators of retention in remote digital health studies: a cross-study evaluation of 100,000 participants. NPJ Digit Med. Feb 17, 2020;3(1):21. [FREE Full text] [CrossRef] [Medline]
    27. Eysenbach G. The law of attrition. J Med Internet Res. Mar 31, 2005;7(1):e11. [FREE Full text] [CrossRef] [Medline]
    28. Larbi D, Randine P, Årsand E, Antypas K, Bradway M, Gabarron E. Methods and evaluation criteria for apps and digital interventions for diabetes self-management: systematic review. J Med Internet Res. Jul 06, 2020;22(7):e18480. [FREE Full text] [CrossRef] [Medline]
    29. Adu MD, Malabu UH, Malau-Aduli AE, Drovandi A, Malau-Aduli BS. User retention and engagement with a mobile app intervention to support self-management in Australians with type 1 or type 2 diabetes (My Care Hub): mixed methods study. JMIR Mhealth Uhealth. Jun 11, 2020;8(6):e17802. [FREE Full text] [CrossRef] [Medline]
    30. Northern A, Troughton J, Hadjiconstantinou M. The role of digital diabetes education (MyDESMOND) during the COVID-19 pandemic. Diabetes Prim Care. May 20, 2021;23(4):97.
    31. Davies MJ, Heller S, Skinner TC, Campbell MJ, Carey ME, Cradock S, et al. Diabetes EducationSelf Management for OngoingNewly Diagnosed Collaborative. Effectiveness of the diabetes education and self management for ongoing and newly diagnosed (DESMOND) programme for people with newly diagnosed type 2 diabetes: cluster randomised controlled trial. BMJ. Mar 01, 2008;336(7642):491-495. [FREE Full text] [CrossRef] [Medline]
    32. Quinn LM, Davies MJ, Northern A, Brough C, Schreder S, Stribling B, et al. Use of MyDesmond digital education programme to support self-management in people with type 2 diabetes during the COVID-19 pandemic. Diabet Med. Mar 23, 2021;38(3):e14469. [FREE Full text] [CrossRef] [Medline]
    33. Castensøe-Seidenfaden P, Husted GR, Jensen AK, Hommel E, Olsen B, Pedersen-Bjergaard U, et al. Testing a smartphone app (Young with Diabetes) to improve self-management of diabetes over 12 months: randomized controlled trial. JMIR Mhealth Uhealth. Jun 26, 2018;6(6):e141. [FREE Full text] [CrossRef] [Medline]
    34. Klasnja P, Kendall L, Pratt W, Blondon K. Long-term engagement with health-management technology: a dynamic process in diabetes. AMIA Annu Symp Proc. 2015;2015:756-765. [FREE Full text] [Medline]
    35. Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med. Nov 2016;51(5):833-842. [CrossRef] [Medline]
    36. Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med. Jun 2017;7(2):254-267. [FREE Full text] [CrossRef] [Medline]
    37. Glasgow RE, Christiansen SM, Kurz D, King DK, Woolley T, Faber AJ, et al. Engagement in a diabetes self-management website: usage patterns and generalizability of program use. J Med Internet Res. Jan 25, 2011;13(1):e9. [FREE Full text] [CrossRef] [Medline]
    38. Short CE, DeSmet A, Woods C, Williams SL, Maher C, Middelweerd A, et al. Measuring engagement in eHealth and mHealth behavior change interventions: viewpoint of methodologies. J Med Internet Res. Nov 16, 2018;20(11):e292. [FREE Full text] [CrossRef] [Medline]
    39. Barisic A, Leatherdale ST, Kreiger N. Importance of frequency, intensity, time and type (FITT) in physical activity assessment for epidemiological research. Can J Public Health. May 1, 2011;102(3):174-175. [CrossRef]
    40. Savage S, Dabkowski S, Dunning T. The education and information needs of young adults with type 2 diabetes: a qualitative study. J Nurs Healthc Chronic Illness. 2009;1(4):321-330. [CrossRef]
    41. Rasmussen B, Terkildsen Maindal H, Livingston P, Dunning T, Lorentzen V. Psychosocial factors impacting on life transitions among young adults with type 2 diabetes: an Australian - Danish qualitative study. Scand J Caring Sci. Jun 02, 2016;30(2):320-329. [CrossRef] [Medline]
    42. Woolley AK, Chudasama Y, Seidu SI, Gillies C, Schreder S, Davies MJ, et al. Influence of sociodemographic characteristics on the preferred format of health education delivery in individuals with type 2 diabetes mellitus and or cardiovascular disease: a questionnaire study. Diabet Med. Jun 28, 2020;37(6):982-990. [CrossRef] [Medline]
    43. Husted GR, Weis J, Teilmann G, Castensøe-Seidenfaden P. Exploring the influence of a smartphone app (young with diabetes) on young people's self-management: qualitative study. JMIR Mhealth Uhealth. Feb 28, 2018;6(2):e43. [FREE Full text] [CrossRef] [Medline]
    44. Ng AH, Crowe TC, Ball K, Rasmussen B. A mHealth support program for Australian young adults with type 1 diabetes: a mixed methods study. Digit Health. Oct 15, 2019;5:2055207619882179. [FREE Full text] [CrossRef] [Medline]
    45. Jang M, Johnson CM, D'Eramo-Melkus G, Vorderstrasse AA. Participation of racial and ethnic minorities in technology-based interventions to self-manage type 2 diabetes: a scoping review. J Transcult Nurs. May 28, 2018;29(3):292-307. [CrossRef] [Medline]
    46. Ricci-Cabello I, Ruiz-Pérez I, Rojas-García A, Pastor G, Rodríguez-Barranco M, Gonçalves DC. Characteristics and effectiveness of diabetes self-management educational programs targeted to racial/ethnic minority groups: a systematic review, meta-analysis and meta-regression. BMC Endocr Disord. Jul 19, 2014;14(1):60. [FREE Full text] [CrossRef] [Medline]
    47. Creamer J, Attridge M, Ramsden M, Cannings-John R, Hawthorne K. Culturally appropriate health education for Type 2 diabetes in ethnic minority groups: an updated Cochrane Review of randomized controlled trials. Diabet Med. Feb 07, 2016;33(2):169-183. [CrossRef] [Medline]
    48. Joo JY. Effectiveness of culturally tailored diabetes interventions for Asian immigrants to the United States: a systematic review. Diabetes Educ. May 14, 2014;40(5):605-615. [CrossRef] [Medline]
    49. Gibbons MC. A historical overview of health disparities and the potential of eHealth solutions. J Med Internet Res. Oct 04, 2005;7(5):e50. [FREE Full text] [CrossRef] [Medline]
    50. Latulippe K, Hamel C, Giroux D. Social health inequalities and eHealth: a literature review with qualitative synthesis of theoretical and empirical studies. J Med Internet Res. Apr 27, 2017;19(4):e136. [FREE Full text] [CrossRef] [Medline]
    51. Kontos E, Blake KD, Chou WS, Prestin A. Predictors of eHealth usage: insights on the digital divide from the Health Information National Trends Survey 2012. J Med Internet Res. Jul 16, 2014;16(7):e172. [FREE Full text] [CrossRef] [Medline]
    52. Gomersall T, Madill A, Summers LK. A metasynthesis of the self-management of type 2 diabetes. Qual Health Res. Jun 23, 2011;21(6):853-871. [CrossRef] [Medline]
    53. Mathew R, Gucciardi E, De Melo M, Barata P. Self-management experiences among men and women with type 2 diabetes mellitus: a qualitative analysis. BMC Fam Pract. Dec 19, 2012;13(1):122. [FREE Full text] [CrossRef] [Medline]
    54. Chiu CJ, Wray LA. Gender differences in functional limitations in adults living with type 2 diabetes: biobehavioral and psychosocial mediators. Ann Behav Med. Feb 2011;41(1):71-82. [CrossRef] [Medline]
    55. Legato MJ, Gelzer A, Goland R, Ebner SA, Rajan S, Villagra V, et al. Writing Group for The Partnership for Gender-Specific Medicine. Gender-specific care of the patient with diabetes: review and recommendations. Gend Med. Jun 2006;3(2):131-158. [CrossRef] [Medline]

    ‎
    DESMOND: Diabetes Education and Self-Management for Ongoing and Newly Diagnosed
    DSMES: diabetes self-management education and support
    FITT: frequency, intensity, time, and type
    myDESMOND: digital-based Diabetes Education and Self-Management for Ongoing and Newly Diagnosed
    T2D: type 2 diabetes

    Edited by K Mizokami-Stout; submitted 09.12.22; peer-reviewed by B Kaveladze, A Middelweerd, Y Jeem; comments to author 20.02.23; revised version received 06.04.23; accepted 24.05.23; published 21.07.23.

    Copyright

    ©Mary M Barker, Radhika Chauhan, Melanie J Davies, Christopher Brough, Alison Northern, Bernie Stribling, Sally Schreder, Kamlesh Khunti, Michelle Hadjiconstantinou. Originally published in JMIR Diabetes (https://diabetes.jmir.org), 21.07.2023.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Diabetes, is properly cited. The complete bibliographic information, a link to the original publication on https://diabetes.jmir.org/, as well as this copyright and license information must be included.