Evidence map›Paper›PMID 38335015›Full record

ArticleJMIR formative research2024

The Impact of Intervention Design on User Engagement in Digital Therapeutics Research: Factorial Experiment With a Mixed Methods Study.

Hyerim Lee, Eung Ho Choi, Jung U Shin, Tae-Gyun Kim, Jooyoung Oh, Bokyoung Shin, Jung Yeon Sim, Jaeyong Shin, Meelim Kim

Abstract read
In one paragraph

Article in JMIR formative research, 2024. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 6 papers.

0numbers the graph read from it
0cells of the map it votes in
6citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

6 citing papers in PubMed.

  1. Article
  2. Review
  3. Article
  4. Review
  5. Article
  6. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors.

Hyerim LeeDepartment of Psychology, College of Liberal Arts, Yonsei University, Seoul, Republic of Korea.ORCID https://orcid.org/0009-0006-2972-5058
Eung Ho ChoiDepartment of Dermatology, Yonsei University Wonju College of Medicine, Wonju, Republic of Korea.ORCID https://orcid.org/0000-0002-0148-5594
Jung U ShinDepartment of Dermatology, CHA Bundang Medical Center, CHA University, Seongnam, Republic of Korea.ORCID https://orcid.org/0000-0001-5259-6879
Tae-Gyun KimDepartment of Dermatology, Severance Hospital, Cutaneous Biology Research Institute, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-2116-4579
Jooyoung OhDepartment of Psychiatry, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0001-6721-399X
Bokyoung ShinDepartment of Integrative Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0001-5307-3199
Jung Yeon SimDepartment of Medical Device Engineering and Management, Yonsei University Graduate School, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-5876-1211
Jaeyong Shin *Department of Preventive Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-2955-6382
Meelim Kim *Department of Preventive Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea.ORCID https://orcid.org/0000-0002-0507-1727

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundUser engagement is crucial for digital therapeutics (DTx) effectiveness; due to variations in the conceptualization of engagement and intervention design, assessment and retention of engagement remain challenging.

objectiveWe investigated the influence of the perceived acceptability of experimental intervention components and satisfaction with core intervention components in DTx on user engagement, while also identifying potential barriers and facilitators to user engagement.

methodsWe conducted a mixed methods study with a 2 × 2 factorial design, involving 12 outpatients with atopic dermatitis. Participants were randomized into 4 experimental groups based on push notification ("basic" or "advanced") and human coach ("on" or "off") experimental intervention components. All participants engaged in self-monitoring and learning courses as core intervention components within an app-based intervention over 8 weeks. Data were collected through in-app behavioral data, physician- and self-reported questionnaires, and semistructured interviews assessed at baseline, 4 weeks, and 8 weeks. Descriptive statistics and thematic analysis were used to evaluate user engagement, perceived acceptability of experimental intervention components (ie, push notification and human coach), satisfaction with core intervention components (ie, self-monitoring and learning courses), and intervention effectiveness through clinical outcomes.

resultsThe primary outcome indicated that group 4, provided with "advanced-level push notifications" and a "human coach," showed higher completion rates for self-monitoring forms and learning courses compared to the predetermined threshold of clinical significance. Qualitative data analysis revealed three key themes: (1) perceived acceptability of the experimental intervention components, (2) satisfaction with the core intervention components, and (3) suggestions for improvement in the overall intervention program. Regarding clinical outcomes, the Perceived Stress Scale and Dermatology Life Quality Index scores presented the highest improvement in group 4.

conclusionsThese findings will help refine the intervention and inform the design of a subsequent randomized trial to test its effectiveness. Furthermore, this design may serve as a model for broadly examining and optimizing overall engagement in DTx and for future investigation into the complex relationship between engagement and clinical outcomes.

trial registrationClinical Research Information Service KCT0007675; http://tinyurl.com/2m8rjrmv.

Indexed as

atopicdermatitisexperimental designmobile healthpatient engagementresearch methodology

Identifiers

PMID38335015
PMCPMC10891489

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.