Evidence map›Paper›PMID 34860675›Full record

Trial reportJournal of medical Internet research2021

Assessing the Implementation and Effectiveness of the Electronic Patient-Reported Outcome Tool for Older Adults With Complex Care Needs: Mixed Methods Study.

Carolyn Steele Gray, Edward Chau, Farah Tahsin, Sarah Harvey, Mayura Loganathan, Brian McKinstry, Stewart W Mercer, Jason Xin Nie, Ted E Palen, Tim Ramsay and 3 more

Registry-linked trialOpen access · goldAbstract readRandomized Controlled TrialPragmatic Clinical Trial
In one paragraph

Trial report in Journal of medical Internet research, 2021. The graph could read no effect estimate from its abstract, so it casts no vote on the map. It is linked to trial NCT02917954 (Full Evaluation, Scale and Spread), which is not on this map. Cited by 15 papers, 2 of them syntheses that pooled it.

0numbers the graph read from it
0cells of the map it votes in
15citing papers in PubMed, 2 pooled it
2.6field-weighted citation impact, top 10% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

NCT02917954 nacompletednot on this map

Full Evaluation, Scale and Spread: Pragmatic Trial of the HSPRN-Bridgepoint Electronic Patient Reported Outcome (ePRO) Mobile Application to Support the Needs of Persons With Complex Chronic Disease and Disability

TypeinterventionalSponsorMount Sinai Hospital, CanadaRan2017 to 2019Enrolled45ConditionsChronic Disease, Quality of LifeArmsePRO Tool Intervention
3 · Its place in the literature

Who cites it

15 citing papers in PubMed, 2 syntheses or guidelines pooled it, 25 citations in OpenAlex.

  1. Pooled it
  2. Pooled it
  3. Pharmacy (Basel, Switzerland) · 2026
    Article
  4. Patient Portal Use Among Older Adults: A Systematic Review and Meta-Analysis.Proceedings. IEEE International Conference on Healthcare Informatics · 2026
    Article
  5. Article
  6. Article
  7. Article
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Review
  15. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

13 authors at 6 institutions in 3 countries.

Carolyn Steele GrayBridgepoint Collaboratory for Research and Innovation, Lunenfeld-Tanenebaum Research Institute, Sinai Health, Toronto, ON, Canada.ORCID 0000-0002-2146-0001
Edward ChauInstitute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.ORCID 0000-0002-5207-500X
Farah TahsinInstitute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.ORCID 0000-0001-9077-7670
Sarah HarveyLogibec Inc (QoC Health Inc), Toronto, ON, Canada.ORCID 0000-0002-6310-5315
Mayura LoganathanRay D Wolfe Department of Family Medicine, Mount Sinai Hospital, Toronto, ON, Canada.ORCID 0000-0001-9754-4175
Brian McKinstryUsher Institute, College of Medicine and Veterinary Medicine, University of Edinburgh, Edinburgh, United Kingdom.ORCID 0000-0001-9581-0468
Stewart W MercerUsher Institute, College of Medicine and Veterinary Medicine, University of Edinburgh, Edinburgh, United Kingdom.ORCID 0000-0002-1703-3664
Jason Xin NieInstitute for Better Health, Trillium Health Partners, Mississauga, ON, Canada.ORCID 0000-0002-9359-3938
Ted E PalenInstitute for Health Research, Kaiser Permanente Colorado, Denver, CO, United States.ORCID 0000-0003-1609-2280
Tim RamsayClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada.ORCID 0000-0001-8478-8170
Kednapa ThavornClinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada.ORCID 0000-0003-4738-8447
Ross UpshurBridgepoint Collaboratory for Research and Innovation, Lunenfeld-Tanenebaum Research Institute, Sinai Health, Toronto, ON, Canada.ORCID 0000-0003-1128-0557
Walter P WodchisInstitute of Health Policy, Management and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, ON, Canada.ORCID 0000-0003-2494-7031
University of Toronto · CAUniversity of Edinburgh · GBUniversity of Ottawa · CAKaiser Permanente · USMount Sinai Hospital · CATrillium Health Centre · CA

Funding

CIHR FN-143559
6 · The paper itself

Abstract

backgroundGoal-oriented care is being adopted to deliver person-centered primary care to older adults with multimorbidity and complex care needs. Although this model holds promise, its implementation remains a challenge. Digital health solutions may enable processes to improve adoption; however, they require evaluation to determine feasibility and impact.

objectiveThis study aims to evaluate the implementation and effectiveness of the electronic Patient-Reported Outcome (ePRO) mobile app and portal system, designed to enable goal-oriented care delivery in interprofessional primary care practices. The research questions driving this study are as follows: Does ePRO improve quality of life and self-management in older adults with complex needs? What mechanisms are likely driving observed outcomes?

methodsA multimethod, pragmatic randomized controlled trial using a stepped-wedge design and ethnographic case studies was conducted over a 15-month period in 6 comprehensive primary care practices across Ontario with a target enrollment of 176 patients. The 6 practices were randomized into either early (3-month control period; 12-month intervention) or late (6-month control period; 9-month intervention) groups. The primary outcome measure of interest was the Assessment of Quality of Life-4D (AQoL-4D). Data were collected at baseline and at 3 monthly intervals for the duration of the trial. Ethnographic data included observations and interviews with patients and providers at the midpoint and end of the intervention. Outcome data were analyzed using linear models conducted at the individual level, accounting for cluster effects at the practice level, and ethnographic data were analyzed using qualitative description and framework analysis methods.

resultsRecruitment challenges resulted in fewer sites and participants than expected; of the 176 target, only 142 (80.6%) patients were identified as eligible to participate because of lower-than-expected provider participation and fewer-than-expected patients willing to participate or perceived as ready to engage in goal-setting. Of the 142 patients approached, 45 (32%) participated. Patients set a variety of goals related to self-management, mental health, social health, and overall well-being. Owing to underpowering, the impact of ePRO on quality of life could not be definitively assessed; however, the intervention group, ePRO plus usual care (mean 15.28, SD 18.60) demonstrated a nonsignificant decrease in quality of life (t

conclusionsThis trial experienced many unexpected and significant implementation challenges related to recruitment and engagement. Future studies could be improved through better alignment of the research methods and intervention to the complex and diverse clinical settings, dynamic goal-oriented care process, and readiness of provider and patient participants.

trial registrationClinicalTrials.gov NCT02917954; https://clinicaltrials.gov/ct2/show/NCT02917954.

Indexed as

Quality of LifeResearch DesignAgedAnthropology, CulturalElectronicsHumansPatient Reported Outcome MeasureseHealthgoal-oriented caremobile phoneolder adultspragmatic trialprimary carequality of lifeself-management

Identifiers

PMID34860675
PMCPMC8726765
OpenAlexW3199799339

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.