Evidence mapPaperPMID 33242136Full record

ArticleJournal of patient-reported outcomes2020

Selecting, implementing and evaluating patient-reported outcome measures for routine clinical use in cancer: the Cancer Care Ontario approach.

Nicole Montgomery, Doris Howell, Zahra Ismail, Susan J Bartlett, Michael Brundage, Denise Bryant-Lukosius, Monika Krzyzanowska, Lesley Moody, Claire Snyder, Lisa Barbera and 1 more

Open access · goldAbstract read
In one paragraph

Article in Journal of patient-reported outcomes, 2020. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 28 papers.

0numbers the graph read from it
0cells of the map it votes in
28citing papers in PubMed
2.8field-weighted citation impact, top 7% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

28 citing papers in PubMed, 61 citations in OpenAlex.

  1. Article
  2. Article
  3. Observational
  4. PatientEClinicalMedicine · 2025
    Review
  5. Review
  6. Review
  7. Article
  8. Review
  9. Review
  10. Healthcare consumer acceptability of routine use of the EQ-5D-5L in clinical care: a cross-sectional survey.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2024
    Article
  11. Article
  12. Article
  13. How to make PROMs work: qualitative insights from leaders at United States hospitals with successful PROMs programs.Quality of life research : an international journal of quality of life aspects of treatment, care and rehabilitation · 2023
    Article
  14. Article
  15. Article
  16. Article
  17. Article
  18. Article
  19. Article
  20. Review
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

11 authors at 8 institutions in 2 countries.

Nicole MontgomeryCancer Care Ontario, Toronto, Canada.
Doris HowellUniversity Health Network, Toronto, Canada.
Zahra IsmailWomen's College Hospital, Toronto, Canada.
Susan J BartlettMcGill University, Montreal, Canada.
Michael BrundageCancer Centre of Southeastern Ontario, Kingston, Canada.
Denise Bryant-LukosiusMcMaster University, Hamilton, Canada.
Monika KrzyzanowskaCancer Care Ontario, Toronto, Canada.
Lesley MoodyUniversity Health Network, Toronto, Canada.
Claire SnyderJohns Hopkins University, Baltimore, USA.
Lisa BarberaTom Baker Cancer Centre, Calgary, Canada. Lisa.Barbera@albertahealthservices.ca.ORCID http://orcid.org/0000-0002-8302-4117
Cancer Care Ontario Patient Reported Outcome Advisory Committee
University Health Network · CAAlberta Cancer Foundation · CACancer Care Ontario · CAJohns Hopkins University · USMcGill University Health Centre · CAMcMaster University · CAQueen's University · CAWomen's College Hospital · CA

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundThe use of Patient-Reported Outcome Measures (PROMs) in routine clinical care can help ensure symptoms are identified, acknowledged and addressed. In 2007, the provincial cancer agency, Cancer Care Ontario, began to implement routine symptom screening with the Edmonton Symptom Assessment System (ESAS) for ambulatory cancer patients. Having had a decade of experience with ESAS, the program developed a strategic interest in implementing new and/or additional measures. This article describes the development of a streamlined PROM selection and implementation evaluation process with core considerations.

methodsDevelopment of the PROM selection and implementation evaluation process involved analysis of quantitative and qualitative data as well as consensus building through a multi-stakeholder workshop. Core PROM selection considerations were developed through a literature scan, review and refinement by a panel of methodological experts and patient advisors, and testing via a test case. Core PROM implementation evaluation considerations were developed through analysis of PROM evaluation frameworks, and review and refinement by a committee of provincial implementation leads.

resultsCore PROM selection considerations were identified under three overarching themes: symptom coverage, usability and psychometric properties. The symptom coverage category assesses each PROM to determine how well the PROM items address the most prevalent and burdensome symptoms in the target patient population. The usability category aims to assess each measure on characteristics key to successful implementation in the clinical setting. The psychometric properties category assesses each PROM to ensure the data collected is credible, meaningful and interpretable. A scoring system was developed to rate PROM performance by assigning a grade of "weak", "average" or "good" for each category. The process results in a summary matrix which illustrates the overall assessment of each PROM. Implementation evaluation considerations were identified under three overarching concepts: acceptability, outcomes, and sustainability. A consensus building exercise resulted in the further identification of patient, provider, and clinic specific indicators for each consideration.

conclusionTo address the need for a systematic, evidence-based approach to selection, implementation and evaluation of PROMs in the clinical setting, Cancer Care Ontario defined a process with embedded core considerations to facilitate decision-making and encourage standardization.

Indexed as

Clinical carePatient-reported outcome measuresRecommendationsRoutine careSymptom management

Identifiers

PMID33242136
PMCPMC7691418
OpenAlexW3109190131

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.