Evidence map›Paper›PMID 26267331›Full record

ArticlePloS one2015

Collective intelligence meets medical decision-making: the collective outperforms the best radiologist.

Max Wolf, Jens Krause, Patricia A Carney, Andy Bogart, Ralf H J M Kurvers

Abstract read
In one paragraph

Article in PloS one, 2015. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 56 papers.

0numbers the graph read from it
0cells of the map it votes in
56citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

56 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Empowering minorities and everyone in participatory budgeting: an agent-based modelling perspective.Philosophical transactions. Series A, Mathematical, physical, and engineering sciences · 2024
    Article
  7. AI-enhanced collective intelligence.Patterns (New York, N.Y.) · 2024
    Review
  8. Humans flexibly integrate social information despite interindividual differences in reward.Proceedings of the National Academy of Sciences of the United States of America · 2024
    Article
  9. Article
  10. Article
  11. Collective Intelligence Increases Diagnostic Accuracy in a General Practice Setting.Medical decision making : an international journal of the Society for Medical Decision Making · 2024
    Article
  12. Article
  13. Article
  14. Article
  15. Article
  16. Article
  17. Automating hybrid collective intelligence in open-ended medical diagnostics.Proceedings of the National Academy of Sciences of the United States of America · 2023
    Article
  18. Experimental evidence for structured information-sharing networks reducing medical errors.Proceedings of the National Academy of Sciences of the United States of America · 2023
    Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

5 authors.

Max WolfLeibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587, Berlin, Germany.
Jens KrauseLeibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587, Berlin, Germany; Faculty of Life Sciences, Humboldt-University of Berlin, Berlin, Germany.
Patricia A CarneyDepartments of Family Medicine and Pubic Health & Preventive Medicine, Knight Cancer Institute, Oregon Health & Science University, 3181 S.W. Sam Jackson Park Road, Portland, Oregon, United States of America.
Andy BogartRAND Corporation, 1776 Main Street, Santa Monica, CA, 90407-2138, United States of America.
Ralf H J M KurversLeibniz Institute of Freshwater Ecology and Inland Fisheries, Müggelseedamm 310, 12587, Berlin, Germany.

Funding

Statistical Coordinating Center for the Breast Cancer Surveillance ConsortiumU01CA086076 · NCI · KAISER FOUNDATION HEALTH PLAN OF WASHINGTON · PI MIGLIORETTI, DIANA L · 2000 to 2011
$8.5M
IMPROVING THE QUALITY OF MAMMOGRAPHIC INTERPRETATIONU01CA063731 · NCI · KAISER FOUNDATION HEALTH PLAN OF WASHINGTON · PI BUIST, DIANA SM · 1994 to 2011
$6.7M
VERMONT BREAST CANCER SURVEILLANCE SYSTEMU01CA070013 · NCI · UNIVERSITY OF VERMONT &ST AGRIC COLLEGE · PI GELLER, BERTA M · 1995 to 2011
$6.7M
UTILITY AND OUTCOMES FROM MAMMOGRAPHY IN NORTH CAROLINAU01CA070040 · NCI · UNIV OF NORTH CAROLINA CHAPEL HILL · PI YANKASKAS, BONNIE C · 1995 to 2011
$6.4M
San Francisco Mammography Registry-A Research SourceU01CA063740 · NCI · UNIVERSITY OF CALIFORNIA, SAN FRANCISCO · PI KERLIKOWSKE, KARLA M · 1994 to 2011
$6.2M
STRATEGIC STUDIES IN BREAST CANCER SURVEILLANCEU01CA086082 · NCI · DARTMOUTH COLLEGE · PI ONEGA, TRACY · 2000 to 2011
$4.9M
NEW MEXICO MAMMOGRAPHY PROJECTU01CA069976 · NCI · UNIVERSITY OF NEW MEXICO · PI ROSENBERG, ROBERT D · 1995 to 2005
$2.7M
NCI NIH HHS HHSN261201100031CNCI NIH HHS U01 CA063731NCI NIH HHS U01 CA063740NCI NIH HHS U01 CA069976NCI NIH HHS U01 CA070013NCI NIH HHS U01 CA070040NCI NIH HHS U01 CA086076NCI NIH HHS U01 CA086082NCI NIH HHS U01CA63731NCI NIH HHS U01CA63740NCI NIH HHS U01CA69976NCI NIH HHS U01CA70013NCI NIH HHS U01CA70040NCI NIH HHS U01CA86076NCI NIH HHS U01CA86082
6 · The paper itself

Abstract

While collective intelligence (CI) is a powerful approach to increase decision accuracy, few attempts have been made to unlock its potential in medical decision-making. Here we investigated the performance of three well-known collective intelligence rules ("majority", "quorum", and "weighted quorum") when applied to mammography screening. For any particular mammogram, these rules aggregate the independent assessments of multiple radiologists into a single decision (recall the patient for additional workup or not). We found that, compared to single radiologists, any of these CI-rules both increases true positives (i.e., recalls of patients with cancer) and decreases false positives (i.e., recalls of patients without cancer), thereby overcoming one of the fundamental limitations to decision accuracy that individual radiologists face. Importantly, we find that all CI-rules systematically outperform even the best-performing individual radiologist in the respective group. Our findings demonstrate that CI can be employed to improve mammography screening; similarly, CI may have the potential to improve medical decision-making in a much wider range of contexts, including many areas of diagnostic imaging and, more generally, diagnostic decisions that are based on the subjective interpretation of evidence.

Indexed as

Clinical Decision-MakingRadiologyBreast NeoplasmsFemaleHumansMaleMammographyWorkforce

Identifiers

PMID26267331
PMCPMC4534443

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.