Evidence map›Paper›PMID 35717401›Full record

ArticleScientific data2022

REFLACX, a dataset of reports and eye-tracking data for localization of abnormalities in chest x-rays.

Ricardo Bigolin Lanfredi, Mingyuan Zhang, William F Auffermann, Jessica Chan, Phuong-Anh T Duong, Vivek Srikumar, Trafton Drew, Joyce D Schroeder, Tolga Tasdizen

Open access · goldAbstract readDataset
In one paragraph

Article in Scientific data, 2022. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 21 papers.

0numbers the graph read from it
0cells of the map it votes in
21citing papers in PubMed
6.5field-weighted citation impact, top 3% of its field
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

21 citing papers in PubMed, 47 citations in OpenAlex.

  1. Article
  2. Article
  3. Article
  4. [Visual prior-guided masked image modeling enhances chest X-ray diagnostic efficacy].Nan fang yi ke da xue xue bao = Journal of Southern Medical University · 2026
    Article
  5. ArXiv · 2026
    Article
  6. Article
  7. Review
  8. Article
  9. Article
  10. Article
  11. Article
  12. Article
  13. Article
  14. Article
  15. The Use of Machine Learning in Eye Tracking Studies in Medical Imaging: A Review.IEEE journal of biomedical and health informatics · 2024
    Review
  16. Article
  17. Review
  18. Article
  19. Article
  20. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

9 authors at 1 institution in 1 country.

Ricardo Bigolin LanfrediScientific Computing and Imaging Institute, University of Utah, 72 S Central Campus Drive, Room 3750, Salt Lake City, UT, 84112, USA. ricbl@sci.utah.edu.ORCID 0000-0001-8740-5796
Mingyuan ZhangDepartment of Population Health Sciences, University of Utah, 295 Chipeta Way, Williams Building, Room 1N410, Salt Lake City, UT, 84108, USA.ORCID 0000-0002-9837-4187
William F AuffermannDepartment of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A071, Salt Lake City, UT, 84132, USA.
Jessica ChanDepartment of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A071, Salt Lake City, UT, 84132, USA.ORCID 0000-0001-9104-118X
Phuong-Anh T DuongDepartment of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A071, Salt Lake City, UT, 84132, USA.
Vivek SrikumarSchool of Computing, University of Utah, Room 3190, 50 Central Campus Dr., Salt Lake City, UT, 84112, USA.ORCID 0000-0003-0419-6568
Trafton DrewDepartment of Psychology, University of Utah, 380 S 1530 E Beh S 502, Salt Lake City, UT, 84112, USA.
Joyce D SchroederDepartment of Radiology and Imaging Sciences, University of Utah, 30 North 1900 East #1A071, Salt Lake City, UT, 84132, USA.ORCID 0000-0002-7451-4886
Tolga TasdizenScientific Computing and Imaging Institute, University of Utah, 72 S Central Campus Drive, Room 3750, Salt Lake City, UT, 84112, USA.ORCID 0000-0001-6574-0366
University of Utah · US

Funding

A scalable non-intrusive image annotation method using eye tracking for training deep learning models in radiologyR21EB028367 · NIBIB · UNIVERSITY OF UTAH · PI TASDIZEN, TOLGA · 2020 to 2021
$396k
NIBIB NIH HHS R21 EB028367
6 · The paper itself

Abstract

Deep learning has shown recent success in classifying anomalies in chest x-rays, but datasets are still small compared to natural image datasets. Supervision of abnormality localization has been shown to improve trained models, partially compensating for dataset sizes. However, explicitly labeling these anomalies requires an expert and is very time-consuming. We propose a potentially scalable method for collecting implicit localization data using an eye tracker to capture gaze locations and a microphone to capture a dictation of a report, imitating the setup of a reading room. The resulting REFLACX (Reports and Eye-Tracking Data for Localization of Abnormalities in Chest X-rays) dataset was labeled across five radiologists and contains 3,032 synchronized sets of eye-tracking data and timestamped report transcriptions for 2,616 chest x-rays from the MIMIC-CXR dataset. We also provide auxiliary annotations, including bounding boxes around lungs and heart and validation labels consisting of ellipses localizing abnormalities and image-level labels. Furthermore, a small subset of the data contains readings from all radiologists, allowing for the calculation of inter-rater scores.

Indexed as

Eye-Tracking TechnologyRadiography, ThoracicDeep LearningHumansRadiographyX-Rays

Identifiers

PMID35717401
PMCPMC9206650
OpenAlexW3204755840

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.