Evidence map›Paper›PMID 42395478›Full record

ArticlebioRxiv : the preprint server for biology2026

Benchmarking cell type annotation in spatial transcriptomics: resolving cellular hierarchies, biological fidelity, and dynamic cell states.

Yuling Zhu, Yunfei Hu, Manfei Bella Xie, Haoran Qin, Zuzanna J Szul, Derek M Young, Weiman Yuan, Qimeng Wang, Yichen Henry Liu, Wenjun Shen and 2 more

Abstract readPreprint
In one paragraph

Article in bioRxiv : the preprint server for biology, 2026. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Not yet cited in PubMed.

0numbers the graph read from it
0cells of the map it votes in
0citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

0 citing papers in PubMed.

No citing paper in PubMed yet.

4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

12 authors.

Yuling ZhuDepartment of Biomedical Engineering, Vanderbilt University, Nashville, USA.
Yunfei HuDepartment of Computer Science, Vanderbilt University, Nashville, USA.
Manfei Bella XieDepartment of Biomedical Engineering, Vanderbilt University, Nashville, USA.
Haoran QinDepartment of Computer Science, Vanderbilt University, Nashville, USA.
Zuzanna J SzulDepartment of Computer Science, Vanderbilt University, Nashville, USA.
Derek M YoungDepartment of Biomedical Engineering, Vanderbilt University, Nashville, USA.
Weiman YuanDepartment of Biomedical Engineering, Vanderbilt University, Nashville, USA.
Qimeng WangDepartment of Pharmacology, Vanderbilt University, Nashville, USA.
Yichen Henry LiuDepartment of Computer Science, Vanderbilt University, Nashville, USA.
Wenjun ShenDepartment of Bioinformatics, Shantou University Medical College, Shantou, China.
Shan MeltzerDepartment of Pharmacology, Vanderbilt University, Nashville, USA.
Xin Maizie ZhouDepartment of Biomedical Engineering, Vanderbilt University, Nashville, USA.

Funding

Detecting structural variants in a large population of samples through high-throughput sequencing dataR35GM146960 · NIGMS · VANDERBILT UNIVERSITY · PI Xin Maizie Zhou · 2022 to 2026
$2.1M
NIGMS NIH HHS R35 GM146960
6 · The paper itself

Abstract

Spatial transcriptomics enables the quantification of gene expression within its native tissue context, providing unprecedented insight into tissue architecture, cellular ecosystems, and local cell-cell interactions at regional and single-cell resolution. Accurate cell type annotation is a critical prerequisite for interpreting these data and is often the first and most essential step in downstream analysis. Despite rapid advances in computational methods, cell type annotation remains challenging and frequently requires extensive expert-driven manual curation based on marker-gene expression, spatial context, and prior biological knowledge. While early approaches relied primarily on transcriptional similarity, newer methods increasingly incorporate spatial information, histological features, and multimodal data to improve annotation accuracy. Nevertheless, reliable annotation remains difficult when biological interpretation requires fine-grained subtype resolution, particularly for platforms with limited gene panels, tissues undergoing dynamic cellular state transitions, and studies in which reference and query datasets differ substantially in biological context or technical modality. Here, we present a systematic benchmark of 20 state-of-the-art cell type annotation methods across four spatial transcriptomics datasets spanning diverse technologies, experimental conditions, cell numbers, and gene panel sizes. Importantly, all benchmark datasets contain expert-curated cell type labels, including well-resolved cell populations and subtype annotations, providing high-quality biological ground truth for evaluation. The benchmark encompasses both reference-based and reference-free methods representing a broad range of computational frameworks. Performance was assessed using conventional classification metrics, including accuracy and F1-based measures, together with structure-aware metrics that evaluate both cell-level annotation accuracy and preservation of higher-order biological organization. Across datasets, annotation performance varied substantially according to tissue context, reference-query similarity, and annotation granularity. Fine-grained subtype annotation and recovery of rare cell populations remained challenging for many methods, particularly in datasets capturing injury, repair, developmental, and regenerative processes characterized by continuous cellular state transitions. Notably, high classification accuracy did not necessarily correspond to preservation of global cellular relationships or biologically coherent downstream pathway and gene-set enrichment analyses. Overall, scANVI, Seurat, and TACCO consistently ranked among the top-performing methods, although their relative advantages were context dependent. Together, our results provide a comprehensive assessment of current annotation strategies for spatial transcriptomics and offer practical guidance for selecting methods that best align with specific biological questions, dataset characteristics, and analytical priorities.

Indexed as

BenchmarkingCell type annotationClusteringLabel transferSpatial Transcriptomics

Identifiers

PMID42395478
PMCPMC13320944

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.