Evidence map›Paper›PMID 40927341›Full record

ReviewFrontiers in psychology2025

Psychology's Questionable Research Fundamentals (QRFs): Key problems in quantitative psychology and psychological measurement beyond Questionable Research Practices (QRPs).

Jana Uher, Jan Ketil Arnulf, Paul T Barrett, Moritz Heene, Jörg-Henrik Heine, Jack Martin, Lucas B Mazur, Marek McGann, Robert J Mislevy, Craig Speelman and 2 more

Abstract readReview
In one paragraph

Review in Frontiers in psychology, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 7 papers.

0numbers the graph read from it
0cells of the map it votes in
7citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

7 citing papers in PubMed.

  1. Article
  2. Article
  3. Article
  4. Article
  5. Review
  6. Article
  7. Article
4 · The record

Corrections and comments

5 · Who and what money

Authors and funding

12 authors.

Jana UherSchool of Human Sciences, University of Greenwich, London, United Kingdom.
Jan Ketil ArnulfBI Norwegian Business School, Oslo, Norway.
Paul T BarrettAdvanced Projects R&D Ltd, Auckland, New Zealand.
Moritz HeeneLudwig-Maximilians-Universität München, Munich, Germany.
Jörg-Henrik HeineUniversity of the Bundeswehr Munich, Neubiberg, Germany.
Jack MartinDepartment of Psychology, Simon Fraser University, Burnaby, BC, Canada.
Lucas B MazurJagiellonian University, Kraków, Poland.
Marek McGannMary Immaculate College, Limerick, Ireland.
Robert J MislevyUniversity of Maryland, Baltimore, MD, United States.
Craig SpeelmanEdith Cowan University, Joondalup, WA, Australia.
Aaro ToomelaTallinn University, Tallinn, Estonia.
Ron WeberFaculty of Information Technology, Monash University, Melbourne, VIC, Australia.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

Psychology's crises (e.g., replicability, generalisability) are currently believed to derive from Questionable Research Practices (QRPs), thus scientific misconduct. Just improving the same practices, however, cannot tackle the root causes of psychology's problems-the Questionable Research Fundamentals (QRFs) of many of its theories, concepts, approaches and methods (e.g., psychometrics), which are grounded in their insufficiently elaborated underlying philosophies of science. Key problems of psychological measurement are critically explored from independent perspectives involving various fields of expertise and lines of research that are well established but still hardly known in mainstream psychology. This comprehensive multi-perspectival review presents diverse philosophies of science that are used in quantitative psychology and pinpoints four major areas of development. (1) Psychology must advance its general philosophy of science (esp. ontology, epistemology, methodology) and elaborate coherent paradigms. (2) Quantitative psychologists must elaborate the philosophy-of-science fundamentals of specific theories, approaches and methods that are appropriate for enabling quantitative research and for implementing genuine analogues of measurement in psychology, considering its study phenomena's peculiarities (e.g., higher-order complexity, non-ergodicity). (3) Psychologists must heed the epistemic necessity to logically distinguish between the study phenomena (e.g., participants' beliefs) and the means used for their exploration (e.g., descriptions of beliefs in items) to avoid confusing ontological with epistemological concepts-psychologists' cardinal error. This requires an increased awareness of the complexities of human language (e.g., inbuilt semantics) and of the intricacies that these entail for scientific inquiry. (4) Epistemically justified strategies for generalising findings across unique individuals must be established using case-by-case based (not sample-based) nomothetic approaches, implemented through individual-/person-oriented (not variable-oriented) analyses. This is crucial to avoid the mathematical-statistical errors that are inherent to quantitative psychologists' common sample-to-individual inferences (e.g., ergodic fallacy) as well as to enable causal analyses of possibly underlying structures and processes. Concluding, just minimising scientific misconduct, as currently believed, and exploiting language-based algorithms (NLP, LLMs) without considering the intricacies of human language will only perpetuate psychology's crises. Rethinking psychology as a science and advancing its philosophy-of-science theories as necessary fundamentals to integrate its fragmented empirical database and lines of research requires open, honest and self-critical debates that prioritise scientific integrity over expediency.

Indexed as

epistemologylanguage modelsmeasurementmethodologyontologypsychometricsquantitative psychologysemantics

Identifiers

PMID40927341
PMCPMC12414940

What Socratic holds

Textmetadata
LicenceCC BY
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.