Evidence map›Paper›PMID 40819047›Full record

SynthesisBMC health services research2025

A systematic review of methods used for COVID-19 telehealth systems evaluation: lessons from past experiences for future use.

Aynaz Nourani, Seyed Mohsen Hosseini, Mozhgan Rassoulian, Laaya Joudivand, Tahereh Samimi, Bahlol Rahimi

Abstract readSystematic Review
In one paragraph

Synthesis in BMC health services research, 2025. The graph could read no effect estimate from its abstract, so it casts no vote on the map. Cited by 2 papers.

0numbers the graph read from it
0cells of the map it votes in
2citing papers in PubMed
–field-weighted citation impact
1 · What the graph read from it

What it found

Each row is one number read from the abstract, on the scale the paper reported it, with its interval. Left of the dashed line favours the treatment, right favours the comparator. Under each row is the sentence it came from. New to these charts? A ten-minute tutorial.

The abstract states no effect estimate the extractor could read, or names no intervention and outcome on the map, so this paper lights no cell and moves no belief. It is still indexed, cited and linked below.

2 · The registry

The trial behind it

Trials whose registry record cites this paper, or whose number appears in the abstract. A trial that started after this paper was published is citing it as background, not reporting it.

Neither the registry nor the abstract names a trial number. If this is a trial report, that itself is worth knowing.

3 · Its place in the literature

Who cites it

2 citing papers in PubMed.

  1. Article
  2. Article
4 · The record

Corrections and comments

PubMed lists nothing against this paper. Absence here is not a guarantee, only a check that was made.

5 · Who and what money

Authors and funding

6 authors.

Aynaz NouraniHealth and Biomedical Informatics Research Center, Urmia University of Medical Sciences, Urmia, Iran.
Seyed Mohsen HosseiniStudent Research Committee, Urmia University of Medical Sciences, Urmia, Iran.
Mozhgan RassoulianStudent Research Committee, Urmia University of Medical Sciences, Urmia, Iran.
Laaya JoudivandStudent Research Committee, Urmia University of Medical Sciences, Urmia, Iran.
Tahereh SamimiStudent Research Committee, Urmia University of Medical Sciences, Urmia, Iran.
Bahlol RahimiHealth and Biomedical Informatics Research Center, Urmia University of Medical Sciences, Urmia, Iran. Bahlol.rahimi@gmail.com.

Funding

No grant is acknowledged in the PubMed record.

6 · The paper itself

Abstract

backgroundDuring the COVID-19 emergency, telehealth systems were rapidly designed and integrated into healthcare delivery frameworks. The main question is whether these systems have been adequately evaluated and whether they are worthy of entering the health service cycle. Thus, this study's objective was to critically analyze the literature on remote health systems developed in response to COVID-19, focusing specifically on the evaluation approaches used.

methodsThe present investigation was executed in 2024, focusing on literature published over five years following the onset of the COVID-19 pandemic, extending until January 2024. Comprehensive searches were conducted across PubMed, Web of Science, and Scopus databases. A team of four researchers systematically evaluated and critically appraised relevant articles. Subsequently, the extracted data underwent rigorous analysis, comparison, and reporting to distill key findings.

resultsOverall, 26 articles met the inclusion criteria. The results indicated that the predominant objective of evaluations was to examine system performance (n = 8, 30.77%). Also, the methodology used in most evaluations was Qualitative and quantitative (non-integrated) (n = 18, 69.23%). In terms of evaluation period, most evaluations were summative (n = 12,46.15%), and the evaluator population in most systems was the healthcare team (n = 14, 53.85%).

conclusionsGiven the COVID-19 emergency conditions, evaluations of telehealth systems have not been conducted systematically and with adequate methods, tools, and populations. Therefore, appropriate systems should be designed and adequately evaluated for future epidemics. Ultimately, the proactive and comprehensive design and evaluation of telehealth systems will create infrastructures that can respond effectively and sustainably to future outbreaks.

Indexed as

COVID-19TelemedicineHumansPandemicsSARS-CoV-2COVID-19EvaluationInformation and communication technologyTelecareTelehealthTelemedicine

Identifiers

PMID40819047
PMCPMC12358072

What Socratic holds

Textmetadata
LicenceCC BY-NC-ND
Read underepoch 390

Registered trials

None linked

Read under generation 80e0d062 · epoch 390. Bibliography from PubMed, PubMed Central and OpenAlex; grants from NIH RePORTER; trial links from ClinicalTrials.gov; estimates, votes and beliefs from the Socratic graph.