Empirical evidence of study design biases in nutrition randomised controlled trials: a meta-epidemiological study.

backgroundInstruments to critically appraise randomised controlled trials (RCTs) are based on evidence from meta-epidemiological studies. We aim to conduct a meta-epidemiological study on the average bias associated with reported methodological trial characteristics such as random sequence generation, allocation concealment, blinding, incomplete outcome data, selective reporting, and compliance of RCTs in nutrition research.

methodsWe searched the Cochrane Database of Systematic Reviews, for systematic reviews of RCTs, published between 01 January 2010 and 31 December 2019. We combined the estimates of the average bias (e.g. ratio of risk ratios [RRR] or differences in standardised mean differences) in meta-analyses using the random-effects model. Subgroup analyses were conducted to investigate the potential differences among the RCTs with low versus high/unclear risk of bias with respect to the different types of interventions (e.g. micronutrients, fatty acids, dietary approach), outcomes (e.g. mortality, pregnancy outcomes), and type of outcome (objective, subjective). Heterogeneity was assessed through I

resultsWe included 27 Cochrane nutrition reviews with 77 meta-analyses (n = 927 RCTs). The available evidence suggests that intervention effect estimates may not be exaggerated in RCTs with high/unclear risk of bias (versus low) judgement for sequence generation (RRR 0.97, 95% CI 0.93 to 1.02; I

conclusionsOn average, most characteristics of nutrition RCTs may not exaggerate intervention effect estimates, but the average bias appears to be greatest in trials of subjective outcomes. Replication of this study is suggested in this field to keep this conclusion updated.