Evidence for compromised data integrity in studies of liberal peri-operative inspired oxygen

P. S. Myles, J. B. Carlisle, B. Scarr

Research output: Contribution to journalArticleResearchpeer-review

Abstract

In 2016 the World Health Organization recommended intra-operative ventilation with 80% inspired oxygen to reduce surgical site infection rates, based upon a meta-analysis of 15 randomised controlled trials, of which two were by Mario Schietroma's research group. Five trials by this group have been retracted for duplication, plagiarism, statistical error and lack of ethical approval. We analysed 40 papers by this group: 24 randomised controlled trials (5064 participants) and 16 observational studies (1847 patients). There was evidence that data integrity was compromised in 38 out of the 40 analysed papers. The distribution of baseline characteristics in randomised controlled trials was unlikely, p = 1.5 × 10 −8 : continuous variables within trials were heterogeneous, p = 1.9 × 10 −9 , and categorical variables were homogeneous, p = 8.5 × 10 −20 . Effects of interventions varied less than expected between studies: for categorical variables, for instance postoperative wound infection, p < 1 × 10 −7 , and for continuous variables, for instance HLA-DR concentration, p = 0.00001. Of 184 calculable p values, for baseline variables or results, 179 (98%) were incorrect, ranging from three orders of magnitude too small to 10 orders of magnitude too large. Twenty-one graphs occurred 81 times in 23 out of 40 papers. Liberal peri-operative oxygen did not reduce surgical site infection in a meta-analysis of 20 trials that excluded seven trials by Mario Schietroma and colleagues (odds ratio (95%CI) 0.89 (0.73-1.08); p = 0.23). An update by the World Health Organization has now excluded trials of liberal oxygen by Schietroma's group, four of which have not been retracted. We conclude that Mario Schietroma's work should not inform practice until investigated.

Original languageEnglish
Pages (from-to)573–584
Number of pages12
JournalAnaesthesia
Volume74
Issue number5
DOIs
Publication statusPublished - 1 May 2019

Keywords

  • anaesthesia
  • data integrity
  • hyperoxia
  • peri-operative medicine
  • surgery
  • surgical site infection

Cite this

Myles, P. S. ; Carlisle, J. B. ; Scarr, B. / Evidence for compromised data integrity in studies of liberal peri-operative inspired oxygen. In: Anaesthesia. 2019 ; Vol. 74, No. 5. pp. 573–584.
@article{19f04cd69e0f4040b0635b92e96667aa,
title = "Evidence for compromised data integrity in studies of liberal peri-operative inspired oxygen",
abstract = "In 2016 the World Health Organization recommended intra-operative ventilation with 80{\%} inspired oxygen to reduce surgical site infection rates, based upon a meta-analysis of 15 randomised controlled trials, of which two were by Mario Schietroma's research group. Five trials by this group have been retracted for duplication, plagiarism, statistical error and lack of ethical approval. We analysed 40 papers by this group: 24 randomised controlled trials (5064 participants) and 16 observational studies (1847 patients). There was evidence that data integrity was compromised in 38 out of the 40 analysed papers. The distribution of baseline characteristics in randomised controlled trials was unlikely, p = 1.5 × 10 −8 : continuous variables within trials were heterogeneous, p = 1.9 × 10 −9 , and categorical variables were homogeneous, p = 8.5 × 10 −20 . Effects of interventions varied less than expected between studies: for categorical variables, for instance postoperative wound infection, p < 1 × 10 −7 , and for continuous variables, for instance HLA-DR concentration, p = 0.00001. Of 184 calculable p values, for baseline variables or results, 179 (98{\%}) were incorrect, ranging from three orders of magnitude too small to 10 orders of magnitude too large. Twenty-one graphs occurred 81 times in 23 out of 40 papers. Liberal peri-operative oxygen did not reduce surgical site infection in a meta-analysis of 20 trials that excluded seven trials by Mario Schietroma and colleagues (odds ratio (95{\%}CI) 0.89 (0.73-1.08); p = 0.23). An update by the World Health Organization has now excluded trials of liberal oxygen by Schietroma's group, four of which have not been retracted. We conclude that Mario Schietroma's work should not inform practice until investigated.",
keywords = "anaesthesia, data integrity, hyperoxia, peri-operative medicine, surgery, surgical site infection",
author = "Myles, {P. S.} and Carlisle, {J. B.} and B. Scarr",
year = "2019",
month = "5",
day = "1",
doi = "10.1111/anae.14584",
language = "English",
volume = "74",
pages = "573–584",
journal = "Anaesthesia",
issn = "0003-2409",
publisher = "Wiley-Blackwell",
number = "5",

}

Evidence for compromised data integrity in studies of liberal peri-operative inspired oxygen. / Myles, P. S.; Carlisle, J. B.; Scarr, B.

In: Anaesthesia, Vol. 74, No. 5, 01.05.2019, p. 573–584.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Evidence for compromised data integrity in studies of liberal peri-operative inspired oxygen

AU - Myles, P. S.

AU - Carlisle, J. B.

AU - Scarr, B.

PY - 2019/5/1

Y1 - 2019/5/1

N2 - In 2016 the World Health Organization recommended intra-operative ventilation with 80% inspired oxygen to reduce surgical site infection rates, based upon a meta-analysis of 15 randomised controlled trials, of which two were by Mario Schietroma's research group. Five trials by this group have been retracted for duplication, plagiarism, statistical error and lack of ethical approval. We analysed 40 papers by this group: 24 randomised controlled trials (5064 participants) and 16 observational studies (1847 patients). There was evidence that data integrity was compromised in 38 out of the 40 analysed papers. The distribution of baseline characteristics in randomised controlled trials was unlikely, p = 1.5 × 10 −8 : continuous variables within trials were heterogeneous, p = 1.9 × 10 −9 , and categorical variables were homogeneous, p = 8.5 × 10 −20 . Effects of interventions varied less than expected between studies: for categorical variables, for instance postoperative wound infection, p < 1 × 10 −7 , and for continuous variables, for instance HLA-DR concentration, p = 0.00001. Of 184 calculable p values, for baseline variables or results, 179 (98%) were incorrect, ranging from three orders of magnitude too small to 10 orders of magnitude too large. Twenty-one graphs occurred 81 times in 23 out of 40 papers. Liberal peri-operative oxygen did not reduce surgical site infection in a meta-analysis of 20 trials that excluded seven trials by Mario Schietroma and colleagues (odds ratio (95%CI) 0.89 (0.73-1.08); p = 0.23). An update by the World Health Organization has now excluded trials of liberal oxygen by Schietroma's group, four of which have not been retracted. We conclude that Mario Schietroma's work should not inform practice until investigated.

AB - In 2016 the World Health Organization recommended intra-operative ventilation with 80% inspired oxygen to reduce surgical site infection rates, based upon a meta-analysis of 15 randomised controlled trials, of which two were by Mario Schietroma's research group. Five trials by this group have been retracted for duplication, plagiarism, statistical error and lack of ethical approval. We analysed 40 papers by this group: 24 randomised controlled trials (5064 participants) and 16 observational studies (1847 patients). There was evidence that data integrity was compromised in 38 out of the 40 analysed papers. The distribution of baseline characteristics in randomised controlled trials was unlikely, p = 1.5 × 10 −8 : continuous variables within trials were heterogeneous, p = 1.9 × 10 −9 , and categorical variables were homogeneous, p = 8.5 × 10 −20 . Effects of interventions varied less than expected between studies: for categorical variables, for instance postoperative wound infection, p < 1 × 10 −7 , and for continuous variables, for instance HLA-DR concentration, p = 0.00001. Of 184 calculable p values, for baseline variables or results, 179 (98%) were incorrect, ranging from three orders of magnitude too small to 10 orders of magnitude too large. Twenty-one graphs occurred 81 times in 23 out of 40 papers. Liberal peri-operative oxygen did not reduce surgical site infection in a meta-analysis of 20 trials that excluded seven trials by Mario Schietroma and colleagues (odds ratio (95%CI) 0.89 (0.73-1.08); p = 0.23). An update by the World Health Organization has now excluded trials of liberal oxygen by Schietroma's group, four of which have not been retracted. We conclude that Mario Schietroma's work should not inform practice until investigated.

KW - anaesthesia

KW - data integrity

KW - hyperoxia

KW - peri-operative medicine

KW - surgery

KW - surgical site infection

UR - http://www.scopus.com/inward/record.url?scp=85061892571&partnerID=8YFLogxK

U2 - 10.1111/anae.14584

DO - 10.1111/anae.14584

M3 - Article

VL - 74

SP - 573

EP - 584

JO - Anaesthesia

JF - Anaesthesia

SN - 0003-2409

IS - 5

ER -