Abstract
Observer variability in local radiological reading is a major concern in large-scale multi-center traumatic brain injury (TBI) studies. A central review process has been advocated to minimize this variability. The aim of this study is to compare central with local reading of TBI imaging datasets and to investigate the added value of central review. A total of 2050 admission computed tomography (CT) scans from subjects enrolled in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study were analyzed for seven main CT characteristics. Kappa statistics were used to calculate agreement between central and local evaluations and a center-specific analysis was performed. The McNemar test was used to detect whether discordances were significant. Central interobserver and intraobserver agreement was calculated in a subset of patients. Good agreement was found between central and local assessment for the presence or absence of structural pathology (CT+, CT-, j = 0.73) and most CT characteristics (j = 0.62 to 0.71), except for traumatic axonal injury lesions (j = 0.37). Despite good kappa values, discordances were significant in four of seven CT characteristics (i.e., midline shift, contusion, traumatic subarachnoid hemorrhage, and cisternal compression; p = 0.0005). Central reviewers showed substantial to excellent interobserver and intra-observer agreement (j = 0.73 to j = 0.96), contrasted by considerable variability in local radiological reading. Compared with local evaluation, a central review process offers a more consistent radiological reading of acute CT characteristics in TBI. It generates reliable, reproducible data and should be recommended for use in multi-center TBI studies.
Original language | English |
---|---|
Pages (from-to) | 1080-1092 |
Number of pages | 13 |
Journal | Journal of Neurotrauma |
Volume | 36 |
Issue number | 7 |
DOIs | |
Publication status | Published - Apr 2019 |
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver
}
In: Journal of Neurotrauma, Vol. 36, No. 7, 04.2019, p. 1080-1092.
Research output: Contribution to journal › Article › Research › peer-review
TY - JOUR
T1 - Central versus local radiological reading of acute computed tomography characteristics in multi-center traumatic brain injury research
AU - Vande Vyvere, Thijs
AU - Wilms, Guido
AU - Claes, Lene
AU - Leon, Francisco Martin
AU - Nieboer, Daan
AU - Verheyden, Jan
AU - Hauwe, Luc Van Den
AU - Pullens, Pim
AU - Maas, Andrew I.R.
AU - Parizel, Paul M.
AU - Cecilia, Ackerlund
AU - Hadie, Adams
AU - Vanni, Agnoletti
AU - Judith, Allanson
AU - Krisztina, Amrein
AU - Norberto, Andaluz
AU - Nada, Andelic
AU - Lasse, Andreassen
AU - Azasevac, Antun
AU - Audny, Anke
AU - Anna, Antoni
AU - Hilko, Ardon
AU - Gérard, Audibert
AU - Kaspars, Auslands
AU - Philippe, Azouvi
AU - Maria Luisa, Azzolini
AU - Camelia, Baciu
AU - Rafael, Badenes
AU - Ronald, Bartels
AU - Pál, Barzó
AU - Ursula, Bauerfeind
AU - Romuald, Beauvais
AU - Ronny, Beer
AU - Francisco Javier, Belda
AU - Bo-Michael, Bellander
AU - Antonio, Belli
AU - Rémy, Bellier
AU - Habib, Benali
AU - Thierry, Benard
AU - Maurizio, Berardino
AU - Luigi, Beretta
AU - Christopher, Beynon
AU - Federico, Bilotta
AU - Harald, Binder
AU - Erta, Biqiri
AU - Morten, Blaabjerg
AU - Hugo, Den Boogert
AU - Pierre, Bouzat
AU - Bragge, Peter
AU - Alexandra, Brazinova
AU - Vibeke, Brinck
AU - Brooker, Joanne
AU - Camilla, Brorsson
AU - Andras, Buki
AU - Monika, Bullinger
AU - Emiliana, Calappi
AU - Maria Rosa, Calvi
AU - Peter, Cameron
AU - Guillermo, Carbayo Lozano
AU - Carbonara, Marco
AU - Elsa, Carise
AU - Carpenter, K.
AU - Castanõ-León, Ana M.
AU - Francesco, Causin
AU - Giorgio, Chevallard
AU - Arturo, Chieregato
AU - Giuseppe, Citerio
AU - Maryse, Cnossen
AU - Mark, Coburn
AU - Jonathan, Coles
AU - Lizzie, Coles Kemp
AU - Johnny, Collett
AU - Cooper, Jamie D.
AU - Marta, Correia
AU - Amra, Covic
AU - Nicola, Curry
AU - Endre, Czeiter
AU - Marek, Czosnyka
AU - Claire, Dahyot Fizelier
AU - François, Damas
AU - Pierre, Damas
AU - Helen, Dawes
AU - Véronique, De Keyser
AU - Francesco, Della Corte
AU - Bart, Depreitere
AU - Godard Cw, De Ruiter
AU - Dula, Dilvesi
AU - Shenghao, Ding
AU - Diederik, Dippel
AU - Abhishek, Dixit
AU - Donoghue, Emma
AU - Jens, Dreier
AU - Guy-Loup, Dulière
AU - George, Eapen
AU - Heiko, Engemann
AU - Ari, Ercole
AU - Patrick, Esser
AU - Erzsébet, Ezer
AU - Martin, Fabricius
AU - Valery, Feigin L.
AU - Junfeng, Feng
AU - Kelly, Foks
AU - Francesca, Fossi
AU - Gilles, Francony
AU - Ulderico, Freo
AU - Shirin, Frisvold
AU - Alex, Furmanov
AU - Pablo, Gagliardo
AU - Damien, Galanaud
AU - Gantner, Dashiell
AU - Guoyi, Gao
AU - Karin, Geleijns
AU - Pradeep, George
AU - Alexandre, Ghuysen
AU - Lelde, Giga
AU - Benoit, Giraud
AU - Ben, Glocker
AU - Jagos, Golubovic
AU - Pedro, Gomez A.
AU - Francesca, Grossi
AU - Gruen, Russell L.
AU - Deepak, Gupta
AU - Juanita, Haagsma A.
AU - Iain, Haitsma
AU - Jed, Hartings A.
AU - Raimund, Helbok
AU - Eirik, Helseth
AU - Daniel, Hertle
AU - Astrid, Hoedemaekers
AU - Stefan, Hoefer
AU - Lindsay, Horton
AU - Jilske, Huijben
AU - Peter, Hutchinson J.
AU - Kristine, Haberg Asta
AU - Bram, Jacobs
AU - Stefan, Jankowski
AU - Jarrett, Mike
AU - Bojan, Jelaca
AU - Jiang, Ji Yao
AU - Kelly, Jones
AU - Konstantinos, Kamnitsas
AU - Mladen, Karan
AU - Kaukonen, Katila Ari
AU - Kerforne, Maija
AU - Kivisaari, Thomas
AU - Kolias, Riku
AU - Kolias, Angelos G.
AU - Ba-Lint, Kolumban
AU - Erwin, Kompanje
AU - Ksenija, Kolundzija
AU - Daniel, Kondziella
AU - Lars-Owe, Koskinen
AU - Noémi, Kovács
AU - Alfonso, Lagares
AU - Linda, Lanyon
AU - Steven, Laureys
AU - Fiona, Lecky
AU - Christian, Ledig
AU - Rolf, Lefering
AU - Valerie, Legrand
AU - Jin, Lei
AU - Leon, Levi
AU - Roger, Lightfoot
AU - Hester, Lingsma
AU - Dirk, Loeckx
AU - Angels, Lozano
AU - Stephen, MacDonald
AU - Marc, Maegele
AU - Marek, Majdan
AU - Sebastian, Major
AU - Alex, Manara
AU - Geoffrey, Manley
AU - Didier, Martin
AU - Costanza, Martino
AU - Armando, Maruenda
AU - Hugues, Maréchal
AU - Alessandro, Masala
AU - Julia, Mattern
AU - Charles, McFadyen
AU - Catherine, McMahon
AU - Béla, Melegh
AU - David, Menon
AU - Tomas, Menovsky
AU - Cristina, Morganti Kossmann
AU - Davide, Mulazzi
AU - Visakh, Muraleedharan
AU - Murray, Lynnette
AU - Holger, Mühlan
AU - Nandesh, Nair
AU - Ancuta, Negru
AU - David, Nelson
AU - Virginia, Newcombe
AU - Daan, Nieboer
AU - Quentin, Noirhomme
AU - József, Nyirádi
AU - Mauro, Oddo
AU - Annemarie, Oldenbeuving
AU - Matej, Oresic
AU - Fabrizio, Ortolano
AU - Aarno, Palotie
AU - Adriana, Patruno
AU - Jean-François, Payen
AU - Natascha, Perera
AU - Vincent, Perlbarg
AU - Paolo, Persona
AU - Wilco, Peul
AU - Anna, Piippo Karjalainen
AU - Sébastien, Pili Floury
AU - Matti, Pirinen
AU - Horia, Ples
AU - Maria Antonia, Poca
AU - Suzanne, Polinder
AU - Inigo, Pomposo
AU - Jussi, Posti
AU - Louis, Puybasset
AU - Andreea, Radoi
AU - Arminas, Ragauskas
AU - Rahul, Raj
AU - Malinka, Rambadagalla
AU - Ruben, Real
AU - Veronika, Rehorcíková
AU - Jonathan, Rhodes
AU - Samuli, Ripatti
AU - Saulius, Rocka
AU - Cecilie, Roe
AU - Olav, Roise
AU - Gerwin, Roks
AU - Jonathan, Rosand
AU - Rosenfeld, Jeffrey
AU - Christina, Rosenlund
AU - Guy, Rosenthal
AU - Rolf, Rossaint
AU - Sandra, Rossi
AU - Daniel, Rueckert
AU - Martin, Rusnák
AU - Marco, Sacchi
AU - Barbara, Sahakian
AU - Juan, Sahuquillo
AU - Oliver, Sakowitz
AU - Francesca, Sala
AU - Renan, Sanchez Porras
AU - Janos, Sandor
AU - Edgar, Santos
AU - Luminita, Sasu
AU - Davide, Savo
AU - Nadin, Schäffer
AU - Inger, Schipper
AU - Barbara, Schlößer
AU - Silke, Schmidt
AU - Herbert, Schoechl
AU - the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) Investigators and Participants
N1 - Funding Information: Data used in preparation of this manuscript were obtained in the context of CENTER-TBI, a large collaborative project supported by the European Commission 7th Framework program (602150). Funding of additional elements has been provided by the Hannelore Kohl Foundation (Germany) and by the non-profit organization One Mind. Funding Information: 3Department of Anesthesia and Intensive Care, M. Bufalini Hospital, Cesena, Italy. 4Department of Clinical Neurosciences, Addenbrooke’s Hospital and University of Cambridge, Cambridge, United Kingdom. 5János Szentágothai Research Centre, University of Pécs, Pécs, Hungary. 6University of Cincinnati, Cincinnati, Ohio. 7Division of Surgery and Clinical Neuroscience, Department of Physical Medicine and Rehabilitation, Oslo University Hospital and University of Oslo, Oslo, Norway. 8Department of Neurosurgery, University Hospital Northern Norway, Tromso, Norway. 9Department of Neurosurgery, Clinical Centre of Vojvodina, Faculty of Medicine, University of Novi Sad, Novi Sad, Serbia. 10Department of Physical Medicine and Rehabilitation, University Hospital, Northern Norway. 11Trauma Surgery, Medical University Vienna, Vienna, Austria. 12Department of Neurosurgery, Elisabeth-Tweesteden Zie-kenhuis, Tilburg, the Netherlands. 13Department of Anesthesiology and Intensive Care, University Hospital Nancy, Nancy, France. 14Riga Eastern Clinical University Hospital, Riga, Latvia. 15Raymond Poincare hospital, Assistance Publique—Hopitaux de Paris, Paris, France. 16Department of Anesthesiology and Intensive Care, San Raf-faele University Hospital, Milan, Italy. 17NeuroIntensive Care, Niguarda Hospital, Milan, Italy. 18Department Anesthesiology and Surgical-Trauma Intensive Care, Hospital Clinic Universitari de Valencia, Spain. 19Department of Neurosurgery, Radboud University Medical Center, Nijmegen, the Netherlands. 20Department of Neurosurgery, University of Szeged, Szeged, Hungary. 21Institute for Transfusion Medicine (ITM), Witten/Herdecke University, Cologne, Germany. 22International Projects Management, ARTTIC, Munchen, Germany. 23Department of Neurology, Neurological Intensive Care Unit, Medical University of Innsbruck, Innsbruck, Austria. 24Department of Neurosurgery and Anesthesia and intensive care medicine, Karolinska University Hospital, Stockholm, Sweden. 25NIHR Surgical Reconstruction and Microbiology Research Centre, Birmingham, U.K 26Intensive Care Unit, CHU Poitiers, Poitiers, France. 27Anesthesie-Réanimation, Assistance Publique—Hopitaux de Paris, Paris, France. 28Department of Anesthesia and ICU, AOU Città della Salute e della Scienza di Torino— Orthopedic and Trauma Center, Torino, Italy. 29Department of Neurosurgery, University Hospital Heidelberg, Heidelberg, Germany. 30Department of Neurology, Odense University Hospital, Odense, Denmark. 31Department of Anesthesiology and Intensive Care, University Hospital of Grenoble, Grenoble, France. 32BehaviourWorks Australia, Monash Sustainability Institute, Monash University, Victoria, Australia. 33Department of Public Health, Faculty of Health Sciences and Social Work, Trnava University, Trnava, Slovakia. 34Quesgen Systems Inc., Burlingame, California. 35Australian and New Zealand Intensive Care Research Centre, Department of Epidemiology and Preventive Medicine, School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia. 36Department of Neurosurgery, Umea University Hospital, Umea, Sweden. 37Department of Neurosurgery, University of Pecs and MTA-PTE Clinical Neuroscience MR Research Group and Janos Szen-tagothai Research Centre, University of Pecs, Hungarian Brain Research Program, Pecs, Hungary. 38Department of Medical Psychology, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany. 39Neuro ICU, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, Milan, Italy. 40ANZIC Research Centre, Monash University, Department of Epidemiology and Preventive Medicine, Melbourne, Vitoria, Australia. 41Department of Neurosurgery, Hospital of Cruces, Bilbao, Spain. 42Intensive Care and Department of Pediatric Surgery, Erasmus Medical Center, Sophia Children’s Hospital, Rotterdam, the Netherlands. 43Department of Neurosurgery, Hospital Universitario 12 de Octubre, Madrid, Spain. 44Department of Neuroscience, Azienda Ospedaliera Università di Padova, Padova, Italy 45NeuroIntensive Care, ASST di Monza, Monza, Italy. 46School of Medicine and Surgery, Università Milano Bicocca, Milano, Italy. 47Department of Public Health, Erasmus Medical Center-University Medical Center, Rotterdam, the Netherlands. 48Department of Anaesthesiology, University Hospital of Aachen, Aachen, Germany. 49Department of Anesthesia and Neurointensive Care, Cambridge University Hospital NHS Foundation Trust, Cambridge, United Kingdom. 50Movement Science Group, Oxford Institute of Nursing, Midwifery and Allied Health Research, Oxford Brookes University, Oxford, United Kingdom. 51School of Public Health and PM, Monash University and The Alfred Hospital, Melbourne, Victoria, Australia. 52Radiology/MRI department, MRC Cognition and Brain Sciences Unit, Cambridge, United Kingdom. 53Institute of Medical Psychology and Medical Sociology, Universitätsmedizin Göttingen, Göttingen, Germany. 54Oxford University Hospitals NHS Trust, Oxford, United Kingdom. 55Department of Neurosurgery, University of Pecs and MTA-PTE Clinical Neuroscience MR Research Group and Janos Szentagothai Research Centre, University of Pecs, Hungarian Brain Research Program (Grant No. KTIA 13 NAP-A-II/8), Pecs, Hungary. 56Brain Physics Lab, Division of Neurosurgery, Department of Clinical Neurosciences, University of Cambridge, Addenbrooke’s Hospital, Cambridge, United Kingdom. 57Intensive Care Unit, CHR Citadelle, Liège, Belgium. 58Intensive Care Unit, CHU, Liège, Belgium. 59Movement Science Group, Faculty of Health and Life Sciences, Oxford Brookes University, Oxford, United Kingdom. 60Department of Neurosurgery, Antwerp University Hospital and University of Antwerp, Edegem, Belgium. 61Department of Anesthesia and Intensive Care, Maggiore Della Carità Hospital, Novara, Italy. 62Department of Neurosurgery, University Hospitals Leuven, Leuven, Belgium. Publisher Copyright: © Mary Ann Liebert, Inc.
PY - 2019/4
Y1 - 2019/4
N2 - Observer variability in local radiological reading is a major concern in large-scale multi-center traumatic brain injury (TBI) studies. A central review process has been advocated to minimize this variability. The aim of this study is to compare central with local reading of TBI imaging datasets and to investigate the added value of central review. A total of 2050 admission computed tomography (CT) scans from subjects enrolled in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study were analyzed for seven main CT characteristics. Kappa statistics were used to calculate agreement between central and local evaluations and a center-specific analysis was performed. The McNemar test was used to detect whether discordances were significant. Central interobserver and intraobserver agreement was calculated in a subset of patients. Good agreement was found between central and local assessment for the presence or absence of structural pathology (CT+, CT-, j = 0.73) and most CT characteristics (j = 0.62 to 0.71), except for traumatic axonal injury lesions (j = 0.37). Despite good kappa values, discordances were significant in four of seven CT characteristics (i.e., midline shift, contusion, traumatic subarachnoid hemorrhage, and cisternal compression; p = 0.0005). Central reviewers showed substantial to excellent interobserver and intra-observer agreement (j = 0.73 to j = 0.96), contrasted by considerable variability in local radiological reading. Compared with local evaluation, a central review process offers a more consistent radiological reading of acute CT characteristics in TBI. It generates reliable, reproducible data and should be recommended for use in multi-center TBI studies.
AB - Observer variability in local radiological reading is a major concern in large-scale multi-center traumatic brain injury (TBI) studies. A central review process has been advocated to minimize this variability. The aim of this study is to compare central with local reading of TBI imaging datasets and to investigate the added value of central review. A total of 2050 admission computed tomography (CT) scans from subjects enrolled in the Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) study were analyzed for seven main CT characteristics. Kappa statistics were used to calculate agreement between central and local evaluations and a center-specific analysis was performed. The McNemar test was used to detect whether discordances were significant. Central interobserver and intraobserver agreement was calculated in a subset of patients. Good agreement was found between central and local assessment for the presence or absence of structural pathology (CT+, CT-, j = 0.73) and most CT characteristics (j = 0.62 to 0.71), except for traumatic axonal injury lesions (j = 0.37). Despite good kappa values, discordances were significant in four of seven CT characteristics (i.e., midline shift, contusion, traumatic subarachnoid hemorrhage, and cisternal compression; p = 0.0005). Central reviewers showed substantial to excellent interobserver and intra-observer agreement (j = 0.73 to j = 0.96), contrasted by considerable variability in local radiological reading. Compared with local evaluation, a central review process offers a more consistent radiological reading of acute CT characteristics in TBI. It generates reliable, reproducible data and should be recommended for use in multi-center TBI studies.
UR - http://www.scopus.com/inward/record.url?scp=85063277328&partnerID=8YFLogxK
U2 - 10.1089/neu.2018.6061
DO - 10.1089/neu.2018.6061
M3 - Article
C2 - 30259789
AN - SCOPUS:85063277328
SN - 0897-7151
VL - 36
SP - 1080
EP - 1092
JO - Journal of Neurotrauma
JF - Journal of Neurotrauma
IS - 7
ER -