External validation of severity scoring systems for acute renal failure using a multinational database

Shigehiko Uchino, Rinaldo Bellomo, Hiroshi Morimatsu, Stanislao Morgera, Miet Schetz, Ian Tan, Catherine Bouman, Ettiene Macedo, Noel Gibney, Ashita Tolwani, Gordon S. Doig, Heleen Oudemans Van Straaten, Claudio Ronco, John A. Kellum

Research output: Contribution to journalArticleResearchpeer-review

91 Citations (Scopus)

Abstract

Objective: Several different severity scoring systems specific to acute renal failure have been proposed. However, most validation studies of these scoring systems were conducted in a single center or in a small number of centers, often the same ones used for their development. Therefore, if is not known whether such severity scoring systems may be widely applied. Design: Prospective clinical investigation. Setting: Intensive care units. Patients: One thousand seven hundred and forty-two intensive care unit patients with acute renal failure who were either treated with renal replacement therapy or fulfilled predefined criteria. Interventions: Demographic and clinical information and outcomes were measured. Measurements and Main Results: Scores for four acute renal failure-specific scoring systems and two general scoring systems (Simplified Acute Physiology Score II and Sequential Organ Failure Assessment) were calculated, and their discrimination and calibration were tested with receiver operating characteristic curves and Hosmer-Lemeshow goodness-of fit-tests. For the receiver operating characteristic curves, blood lactate levels were also used as a reference. All scores had an area under the receiver operating characteristic curve <0.7 (Mehta 0.670, Liano 0.698, Chertow 0.610, Paganini 0.643, Simplified Acute Physiology Score II 0.645, Sequential Organ Failure Assessment 0.675, lactate 0.639). For scores that can calculate predicted mortality, the Hosmer-Lemeshow goodness-of-fit test showed poor calibration. Conclusions: None of the scoring systems tested had a high level of discrimination or calibration to predict mortality for patients with acute renal failure when tested in a broad cohort of patients from multiple countries. A large, multiple-center database might be needed to improve the discrimination and calibration of acute renal failure scoring system.

Original languageEnglish
Pages (from-to)1961-1967
Number of pages7
JournalCritical Care Medicine
Volume33
Issue number9
DOIs
Publication statusPublished - 1 Jan 2005
Externally publishedYes

Keywords

  • Acute kidney failure
  • Critical illness
  • Hemodialysis
  • Hemofiltration
  • Renal replacement therapy
  • Severity score

Cite this

Uchino, Shigehiko ; Bellomo, Rinaldo ; Morimatsu, Hiroshi ; Morgera, Stanislao ; Schetz, Miet ; Tan, Ian ; Bouman, Catherine ; Macedo, Ettiene ; Gibney, Noel ; Tolwani, Ashita ; Doig, Gordon S. ; Van Straaten, Heleen Oudemans ; Ronco, Claudio ; Kellum, John A. / External validation of severity scoring systems for acute renal failure using a multinational database. In: Critical Care Medicine. 2005 ; Vol. 33, No. 9. pp. 1961-1967.
@article{78d9b871c16b432aadc5001c378a1da8,
title = "External validation of severity scoring systems for acute renal failure using a multinational database",
abstract = "Objective: Several different severity scoring systems specific to acute renal failure have been proposed. However, most validation studies of these scoring systems were conducted in a single center or in a small number of centers, often the same ones used for their development. Therefore, if is not known whether such severity scoring systems may be widely applied. Design: Prospective clinical investigation. Setting: Intensive care units. Patients: One thousand seven hundred and forty-two intensive care unit patients with acute renal failure who were either treated with renal replacement therapy or fulfilled predefined criteria. Interventions: Demographic and clinical information and outcomes were measured. Measurements and Main Results: Scores for four acute renal failure-specific scoring systems and two general scoring systems (Simplified Acute Physiology Score II and Sequential Organ Failure Assessment) were calculated, and their discrimination and calibration were tested with receiver operating characteristic curves and Hosmer-Lemeshow goodness-of fit-tests. For the receiver operating characteristic curves, blood lactate levels were also used as a reference. All scores had an area under the receiver operating characteristic curve <0.7 (Mehta 0.670, Liano 0.698, Chertow 0.610, Paganini 0.643, Simplified Acute Physiology Score II 0.645, Sequential Organ Failure Assessment 0.675, lactate 0.639). For scores that can calculate predicted mortality, the Hosmer-Lemeshow goodness-of-fit test showed poor calibration. Conclusions: None of the scoring systems tested had a high level of discrimination or calibration to predict mortality for patients with acute renal failure when tested in a broad cohort of patients from multiple countries. A large, multiple-center database might be needed to improve the discrimination and calibration of acute renal failure scoring system.",
keywords = "Acute kidney failure, Critical illness, Hemodialysis, Hemofiltration, Renal replacement therapy, Severity score",
author = "Shigehiko Uchino and Rinaldo Bellomo and Hiroshi Morimatsu and Stanislao Morgera and Miet Schetz and Ian Tan and Catherine Bouman and Ettiene Macedo and Noel Gibney and Ashita Tolwani and Doig, {Gordon S.} and {Van Straaten}, {Heleen Oudemans} and Claudio Ronco and Kellum, {John A.}",
year = "2005",
month = "1",
day = "1",
doi = "10.1097/01.CCM.0000172279.66229.07",
language = "English",
volume = "33",
pages = "1961--1967",
journal = "Critical Care Medicine",
issn = "0090-3493",
publisher = "Lippincott Williams & Wilkins",
number = "9",

}

Uchino, S, Bellomo, R, Morimatsu, H, Morgera, S, Schetz, M, Tan, I, Bouman, C, Macedo, E, Gibney, N, Tolwani, A, Doig, GS, Van Straaten, HO, Ronco, C & Kellum, JA 2005, 'External validation of severity scoring systems for acute renal failure using a multinational database', Critical Care Medicine, vol. 33, no. 9, pp. 1961-1967. https://doi.org/10.1097/01.CCM.0000172279.66229.07

External validation of severity scoring systems for acute renal failure using a multinational database. / Uchino, Shigehiko; Bellomo, Rinaldo; Morimatsu, Hiroshi; Morgera, Stanislao; Schetz, Miet; Tan, Ian; Bouman, Catherine; Macedo, Ettiene; Gibney, Noel; Tolwani, Ashita; Doig, Gordon S.; Van Straaten, Heleen Oudemans; Ronco, Claudio; Kellum, John A.

In: Critical Care Medicine, Vol. 33, No. 9, 01.01.2005, p. 1961-1967.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - External validation of severity scoring systems for acute renal failure using a multinational database

AU - Uchino, Shigehiko

AU - Bellomo, Rinaldo

AU - Morimatsu, Hiroshi

AU - Morgera, Stanislao

AU - Schetz, Miet

AU - Tan, Ian

AU - Bouman, Catherine

AU - Macedo, Ettiene

AU - Gibney, Noel

AU - Tolwani, Ashita

AU - Doig, Gordon S.

AU - Van Straaten, Heleen Oudemans

AU - Ronco, Claudio

AU - Kellum, John A.

PY - 2005/1/1

Y1 - 2005/1/1

N2 - Objective: Several different severity scoring systems specific to acute renal failure have been proposed. However, most validation studies of these scoring systems were conducted in a single center or in a small number of centers, often the same ones used for their development. Therefore, if is not known whether such severity scoring systems may be widely applied. Design: Prospective clinical investigation. Setting: Intensive care units. Patients: One thousand seven hundred and forty-two intensive care unit patients with acute renal failure who were either treated with renal replacement therapy or fulfilled predefined criteria. Interventions: Demographic and clinical information and outcomes were measured. Measurements and Main Results: Scores for four acute renal failure-specific scoring systems and two general scoring systems (Simplified Acute Physiology Score II and Sequential Organ Failure Assessment) were calculated, and their discrimination and calibration were tested with receiver operating characteristic curves and Hosmer-Lemeshow goodness-of fit-tests. For the receiver operating characteristic curves, blood lactate levels were also used as a reference. All scores had an area under the receiver operating characteristic curve <0.7 (Mehta 0.670, Liano 0.698, Chertow 0.610, Paganini 0.643, Simplified Acute Physiology Score II 0.645, Sequential Organ Failure Assessment 0.675, lactate 0.639). For scores that can calculate predicted mortality, the Hosmer-Lemeshow goodness-of-fit test showed poor calibration. Conclusions: None of the scoring systems tested had a high level of discrimination or calibration to predict mortality for patients with acute renal failure when tested in a broad cohort of patients from multiple countries. A large, multiple-center database might be needed to improve the discrimination and calibration of acute renal failure scoring system.

AB - Objective: Several different severity scoring systems specific to acute renal failure have been proposed. However, most validation studies of these scoring systems were conducted in a single center or in a small number of centers, often the same ones used for their development. Therefore, if is not known whether such severity scoring systems may be widely applied. Design: Prospective clinical investigation. Setting: Intensive care units. Patients: One thousand seven hundred and forty-two intensive care unit patients with acute renal failure who were either treated with renal replacement therapy or fulfilled predefined criteria. Interventions: Demographic and clinical information and outcomes were measured. Measurements and Main Results: Scores for four acute renal failure-specific scoring systems and two general scoring systems (Simplified Acute Physiology Score II and Sequential Organ Failure Assessment) were calculated, and their discrimination and calibration were tested with receiver operating characteristic curves and Hosmer-Lemeshow goodness-of fit-tests. For the receiver operating characteristic curves, blood lactate levels were also used as a reference. All scores had an area under the receiver operating characteristic curve <0.7 (Mehta 0.670, Liano 0.698, Chertow 0.610, Paganini 0.643, Simplified Acute Physiology Score II 0.645, Sequential Organ Failure Assessment 0.675, lactate 0.639). For scores that can calculate predicted mortality, the Hosmer-Lemeshow goodness-of-fit test showed poor calibration. Conclusions: None of the scoring systems tested had a high level of discrimination or calibration to predict mortality for patients with acute renal failure when tested in a broad cohort of patients from multiple countries. A large, multiple-center database might be needed to improve the discrimination and calibration of acute renal failure scoring system.

KW - Acute kidney failure

KW - Critical illness

KW - Hemodialysis

KW - Hemofiltration

KW - Renal replacement therapy

KW - Severity score

UR - http://www.scopus.com/inward/record.url?scp=24944480953&partnerID=8YFLogxK

U2 - 10.1097/01.CCM.0000172279.66229.07

DO - 10.1097/01.CCM.0000172279.66229.07

M3 - Article

AN - SCOPUS:24944480953

VL - 33

SP - 1961

EP - 1967

JO - Critical Care Medicine

JF - Critical Care Medicine

SN - 0090-3493

IS - 9

ER -