ABSTRACT

Background. Acute kidney injury (AKI) is common in critically ill patients and is associated with high morbidity and mortality. Early identification of high-risk patients provides an opportunity to develop strategies for prevention, early diagnosis and treatment of AKI.

Methods. We undertook this multicenter prospective cohort study to develop and validate a risk score for predicting AKI in patients admitted to an intensive care unit (ICU). Patients were screened for predictor variables within 48 h of ICU admission. Baseline and acute risk factors were recorded at the time of screening and serum creatinine was measured daily for up to 7 days. A risk score model for AKI was developed with multivariate regression analysis combining baseline and acute risk factors in the development cohort (573 patients) and the model was further evaluated on a test cohort (144 patients). Validation was performed on an independent prospective cohort of 1300 patients. The discriminative ability of the risk model was assessed by the area under the receiver operating characteristic curve (AUROC) and model calibration was evaluated by Hosmer–Lemeshow statistic. AKI was defined by the Kidney Disease: Improving Global Outcomes criteria (absolute change of 0.3 mg/dL or relative change of 50% from baseline serum creatinine in 48 h to 7 days, respectively).

Results. AKI developed in 754 (37.2%) patients. In the multivariate model, chronic kidney disease, chronic liver disease, congestive heart failure, hypertension, atherosclerotic coronary vascular disease, pH ≤ 7.30, nephrotoxin exposure, sepsis, mechanical ventilation and anemia were identified as independent predictors of AKI and the AUROC for the model in the test cohort was 0.79 [95% confidence interval (CI) 0.70–0.89]. On the external validation cohort, the AUROC value was 0.81 (95% CI 0.78–0.83). The risk model demonstrated good calibration in both cohorts. Positive and negative predictive values for the optimal cutoff value of ≥ 5 points in test and validation cohorts were 22.7 and 96.1% and 31.8 and 95.4%, respectively.

Conclusions. A risk score model integrating chronic comorbidities and acute events at ICU admission can identify patients at high risk to develop AKI. This risk assessment tool could help clinicians to stratify patients for primary prevention, surveillance and early therapeutic intervention to improve care and outcomes of ICU patients.

INTRODUCTION

Acute kidney injury (AKI) is a life-threatening and disabling complication of critical illnesses encountered in 25–50% of intensive care unit (ICU) admissions [1–3]. Several studies have established the relationship between small increments in serum creatinine (SCr) and adverse events and suggested that accurate identification of individuals at risk and early recognition of AKI episodes could offer opportunities for diagnostic, preventive or even therapeutic interventions [4–8]. Over the past decade, several risk stratification scores have been developed to predict AKI in specific clinical settings (e.g. after cardiac surgery, contrast exposure, hospital acquired, general surgery and high-risk surgery) [9–22]. There are also few models examining the clinical risk factors for the development of AKI in the ICU population [23–30]. However, these risk assessment tools were limited to single centers, small sample sizes and with no internal or external validation.

Recent studies have focused on the use of biomarkers of kidney injury to identify patients at increased risk but mostly have not integrated these with clinical risk models [31–38]. Basu et al. [39] recently showed that combining clinical data with plasma biomarkers can improve the accuracy of risk prediction of severe AKI in pediatric ICU patients. We believe that there is a need to develop improved clinical risk prediction tools for AKI in the adult ICU setting to provide clinicians actionable information for prevention, early diagnosis and targeted interventions. We hypothesized that a risk stratification score based on routinely available clinical variables would accurately predict the risk for AKI in an ICU population.

MATERIALS AND METHODS

This is a prospective observational study conducted at two large, tertiary care university hospitals. The Institutional Review Board committees at the University of California, San Diego (UCSD), San Diego, CA and Mayo Clinic, Rochester, MN, USA approved the study. Informed consent was obtained from each participant in the UCSD cohort and was waived for patients who provided research authorization in the Mayo cohort. We excluded patients without research authorization in the Mayo cohort.

Study population

In this multicenter study, adult patients were enrolled in two independent cohorts, UCSD and Mayo Clinic. The UCSD cohort included 717 of the 1117 patients admitted to the surgical intensive care unit (SICU) and medical intensive care unit (MICU) at the UCSD Hillcrest Medical Center between 1 June 2006 and 31 December 2008. Patients were screened for a prospective observational study on the use of biomarkers to predict AKI in critically ill patients (Figure 1A). A total of 59 patients with CKD stage 5, 52 patients on hemodialysis (HD) and 289 patients with known AKI according to the Kidney Disease: Improving Global Outcomes (KDIGO) SCr criteria at the time of screening were excluded from the analysis (Figure 1B) [38]. The Mayo cohort consisted of 1300 of 1486 Olmsted County residents who were admitted to multidisciplinary ICUs at the Mayo Clinic Hospital between 1 January and 31 December 2010. Patients were screened as part of a prospective observational study to determine the incidence of AKI in Olmsted County. In total, 13 patients with no research authorization, 62 patients with CKD stage 5 and 111 patients with known AKI were excluded from the analysis (Figure 1B).
(A) Screening and enrollement procedures and (B) Flow chart of Study.
FIGURE 1

(A) Screening and enrollement procedures and (B) Flow chart of Study.

Data collection and outcomes

We recorded therapeutic regimens and demographic, anthropometric, clinical and laboratory data from the electronic health records at the time of screening, i.e. within 48 h of ICU admission (Figure 1A). Each institution’s local laboratory measured SCr values using the Jaffe alkaline picrate method. The primary outcome variable measured was the development of AKI, defined as an absolute increase in SCr level of ≥0.3 mg/dL within 48 h or ≥50% above the reference value within 7 days after study enrollment [40]. We considered the mean of all SCr measurements 7–365 days prior to admission as the reference SCr. We used SCr measured at ICU admission as an imputation value in patients with missing baseline SCr [24% (n = 172) in the UCSD cohort and 30% (n = 384) in the Mayo cohort]. Secondary outcome variables were lengths of stay (LOSs) in the ICU and hospital, need for renal replacement therapy (RRT) and ICU mortality.

Risk factor profiling

Risk factors were classified as chronic comorbidities [advanced age (>70 years), diabetes mellitus (DM), atherosclerotic coronary vascular disease (ASCVD), congestive heart failure (CHF), CKD, chronic liver disease, hypertension (HTN), obesity, cancer, drug abuse, cerebrovascular accident, human immunodeficiency virus or chronic lung disease] and acute events [i.e. hypotension (mean arterial pressure < 70 mmHg or use of any vasopressor)], sepsis, high-risk surgery, (cardiac surgery, including valvular or coronary artery bypass grafting, aortic surgery and hepatobiliary surgery), mechanical ventilation (MV), traumatic brain injury, rhabdomyolysis, anemia (hemoglobin < 9 mg/dL or hematocrit < 27%), hyperglycemia (blood glucose >120 mg/dL, excluding DM), elevated bilirubin (total bilirubin > 2 mg/dL, excluding chronic liver disease), decreased albumin (serum albumin < 3 mg/dL), low blood pH ( ≤ 7.30) or nephrotoxin exposure (Supplementary data, Table E1). The chronic and acute risk factors were evaluated at the time of screening, i.e. within 48 h of ICU admission. The chronic comorbidities were collected from the electronic health records problem list. The risk factors were chosen based on previous studies (Supplementary data, Table E1) [30, 41–59]. Continuous predictor variables were converted into categorical ones based on optimal clinical cutoff points used in the AKI literature. We have chosen categorization, as it is easier to interpret and also the simplicity of reporting results. In total, 25 binary predictor variables and 4 continuous predictor variables [age, first SCr at ICU admission, body surface area (BSA) and body mass index (BMI)] were selected for model development. Risk factor data were missing in <5% of patients and were imputed in none.

Statistical analysis

Continuous variables were expressed as the mean (SD) or median and interquartile range and analyzed by unpaired t-test or the Wilcoxon rank-sum test, as appropriate. Categorical variables are expressed as absolute (n) and relative (%) frequency and analyzed by chi-square test or Fisher’s exact test, as appropriate.

Risk model development and validation

Using the development cohort at UCSD, the regression coefficient-based models were constructed using a 5-fold cross-validation procedure [60, 61]. Of the 717 patients from the UCSD cohort included in the analysis, we randomly split the data into five mutually exclusive partitions of nearly equal size (n ∼ 144) with a stratified sampling to keep the ratio between AKI outcome positives and negatives identical across five partitions. In a preprocessing step, categorical variables were prescreened using chi-square test (P < 0.1). Stepwise forward elimination was used for variable selection in the multiple logistic regression. Selected predictor variables were checked for collinearity and interactions. For round 1, we held the partition 1 as a test set, trained a model on the other four partitions and calculated two performance measures, the area under the receiver operating characteristic (AUROC) value and the Hosmer–Lemeshow (HL) P-value, on partition 1, unused in the model training. For round 2, we held the partition 2 as a test set, trained a model on the other four partitions and calculated two performance metrics, the AUROC and HL P-value, on partition 2, unused in the model training. We repeated this five times to have five candidate models with a corresponding five pairs of AUROC values and HL P-values. Of these, the second candidate model of the five (Model 2), which had the largest AUROC and passing HL test, was selected as the final model. The coefficients generated for each variable in the final multivariate model was rounded to the nearest integer for the development of an easy-to-use AKI risk score. By summing the component variables together, the total score can range from a minimum of 0 to a maximum of 21 points. Subsequently, the final AKI risk score model was assessed in the Mayo Clinic validation cohort using the AUROC curve C-statistic and HL goodness-of-fit test.

The optimal cutoff point for the continuous risk score was determined using the highest Youden’s index, which is defined as J = maximum [sensitivity + specificity − 1], calculated from the AUROC analysis [62]. The definitions of risk factors and clinical outcomes used were similar in the UCSD and Mayo cohorts (Supplementary data, Table E1). Statistical analysis was performed using SPSS software version 17.0 (SPSS, Chicago, IL, USA) and R version 3.2.1 (R Project for Statistical Computing, Vienna, Austria).

RESULTS

Study cohort characteristics and outcomes

Clinical and demographic characteristics of both cohorts are summarized in Table 1. In the UCSD cohort, 717 patients enrolled with a mean age of 54 (SD 18) years; 63% (n = 453) were men and 58% (n = 413) were white. The Mayo Clinic cohort consisted of 1303 patients with a mean age of 63 (SD 20) years; 53% (n = 687) were men and 97% (n = 1268) were white. The prevalence of HTN in the UCSD and Mayo Clinic cohorts was 35% (n = 254) and 61% (n = 796), respectively. In total, 42% (n = 301) of UCSD patients and 27% (357) of Mayo Clinic patients were on MV. The overall incidence of AKI was 37.2% (n = 754); stage 1, 39.5% (n = 298); stage 2, 35.5% (n = 268); stage 3, 7.7% (n = 58) and 15.5% (n = 117) requiring dialysis. The median time to develop AKI from study enrollment was 24.3 h [95% confidence interval (CI) 12.2–54.7; 23.2 h (12.4–48.4) in the UCSD and 24.4 h (12.0–60.1) in Mayo Clinic cohort, respectively]. The overall ICU mortality rate was 6.3% [7% (n = 52) and 6% (n = 76) in the UCSD and Mayo Clinic cohorts, respectively]. The patients who developed AKI had significantly higher ICU mortality rates than those without AKI [n = 77 (10%) versus n = 51 (4%); P ≤ 0.001].

Table 1

Demographic and outcome characteristics of the UCSD development, UCSD test and Mayo Clinic validation cohorts

VariablesUCSD training set  (A) (n = 573)UCSD test set  (B) (n = 144)Mayo Clinic validation set  (C) (n = 1300)
CCU and MICU, n (%)277   (48)71  (49)786  (61)
SICU, n (%)296  (52)73  (51)514  (40)
Age, years, mean (SD)54  (18)54.2  (18)65  (48–78)
Race, white, n (%)337  (59)76  (53)1265  (97)
Male, n (%)367  (64)86  (60)686  (53)
BSA, m2, median (IQR)1.9  (1.7–2.1)1.9  (1.7–2.1)1.8  (1.6–1.9)
BMI, kg/m2, median (IQR)26  (23–31)25  (23–29)25  (22–30)
SCr at ICU admission, mg/dL, median (IQR)0.9  (0.7–1.1)0.9  (0.7–1.0)1.0  (0.8–1.2)
Age >70, years, mean (SD)120  (21)23  (16)670  (51)
Diabetes, n (%)143  (25)44  (31)352  (27)
Hypertension, n (%)207  (36)47  (33)793  (61)
Morbid obesity, n (%)155  (27)28  (19)311  (24)
Chronic liver disease, n (%)61  (11)23  (16)70  (5)
Congestive heart failure, n (%)77  (13)20  (14)166  (13)
Chronic lung disease, n (%)114  (20)32  (22)81  (6)
Chronic kidney disease, n (%)43  (8)8  (6)144  (11)
Hypotension, n (%)154  (27)46  (32)103  (8)
Mechanical ventilation, n (%)238  (42)63  (44)357  (27)
pH value ≤7.30, n (%)79  (14)13  (9)172  (13)
Severe infection/sepsis, n (%)93  (16)26  (18)463  (36)
Nephrotoxin exposure, n (%)114  (20)30  (21)96  (7)
Incidence of AKI, n  (%)127  (22)35  (24)590  (45)
Need for RRT, n  (%)30  (5)10  (7)77  (5)
ICU mortality, n  (%)41  (7)11  (8)76  (6)
ICU stay, days, median (IQR)3  (2–5)3  (2–7)1  (1–2)
Hospital stay, days, median (IQR)6  (3–13)10  (4–24)5  (3–8)
VariablesUCSD training set  (A) (n = 573)UCSD test set  (B) (n = 144)Mayo Clinic validation set  (C) (n = 1300)
CCU and MICU, n (%)277   (48)71  (49)786  (61)
SICU, n (%)296  (52)73  (51)514  (40)
Age, years, mean (SD)54  (18)54.2  (18)65  (48–78)
Race, white, n (%)337  (59)76  (53)1265  (97)
Male, n (%)367  (64)86  (60)686  (53)
BSA, m2, median (IQR)1.9  (1.7–2.1)1.9  (1.7–2.1)1.8  (1.6–1.9)
BMI, kg/m2, median (IQR)26  (23–31)25  (23–29)25  (22–30)
SCr at ICU admission, mg/dL, median (IQR)0.9  (0.7–1.1)0.9  (0.7–1.0)1.0  (0.8–1.2)
Age >70, years, mean (SD)120  (21)23  (16)670  (51)
Diabetes, n (%)143  (25)44  (31)352  (27)
Hypertension, n (%)207  (36)47  (33)793  (61)
Morbid obesity, n (%)155  (27)28  (19)311  (24)
Chronic liver disease, n (%)61  (11)23  (16)70  (5)
Congestive heart failure, n (%)77  (13)20  (14)166  (13)
Chronic lung disease, n (%)114  (20)32  (22)81  (6)
Chronic kidney disease, n (%)43  (8)8  (6)144  (11)
Hypotension, n (%)154  (27)46  (32)103  (8)
Mechanical ventilation, n (%)238  (42)63  (44)357  (27)
pH value ≤7.30, n (%)79  (14)13  (9)172  (13)
Severe infection/sepsis, n (%)93  (16)26  (18)463  (36)
Nephrotoxin exposure, n (%)114  (20)30  (21)96  (7)
Incidence of AKI, n  (%)127  (22)35  (24)590  (45)
Need for RRT, n  (%)30  (5)10  (7)77  (5)
ICU mortality, n  (%)41  (7)11  (8)76  (6)
ICU stay, days, median (IQR)3  (2–5)3  (2–7)1  (1–2)
Hospital stay, days, median (IQR)6  (3–13)10  (4–24)5  (3–8)

CCU, critical care unit.

Table 1

Demographic and outcome characteristics of the UCSD development, UCSD test and Mayo Clinic validation cohorts

VariablesUCSD training set  (A) (n = 573)UCSD test set  (B) (n = 144)Mayo Clinic validation set  (C) (n = 1300)
CCU and MICU, n (%)277   (48)71  (49)786  (61)
SICU, n (%)296  (52)73  (51)514  (40)
Age, years, mean (SD)54  (18)54.2  (18)65  (48–78)
Race, white, n (%)337  (59)76  (53)1265  (97)
Male, n (%)367  (64)86  (60)686  (53)
BSA, m2, median (IQR)1.9  (1.7–2.1)1.9  (1.7–2.1)1.8  (1.6–1.9)
BMI, kg/m2, median (IQR)26  (23–31)25  (23–29)25  (22–30)
SCr at ICU admission, mg/dL, median (IQR)0.9  (0.7–1.1)0.9  (0.7–1.0)1.0  (0.8–1.2)
Age >70, years, mean (SD)120  (21)23  (16)670  (51)
Diabetes, n (%)143  (25)44  (31)352  (27)
Hypertension, n (%)207  (36)47  (33)793  (61)
Morbid obesity, n (%)155  (27)28  (19)311  (24)
Chronic liver disease, n (%)61  (11)23  (16)70  (5)
Congestive heart failure, n (%)77  (13)20  (14)166  (13)
Chronic lung disease, n (%)114  (20)32  (22)81  (6)
Chronic kidney disease, n (%)43  (8)8  (6)144  (11)
Hypotension, n (%)154  (27)46  (32)103  (8)
Mechanical ventilation, n (%)238  (42)63  (44)357  (27)
pH value ≤7.30, n (%)79  (14)13  (9)172  (13)
Severe infection/sepsis, n (%)93  (16)26  (18)463  (36)
Nephrotoxin exposure, n (%)114  (20)30  (21)96  (7)
Incidence of AKI, n  (%)127  (22)35  (24)590  (45)
Need for RRT, n  (%)30  (5)10  (7)77  (5)
ICU mortality, n  (%)41  (7)11  (8)76  (6)
ICU stay, days, median (IQR)3  (2–5)3  (2–7)1  (1–2)
Hospital stay, days, median (IQR)6  (3–13)10  (4–24)5  (3–8)
VariablesUCSD training set  (A) (n = 573)UCSD test set  (B) (n = 144)Mayo Clinic validation set  (C) (n = 1300)
CCU and MICU, n (%)277   (48)71  (49)786  (61)
SICU, n (%)296  (52)73  (51)514  (40)
Age, years, mean (SD)54  (18)54.2  (18)65  (48–78)
Race, white, n (%)337  (59)76  (53)1265  (97)
Male, n (%)367  (64)86  (60)686  (53)
BSA, m2, median (IQR)1.9  (1.7–2.1)1.9  (1.7–2.1)1.8  (1.6–1.9)
BMI, kg/m2, median (IQR)26  (23–31)25  (23–29)25  (22–30)
SCr at ICU admission, mg/dL, median (IQR)0.9  (0.7–1.1)0.9  (0.7–1.0)1.0  (0.8–1.2)
Age >70, years, mean (SD)120  (21)23  (16)670  (51)
Diabetes, n (%)143  (25)44  (31)352  (27)
Hypertension, n (%)207  (36)47  (33)793  (61)
Morbid obesity, n (%)155  (27)28  (19)311  (24)
Chronic liver disease, n (%)61  (11)23  (16)70  (5)
Congestive heart failure, n (%)77  (13)20  (14)166  (13)
Chronic lung disease, n (%)114  (20)32  (22)81  (6)
Chronic kidney disease, n (%)43  (8)8  (6)144  (11)
Hypotension, n (%)154  (27)46  (32)103  (8)
Mechanical ventilation, n (%)238  (42)63  (44)357  (27)
pH value ≤7.30, n (%)79  (14)13  (9)172  (13)
Severe infection/sepsis, n (%)93  (16)26  (18)463  (36)
Nephrotoxin exposure, n (%)114  (20)30  (21)96  (7)
Incidence of AKI, n  (%)127  (22)35  (24)590  (45)
Need for RRT, n  (%)30  (5)10  (7)77  (5)
ICU mortality, n  (%)41  (7)11  (8)76  (6)
ICU stay, days, median (IQR)3  (2–5)3  (2–7)1  (1–2)
Hospital stay, days, median (IQR)6  (3–13)10  (4–24)5  (3–8)

CCU, critical care unit.

Development of a risk prediction model for AKI (UCSD cohort)

Univariate variables associated with AKI are shown in Supplementary data, Table E2. Chronic comorbidities significantly associated with AKI included DM, chronic liver disease, ASCVD, chronic lung disease, CKD, CHF, HTN and morbid obesity. Acute events associated with AKI included anemia, low serum albumin, MV, high-risk surgery, nephrotoxin exposure, hypotension, low pH, elevated serum bilirubin and sepsis. In the multivariate model, CKD, chronic liver disease, CHF, HTN, ASCVD, pH ≤ 7.30, nephrotoxin exposure, sepsis, MV and anemia were identified as independent predictors of AKI in the final model (Table 2). Stepwise forward elimination regression analysis calculated in Model 2 can be described with the following equation: Probability of AKI = ea/(1 + ea), where a = (0.059 +  [0.860 × CKD] + [0.778 × chronic liver disease] +  [0.720 ×  CHF]  +   [0.563 × HTN] + [0.490 × ASCVD] + [0.977  ×   pH ≤ 7.30] + [0.929 × nephrotoxic exposure] + [0.743 × sepsis] +  [0.447 × MV] + [0.390 × anemia] (Table 2). Dichotomous variables were classified as equal to 1 for presence and 0 for absence. The AUROC of the model in the test cohort was 0.79 (95% CI 0.70–0.89) (Figure 2) and the P-value for the HL test was 0.293. For easier use in clinical practice, we converted the coefficients in Model 2 into additive risk scores as described in the Materials and Methods section and shown in Table 3. We found no significant change in the AUROC after converting the regression coefficient-based model to the risk score.
Discriminative ability of the five candidate models for the risk prediction of acute kidney injury expressed as AUC for the UCSD test cohort (n = 144 patients). The one with the largest AUC, Model 2, is drawn in solid and bold line.
FIGURE 2

Discriminative ability of the five candidate models for the risk prediction of acute kidney injury expressed as AUC for the UCSD test cohort (n = 144 patients). The one with the largest AUC, Model 2, is drawn in solid and bold line.

Table 2

Predictors of AKI obtained by binary multivariate logistic regression analysis in the UCSD development cohort (n = 573 patients)

ComorbiditiesCoefficientOR95% CI for OR
P-value
LowerUpper
pH ≤ 7.300.9772.6561.4364.9160.002
Nephrotoxin exposure0.9292.5321.4974.2810.001
Chronic kidney disease0.8602.3631.1534.8420.02
Chronic liver disease0.7782.1771.1184.2390.02
Severe infection/sepsis0.7432.1021.1753.7630.01
Congestive heart failure0.7202.0541.0593.9850.03
Hypertension0.5631.7561.0842.8440.02
Atherosclerotic coronary vascular disease0.4901.6320.9052.9450.10
Mechanical ventilation0.4471.5640.9812.4930.06
Anemia0.3901.4770.8912.4490.13
ComorbiditiesCoefficientOR95% CI for OR
P-value
LowerUpper
pH ≤ 7.300.9772.6561.4364.9160.002
Nephrotoxin exposure0.9292.5321.4974.2810.001
Chronic kidney disease0.8602.3631.1534.8420.02
Chronic liver disease0.7782.1771.1184.2390.02
Severe infection/sepsis0.7432.1021.1753.7630.01
Congestive heart failure0.7202.0541.0593.9850.03
Hypertension0.5631.7561.0842.8440.02
Atherosclerotic coronary vascular disease0.4901.6320.9052.9450.10
Mechanical ventilation0.4471.5640.9812.4930.06
Anemia0.3901.4770.8912.4490.13

OR, odds ratio.

Table 2

Predictors of AKI obtained by binary multivariate logistic regression analysis in the UCSD development cohort (n = 573 patients)

ComorbiditiesCoefficientOR95% CI for OR
P-value
LowerUpper
pH ≤ 7.300.9772.6561.4364.9160.002
Nephrotoxin exposure0.9292.5321.4974.2810.001
Chronic kidney disease0.8602.3631.1534.8420.02
Chronic liver disease0.7782.1771.1184.2390.02
Severe infection/sepsis0.7432.1021.1753.7630.01
Congestive heart failure0.7202.0541.0593.9850.03
Hypertension0.5631.7561.0842.8440.02
Atherosclerotic coronary vascular disease0.4901.6320.9052.9450.10
Mechanical ventilation0.4471.5640.9812.4930.06
Anemia0.3901.4770.8912.4490.13
ComorbiditiesCoefficientOR95% CI for OR
P-value
LowerUpper
pH ≤ 7.300.9772.6561.4364.9160.002
Nephrotoxin exposure0.9292.5321.4974.2810.001
Chronic kidney disease0.8602.3631.1534.8420.02
Chronic liver disease0.7782.1771.1184.2390.02
Severe infection/sepsis0.7432.1021.1753.7630.01
Congestive heart failure0.7202.0541.0593.9850.03
Hypertension0.5631.7561.0842.8440.02
Atherosclerotic coronary vascular disease0.4901.6320.9052.9450.10
Mechanical ventilation0.4471.5640.9812.4930.06
Anemia0.3901.4770.8912.4490.13

OR, odds ratio.

Table 3

AKI risk prediction scorea of the final model

Risk factorPoints
ChronicChronic kidney disease2
Chronic liver disease2
Congestive heart failure2
Hypertension2
Atherosclerotic coronary vascular disease2
AcutepH ≤ 7.303
Nephrotoxin exposure3
Severe infection/sepsis2
Mechanical ventilation2
Anemia1
Risk factorPoints
ChronicChronic kidney disease2
Chronic liver disease2
Congestive heart failure2
Hypertension2
Atherosclerotic coronary vascular disease2
AcutepH ≤ 7.303
Nephrotoxin exposure3
Severe infection/sepsis2
Mechanical ventilation2
Anemia1

Minimum total score, 0; maximum total score, 21.

Table 3

AKI risk prediction scorea of the final model

Risk factorPoints
ChronicChronic kidney disease2
Chronic liver disease2
Congestive heart failure2
Hypertension2
Atherosclerotic coronary vascular disease2
AcutepH ≤ 7.303
Nephrotoxin exposure3
Severe infection/sepsis2
Mechanical ventilation2
Anemia1
Risk factorPoints
ChronicChronic kidney disease2
Chronic liver disease2
Congestive heart failure2
Hypertension2
Atherosclerotic coronary vascular disease2
AcutepH ≤ 7.303
Nephrotoxin exposure3
Severe infection/sepsis2
Mechanical ventilation2
Anemia1

Minimum total score, 0; maximum total score, 21.

Validation of the risk prediction model (Mayo Clinic cohort)

We used data from 1300 consecutive ICU patients at the Mayo Clinic for validation, resulting in an AUROC of 0.81 (95% CI 0.78–0.83) (Figure 3). The risk prediction model showed good calibration, with reasonable agreement between observed and predicted AKI outcome in the Mayo Clinic cohort (Figure 4). For visual inspection, we drew bar plots of the distribution of patients in the UCSD test cohort and Mayo Clinic validation cohort based on risk score categories (Supplementary data, Figure E1).
Area under curve of UCSD risk model for prediction of acute kidney injury in Mayo clinic validation cohort.
FIGURE 3

Area under curve of UCSD risk model for prediction of acute kidney injury in Mayo clinic validation cohort.

Calibration curves in UCSD cohort and Mayo clinic validation cohort.
FIGURE 4

Calibration curves in UCSD cohort and Mayo clinic validation cohort.

The information on sensitivity, specificity and predictive values according to cutoff points of the score in the UCSD and Mayo Clinic cohorts suggested a threshold of ≥5 points as the optimal cutoff value to define high-risk individuals [sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and Youden’s index were 74%, 72%, 23%, 96% and 0.46 and 63%, 85%, 32%, 95% and 0.48, respectively] (Supplementary data, Table E3). The increase in cutoff leads to higher PPVs (data not shown). The cutoff of ≥5 points was chosen based on the best combination of sensitivity and specificity, with the goal to identify high-risk patients as well as avoid electronic alert fatigue.

DISCUSSION

AKI is a major complication of critical illnesses associated with adverse outcomes, increased mortality and significant increases in resource utilization [1–3]. In recent years, standardized diagnostic and staging criteria for AKI have contributed to an improved understanding of the incidence and course of AKI in ICU patients; however, there is wide variation in its timely recognition, management and outcomes [2, 3]. Several sensitive and specific urine and serum biomarkers of kidney injury have emerged for the early detection of AKI [31–38]. These novel markers, including insulin-like growth factor-binding protein 7, tissue inhibitor of metalloproteinases-2, kidney injury molecule-1, neutrophil gelatinase–associated lipocalin, interleukin-18, protein C and cystatin C have shown promising results to predict AKI in adult (AUROC ≤0.8) and pediatric (AUROC >0.95) patient populations [27–32, 6366] but have not been applied in routine clinical care.

Biomarker alone–based strategies are costly and prone to failure because of the clinical heterogeneity displayed by individual patients. A predictive model for a complex disease such as AKI ideally requires a combination of epidemiological, clinical, biological and hereditary factors along with a panel of biomarkers [67]. In this study, we have developed and validated a risk score derived from patient’s demographics, chronic comorbidities and acute risk factors and demonstrated that it can reliably predict AKI in a critically ill adult population at ICU admission, with an AUROC of 0.79 and AUROC of 0.81 in two different cohorts (Figures 2 and 3). The optimal cutoff for the diagnosis of AKI was estimated to be ≥5 points (Supplementary data, Table E3). With this score value, our model identifies 40% of the ICU patient population as high risk, 23% of which will likely develop AKI within 48 h. In contrast, 96% of the individuals with a score <5 may not develop AKI.

The risk factors we used for identification of AKI are consistent with previous AKI literature [30, 39–57]. Several of the AKI predictors used in our study have been identified previously in other AKI risk scores: CHF, HTN, CKD, nephrotoxin exposure, chronic liver disease and sepsis [9–19, 45]. We also observed that acidosis, MV, atherosclerotic coronary artery disease and anemia were predictors of AKI in our model. Anemia and acidosis are potentially modifiable and could be targeted for correction [25, 54].

Our findings also confirm the high incidence of AKI in ICU patients seen in other studies [2–3, 68], with the majority of patients developing AKI within the first 48 h after study enrollment. AKI patients had a higher mortality rate and increased LOS in the ICU, supporting the need for identifying high-risk patients who could benefit from surveillance and primary prevention strategies to reduce the chance for AKI. Although risk factors for AKI have been identified in other settings and are utilized for patient management [10, 14], there are limited risk prediction tools for AKI development in adult ICU patients [24–26, 30]. Recently, the Renal Angina Index (RAI), based on hazard tranches of clinical factors, was described to identify critically ill children with evidence of early kidney injury who are at risk for developing severe AKI [28]. The RAI has been validated in 506 adult ICU populations to predict AKI stages 2 and 3 [27]. While effectively ruling out patients at low risk for severe AKI, the PPV of the RAI for predicting severe AKI was only 16%, compared with a PPV of 23% for our risk model. Our risk stratification clinical model has a higher the AUROC of 0.79 than the AUROC of 0.74 for the RAI clinical model. In addition, a limitation of the RAI is that SCr was used both to identify risk groups and to define AKI and 14 risk factors were evaluated as predictors of AKI without variable selection regression methodology.

We believe our risk score considering underlying comorbidities with acute risk factors equips clinicians with a new tool to identify high-risk patients and implement preventive strategies, e.g. optimization of volume status, drug dosing adjustments and avoidance of potentially nephrotoxic medicines and procedures. The incorporation of risk prediction tools in electronic databases can allow the automatic detection of high-risk patients for surveillance, and integration with biomarkers can further improve diagnostic accuracy and help in the early management and individualization of treatment for AKI, facilitating patient counseling [69–74]. From a research standpoint, we anticipate that the risk profile models will assist in designing more sophisticated and effective clinical trials for AKI to improve patient selection for prevention and intervention studies.

Our study has several strengths. Data were collected prospectively with a predefined standardized definition of the risk variables within the development and validation cohorts (Supplementary data, Table E1). Most of the major risk variables associated with AKI were included in the study. Risk score development was based on parameters available to clinicians. We can estimate AKI risk via the regression equation or an easy-to-use categorical formulation. The patient population was fairly heterogeneous and well representative of critically ill patients with both medical and surgical conditions. The risk model was developed in multicenter cohorts, with a relatively large population size and showed good discrimination despite significant differences in underlying comorbidities and the incidence of AKI. These differences are significant, as previous studies by Coritsidis et al. [24], Peres et al. [25], Chawla et al. [26] and Hoste et al. [30] that examined risk prediction of AKI in the ICU setting were small, homogeneous and single center with no internal or external validation. Also, not all the relevant covariates were evaluated in previous AKI risk prediction models [24–27, 30] (Tables 4 and 5).

Table 4

Comparison of risk factors in risk prediction studies for AKI in the ICU setting

Risk factorsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Nephrotoxin exposure××
Chronic kidney disease××
Diabetes×
Severe infection/sepsis×××
Congestive heart failure×
Cardiovascular disease××
Hypertension××
Hypotension×
Metabolic acidosis× (pH ≤ 7.35)×
Mechanical ventilation××
Anemia×
SCr on admission× (≥ 1 mg/dL)×
Urea on admission×
Serum albumin××
Urine osmolality×
Active cancer××
A-a gradient×
Hyperglycemia
Obesity×
Age×
High-risk surgery×
Aids×
Cerebrovascular accident×
Hyperbilirubinemia×
Early SCr elevation×
Risk factorsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Nephrotoxin exposure××
Chronic kidney disease××
Diabetes×
Severe infection/sepsis×××
Congestive heart failure×
Cardiovascular disease××
Hypertension××
Hypotension×
Metabolic acidosis× (pH ≤ 7.35)×
Mechanical ventilation××
Anemia×
SCr on admission× (≥ 1 mg/dL)×
Urea on admission×
Serum albumin××
Urine osmolality×
Active cancer××
A-a gradient×
Hyperglycemia
Obesity×
Age×
High-risk surgery×
Aids×
Cerebrovascular accident×
Hyperbilirubinemia×
Early SCr elevation×

× means presence (yes) of the variable.

Table 4

Comparison of risk factors in risk prediction studies for AKI in the ICU setting

Risk factorsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Nephrotoxin exposure××
Chronic kidney disease××
Diabetes×
Severe infection/sepsis×××
Congestive heart failure×
Cardiovascular disease××
Hypertension××
Hypotension×
Metabolic acidosis× (pH ≤ 7.35)×
Mechanical ventilation××
Anemia×
SCr on admission× (≥ 1 mg/dL)×
Urea on admission×
Serum albumin××
Urine osmolality×
Active cancer××
A-a gradient×
Hyperglycemia
Obesity×
Age×
High-risk surgery×
Aids×
Cerebrovascular accident×
Hyperbilirubinemia×
Early SCr elevation×
Risk factorsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Nephrotoxin exposure××
Chronic kidney disease××
Diabetes×
Severe infection/sepsis×××
Congestive heart failure×
Cardiovascular disease××
Hypertension××
Hypotension×
Metabolic acidosis× (pH ≤ 7.35)×
Mechanical ventilation××
Anemia×
SCr on admission× (≥ 1 mg/dL)×
Urea on admission×
Serum albumin××
Urine osmolality×
Active cancer××
A-a gradient×
Hyperglycemia
Obesity×
Age×
High-risk surgery×
Aids×
Cerebrovascular accident×
Hyperbilirubinemia×
Early SCr elevation×

× means presence (yes) of the variable.

Table 5

Comparison of risk prediction models for AKI in the ICU setting

CharacteristicsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Year of publication19952003200520142015
Years data acquired2002–032009–102012–132006–08, 2010
Study cohortn = 115n =185 (sepsis)n = 194n = 506n = 152n = 717, n = 1300
ProspectiveRetrospectiveProspectiveProspective (secondary analysis)RetrospectiveProspective
Single centerSingle centerSingle centerMulticenterSingle centerMulticenter
Input variablesClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, procedural
Primary outcome variableARF (SCr ≥ 0.5 mg/dL)ARF (increase from normal SCr to at least SCr ≥ 2)ARF (>75% increase in SCr if baseline creatinine ≤2.0, or >50% increase in SCr if baseline creatinine >2.0)Severe ARF (AKIN stages 2 and 3)ARF (>0.3 or increases >50%)ARF (absolute increase in SCr level >0.3 mg/dL in 48 h or ≥50% above the reference value within 7 days)
Statistical modelMLR/ORMLR/ORMLR/ORMLR/ORMLR/ORMLR/OR
Validation
 By same groupNoNoNoNoNoInternal/external validation
 Independently by othersNoNoNoNoNoNo
CharacteristicsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Year of publication19952003200520142015
Years data acquired2002–032009–102012–132006–08, 2010
Study cohortn = 115n =185 (sepsis)n = 194n = 506n = 152n = 717, n = 1300
ProspectiveRetrospectiveProspectiveProspective (secondary analysis)RetrospectiveProspective
Single centerSingle centerSingle centerMulticenterSingle centerMulticenter
Input variablesClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, procedural
Primary outcome variableARF (SCr ≥ 0.5 mg/dL)ARF (increase from normal SCr to at least SCr ≥ 2)ARF (>75% increase in SCr if baseline creatinine ≤2.0, or >50% increase in SCr if baseline creatinine >2.0)Severe ARF (AKIN stages 2 and 3)ARF (>0.3 or increases >50%)ARF (absolute increase in SCr level >0.3 mg/dL in 48 h or ≥50% above the reference value within 7 days)
Statistical modelMLR/ORMLR/ORMLR/ORMLR/ORMLR/ORMLR/OR
Validation
 By same groupNoNoNoNoNoInternal/external validation
 Independently by othersNoNoNoNoNoNo

AKIN, Acute Kidney Injury Network; ARF, acute renal failure; MLR, multivariate logistic regression; OR, odds ratio.

Table 5

Comparison of risk prediction models for AKI in the ICU setting

CharacteristicsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Year of publication19952003200520142015
Years data acquired2002–032009–102012–132006–08, 2010
Study cohortn = 115n =185 (sepsis)n = 194n = 506n = 152n = 717, n = 1300
ProspectiveRetrospectiveProspectiveProspective (secondary analysis)RetrospectiveProspective
Single centerSingle centerSingle centerMulticenterSingle centerMulticenter
Input variablesClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, procedural
Primary outcome variableARF (SCr ≥ 0.5 mg/dL)ARF (increase from normal SCr to at least SCr ≥ 2)ARF (>75% increase in SCr if baseline creatinine ≤2.0, or >50% increase in SCr if baseline creatinine >2.0)Severe ARF (AKIN stages 2 and 3)ARF (>0.3 or increases >50%)ARF (absolute increase in SCr level >0.3 mg/dL in 48 h or ≥50% above the reference value within 7 days)
Statistical modelMLR/ORMLR/ORMLR/ORMLR/ORMLR/ORMLR/OR
Validation
 By same groupNoNoNoNoNoInternal/external validation
 Independently by othersNoNoNoNoNoNo
CharacteristicsCoritsidis et al. [24]Hoste et al. [30]Chawla et al.[26]Renal angina index [28]Peres et al. [25]UCSD–Mayo model
Year of publication19952003200520142015
Years data acquired2002–032009–102012–132006–08, 2010
Study cohortn = 115n =185 (sepsis)n = 194n = 506n = 152n = 717, n = 1300
ProspectiveRetrospectiveProspectiveProspective (secondary analysis)RetrospectiveProspective
Single centerSingle centerSingle centerMulticenterSingle centerMulticenter
Input variablesClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, proceduralClinical, laboratory, procedural
Primary outcome variableARF (SCr ≥ 0.5 mg/dL)ARF (increase from normal SCr to at least SCr ≥ 2)ARF (>75% increase in SCr if baseline creatinine ≤2.0, or >50% increase in SCr if baseline creatinine >2.0)Severe ARF (AKIN stages 2 and 3)ARF (>0.3 or increases >50%)ARF (absolute increase in SCr level >0.3 mg/dL in 48 h or ≥50% above the reference value within 7 days)
Statistical modelMLR/ORMLR/ORMLR/ORMLR/ORMLR/ORMLR/OR
Validation
 By same groupNoNoNoNoNoInternal/external validation
 Independently by othersNoNoNoNoNoNo

AKIN, Acute Kidney Injury Network; ARF, acute renal failure; MLR, multivariate logistic regression; OR, odds ratio.

There are also limitations to our study. First, the urine criterion was not applied to diagnose AKI in the UCSD cohort, as urine output data were not uniformly available, and this may have decreased the overall incidence of AKI diagnosis [68, 75]. Second, we could not determine all the risk variables associated with AKI, including hypovolemia, oliguria and severity of illness scores, as the standard of care labs were applied with variable frequency across the cohorts. Third, baseline SCr values were missing in 24% (n = 172) of ICU patients in the UCSD cohort and 30% (n = 384) in the Mayo cohort. We performed a sensitivity analysis after excluding ICU patients with missing baseline SCr values and the AKI risk score model developed was very similar to the earlier model (data not shown). The patient population of our cohorts was not very sick and the majority of our patients developed AKI within the first 48 h of ICU admission, thus limiting the generalizability of our results. Finally, it was not always possible to ascertain chronic risk factors in unconscious ICU patients when the family was not available to provide a medical history. Further refinements could explore a separate risk scoring system for AKI in patients with unknown baseline risk who are still exposed to acute insults.

CONCLUSION

We developed a simple, reliable risk model using readily available clinical variables that can be used to predict AKI at ICU admission. Implementation of this risk model in clinical practice may help target high-risk patients for surveillance and enable clinicians to evaluate novel diagnostic, preventive and therapeutic modalities to mitigate the devastating consequences of AKI. Future studies are needed to prospectively validate our model to predict AKI in independent datasets with different backgrounds.

SUPPLEMENTARY DATA

Supplementary data are available online at http://ndt.oxfordjournals.org.

ACKNOWLEDGEMENTS

R.Me, R.Ma, K.B.K. and J.K. had full access to all of the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. This work was supported by NLM R01 LM009520 (L.O-M.), NIH P30 DK079337 UAB-UCSD O'Brien Core Center for Acute Kidney Injury Research, and NIH U54 HL108460.

AUTHORS’ CONTRIBUTIONS

Study concept and design: R.Ma, R.Me, L.O-M., K.B.K. and E.M.

Acquisition, analysis or interpretation of data: R.Ma, R.Me, L.O-M., K.B.K., E.M., J.K. and S.W.

Drafting of the manuscript: R.Me, R.Ma, L.O-M., K.B.K., E.M. and J.B.

Critical revision of the manuscript for intellectual content: R.Me, L.O-M., K.B.K., J.B. and G.L.

Statistical analysis: J.K., K.B.K., R.Ma and E.M.

Obtained funding: R.Me, L.O-M. and K.B.K.

Administrative, technical or material support: S.W.

Study supervision: R.Me, K.B.K. and L.O-M.

CONFLICT OF INTEREST STATEMENT

None declared.

REFERENCES

1

Sileanu
FE
,
Murugan
R
,
Lucko
N
et al.
AKI in low-risk versus high-risk patients in intensive care
.
Clin J Am Soc Nephrol
2015
;
10
:
187
196

2

Hoste
EA
,
Bagshaw
SM
,
Bellomo
R
et al.
Epidemiology of acute kidney injury in critically ill patients: the multinational AKI-EPI study
.
Intensive Care Med
2015
;
41
:
1411
1423

3

Bouchard
J
,
Acharya
A
,
Cerda
J
et al.
A prospective international multicenter study of AKI in the intensive care unit
.
Clin J Am Soc Nephrol
2015
;
10
:
1324
1331

4

Levy
EM
,
Viscoli
CM
,
Horwitz
RI.
The effect of acute renal failure on mortality. A cohort analysis
.
JAMA
1996
;
275
:
1489
1494

5

Chertow
GM
,
Burdick
E
,
Honour
M
et al.
Acute kidney injury, mortality, length of stay, and costs in hospitalized patients
.
J Am Soc Nephrol
2005
;
16
:
3365
3370

6

Gottlieb
SS
,
Abraham
W
,
Butler
J
et al.
The prognostic importance of different definitions of worsening renal function in congestive heart failure
.
J Card Fail
2002
;
8
:
136
141

7

Lassnigg
A
,
Schmidlin
D
,
Mouhieddine
M
et al.
Minimal changes of serum creatinine predict prognosis in patients after cardiothoracic surgery: a prospective cohort study
.
J Am Soc Nephrol
2004
;
15
:
1597
1605

8

Perinel
S
,
Vincent
F
,
Lautrette
A
et al.
Transient and persistent acute kidney injury and the risk of hospital mortality in critically ill patients: results of a multicenter cohort study
.
Crit Care Med
2015
;
43
:
e269
e275

9

Palomba
H
,
de Castro
I
,
Neto
AL
et al.
Acute kidney injury prediction following elective cardiac surgery: AKICS score
.
Kidney Int
2007
;
72
:
624
631

10

Thakar
CV
,
Arrigain
S
,
Worley
S
et al.
A clinical score to predict acute renal failure after cardiac surgery
.
J Am Soc Nephrol
2005
;
16
:
162
168

11

Kristovic
D
,
Horvatic
I
,
Husedzinovic
I
et al.
Cardiac surgery-associated acute kidney injury: risk factors analysis and comparison of prediction models
.
Interact Cardiovasc Thorac Surg
2015
;
21
:
366
373

12

Kiers
HD
,
van den Boogaard
M
,
Schoenmakers
MC
et al.
Comparison and clinical suitability of eight prediction models for cardiac surgery-related acute kidney injury
.
Nephrol Dial Transplant
2013
;
28
:
345
351

13

Aronson
S
,
Fontes
ML
,
Miao
Y
et al.
Risk index for perioperative renal dysfunction/failure: critical dependence on pulse pressure hypertension
.
Circulation
2007
;
115
:
733
742

14

Mehran
R
,
Aymong
ED
,
Nikolsky
E
et al.
A simple risk score for prediction of contrast-induced nephropathy after percutaneous coronary intervention: development and initial validation
.
J Am Coll Cardiol
2004
;
44
:
1393
1399

15

Inohara
T
,
Kohsaka
S
,
Abe
T
et al.
Development and validation of a pre-percutaneous coronary intervention risk model of contrast-induced acute kidney injury with an integer scoring system
.
Am J Cardiol
2015
;
115
:
1636
1642

16

Matheny
ME
,
Miller
RA
,
Ikizler
TA
et al.
Development of inpatient risk stratification models of acute kidney injury for use in electronic health records
.
Med Decis Making
2010
;
30
:
639
650

17

Kheterpal
S
,
Tremper
KK
,
Heung
M
et al.
Development and validation of an acute kidney injury risk index for patients undergoing general surgery: results from a national data set
.
Anesthesiology
2009
;
110
:
505
515

18

Rueggeberg
A
,
Boehm
S
,
Napieralski
F
et al.
Development of a risk stratification model for predicting acute renal failure in orthotopic liver transplantation recipients
.
Anaesthesia
2008
;
63
:
1174
1180

19

Kheterpal
S
,
Tremper
KK
,
Englesbe
MJ
et al.
Predictors of postoperative acute renal failure after noncardiac surgery in patients with previously normal renal function
.
Anesthesiology
2007
;
107
:
892
902

20

Grimm
JC
,
Lui
C
,
Kilic
A
et al.
A risk score to predict acute renal failure in adult patients after lung transplantation
.
Ann Thorac Surg
2015
;
99
:
251
257

21

Kim
WH
,
Park
MH
,
Kim
HJ
et al.
Potentially modifiable risk factors for acute kidney injury after surgery on the thoracic aorta: a propensity score matched case-control study
.
Medicine (Baltimore)
2015
;
94
:
e273

22

Cho
E
,
Kim
SC
,
Kim
MG
et al.
The incidence and risk factors of acute kidney injury after hepatobiliary surgery: a prospective observational study
.
BMC Nephrol
2014
;
15
:
169

23

Kane-Gill
SL
,
Sileanu
FE
,
Murugan
R
et al.
Risk factors for acute kidney injury in older adults with critical illness: a retrospective cohort study
.
Am J Kidney Dis
2015
;
65
:
860
869

24

Coritsidis
GN
,
Guru
K
,
Ward
L
et al.
Prediction of acute renal failure by “bedside formula"” in medical and surgical intensive care patients
.
Ren Fail
2000
;
22
:
235
244

25

Peres
LA
,
Wandeur
V
,
Matsuo
T.
Predictors of acute kidney injury and mortality in an intensive care unit
.
J Bras Nefrol
2015
;
37
:
38
46

26

Chawla
LS
,
Abell
L
,
Mazhari
R
et al.
Identifying critically ill patients at high risk for developing acute renal failure: a pilot study
.
Kidney Int
2005
;
68
:
2274
2280

27

Cruz
DN
,
Ferrer-Nadal
A
,
Piccinni
P
et al.
Utilization of small changes in serum creatinine with clinical risk factors to assess the risk of AKI in critically lll adults
.
Clin J Am Soc Nephrol
2014
;
9
:
663
672

28

Basu
RK
,
Zappitelli
M
,
Brunner
L
et al.
Derivation and validation of the renal angina index to improve the prediction of acute kidney injury in critically ill children
.
Kidney Int
2014
;
85
:
659
667

29

Fan
PC
,
Chang
CH
,
Tsai
MH
et al.
Predictive value of acute kidney injury in medical intensive care patients with sepsis originating from different infection sites
.
Am J Med Sci
2012
;
344
:
83
89

30

Hoste
EA
,
Lameire
NH
,
Vanholder
RC
et al.
Acute renal failure in patients with sepsis in a surgical ICU: predictive factors, incidence, comorbidity, and outcome
.
J Am Soc Nephrol
2003
;
14
:
1022
1030

31

Di Grande
A
,
Giuffrida
C
,
Carpinteri
G
et al.
Neutrophil gelatinase-associated lipocalin: a novel biomarker for the early diagnosis of acute kidney injury in the emergency department
.
Eur Rev Med Pharmacol Sci
2009
;
13
:
197
200

32

Bihorac
A
,
Chawla
LS
,
Shaw
AD
et al.
Validation of cell-cycle arrest biomarkers for acute kidney injury using clinical adjudication
.
Am J Respir Crit Care Med
2014
;
189
:
932
939

33

Kashani
K
,
Al-Khafaji
A
,
Ardiles
T
et al.
Discovery and validation of cell cycle arrest biomarkers in human acute kidney injury
.
Crit Care
2013
;
17
:
R25

34

Vaidya
VS
,
Ramirez
V
,
Ichimura
T
et al.
Urinary kidney injury molecule-1: a sensitive quantitative biomarker for early detection of kidney tubular injury
.
Am J Physiol Renal Physiol
2006
;
290
:
F517
F529

35

Bouchard
J
,
Malhotra
R
,
Shah
S
et al.
Levels of protein C and soluble thrombomodulin in critically ill patients with acute kidney injury: a multicenter prospective observational study
.
PLoS One
2015
;
10
:
e0120770

36

Parikh
CR
,
Abraham
E
,
Ancukiewicz
M
et al.
Urine IL-18 is an early diagnostic marker for acute kidney injury and predicts mortality in the intensive care unit
.
J Am Soc Nephrol
2005
;
16
:
3046
3052

37

Coca
SG
,
Yalavarthy
R
,
Concato
J
et al.
Biomarkers for the diagnosis and risk stratification of acute kidney injury: a systematic review
.
Kidney Int
2008
;
73
:
1008
1016
.

38

Shlipak
MG
,
Coca
SG
,
Wang
Z
et al.
Presurgical serum cystatin C and risk of acute kidney injury after cardiac surgery
.
Am J Kidney Dis
2011
;
58
:
366
373

39

Basu
RK
,
Wang
Y
,
Wong
HR
et al.
Incorporation of biomarkers with the renal angina index for prediction of severe AKI in critically ill children
.
Clin J Am Soc Nephrol
2014
;
9
:
654
662

40

Mehta
RL
,
Kellum
JA
,
Shah
SV
et al.
Acute kidney injury network: report of an initiative to improve outcomes in acute kidney injury
.
Crit Care
2007
;
11
:
R31

41

Oliveira
JF
,
Silva
CA
,
Barbieri
CD
et al.
Prevalence and risk factors for aminoglycoside nephrotoxicity in intensive care units
.
Antimicrob Agents Chemother
2009
;
53
:
2887
2891

42

Moffett
BS
,
Hilvers
PS
,
Dinh
K
et al.
Vancomycin-associated acute kidney injury in pediatric cardiac intensive care patients
.
Congenit Heart Dis
2015
;
10
:
E6
E10

43

Vivino
G
,
Antonelli
M
,
Moro
ML
et al.
Risk factors for acute renal failure in trauma patients
.
Intensive Care Med
1998
;
24
:
808
814

44

Toprak
O.
Conflicting and new risk factors for contrast induced nephropathy
.
J Urol
2007
;
178
:
2277
2283

45

Chertow
GM
,
Lazarus
JM
,
Christiansen
CL
et al.
Preoperative renal risk stratification
.
Circulation
2007
;
95
:
878
884

46

Grams
ME
,
Sang
Y
,
Ballew
SH
et al.
A meta-analysis of the association of estimated GFR, albuminuria, age, race, and sex with acute kidney injury
.
Am J Kidney Dis
2015
;
66
:
591
601

47

Leblanc
M
,
Kellum
JA
,
Gibney
RT
et al.
Risk factors for acute renal failure: inherent and modifiable risks
.
Curr Opin Crit Care
2005
;
11
:
533
536

48

Hsu
CY
,
Ordonez
JD
,
Chertow
GM
et al.
The risk of acute renal failure in patients with chronic kidney disease
.
Kidney Int
2008
;
74
:
101
107

49

Vanhorebeek
I
,
Gunst
J
,
Ellger
B
et al.
Hyperglycemic kidney damage in an animal model of prolonged critical illness
.
Kidney Int
2009
;
76
:
512
520

50

Bosch
X
,
Poch
E
,
Grau
JM.
Rhabdomyolysis and acute kidney injury
.
N Engl J Med
2009
;
361
:
62
72

51

Cabezuelo
JB
,
Ramirez
P
,
Rios
A
et al.
Risk factors of acute renal failure after liver transplantation
.
Kidney Int
2006
;
69
:
1073
1080

52

Kuiper
JW
,
Groeneveld
AB
,
Slutsky
AS
et al.
Mechanical ventilation and acute renal failure
.
Crit Care Med
2005
;
33
:
1408
1415

53

Sipkins
JH
,
Kjellstrand
CM.
Severe head trauma and acute renal failure
.
Nephron
1981
;
28
:
36
41

54

Karkouti
K
,
Grocott
HP
,
Hall
R
et al.
Interrelationship of preoperative anemia, intraoperative anemia, and red blood cell transfusion as potentially modifiable risk factors for acute kidney injury in cardiac surgery: a historical multicentre cohort study
.
Can J Anaesth
2015
;
62
:
377
384

55

Li
SY
,
Chuang
CL
,
Yang
WC
et al.
Proteinuria predicts postcardiotomy acute kidney injury in patients with preserved glomerular filtration rate
.
J Thorac Cardiovasc Surg
2015
;
149
:
894
899

56

Coca
SG
,
Jammalamadaka
D
,
Sint
K
et al.
Preoperative proteinuria predicts acute kidney injury in patients undergoing cardiac surgery
.
J Thorac Cardiovasc Surg
2012
;
143
:
495
502

57

Joung
KW
,
Jo
JY
,
Kim
WJ
et al.
Association of preoperative uric acid and acute kidney injury following cardiovascular surgery
.
J Cardiothorac Vasc Anesth
2014
;
28
:
1440
1447

58

Frenette
AJ
,
Bouchard
J
,
Bernier
P
et al.
Albumin administration is associated with acute kidney injury in cardiac surgery: a propensity score analysis
.
Crit Care
2014
;
18
:
602

59

Varrier
M
,
Ostermann
M.
Novel risk factors for acute kidney injury
.
Curr Opin Nephrol Hypertens
2014
;
23
:
560
569

60

Bouwmeester
W
,
Zuithoff
NP
,
Mallett
S
et al.
Reporting and methods in clinical prediction research: a systematic review
.
PLoS Med
2012
;
9
:
1
12

61

Smith
AD
,
Tilling
K
,
Lawlor
DA
et al.
External validation and calibration of IVF predict: a national prospective cohort study of 130,960 in vitro fertilisation cycles
.
PLoS One
2015
;
10
:
e0121357

62

Hilden
J
,
Glasziou
P.
Regret graphs, diagnostic uncertainty and Youden's index
.
Stat Med
1996
;
15
:
969
986

63

Mishra
J
,
Dent
C
,
Tarabishi
R
et al.
Neutrophil gelatinase-associated lipocalin (NGAL) as a biomarker for acute renal injury after cardiac surgery
.
Lancet
2005
;
365
:
1231
1238

64

Parikh
CR
,
Jani
A
,
Mishra
J
et al.
Urine NGAL and IL-18 are predictive biomarkers for delayed graft function following kidney transplantation
.
Am J Transplant
2006
;
6
:
1639
1645

65

Koyner
JL
,
Bennett
MR
,
Worcester
EM
et al.
Urinary cystatin C as an early biomarker of acute kidney injury following adult cardiothoracic surgery
.
Kidney Int
2008
;
74
:
1059
1069

66

Siew
ED
,
Ware
LB
,
Gebretsadik
T
et al.
Urine neutrophil gelatinase-associated lipocalin moderately predicts acute kidney injury in critically ill adults
.
J Am Soc Nephrol
2009
;
20
:
1823
1832

67

Moriates
C
,
Maisel
A.
The utility of biomarkers in sorting out the complex patient
.
Am J Med
2010
;
123
:
393
399

68

Kellum
JA
,
Sileanu
FE
,
Murugan
R
et al.
Classifying AKI by urine output versus serum creatinine level
.
J Am Soc Nephrol
2015
;
26
:
2231
2238

69

Porter
CJ
,
Juurlink
I
,
Bisset
LH
et al.
A real-time electronic alert to improve detection of acute kidney injury in a large teaching hospital
.
Nephrol Dial Transplant
2014
;
29
:
1888
1893

70

Wallace
K
,
Mallard
AS
,
Stratton
JD
et al.
Use of an electronic alert to identify patients with acute kidney injury
.
Clin Med
2014
;
14
:
22
26

71

Wilson
FP
,
Shashaty
M
,
Testani
J
et al.
Automated, electronic alerts for acute kidney injury: a single-blind, parallel-group, randomised controlled trial
.
Lancet
2015
;
385
:
1966
1974

72

Thomas
M
,
Sitch
A
,
Dowswell
G.
The initial development and assessment of an automatic alert warning of acute kidney injury
.
Nephrol Dial Transplant
2011
;
26
:
2161
2168

73

Selby
NM
,
Crowley
L
,
Fluck
RJ
et al.
Use of electronic results reporting to diagnose and monitor AKI in hospitalized patients
.
Clin J Am Soc Nephrol
2012
;
7
:
533
540

74

Parikh
CR
,
Moledina
DG
,
Coca
SG
et al.
Application of new acute kidney injury biomarkers in human randomized controlled trials
.
Kidney Int
2016
;
89
:
1372
1379

75

Vaara
ST
,
Parviainen
I
,
Pettilä
V
et al.
Association of oliguria with the development of acute kidney injury in the critically ill
.
Kidney Int
2015
. doi:10.1038/ki.2015.269

Supplementary data

Comments

0 Comments
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.