External validation of a nomogram for outcome prediction in management of medium-sized (1-2 cm) kidney stones

BACKGROUND: Stone nomogram by Micali et al., able topredict treatment failure of shock-wave lithotripsy (SWL), retrograde intrarenal surgery (RIRS) and percutaneous nephrolithotomy (PNL) in the management of single 1-2 cm renal stones, was developed on 2605 patients and showed a high predictive accuracy, with an area under ROC curve of 0.793 at internal validation. The aim of the present study is to externally validate the model to assess whether it displayed a satisfactory predictive performance if applied to different populations. METHODS: External validation was retrospectively performed on 3025 patients who underwent an active stone treatment from December 2010 to June 2021 in 26 centers from four countries (Italy, USA, Spain, Argentina). Collected variables included: age, gender, previous renal surgery, preoperative urine culture, hydronephrosis, stone side, site, density, skin-to-stone distance. Treatment failure was the defined outcome (residual fragments >4 mm at three months CT-scan). RESULTS: Model discrimination in external validation datasets showed an area under ROC curve of 0.66 (95% 0.59-0.68) with adequate calibration. The retrospective fashion of the study and the lack of generalizability of the tool towards populations from Asia, Africa or Oceania represent limitations of the current analysis. CONCLUSIONS: According to the current findings, Micali's nomogram can be used for treatment prediction after SWL, RIRS and PNL; however, a lower discrimination performance than the one at internal validation should be acknowledged, reflecting geographical, temporal and domain limitation of external validation studies. Further prospective evaluation is required to refine and improve the nomogram findings and to validate its clinical value.