External validation and calibration of risk models in isolated coronary artery bypass grafting: a systematic review
Published 2026-08-10
Keywords
- calibration; cardiac surgery; coronary artery bypass; external validation; hospital mortality; prognostic models; risk assessment
How to Cite
Copyright (c) 2026 Arutyunyan et al.

This work is licensed under a Creative Commons Attribution 4.0 International License.
Abstract
Introduction: In-hospital mortality after isolated coronary artery bypass grafting is now low, yet it differs markedly between centers and countries. Preoperative risk estimates guide patient routing, informed consent, and quality benchmarking. Because surgical technique, perioperative care, and patient profiles have shifted since 2018, risk models built on earlier cohorts lose calibration and call for re-examination in current practice.
Objective: To assess contemporary external validity and calibration of EuroSCORE II and the Society of Thoracic Surgeons risk model (STS) for shortterm mortality in adults undergoing isolated coronary artery bypass grafting.
Methods: We performed a systematic search of PubMed/MEDLINE, Scopus,
and Web of Science restricted to 2018–2025 and English-language publications. Eligible records were original external validations in isolated coronary artery bypass grafting or studies with a clearly reported subgroup; endpoints were inhospital mortality or 30-day survival. We extracted discrimination (area under
the ROC curve) and calibration metrics (observed-to-expected mortality ratio,
Hosmer – Lemeshow p-value, calibration slope and intercept when available). Study selection and data extraction were performed independently by two reviewers; unreported metrics were recorded as “not reported”. Risk of bias was assessed using Prediction Model Risk of Bias Assessment Tool (PROBAST).
Results: Nine studies from Europe, Asia, and Latin America were included
(sample sizes 438–14,118). Discrimination ranged from modest to high: for EuroSCORE II AUC 0.55–0.90 (0.82–0.90 in the largest cohorts); for the STS model AUC 0.65–0.88. Calibration was heterogeneous: overestimation in low-risk and younger patients (e.g., overall observed-to-expected ratio 0.58; 0.26 in patients <60 years) contrasted with underestimation in older adults, in procedures with cardiopulmonary bypass, and in several non-European populations. In some reports, simple centre-specific recalibration improved agreement between predicted and observed outcomes.
Conclusion: In contemporary isolated coronary artery bypass grafting, EuroSCORE II and the STS model remain useful for risk ranking but centrelevel calibration checks and – when indicated – straightforward recalibration are recommended. Regular auditing of observed-to-expected mortality and stratified verification in key subgroups is also recommended.
Received 22 October 2025. Revised 20 March 2026. Accepted 10 April 2026.
Funding
The study did not have sponsorship.
Conflict of interest
The authors declare no conflict of interest.
Contribution of the authors
Conception and study design: L.A. Arutyunyan
Data collection and analysis: L.A. Arutyunyan, S.V. Shalaev, S.B. Tsiryatieva
Statistical analysis: L.A. Arutyunyan, L.V. Kremneva, V.V. Ostanina
Drafting the article: L.A. Arutyunyan, R.T. Gaibova, M.V. Martynenko
Critical revision of the article: L.A. Arutyunyan, S.V. Shalaev, S.B. Tsiryatieva
Final approval of the version to be published: all authors
References
- Семченко А.Н., Зайцев И.В., Шевченко А.М., Семченко А.В. Влияние неполной реваскуляризации на результаты коронарного шунтирования у больных ишемической болезнью сердца. Патология кровообращения и кардиохирургия. 2021;25(1):74- 84. http://dx.doi.org/10.21688/1681-3472-2021-1-74-84 Semchenko A.N., Zaitsev I.V., Shevchenko A.M., Semchenko A.V. Influence of incomplete revascularization on the outcomes of coronary artery bypass grafting in patients with ischemic heart disease. Patologiya krovoobrashcheniya i kardiokhirurgiya = Circulation Pathology and Cardiac Surgery. 2021;25(1):74-84. (In Russ.) http://dx.doi.org/10.21688/1681-3472-2021-1-74-84
- Каменщиков Н.О., Подоксенов Ю.К., Дьякова М.Л., Бойко А.М., Козлов Б.Н. Острое повреждение почек в кардиохирургии: предиктивная диагностика в предоперационном периоде. Патология кровообращения и кардиохирургия. 2021;25(1):40-51. http://dx.doi.org/10.21688/1681-3472-2021-1-40-51Kamenshchikov N.O., Podoksenov Yu.K., Diakova M.L., Boyko A.M., Kozlov B.N. Acute kidney injury in cardiac surgery: preoperative predictive diagnostics. Patologiya krovoobrashcheniya i kardiokhirurgiya = Circulation Pathology and Cardiac Surgery. 2021;25(1):40–51. (In Russ.) http://dx.doi.org/10.21688/1681-3472-2021-1-40-51
- Nashef S.A., Roques F., Sharples L.D., Nilsson J., Smith C, Goldstone A.R., Lockowandt U. EuroSCORE II. Eur J Cardiothorac Surg. 2012;41(4):734-44. PMID: 22378855. https://doi.org/10.1093/ejcts/ezs043
- O’Brien S.M., Feng L., He X., Xian Y., Jacobs JP, Badhwar V., Kurlansky P.A., Furnary A.P., Cleveland J.C. Jr, Lobdell K.W., Vassileva C., Wyler Von Ballmoos M.C., Thourani V.H., Rankin J.S., Edgerton J.R., D’Agostino R.S., Desai N.D., Edwards F.H., Shahian D.M. The Society of Thoracic Surgeons 2018 Adult Cardiac Surgery Risk Models: Part 2-Statistical Methods and Results. Ann Thorac Surg. 2018;105(5):1419-1428. PMID: 29577924. https://doi.org/10.1016/j.athoracsur.2018.03.003
- Nashef S.A., Roques F., Michel P., Gauducheau E., Lemeshow S., Salamon R. European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999;16(1):9-13. PMID: 10456395.https://doi.org/10.1016/S1010-7940(99)00134-7
- Shahian D.M., O’Brien S.M., Filardo G., Ferraris V.A., Haan C.K., Rich J.B., Normand S.L., DeLong E.R., Shewan C.M., Dokholyan R.S., Peterson E.D., Edwards F.H., Anderson R.P.; Society of Thoracic Surgeons Quality Measurement Task Force. The Society of Thoracic Surgeons 2008 cardiac surgery risk models: part 1 – coronary artery bypass grafting surgery. Ann Thorac Surg. 2009;88(1 Suppl):S2–22. PMID: 19559822. https://doi.org/10.1016/j.athoracsur.2009.05.053
- Bowdish M.E., D’Agostino R.S., Thourani V.H., Desai N., Shahian D.M., Fernandez F.G., Badhwar V. The Society of Thoracic Surgeons Adult Cardiac Surgery Database: 2020 Update on Outcomes and Research. Ann Thorac Surg. 2020;109(6):1646- 1655. PMID: 32247780. https://doi.org/10.1016/j.athoracsur.2020.03.003
- Ефремов С.М., Шмидт Р.Е., Зырянова А.В., Шмидт Т.А., Каменских М.С., Шматов Д.В. Взаимосвязь между характеристиками диастолической функции и тяжелым повреждением миокарда при операциях шунтирования коронарных артерий в условиях искусственного кровообращения: ретроспективное когортное исследование. Патология кровообращения и кардиохирургия. 2024;28(2):51-61. https://doi.org/10.21688/1681-3472-2024-2-51-61 Efremov S.M., Shmidt R.E., Zyryanova A.V., Shmidt T.A., Kamenskikh M.S., Shmatov D.V. The relationship between diastolic function characteristics and severe myocardial injury in coronary artery bypass graft surgery: a retrospective cohort study. Patologiya krovoobrashcheniya i kardiokhirurgiya = Circulation Pathology and Cardiac Surgery. 2024;28(2):51-61. (In Russ.) https://doi.org/10.21688/1681-3472-2024-2-51-61
- Van Calster B., McLernon D.J., van Smeden M., Wynants L., Steyerberg E.W.; Topic Group ‘Evaluating diagnostic tests and prediction models’ of the STRATOS initiative. Calibration: the Achilles heel of predictive analytics. BMC Med. 2019;17(1):230. PMID: 31842878; PMCID: PMC6912996. https://doi.org/10.1186/s12916-019-1466-7
- El Hadj Sidi C., Mgarrech I., Tarmiz A., Jerbi S. External validation of the European System for Cardiac Operative Risk Evaluation II in a Tunisian population. J Card Surg. 2019;34(5):266-273. PMID: 30873659. https://doi.org/10.1111/jocs.14015
- Atashi A., Amini S., Tashnizi M.A., Moeinipour A.A., Aazami M.H., Tohidnezhad F., Ghasemi E., Eslami S. External Validation of European System for Cardiac Operative Risk Evaluation II (EuroSCORE II) for Risk Prioritization in an Iranian Population. Braz J Cardiovasc Surg. 2018;33(1):40-46. PMID: 29617500; PMCID: PMC5873780. https://doi.org/10.21470/1678-9741-2017-0030
- Stavridis G., Panaretos D., Kadda O., Panagiotakos D.B. Validation of the EuroSCORE II in a Greek Cardiac Surgical Population: A Prospective Study. Open Cardiovasc Med J. 2017;11:94-101. PMID: 29204219; PMCID: PMC5688389. https://doi.org/10.2174/1874192401711010094
- Nezic D., Spasic T., Micovic S., Kosevic D., Petrovic I., Lausevic- Vuk L., Unic-Stojanovic D., Borzanovic M. Consecutive Observational Study to Validate EuroSCORE II Performances on a Single-Center, Contemporary Cardiac Surgical Cohort. J Cardiothorac Vasc Anesth. 2016;30(2):345-51. PMID: 26873386. https://doi.org/10.1053/j.jvca.2015.11.011
- Sullivan P.G., Wallach J.D., Ioannidis J.P.. Meta-Analysis Comparing Established Risk Prediction Models (EuroSCORE II, STS Score, and ACEF Score) for Perioperative Mortality During Cardiac Surgery. Am J Cardiol. 2016;118(10):1574-1582. PMID: 27687052. https://doi.org/10.1016/j.amjcard.2016.08.024
- Liu P.H., Shih H.H., Kang P.L., Pan J.Y., Wu T.H., Wu C.J. Performance of the EuroSCORE II Model in Predicting Short-Term Mortality of General Cardiac Surgery: A Single-Center Study in Taiwan. Acta Cardiol Sin. 2022;38(4):495-503. PMID: 35873132; PMCID: PMC9295035. https://doi.org/10.6515/ACS.202207_38(4).20220128B
- Kuźma Ł., Kowalewski M., Wańha W., Dąbrowski E.J., Jasiński M., Widenka K., Deja M., Bartuś K., Hirnle T., Wojakowski W., Lorusso R., Tobota Z., Maruszewski B.J., Suwalski P., KROK nvestigators. Validation of EuroSCORE II in atrial fibrillation heart surgery patients from the KROK Registry. Sci Rep. 2023;13(1):13024. PMID: 37563207; PMCID: PMC10415263. https://doi.org/10.1038/s41598-023-39983-w
- Кравченко И.В., Подоксенов Ю.К., Тё М.А., Калашникова Т.П., Чурилина Е.А., Козулин М.С., Гусакова А.М., Козлов Б.Н., Каменщиков Н.О. Профилактика дыхательных осложнений у пациентов с риском неблагоприятных респираторных событий путем периоперационной доставки оксида азота при кардиохирургических операциях в условиях искусственного кровообращения: одноцентровое проспективное рандомизированное исследование. Патология кровообращения и кардиохирургия. 2024;28(3):78-93. https://doi.org/10.21688/1681-3472-2024-3-78-93 Kravchenko I.V., Podoksenov Yu.K., Tyo M.A., Kalashnikova T.P.,Churilina E.A., Kozulin M.S., Gusakova A.M., Kozlov B.N., Kamenshchikov N.O. Prevention of respiratory complications in patients at risk of adverse respiratory events by perioperative nitric oxide delivery during cardiac surgery under cardiopulmonary bypass: a single-center prospective randomized study. Patologiya krovoobrashcheniya i kardiokhirurgiya = Circulation Pathology and Cardiac Surgery. 2024;28(3):78-93. (In Russ.) https://doi.org/10.21688/1681-3472-2024-3-78-93
- Neumann F.J., Sousa-Uva M., Ahlsson A., Alfonso F., Banning A.P., Benedetto U., Byrne R.A., Collet J.P., Falk V., Head S.J., Jüni P., Kastrati A., Koller A., Kristensen S.D., Niebauer J., Richter D.J., Seferovic P.M., Sibbing D., Stefanini G.G., Windecker S., Yadav R., Zembala M.O., ESC Scientific Document Group. 2018 ESC/ EACTS Guidelines on myocardial revascularization. Eur Heart J. 2019;40(2):87-165. PMID: 30165437. https://doi.org/10.1093/eurheartj/ehy507
- Grant M.C., Crisafi C., Alvarez A., Arora R.C., Brindle M.E., Chatterjee S., Ender J., Fletcher N., Gregory A.J., Gunaydin S., Jahangiri M., Ljungqvist O., Lobdell K.W., Morton V., Reddy V.S., Salenger R., Sander M., Zarbock A., Engelman D.T. Perioperative Care in Cardiac Surgery: A Joint Consensus Statement by the Enhanced Recovery After Surgery (ERAS) Cardiac Society, ERAS International Society, and The Society of Thoracic Surgeons (STS). Ann Thorac Surg. 2024;117(4):669-689. PMID: 38284956. https://doi.org/10.1016/j.athoracsur.2023.12.006
- Chan J., Dimagli A., Dong T., Fudulu D.P., Sinha S., Angelini G.D. Trend and early clinical outcomes of off-pump coronary artery bypass grafting in the UK. Eur J Cardiothorac Surg. 2023;64(2):ezad272. PMID: 37522886; PMCID: PMC10876163. https://doi.org/10.1093/ejcts/ezad272
- Акчурин Р.С., Ширяев А.А., Галяутдинов Д.М., Васильев В.П., Курбанов С.К., Андреев А.В., Зайковский В.Ю., Майоров Г.Б. Годичные результаты коронарного шунтирования у пациентов с кальцинозом целевых коронарных артерий. Патология кровообращения и кардиохирургия. 2022;26(1):55-65. http://dx.doi.org/10.21688/1681-3472-2022-1-55-65 Akchurin R.S., Shiryaev A.A., Galyautdinov D.M., Vasiliev V.P., Kurbanov S.K., Andreev A.V., Zaikovsky V.Yu., Mayorov G.B. 1-year outcomes of coronary artery bypass grafting in patients with target artery distal calcinosis. Patologiya krovoobrashcheniya i kardiokhirurgiya = Circulation Pathology and Cardiac Surgery. 2022;26(1):55-65. (In Russ.) http://dx.doi.org/10.21688/1681-3472-2022-1-55-65
- Collins G.S., Reitsma J.B., Altman D.G., Moons K.G. Transparent reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): the TRIPOD statement. J Clin Epidemiol. 2015;68(2):134-43. PMID: 25579640. https://doi.org/10.1016/j.jclinepi.2014.11.010
- Moons K.G.M., Damen J.A.A., Kaul T., Hooft L., Andaur Navarro C., Dhiman P., Beam A.L., Van Calster B., Celi L.A., Denaxas S., Denniston A.K., Ghassemi M., Heinze G., Kengne A.P., Maier- Hein L., Liu X., Logullo P., McCradden M.D., Liu N., Oakden- Rayner L., Singh K., Ting D.S., Wynants L., Yang B., Reitsma J.B., Riley R.D., Collins G.S., Van Smeden M. PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods. BMJ. 2025;388:e082505. PMID: 40127903; PMCID: PMC11931409. https://doi.org/10.1136/bmj-2024-082505
- Wolff R.F., Moons K.G.M., Riley R.D., Whiting P.F., Westwood M., Collins G.S., Reitsma J.B., Kleijnen J., Mallett S.; PROBAST Group†. PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies. Ann Intern Med. 2019;170(1):51-58. PMID: 30596875. https://doi.org/10.7326/M18-1376
- Page M.J., McKenzie J.E.., Bossuyt P.M., Boutron I., Hoffmann T.C., Mulrow C.D., Shamseer L., Tetzlaff J.M., Akl E.A., Brennan S.E., Chou R., Glanville J., Grimshaw J.M., Hróbjartsson A., Lalu M.M., Li T., Loder EW, Mayo-Wilson E., McDonald S., McGuinness L.A., Stewart L.A., Thomas J., Tricco A.C., Welch V.A., Whiting P., Moher D. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. PMID: 33782057; PMCID: PMC8005924. https://doi.org/10.1136/bmj.n71
- Silverborn M., Nielsen S., Karlsson M. The performance of EuroSCORE II in CABG patients in relation to sex, age, and surgical risk: a nationwide study in 14,118 patients. J Cardiothorac Surg. 2023;18(1):40. PMID: 36658617; PMCID: PMC9850511.https://doi.org/10.1186/s13019-023-02141-4
- Zahara R., Soeharto D.F., Widyantoro B., Sugisman, Herlambang B. Validation of EuroSCORE II Scoring System on Isolated CABG Patient in Indonesia. Egypt Heart J. 2023;75(1):86. PMID: 37828408; PMCID: PMC10570231. https://doi.org/10.1186/s43044-023-00410-0
- Mokhtar M.N., Abdullah F.H., Abdul Rahman M.R., Ooi J.S.M. Evaluation of cardiac operative risk and outcome using EuroSCORE II for coronary artery bypass graft surgery. Anaesth Pain Intensive Care. 2023;27(3):307-14. https://doi.org/10.35975/apic.v27i3.2228
- Wolf P.J.W., Amato V.L. Assessment of EuroSCORE II and STS Score Performance and the Impact of Surgical Urgency in Isolated Coronary Artery Bypass Graft Surgery at a Referral Center in São Paulo, Brazil. Braz J Cardiovasc Surg. 2024;39(5):e20230282. PMID: 39241182; PMCID: PMC11378809. https://doi.org/10.21470/1678-9741-2023-0282
- Hirnle G., Aboul-Hassan S.S., Knapik P., Tobota Z., Maruszewski B.J., Rogowski J., Pawliszak W., Bugajski P., Deja M., Hrapkowicz T. Performance of EuroSCORE II in Octogenarians Undergoing Coronary Artery Surgery (from the KROK Registry). J Clin Med.2024;13(22):6863. PMID: 39598006; PMCID: PMC11594418. https://doi.org/10.3390/jcm13226863
- Musa A.F., Cheong X.P, Dillon J., Nordin R.B. Validation of EuroSCORE II in patients undergoing coronary artery bypassgrafting (CABG) surgery at the National Heart Institute, Kuala Lumpur: a retrospective review. F1000Res. 2018;7:534. PMID: 32913630; PMCID: PMC7459866. https://doi.org/10.12688/f1000research.14760.2
- Hogervorst E.K., Rosseel P.M.J., van de Watering L.M.G., Brand A., Bentala M., van der Meer B.J.M., van der Bom J.G. Prospective validation of the EuroSCORE II risk model in a single Dutch cardiac surgery centre. Neth Heart J. 2018;26(11):540-551. PMID: 30232783; PMCID: PMC6220016. https://doi.org/10.1007/s12471-018-1161-x
- Gao F., Shan L., Wang C., Meng X., Chen J., Han L., Zhang Y., Li Z. Predictive Ability of European Heart Surgery Risk Assessment System II (EuroSCORE II) and the Society of Thoracic Surgeons (STS) Score for in-Hospital Mortality of Patients Undergoing Coronary Artery Bypass Grafting. Int J Gen Med. 2021;14:8509- 8519. PMID: 34824547; PMCID: PMC8610380. https://doi.org/10.2147/IJGM.S338819
- Rodríguez Lima D.R., Rodríguez Aparicio E.E., Otálora González L., Hernández D.C., González-Muñoz A. Performance of the EuroSCORE in coronary artery bypass graft in Colombia, a middle-income country: A retrospective cohort. World J Cardiol. 2025;17(3):100506. PMID: 40161567; PMCID: PMC11947952. https://doi.org/10.4330/wjc.v17.i3.100506
- Mastroiacovo G., Bonomi A., Ludergnani M., Franchi M., Maragna R., Pirola S., Baggiano A., Caglio A., Pontone G., Polvani G., Merlino L. Is EuroSCORE II still a reliable predictor for cardiac surgery mortality in 2022? A retrospective study. Eur J Cardiothorac Surg. 2022;64(3):ezad294. PMID: 37669150; PMCID: PMC10722878. https://doi.org/10.1093/ejcts/ezad294
- Di Bacco L., D’Alonzo M., Baudo M., Montisci A., Di Eusanio M., Folliguet T., Solinas M., Miceli A., Fischlein T., Rosati F., Muneretto C. Reliability of EuroSCORE II on Prediction of Thirty-Day Mortality and Long-Term Results in Patients Treated with Sutureless Valves. J Clin Med. 2024;13(13):3986. PMID: 38999550; PMCID: PMC11242606. https://doi.org/10.3390/jcm13133986
- Kim K.M., Arghami A., Habib R., Daneshmand M.A., Parsons N., Elhalabi Z., Krohn C., Thourani V., Bowdish M.E. The Society of Thoracic Surgeons Adult Cardiac Surgery Database: 2022 Update on Outcomes and Research. Ann Thorac Surg. 2023;115(3):566-574. PMID: 36623634. https://doi.org/10.1016/j.athoracsur.2022.12.033
- Saka E., Öztürk E., Yüksel A.E., Kocabaş N.S. Comparison of EuroSCORE II and STS Risk Scoring Systems in Patients who Underwent Open-heart Surgery. Turk J Anaesthesiol Reanim. 2025;53(4):163-169. PMID: 40631722; PMCID: PMC12288423. https://doi.org/10.4274/TJAR.2025.241778
- Machado R.J., Saraiva F.A., Mancio J., Sousa P., Cerqueira R.J., Barros A.S., Lourenço A.P., Leite-Moreira A.F. A systematic review and meta-analysis of randomized controlled studies comparing off-pump versus on-pump coronary artery bypass grafting in the elderly. J Cardiovasc Surg (Torino). 2022;63(1):60-68. PMID: 34792312. https://doi.org/10.23736/S0021-9509.21.12012-9
- Chen S., Zhang S., Cai S., Wang H. Impact of frailty on outcomes following coronary artery bypass grafting: a systematic review and meta-analysis. BMC Surg. 2024;24(1):419. PMID: 39725933; PMCID: PMC11673924. https://doi.org/10.1186/s12893-024-02728-1
- Chandiramani A., Ali J.M. Frailty in Cardiac Surgery-Assessment Tools, Impact on Outcomes, and Optimisation Strategies: A Narrative Review. J Cardiovasc Dev Dis. 2025;12(4):127. PMID: 40278186; PMCID: PMC12028191. https://doi.org/10.3390/jcdd12040127
- Binuya M.A.E., Engelhardt E.G., Schats W., Schmidt M.K., Steyerberg E.W. Methodological guidance for the evaluation and updating of clinical prediction models: a systematic review. BMC Med Res Methodol. 2022;22(1):316. PMID: 36510134; PMCID: PMC9742671. https://doi.org/10.1186/s12874-022-01801-8
