Development of a system of integrated assessment of efficiency of cardiac care in the Russian Federation regions

Highlights. Methodology for the development of a system of indicators for the integral assessment of effectiveness and efficiency of cardiac care (cardiovascular surgery) in the subjects of the Russian Federation is proposed and tested.

Indicators, such as the length of stay, the number of operations on the heart and blood vessels, the number of ambulatory patients have high overall rating and consistency of expert opinions.

Aim. To develop a system of indicators for assessment of the effectiveness of cardiac care, cardiovascular surgery in particular, in the Russian Federation regions.

Methods. The study using expert surveys was conducted in the form of a structured interview. At the first stage, the primary selection of indicators was carried out using the annual public and field reports of the national medical research center. At the second stage, experts were selected and the level of expert competence was assessed. In total, out of 14 interviewed specialists, 10 were defined as experts. The average expert authority coefficient was 0.89. To quantify the degree of agreement between the experts` answers, Kendall's coefficient of concordance (W) was calculated. The significance of differences was assessed using the nonparametric Friedman test.

Results. The following indicators are recommended as indicators for rating efficiency of cardiac care in the regions of the Russian Federation: mortality after heart surgery, vascular surgery and percutaneous coronary interventions; mortality from diseases of the circulatory system; the number of ambulatory patients; the ratio of the number of endovascular interventions to the total number of discharged patients who suffered from acute coronary syndrome.

Conclusion. The selected indicators can be used both for the rating of the constituent entities of the Russian Federation, and in the development of federal projects or ministerial target programs. The results of the study can also be used to organize a system for monitoring the effectiveness of the implementation of these projects and programs.

1. Roth G.A., Mensah G.A., Johnson C.O., Addolorato G., Ammirati E., Baddour L.M., Barengo N.C., Beaton A.Z., Benjamin E.J., Benziger C.P., Bonny A., Brauer M., Brodmann M., Cahill T.J., Carapetis J., Catapano A.L., Chugh S.S., Cooper L.T., Coresh J., Criqui M., DeCleene N., Eagle K.A., Emmons-Bell S., Feigin V.L., Fernández-Solà J., Fowkes G., Gakidou E., Grundy S.M., He F.J., Howard G., Hu F., Inker L., Karthikeyan G., Kassebaum N., Koroshetz W., Lavie C., Lloyd-Jones D., Lu H.S., Mirijello A., Temesgen A.M., Mokdad A., Moran A.E., Muntner P., Narula J., Neal B., Ntsekhe M., Moraes de Oliveira G., Otto C., Owolabi M., Pratt M., Rajagopalan S., Reitsma M., Ribeiro A.L.P., Rigotti N., Rodgers A., Sable C., Shakil S., Sliwa-Hahnle K., Stark B., Sundström J., Timpel P., Tleyjeh I.M., Valgimigli M., Vos T., Whelton P.K., Yacoub M., Zuhlke L., Murray C., Fuster V. Global Burden of Cardiovascular Diseases and Risk Factors, 1990-2019: Update From the GBD 2019 Study. J Am Coll Cardiol. 2020; 76 (25): 2982–3021. doi: 10.1016/j.jacc.2020.11.010

2. Amini M., Zayeri F., Salehi M. Trend analysis of cardiovascular disease mortality, incidence, and mortality-to-incidence ratio: results from global burden of disease study 2017. BMC Public Health. 2021; 21 (1): 401. doi:10.1186/s12889-021-10429-0

3. Matskeplishvili S., Kontsevaya A. Cardiovascular Health, Disease, and Care in Russia. Circulation. 2021; 144 (8): 586–8. doi:10.1161/CIRCULATIONAHA.121.055239

4. Medvedeva E.A., Zvartau N.E., Villevalde S.V., Yakovlev A.N., Solovieva A.E., Fedorenko A.A., Karlina V.A., Zaitsev V.V., Endubaeva G.V., Panarina S.A., Erastov A.M. Analysis of healthcare for patients with cardiovascular diseases in Russian Federation in comparison with the practice of Europe and USA. Kardiologiia. 2021; 61 (3): 105–14 (in Russian) doi:10.18087/cardio.2021.3.n1179

5. Alekyan B.G., Boytsov S.A., Manoshkina E.M., Ganyukov V.I. Myocardial revascularization in Russian Federation for acute coronary syndrome in 2016-2020. Kardiologiia. 2021 ;61 (12): 4–15 (in Russian) doi:10.18087/cardio.2021.12.n1879

6. Carinci F., Van Gool K., Mainz J., Veillard J., Pichora E.C., Januel J.M., Arispe I., Kim S.M., Klazinga N.S. Towards actionable international comparisons of health system performance: expert revision of the OECD framework and quality indicators. Int J Qual Heal care. 2015; 27 (2): 137–46. doi:10.1093/intqhc/mzv004

7. Golukhova E.Z., Semenov V.Y., Kovalenko O.A. Development of medical care in the field of “cardiovascular surgery” in the Central, Volga and North Caucasian Federal Districts of the Russian Federation in the framework of the implementation of regional programs “Fight Against Cardiovascular Diseases.” Bull Bakoulev Center Cardiovasc Dis. 2021; 22 (2): 195–204 (in Russian) doi:10.24022/1810-0694-2021-22-2-195-204

8. Willerman B. The adaptation and use of Kendall’s coefficient of concordance (W) to sociometric-type rankings. Psychol Bull. 1955; 52 (2): 132–3. doi:10.1037/h0041665

9. Tandon A., Murray C.J., Lauer J., Evans D.B. Measuring health system performance for 191 countries. Eur J Health Econ. 2002; 3 (3): 145–8.

10. Hibbard J.H., Stockard J., Tusler M. Hospital performance reports: Impact on quality, market share, and reputation. Health Aff. 2005; 24 (4): 1150–60. doi:10.1377/hlthaff.24.4.1150

11. Hibbard J.H., Stockard J., Tusler M. Does publicizing hospital performance stimulate quality improvement efforts? Health Aff. 2003; 22 (2): 84–94. doi:10.1377/hlthaff.22.2.84

12. The Quality Indicator Study Group. An approach to the evaluation of quality indicators of the outcome of care in hospitalized patients, with a focus on nosocomial infection indicators. American Journal of Infection Control. 1995; 23 (3): 215-222. doi:10.1016/0196-6553(95)90045-4

13. Roberts D.A., Ng M., Ikilezi G., Gasasira A., Dwyer-Lindgren L., Fullman N., Nalugwa T., Kamya M., Gakidou E. Benchmarking health system performance across regions in Uganda: A systematic analysis of levels and trends in key maternal and child health interventions, 1990-2011. BMC Med. 2015; 13 (1): 1–16. doi: 10.1186/s12916-015-0518-x

14. Giovanelli L., Marinò L., Rotondo F., Fadda N., Ezza A., Amadori M. Developing a performance evaluation system for the Italian public healthcare sector. Public Money & Manag. 2015; 35 (4): 297–302. doi: 10.1080/09540962.2015.1047274