Development of an intelligent simulator for training coronary artery angioplasty and stenting using virtual reality technology
y.daineko@iitu.edu.kz
GOAL
Project Goal
To develop an intelligent multilingual software complex using virtual reality technology that enables training and the acquisition of skills in coronary artery angioplasty and stenting.
ABOUT THE PROJECT
Abstract
The use of virtual and augmented reality technologies to develop modern trainers or simulators makes it possible to train and improve the skills of surgeons and to create new techniques that take into account the individual characteristics of patients. This, in turn, contributes to the further development of national medicine and, as a result, to improving the quality of life of the population.
Project Objectives
- To research and analyze international experience in the development and implementation of computer-based training simulators built on various integrated development environments.
- To develop general requirements for the software complex of a virtual simulator running on a personal computer and intended for training and acquiring skills in coronary angioplasty. One of the main requirements is that the simulated devices, the human cardiovascular system and tissues must have an interface similar to the real one.
- To develop an approach to creating a virtual reality simulator for coronary artery angioplasty and stenting.
- To create a mathematical model of the motion of an inhomogeneous compressible fluid based on the 2D–3D Navier–Stokes equations.
- To develop a computer model of blood flow in the human cardiovascular system based on compressible fluid dynamics (Navier–Stokes equations) for inclusion in the simulator.
- To create computer models of the devices and 3D models of the organs used in the virtual reality simulator.
- To develop a virtual reality simulator for training coronary artery angioplasty and stenting.
- To write guidelines and documentation on the use of the virtual reality simulator.
Novelty
- Development of improved algorithms for the interaction of objects in a virtual environment using Oculus Rift virtual reality headsets and the Leap Motion controller for coronary artery angioplasty and stenting.
- Computer modeling of the motion of an inhomogeneous compressible fluid (cells, cell fragments, aqueous solution, plasma) in veins (internal channels) based on the 2D–3D Navier–Stokes equations.
RESULTS
Current Results
An analysis was carried out in the field of developing and implementing computer-based training simulators built on various integrated development environments, and general requirements for the software complex were drawn up. The analysis of international experience showed that most work in medical training has been implemented with the Unity development platform. Therefore, virtual reality technology using the Unity developer platform was chosen as the implementation technology and development environment. A camera algorithm was developed: since the user interacts with a first-person camera inside the scene, a camera system was created that makes it possible to observe what happens when instruments are inserted into the artery, as well as a first-person view. The user's view changes with the position of the body, head and hands.
An instrument algorithm was developed that allows the user to interact with medical instruments in a realistic virtual environment. 3D models of the instruments and text descriptions make the simulator accessible to users with different levels of medical knowledge.
An algorithm for the behavior of organic tissues was developed that allows the skin to deform when pressed and to be punctured for catheter insertion and other necessary medical procedures. Moreover, the user can adjust the characteristics of the artery to account for the individual features of each patient's vessels. Both hands are supported inside the simulator: code was developed that includes all the necessary functionality for both of the user's hands, so the user can fully take part in the operation and interact with both the instruments and the patient's virtual body. A mathematical model of the motion of an inhomogeneous compressible fluid based on the 2D–3D Navier–Stokes equations was created. The two-dimensional model was discretized using the finite difference method, and blood flow velocity distributions in a rectangular vessel region were obtained.
- .
To model the pulsatile nature of blood flow, a non-stationary boundary condition was implemented, and the results of two-dimensional blood flow solved by the Euler and Runge–Kutta methods are presented. The results show a wave-like pattern consistent with the pulsation function, and the maximum velocities at the peak of ejection roughly match the results reported by other authors.
IMPLEMENTATION
Commercialization and Practical Application
The project is subject to further commercialization.
TEAM
Research Team
Daineko Yevgeniya Aleksandrovna, PhD, Associate Professor
IITU JSC, Associate Professor
Scopus ID: 36060995800
ORCID: 0000-0001-6581-2622
Ipalakova Madina Tulegenovna, Cand. Tech. Sci., Associate Professor
IITU JSC, Associate Professor
Scopus ID: 56912288100
ORCID: 0000-0002-8700-1852
Alipova Bakhyt Nurashevna, PhD
IITU JSC, Associate Professor
Scopus ID: 55574803800
ORCID: 0000-0003-0915-2759
Kozhakhmetov Azamat Kosherbayevich
Cardiologist
Bolatov Zhiger Zhasulanuly, MSc
IITU JSC, Head of the Computer Modeling and Simulation Laboratory
Scopus ID: 57194322791
ORCID: 0000-0002-1945-8156
Tsoy Dana Dmitriyevna, MSc
IITU JSC, Head of the Mixed Reality Laboratory
Scopus ID: 57203037057
ORCID: 0000-0003-0172-9760
Seitnur Aigerim Mukhtarkyzy, MSc
IITU JSC, Senior Lecturer
Scopus ID: 57209970291
ORCID: 0000-0003-1058-1016
Tokmukhamedova Fatima Kadyrovna, MSc
IITU JSC, Senior Lecturer
Scopus ID: 57250078700
ORCID: 0000-0001-7980-8245
Alpar S.D., PhD
IITU JSC, Assistant Professor
Scopus ID: 57249512400
ORCID: 0000-0003-0579-4180
Rysbek Nazerke Sakenkyzy
IITU JSC
Karimova Bibinur Sarsemkhanovna
IITU JSC, Accountant