Development of a mobile application for distance learning in physics using augmented reality technology
GOAL
Project Goal
To develop a mobile application for a multilingual educational platform (Kazakh, Russian, English) for distance learning in physics at higher and secondary educational institutions using augmented reality technology.
ABOUT THE PROJECT
Relevance
The development of information and communication technologies poses new challenges for schools. The textbook is no longer the only source of knowledge for students. There is a need to develop students' skills such as navigating the modern information space, solving non-standard problems, working in a team, and independently planning, analyzing and evaluating their own activities. This can be achieved with mobile devices, which are a powerful tool for modeling, interaction and observation. Thus, the idea of using mobile technologies in education is becoming increasingly relevant.
With the emergence of new computing power in mobile devices (tablets, smartphones), new prospects have opened up for their use in trade, industry, medicine, education and other fields. In education, mobile devices have high potential which, if properly integrated, can form a new effective learning model.
In this regard, the idea of the project is to develop our own mobile application for learning physics using augmented reality technology.
PLANS
Expected Results
The expected scientific impact lies in developing our own software product based on modern smart technologies using augmented reality. The project will improve the quality of training of specialists in technical fields by involving bachelor's, master's and PhD students in its implementation. The software was developed using an ecological approach that treats the object as part of the environment, as a rule in the form of an ecosystem, taking sustainable development into account. The multiplier effect lies in the repeated use of the product at higher, technical and vocational, and secondary educational institutions, as well as by any interested users. The scientific and technical impact lies in the development of virtual and augmented reality and computer visualization, as well as the transition to advanced digital and intelligent manufacturing technologies, robotic systems, new materials and design methods, and the creation of big data processing, machine learning and artificial intelligence systems.
RESULTS
Achieved Results
To define the set of requirements for the mobile application, an analysis of the market for similar commercial and non-commercial projects was carried out. They were selected based on similarity of subject (educational software) and format (virtual laboratory works). As a result, the following set of requirements was formed:
- Realistic models simulating laboratory equipment;
- Compatibility with the most popular platforms: iOS, Android;
- Correspondence of the simulated process to a real physical experiment;
- Operation of the application in augmented reality mode.
Due to the specifics of the project — conducting physical experiments — much attention was paid to developing a prototype of the experiment scene. This was implemented with technologies that make it possible to create images close to real prototypes in the virtual world. To give users freedom in performing the work, a significant part of the screen is reserved as a workspace. The Unity 3D game engine, a cross-platform environment following the WORA (write once, run anywhere) principle, was chosen as the most suitable platform for developing the virtual physics laboratory prototype. The functionality was written in C#, and the graphic models were created in Substance Painter.
The project was built, a mobile application for learning physics using augmented reality technology was developed, and the project was tested for critical runtime errors.
The user interface of the application and its adaptability to different device sizes were tested.
Guidelines for performing laboratory works were written to make working with the application comfortable and to support its introduction into the educational process.
The guidelines serve as a guide describing the application's functionality and each interface element, making it easy to start working with the program.
PUBLICATIONS
List of Publications
- Ye.A. Daineko, D.D. Tsoy, A.M. Seitnur, M.T. Ipalakova, Zh.B. Kalpeyeva. Development of a mobile application for learning physics using augmented reality technology (in Russian). Bulletin of D. Serikbayev EKTU, 2021, No. 4 (138), pp. 63–70
- Ye. Daineko, A. Seitnur, D. Tsoy, M. Ipalakova, R. Sharshova, “Development of a mobile textbook using augmented Reality technology for studying physics”, Proceedings of ICERI2021 Conference 8th-9th November 2021. P. 6481-6486
- A. Niyazgulova, N. Ibragimov, G. Zakirova, Y. Daineko, D. Tsoy, A. Seitnur, “Implementation of bologna process tools in the technology of education in secondary vocational School”, Proceedings of ICERI2021 Conference 8th-9th November 2021. P. 6552-6562
- Y.A. Daineko, D.D. Tsoy, A.M. Seitnur, M.T. Ipalakova. Development of a mobile e-learning platform on physics using augmented reality technology. iJIM ‒ Vol. 16, No. 5, 2022. P. 4-18
INTELLECTUAL PROPERTY
Copyright Certificates
- Ipalakova M.T., Daineko Ye.A., Tsoy D.D., Seitnur A.M. Copyright Certificate No. 21094 "Development of a multilingual mobile application (Kazakh, Russian, English) for distance learning in physics at higher and secondary educational institutions using augmented reality technology"
TEAM
Research Team
Daineko Yevgeniya Aleksandrovna, PhD
IITU JSC, Associate Professor
Scopus ID: 36060995800
ORCID: 0000-0001-6581-2622
Tsoy Dana Dmitriyevna, MSc
IITU JSC, Head of the Mixed Reality Laboratory
Scopus ID: 57203037057
ORCID: 0000-0003-0172-9760
Seitnur Aigerim Mukhtarkyzy, MSc
IITU JSC, Senior Lecturer
Scopus ID: 57209970291
ORCID: 0000-0003-1058-1016