Course · ANL7312
Markov Chains and Decision-Making Processes
Course information
- Course code
- ANL7312
- Credits (ECTS)
- 5
- L + S + Lab
- 0 + 0 + 0
- Year / semester
- Year 1 / semester 1
- Level of course
- Master's degree
- Component
- Elective component (EC)
- Cycle
- PD
- Final assessment
- Examination
- Educational programme
- 7M06110 Computing and software
- Curriculum
- Вычислительная техника и программное обеспечение (2026-2028)
Elective course; offered as a choice together with:
- ANL7306Computer Vision
- ANL7311Generative-Adversarial Networks
Course description
Brief course description This discipline involves the study of Markov chains, in which each element is completely determined by the previous one. These chains are widely used in the formulation of tasks of linking artificial intelligence to the behaviour of an agent in a certain environment, for example, a robot in a real environment, on which, for example, reinforcement learning is based.
Expected learning outcomes Upon successful completion of the course, students will be able to:
- work with methods of building probabilistic models describing stochastic dynamics of processes;
- perform sampling and estimation;
- develop a mass service system
- be able to establish properties of solutions of stochastic systems.
Source: Platonus, working curriculum for the 2026–2027 academic year.
← Programme curriculum