Master
2022/2023
Visual geometry and 3D image processing
Type:
Compulsory course (Master of Computer Vision)
Area of studies:
Applied Mathematics and Informatics
Delivered by:
Department of Applied Mathematics and Informatics
When:
2 year, 2 module
Mode of studies:
distance learning
Online hours:
90
Open to:
students of one campus
Instructors:
Ilya Makarov
Master’s programme:
Master of Computer Vision
Language:
English
ECTS credits:
6
Contact hours:
12
Course Syllabus
Abstract
This online course offers an introduction to the main tasks of 3D computer vision. We discuss both classical algorithms and modern neural network approaches. Students will get familiar with the theoretical description of the methods and obtain hands-on experience with practical tasks. Everyone who has been introduced to 2D computer vision and wants to extend their knowledge to the 3D world will be interested in this course.
Learning Objectives
- The aim of this online course is to introduce students to 3D computer vision algorithms. Students will work with classic approaches and deep learning models for depth estimation and processing point clouds, understanding scene geometry for augmented reality and implementing vision perception for self-driving cars. Both core theory related to 3D computer vision and practical skills will be presented through the course in order to give students a solid background for using learned material in the future.
Expected Learning Outcomes
- Distinguish the main tasks of 3D image processing
- Distinguish the basics of 3d image processing
- Apply epipolar geometry
- Estimate depth based on various input modalities
- Apply depth estimation models in practice
- Distinguish applications of point clouds
- Apply PointNet architecture for different tasks
- Distinguish simultaneous localization and mapping (SLAM) methods
- Apply SLAM in practice
- Distinguish between approaches for multi-view generation
- Apply NeRF algorithm for new view generation
- Being able to perform 3D image processing
- Apply neural network models in practice
Course Contents
- Introduction to 3d image processing
- Basics of 3D image processing
- Depth Estimation
- Point Clouds
- Localization and mapping
- Multi-View Generation
- Final task with instructor’s evaluation
Assessment Elements
- Testing Assignment week 1
- Testing Assignment week 2
- Testing Assignment week 3
- Testing Assignment week 4
- Testing Assignment week 5
- Testing Assignment week 6
- Programming Assignment
Interim Assessment
- 2022/2023 2nd module0 * Testing Assignment week 2 + 1 * Programming Assignment + 0 * Testing Assignment week 1
Bibliography
Recommended Core Bibliography
- Hartley, R., & Zisserman, A. (2015). Multiple View Geometry in Computer Vision (2nd ed). Australia, Australia/Oceania: Cambridge University Press. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.1FEA5378
- Mathematical methods in computer vision, , 2003
- Richard Szeliski. (2010). Computer Vision: Algorithms and Applications. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsbas&AN=edsbas.E8FCD1BD
Recommended Additional Bibliography
- Инженерная 3D - компьютерная графика : учебник и практикум для акад. бакалавриата, Хейфец, А. Л., 2015