CS 5678

Topics in Mixed Reality

Course Description

Course information provided by the 2020-2021 Catalog.

Head-worn mixed reality devices require real-time computer vision for multiple purposes, such as motion tracking, scene understanding, and interaction input. This course presents a hands-on overview of these computer vision techniques for mixed reality, from monocular pose estimation to stereo-view hand tracking, and scene reconstruction with depth sensors and multiple cameras. Fundamental approaches as well as current challenges, from geometric vision to learning-based approaches, are presented in the context of mixed reality, with readings from textbooks and relevant papers. Students will complete three individual assignments and one group project, in the form of mixed reality research prototypes and conference-style report.

Prerequisites/Corequisites Prerequisite: CS 5650, INFO 5340 , or permission from the instructor.

Permission Note Enrollment limited to: Cornell Tech students.

When Offered Spring.

View Enrollment Information