16-726 Learning-based Image Synthesis

12 units, Carnegie Mellon University

This course introduces machine learning methods for image and video synthesis. The objectives of synthesis research vary from modeling statistical distributions of visual data, through realistic pictureperfect recreations of the world in graphics, and all the way to providing interactive tools for artistic expression. Key machine learning algorithms will be presented, ranging from classical learning methods e.g., nearest neighbor, PCA to deep learning models e.g., ConvNets, NeRF, deep generative models, including GANs, VAEs, autoregressive models, and diffusion models. Finally, we will discuss image and video forensics methods for detecting synthetic content. In this class, students will learn to build practical applications and create new visual effects using their own photos and videos.

Prerequisites: none listed

Courseweave needs JavaScript to show sections, workloads and planning tools.