10-714 Deep Learning Systems: Algorithms and Implementation
12 units, Carnegie Mellon University
The goal of this course is to provide students an understanding and overview of the "full stack" of deep learning systems, ranging from the high-level modeling design of modern deep learning systems, to the basic implementation of automatic differentiation tools, to the underlying device-level implementation of efficient algorithms. Throughout the course, students will design and build from scratch a complete deep learning library, capable of efficient GPU-based operations, automatic differentiation of all implemented functions, and the necessary modules to support parameterized layers, loss functions, data loaders, and optimizers. Using these tools, students will then build several state-of-the-art modeling methods, including convolutional networks for image classification and segmentation, recurrent networks and self-attention models for sequential tasks such as language modeling, and generative models for image generation.
Prerequisites: (15-213 (min C) or 15-513 (min C)) and (21-240 (min C) or 21-241 (min C)) and (21-127 (min C) or 21-128 (min C) or 15-151 (min C)) and (10-301 (min C) or 10-315 (min C) or 10-601 (min C) or 10-701 (min C) or 10-715 (min C) or 07-280 (min C))
Offered: Fall 2026, Fall 2025
Courseweave needs JavaScript to show sections, workloads and planning tools.