16-884 Deep Learning for Robotics
12 units, Carnegie Mellon University
The goal of this course is to study relevant topics towards building intelligent robots that can learn to act and perceive in the real world. The course material should be a selfcontained collection of key topics from the intersection of four research areas geared towards this common goal a Robot Learning Deep RL b Computer Vision c Control d Psychology Neuroscience. This course is geared mainly towards learning and brainstorming. There will be two classes every week. In this first class, instructor will present an indepth overview of a topic, and then in the second class, students will present instructorassigned papers related to that topic. There will be no homeworks and just a course project. In the first quarter, we will cover stateoftheart topics in robot learning deep RL, inverse RL, etc. and control optimal control, dynamic movement primitives, etc. by studying classical and recent papers in the area. In the second quarter, we will study the role of perception in control and viceversa to build methods that can learn from highdimensional raw sensory input. In the third quarter, we will discuss the state of the current understanding of how the brain integrates action and perception. We will also discuss relevant papers from ontogeny child development literature in Psychology and phylogeny evolutionary development literature in Biology of biological animals that have inspired ideas in learning and robotics. Finally, in the fourth quarter, we will bring these ideas together to brainstorm potential highlevel directions that could guide the development of intelligent robots.
Prerequisites: none listed
Courseweave needs JavaScript to show sections, workloads and planning tools.