CBLL HOME
VLG Group
News/Events
Seminars
People
Research
Publications
Talks
Demos
Datasets
Software
Courses
Links
Group Meetings
Join CBLL
Y. LeCun's website
CS at Courant
Courant Institute
NYU
Lush
Lush

V22-0480-002, Spring 2010:
Introduction to Robotics


[ Course Homepage | Schedule and Course Material | Videos/Photos | Mailing List ]

A course for undergraduates on robotics, physical computing, embedded systems, sensing and control.

Instructor: Yann LeCun, 715 Broadway, Room 1220, 212-998-3283, yann [ a t ] cs.nyu.edu

Teaching Asistant: TBA

Classes: Tuesdays and Thursdays 3:30-4:45PM, Room 1221, 715 Broadway.

Office Hours for Prof. LeCun: Thursdays 5:00-7:00 PM. Please send an email to Prof. LeCun prior to an office hour visit.

Assignments and announcements >>>

Robot documentation and links to on-line material >>>

Schedule >>>

pictures and videos >>>

Link to the 2009 edition of the class with videos of soccer-playing robots! >>>

News and Announcements

2010-05-05: Schedule of oral exams. Alphabetical:

Chronological:
  • Tyler Hsu: 05/06, 2:00
  • Quenton Cook: 05/06, 2:15
  • Lev Tatz: 05/06, 2:30
  • Alex Lobascio: 05/06, 3:00
  • Stanley Dady: 05/06: 3:15
  • Mike Chrzanowski: 05/06, 3:30
  • Andrew Stone: 05/06, 4:00
  • Steve Ellis: 05/06, 4:15
  • Ariel Hou: 05/06, 4:30
  • Eva Schooling: 05/07, 3:30
  • Kevin Wong: 05/07, 3:45
  • Tony Cheng: 05/07, 4:00
  • Ricky Cheng: 05/07, 4:30
  • Jason Alpert: 05/07, 4:45
  • Yeison Rodriguez: 05/07, 5:00
  • Liz Balsam: 05/07, 5:30
  • Mike C: 05/07, 5:45
  • Leon Weingard: 05/07, 6:00
  • Yunfan Luo: 05/11, 2:15
  • Arian Amiri: 05/11, 2:30
  • Charles Brillant: 05/11, 3:00
  • Ken H. Lai: 05/11, 3:15
  • Xi Sean Xu: 05/11, 3:30
  • Andy Entrekin: 05/11, 4:00
  • Mark Ackert: 05/11, 4:15
  • Louis Sanchez: 05/11, 4:30

2010-04-29: sign up for oral exams.

2010-04-28: Spring showcase is May 5th at 5:00 on the 13th floor of WWH.

2010-11-30: The class is full, but you can get on the waiting list.

Course Description

The robotics industry has been expanding at a very fast pace in recent years. Several companies now sell mobile robots to consumers for entertainment, surveillance, cleaning, and other applications. Concurrently, robotic-like capabilities are being integrated into traditional products such as cars, vacuum cleaners, lawnmowers.

Over the next decade, intelligent domestic robots will become ubiquitous. Automonous vacuum cleaners and lawnmowers will become widely available, as well as cars that essentially drive themselves

Autonomous unmanned vehicles of various types (UGV on the ground, UAV in the air, UUV under water) will be widely deployed for inspection, search and rescue operations, surveillance, and military applications.

Robots are computers with sensors and actuators that can interact directly with the physical world. The course will consist of hands-on sessions in which students will write software for a variety of robot platforms for tasks such as maze solving, grasping, obstacle avoidance, and target tracking using vision. Class projects will include various challenges and robot races. Topics will include sensors and actuators, micro-controler programming and real-time embedded systems, simple kinematics, trajectory planning, simple vision and pattern recognition methods, and elementary machine learning techniques.

prerequisite: V22.0201 or familiarity with C programming, Calculus.

Who Can Take This Course?

This course has very little prerequisites, besides calculus. It requires some familiarity with C programming, Some optional projects requires some notion of linear algebra. Familiarity with Linux is encouraged but not required.

The course is designed for seniors, juniors and advanced sophomores of all majors, as long as they satisfy the prerequisites.

Projects will use a variety of robotics platforms, from simple micro-controler boards to fully autonomous wheeled robots, to legged robots, to robots with wireless IP cameras remote controlled from a laptop.

Students are expected to bring a laptop to the class runing Ubuntu Linux.

Topics Treated

The topics studied in the course include:
  • sensors, and actuators.
  • microcontrolers, real-time programming, interrupts.
  • servomotors and feedback control.
  • light sensors, proximity sensors.
  • obstacle detection and line following.
  • PID controllers
  • Kinematics, odometry, and dead reckoning.
  • elements of pattern recognition.
  • introduction to image processing and computer vision.
  • vision-baed navigation and behavior control.
  • trajectory planning.
  • basic direct and inverse kinematics, robot arms and legs (if time permits)


The LAGR project

Evaluations

The best way (some would say the only way) to understand an algorithm is to implement it and apply it. Building working systems is also a lot more fun, more creative, and more relevant than taking formal exams.

Therefore students will be evaluated primarily (almost exclusively) on project assignments given on a 2 week cycle, and on a final project.

Mailing List

Register to the course's mailing list.

Text Books

There is no single textbook for the class, but the following books contain useful reference material:
  • Embedded Robotics, by Thomas Braunl (Springer): covers many aspects of robotics and embedded computing, although the code samples are specific to a particular robot controller platform.
  • Introduction to Autonomous Mobile Robots, by Roland Siegwart and Illah Nourbakhsh (MIT Press): everything about mobile robots: kinematics, localization/mapping, planning, perception, sensors.
  • Planning Algorithms, by Steven Lavalle (Cambridge) This book has the considerable advantage of being freely available on-line. It is a very thorough treatise on motion planning.
  • Probabilistic Robotics by Thrun, Burgard and Fox (MIT Press): a rather mathematical treatment of localization/mapping topics such as Kalman filters, SLAM, particle filters and such.

There are other robotics book from the "MIT" school. These books talk about "behavior-based robotics", which attempt to reproduce the behavior of simple animals, such as insects:

  • Cambrian Intelligence by Rodney Brooks (MIT Press): "intelligence without reason", "elephants don't play chess".
  • Robot Programming: a Practical Guide to Behavior-Based Robotics, by Joseph Jones (McGraw Hill): a more recent and more practical book on behavior-based robotics, by engineers fro iRobot (of Roomba fame).


automatic obstacle avoidance

Robotics and Machine Learning Research at NYU

Please have a look at the research project page of the Computational and Biological Learning Lab for a few example of robotics and machine learning research at NYU.

Links

3PI robot

Rovio robot with wireless webcam

.