Lerrel Pinto

Lerrel Pinto

I am an Assistant Professor of Computer Science at NYU working on problems in Robotics and Machine Learning. If you are interested in joining my research group please read this.

Previously, I was a postdoctoral fellow at UC Berkeley, working with Alyosha Efros and Pieter Abbeel. Before this, I received a Ph.D. in Robotics from Carnegie Mellon University, working with Abhinav Gupta.

Email / Scholar / Thesis / Teaching / Twitter

News

VentureBeat just covered our work on visual imitation learning!
TechCrunch just covered our work on using sound in robotics!
I'll be teaching a Deep RL class in Fall 2020. More details can be found here.
WIRED recently covered our work on learning with adversarial humans.
Our open source robotics research platform, PyRobot, is now online!

Learning to Grasp	Learning to Fly	Learning in Homes

Simulation to Real Transfer	Manipulation of Deformable Objects	Visual Imitation Learning

Recent Talk (May 2020)

Press Coverage

Learning with human adversaries

Tech Xplore

Science Daily

Daily Mail

Scaling up self supervised learning

Learning to Fly

Self supervised Grasping

MIT Tech Review

Futurism Tech Review

direct industry Tech Review

Tech Xplore Review

Research and Selected Projects

GIF

Self-Supervised Policy Adaptation during Deployment
Nicklas Hansen, Rishabh Jangir, Yu Sun, Guillem Alenya, Pieter Abbeel, Alexei A. Efros, Lerrel Pinto, Xiaolong Wang
ICLR 2021 (Spotlight Presentation)
paper / project page / code

GIF

Task-Agnostic Morphology Evolution
Donald J. Hejna III, Pieter Abbeel, Lerrel Pinto
ICLR 2021
paper / project page

GIF

Learning Cross-Domain Correspondence for Control with Dynamics Cycle-Consistency
Qiang Zhang, Tete Xiao, Alexei A. Efros, Lerrel Pinto, Xiaolong Wang
ICLR 2021 (Oral Presentation)
paper / project page

GIF

Visual Imitation Made Easy
Sarah Young, Dhiraj Gandhi, Shubham Tulsiani, Abhinav Gupta, Pieter Abbeel, Lerrel Pinto
CoRL 2020
paper / data

GIF

Learning Predictive Representations for Deformable Objects Using Contrastive Estimation
Wilson Yan, Ashwin Vangipuram, Pieter Abbeel, Lerrel Pinto
CoRL 2020
paper / code / blog post

GIF

Robust Policies via Mid-Level Visual Representations
Bryan Chen*, Alexander Sax*, Francis E. Lewis, Silvio Savarese, Jitendra Malik, Amir Zamir, Lerrel Pinto
CoRL 2020
paper / code / project page

	Reinforcement Learning with Augmented Data Michael Laskin, Kimin Lee, Adam Stooke, Lerrel Pinto, Pieter Abbeel, Aravind Srinivas NeurIPS 2020 (Spotlight Presentation) paper / code
	Automatic Curriculum Learning through Value Disagreement Yunzhi Zhang, Pieter Abbeel, Lerrel Pinto NeurIPS 2020 paper / website / code
	Generalized Hindsight for Reinforcement Learning Alexander Li, Lerrel Pinto, Pieter Abbeel NeurIPS 2020 paper / website
	Swoosh! Rattle! Thump! - Actions that Sound Dhiraj Gandhi, Abhinav Gupta, Lerrel Pinto RSS 2020 paper / website / data
	Learning to Manipulate Deformable Objects without Demonstrations Yilin Wu, Wilson Yan, Thanard Kurutach, Lerrel Pinto, Pieter Abbeel RSS 2020 paper / website / code / blog post / talk
	Hierarchically Decoupled Imitation for Morphological Transfer Donald J. Hejna III, Pieter Abbeel, Lerrel Pinto ICML 2020 paper / website / code
	Discovering Motor Programs by Recomposing Demonstrations Tanmay Shankar, Shubham Tulsiani, Lerrel Pinto, Abhinav Gupta ICLR 2020 paper / website
	Robot Learning via Human Adversarial Games Jiali Duan, Qian Wang, Lerrel Pinto, C.-C. Jay Kuo, Stefanos Nikolaidis IROS 2019 (Best Cognitive Robotics Paper Award Finalist) paper
	PyRobot: An Open-source Robotics Framework for Research and Benchmarking Adithya Murali, Tao Chen, Kalyan Vasudev Alwala, Dhiraj Gandhi, Lerrel Pinto, Saurabh Gupta, Abhinav Gupta Open source platform (https://www.pyrobot.org/) white paper / code
	Environment Probing Interaction Policies WenXuan Zhou, Lerrel Pinto, Abhinav Gupta ICLR 2019 paper / code
	Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitation Pratyusha Sharma^, Lekha Mohan^, Lerrel Pinto, Abhinav Gupta CoRL 2018 paper / dataset
	Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias Abhinav Gupta, Adithya Murali, Dhiraj Gandhi, Lerrel Pinto [Equal contribution] NeurIPS 2018 paper / dataset / models
	Asymmetric Actor Critic for Image-Based Robot Learning Lerrel Pinto, Marcin Andrychowicz, Peter Welinder, Wojciech Zaremba, Pieter Abbeel RSS 2018 paper / Video / Blog
	CASSL: Curriculum Accelerated Self-Supervised Learning Adithyavairavan Murali, Lerrel Pinto, Dhiraj Gandhi, Abhinav Gupta ICRA 2018 paper / Video
	Learning to Fly by Crashing Dhiraj Gandhi, Lerrel Pinto, Abhinav Gupta IROS 2017 paper / Video
	Robust Adversarial Reinforcement Learning Lerrel Pinto, James Davidson, Rahul Sukthankar, Abhinav Gupta ICML 2017 paper / Video
	Supervision via Competition: Robot Adversaries for Learning Tasks Lerrel Pinto, James Davidson and Abhinav Gupta ICRA 2017 paper / Video / Grasp Detection Code
	Learning to Push by Grasping: Using multiple tasks for effective learning Lerrel Pinto and Abhinav Gupta ICRA 2017 paper / Video
	The Curious Robot: Learning Visual Representations via Physical Interactions Lerrel Pinto, Dhiraj Gandhi, Yuanfeng Han, Yong-Lae Park and Abhinav Gupta ECCV 2016 (Spotlight Presentation) paper
	Supersizing Self-supervision: Learning to Grasp from 50K Tries and 700 Robot Hours Lerrel Pinto and Abhinav Gupta ICRA 2016 (Best Student Paper Award) paper / raw data / patch dataset

Source borrowed from here