UM EECS 598: Action and Perception, Winter 2023

Instructors: Stella Yu, Benjamin Kuipers, Andrew Owens

Assistants: Zilin Wang, Sangryul Jeon

# Date Papers Slides
0 01/04/2023 Syllabus Introduction
1 01/09/2023 1994 A Critique of Pure Vision

2018 Deep Learning: A Critical Appraisal

1994PureVisionSlides

2018DLAppraisalSlides

2 01/11/2023 2009 The Interface Theory of Perception

2017 Shakey: From Conception to History

2009InterfaceTheorySlides

2017ShakeySlides (discussion only)

01/16/2023 MLK Holiday
3 01/18/2023 2019 Vision, an Optical User Interface

2021 The Language of Vision

2019OpticalInterfaceSlides

2021LanguageVisionSlides

4 01/23/2023 1978 Principles of Categorization

2002 Big Book of Concepts Chapter 3

1978CategorizationSlides

2002ConceptsSlides

5 01/25/2023 1979 The Theory of Affordances (Chapter 8)

2019 Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments

1979AffordanceSlides

2019Affordance3DSlides

6 01/30/2023 1988 Exploratory Behavior in the Development of Perceiving, Acting, and the Acquiring of Knowledge

2019 An Ecological Approach to Learning in (Not and) Development

1988ExploratoryBehaviorSlides

2019LearningInDevelopmentSlides

7 02/01/2023 1994 Initial Knowledge: 6 Suggestions

2001 A Sensori-motor Account of Vision and Visual Consciousness

1994InitialKnowledgeSlides

2001SensorimotorAccountSlides

8 02/06/2023 2007 Intrinsic Motivation Systems for Autonomous Mental Development

2013 Information-seeking, Curiosity, and Attention: Computational and Neural Mechanisms

2007IntrinsicMotivationSlides

2013InfomationSeekingSlides

9 02/08/2023 2017 Curiosity-driven Exploration by Self-supervised Prediction

2017 Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks

2017CuriosityDrivenSlides

2017MAMLSlides

10 02/13/2023 2003 Perception of the Structure of the Physical World Using Unknown Multimodal Sensors and Effectors

2020 A Formal Account of Structuring Motor Actions With Sensory Prediction for a Naive Agent

2003UnknownMultimodalSlides

2020MotorActionSlides

11 02/15/2023 2012 Object Individuation and Physical Reasoning in Infancy: An Integrative Account

2021 The Emergence of Objectness: Learning Zero-Shot Segmentation from Videos

2012ObjectIndividuationSlides

2021EmergenceObjectnessSlides

12 02/20/2023 2016 The Roles of Vision and Eye Movements in the Control of Activities of Daily Living

2018 The Developing Infant Creates a Curriculum for Statistical Learning

2016EyeMovementSlides

2018DevelopingInfantsSlides

13 02/22/2023 1987 Hand Movements: A Window into Haptic Object Recognition

2006 Control Strategies in Object Manipulation Tasks

1987HandMovementsSlides

2006ObjectManipulationSlides

02/24/2023

Project proposal due at 11:59 pm EST

02/27/2023

Winter Vacation

03/01/2023

Winter Vacation

14 03/06/2023 1989 A Robot That Walks; Emergent Behaviors from A Carefully Evolved Network

2010 The iCub Humanoid Robot: An Open-systems Platform for Research in Cognitive Development

1989RobotThatWalksSlides

2010ICubRobotSlides

15 03/08/2023 1999 Internal Models for Motor Control and Trajectory Planning

2020 Learning Quadrupedal Locomotion over Challenging Terrain

1999InternalModelsSlides

2020QuadrupedalLocomotionSlides

16 03/13/2023 2021 How to Train Your Robot with Deep Reinforcement Learning: Lessons We Have Learned

2018 Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Control

2021TrainRobotRLSlides

2018VisualForesightSlides

17 03/15/2023 2021 RMA: Rapid Motor Adaptation for Legged Robots

2023 Learning Visual Locomotion with Cross-Modal Supervision

2021RMASlides

2023VisionRMASlides

18 03/20/2023 2015 Motor Development

2020 Infant Object Manipulation and Play

2015MotorDevelopmentSlides

2020InfantObjManipulationSlides

19 03/22/2023 2020 Deep Learning Can Accelerate Grasp-optimized Motion Planning

2021 A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms

2020GraspOptimizedMotionPlanSlides

2021ReviewRobotLearningSlides

20 03/27/2023 2018 Learning to Grasp by Extending the Peri-personal Space Graph 2018LearningToGraspSlides
21 03/29/2023 2017 Time-Contrastive Networks: Self-Supervised Learning from Video

2023 VideoDex: Learning Dexterity from Internet Videos

2017TCNSlides

2023VideoDexSlides

22 04/03/2023 2004 Tools for the Body (Schema)

2010 Body Schema in Robotics: A Review

2004ToolsForTheBodySlides

2010BodySchemaReviewSlides

23 04/05/2023 2011 A New Neural Framework for Visuospatial Processing 2011VisuospatialProcessingSlides
24 04/10/2023 2022 Deep Learning Approaches to Grasp Synthesis: A Review

2018 More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch

2022GraspSynthesisReviewSlides

2018MoreThanAFeelingSlides

25 04/12/2023 2016 RL^2: Fast Reinforcement Learning via Slow Reinforcement Learning

2018 Modular Meta-learning

2016RL2Slides

2018ModularMetaLearningSlides

26 04/17/2023 2022 Navigating to Objects in the Real World

2005 The Development of Embodied Cognition: Six Lessons from Babies

2022NavigateToObjectsSlides

2005EmbodiedCognitionSlides

04/25/2023

Project write-up and slides due at 11:59 pm EST

04/26/2023

Project presentation at EECS1303 10:30am - 12:30pm EST

Examples:

CuriosityDrivenExploration

Disambiguation

HumanEyeInspiredRNN

InvestigatingObjectness

LearningByLooking

ToddlerNet