{"671114":{"#nid":"671114","#data":{"type":"event","title":"IRIM Spring 2024 Seminar | Interactive Learning in the Era of Large Models","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003EAbstract:\u003C\/strong\u003E \u003Cspan\u003EIn this talk, I will discuss the problem of interactive learning by discussing how we can actively learn objective functions from human feedback capturing their preferences. I will then talk about how the value alignment and reward design problem can have solutions beyond active preference-based learning by tapping into the rich context available from large language models. In the second section of the talk, I will more generally talk about the role of large pretrained models in today\u2019s robotics and control systems. Specifically, I will present two viewpoints: 1) pretraining large models for downstream robotics tasks, and 2) finding creative ways of tapping into the rich context of large models to enable more aligned embodied AI agents. For pretraining, I will introduce Voltron, a language-informed visual representation learning approach that leverages language to ground pretrained visual representations for robotics. For leveraging large models, I will talk about a few vignettes about how we can leverage LLMs and VLMs to learn human preferences, allow for grounded social reasoning, or enable teaching humans using corrective feedback. Finally, I will conclude the talk by discussing some preliminary results on how large models can be effective pattern machines that can identify patterns in a token invariant fashion and enable pattern transformation, extrapolation, and even show some evidence of pattern optimization for solving control problems\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EBio: \u003C\/strong\u003EDo\u003Cspan\u003E\u003Cspan\u003Ersa\u003C\/span\u003E Sadigh is an assistant professor in Computer Science at Stanford University.\u0026nbsp; Her research interests lie in the intersection of robotics, machine learning, and human-AI interaction. Specifically, she is interested in developing algorithms that learn robot policies from various sources of data and human feedback, and can seamlessly interact and coordinate with humans. \u003Cspan\u003EDorsa\u003C\/span\u003E received her doctoral degree in Electrical Engineering and Computer Sciences (EECS) from UC Berkeley in 2017, and received her bachelor\u2019s degree in EECS from UC Berkeley in 2012.\u0026nbsp; She is awarded the Sloan Fellowship, NSF CAREER, ONR Young Investigator Award, AFOSR Young Investigator Award, DARPA Young Faculty Award, Okawa Foundation Fellowship, MIT TR35, and the IEEE RAS Early Academic Career Award. Her work has received best paper awards and nominations at robotics conferences such as Conference on Robot Learning (CoRL) and Robotics: Science and Systems (RSS).\u003C\/span\u003E\u003C\/p\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EAll Seminars Held on Wednesdays 12:15 - 1:15pm in Marcus Nanotechnology\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"Featuring Dora Sadigh, Stanford Robotics Center"}],"uid":"27863","created_gmt":"2023-11-16 17:43:33","changed_gmt":"2024-02-22 18:38:13","author":"Christa Ernst","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2024-02-21T12:15:00-05:00","event_time_end":"2024-02-21T13:15:00-05:00","event_time_end_last":"2024-02-21T13:15:00-05:00","gmt_time_start":"2024-02-21 17:15:00","gmt_time_end":"2024-02-21 18:15:00","gmt_time_end_last":"2024-02-21 18:15:00","rrule":null,"timezone":"America\/New_York"},"location":"Marcus Nanotechnology Building 1118","extras":["free_food"],"related_links":[{"url":"https:\/\/research.gatech.edu\/robotics\/irim-seminar-series","title":"Series Schedule"}],"groups":[{"id":"142761","name":"IRIM"}],"categories":[],"keywords":[{"id":"7264","name":"autonomous"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1795","name":"Seminar\/Lecture\/Colloquium"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"174045","name":"Graduate students"},{"id":"177814","name":"Postdoc"},{"id":"78771","name":"Public"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003Echrista.ernst@research.gatech.edu\u003C\/p\u003E\r\n","format":"limited_html"}],"email":[],"slides":[],"orientation":[],"userdata":""}}}