{"673092":{"#nid":"673092","#data":{"type":"event","title":"IC Spring Seminar Series with Guest Speaker Krishna Murthy","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003ETalk Title \u2014 Structured World Models for Robots\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cstrong\u003E\u003Cspan\u003EAbstract\u003C\/span\u003E\u003C\/strong\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EHumans have an innate ability to construct detailed mental representations of the world from limited sensory data. These \u0027world models\u0027 are central to natural intelligence, allowing us to perceive, reason about, and act in the physical world. My research seeks to create \u0027computational world models\u0027 \u2014 artificial intelligence techniques that enable robots to understand and operate in the world around as effectively as humans. Despite the impressive successes of modern machine learning approaches on domains such as text, images, and video \u2014 where abundant training data is readily available \u2014 these have not translated to robotics. Building generally capable robotic systems presents unique challenges including the lack of data, and the need to adapt learning algorithms to a wide variety of embodiments, environments, and tasks of interest.\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cbr \/\u003E\r\n\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003EIn my talk, I will present how my research contributes to the design of computational models for spatial, physical, and multimodal understanding. I will discuss differentiable computing approaches that have advanced the field of spatial perception, enabling an understanding of the structure of the 3D world, its constituent objects, and their semantic and physical properties from videos. I will also detail how my work interfaces advances in large image, language, and audio models with 3D scenes, enabling robots and computer vision systems to flexibly query these structured world models for a wide range of tasks. Finally, I will outline my vision for the future, where structured world models and modern scaling-based approaches work in tandem to create versatile robot perception and planning algorithms with the potential to meet and ultimately surpass human-level capabilities.\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003E\u003Cstrong\u003EStructured World Models for Robots\u003C\/strong\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"Structured World Models for Robots"}],"uid":"36530","created_gmt":"2024-02-21 14:37:08","changed_gmt":"2024-02-22 15:52:03","author":"Nathan Deen","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2024-02-27T11:00:00-05:00","event_time_end":"2024-02-27T12:00:00-05:00","event_time_end_last":"2024-02-27T12:00:00-05:00","gmt_time_start":"2024-02-27 16:00:00","gmt_time_end":"2024-02-27 17:00:00","gmt_time_end_last":"2024-02-27 17:00:00","rrule":null,"timezone":"America\/New_York"},"location":"IC Cafe, Technology Square Research Building, 2nd Floor","extras":[],"hg_media":{"673162":{"id":"673162","type":"image","title":"Murthy_Krishna.png","body":null,"created":"1708526188","gmt_created":"2024-02-21 14:36:28","changed":"1708526169","gmt_changed":"2024-02-21 14:36:09","alt":"Krishna Murthy","file":{"fid":"256520","name":"Murthy_Krishna.png","image_path":"\/sites\/default\/files\/2024\/02\/21\/Murthy_Krishna.png","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2024\/02\/21\/Murthy_Krishna.png","mime":"image\/png","size":1368212,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2024\/02\/21\/Murthy_Krishna.png?itok=yjXEQshC"}}},"media_ids":["673162"],"groups":[{"id":"47223","name":"College of Computing"},{"id":"50876","name":"School of Interactive Computing"}],"categories":[],"keywords":[],"core_research_areas":[],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}