{"682855":{"#nid":"682855","#data":{"type":"event","title":"PhD Proposal by Fiona Ryan","body":[{"value":"\u003Cp\u003ETitle: Contextual Behavior Modeling with Computer Vision\u003Cbr\u003E\u0026nbsp;\u003Cbr\u003EFiona Ryan\u003Cbr\u003EPh.D. Student in Computer Science\u003Cbr\u003ESchool of Interactive Computing\u0026nbsp;\u003Cbr\u003EGeorgia Institute of Technology\u0026nbsp;\u003Cbr\u003E\u003Cbr\u003EDate: Wednesday, June 25th, 2025\u003Cbr\u003ETime: \u0026nbsp;3-5pm EDT\u003Cbr\u003ELocation: (Virtual) https:\/\/gatech.zoom.us\/j\/95216024861\u003C\/p\u003E\u003Cp\u003ECommittee\u0026nbsp;\u003Cbr\u003EDr. Judy Hoffman (Advisor) - School of Interactive Computing, Georgia Institute of Technology\u003Cbr\u003EDr. James Rehg (Advisor) - Department of Computer Science, University of Illinois Urbana-Champaign\u003Cbr\u003EDr. Zsolt Kira - School of Interactive Computing, Georgia Institute of Technology\u003Cbr\u003EDr. James Hays - School of Interactive Computing, Georgia Institute of Technology\u003Cbr\u003EDr. Josef Sivic - Czech Institute of Informatics, Robotics, and Cybernetics, Czech Technical University in Prague\u003C\/p\u003E\u003Cp\u003EAbstract\u0026nbsp;\u003Cbr\u003EUnderstanding human behavior with computer vision is a core challenge for developing AI systems that can effectively interact with and assist people in everyday life. Modeling human behavior is challenging because it requires not only visual recognizing behaviors like gaze, gesture, and movement, but also interpreting them in context. Human behavior is shaped by intent and higher-level goals, the surrounding physical environment, interactions with other people, and additional modalities such as speech, making it inherently multimodal and situated.\u003C\/p\u003E\u003Cp\u003EThis thesis proposal explores how to model human behavior in context by addressing two core needs: (1) multimodal datasets that capture naturalistic human interactions in everyday environments, enabling new behavior modeling tasks and (2) methods that leverage foundation models that encode general-purpose world knowledge \u2014 including visual semantics, physical structure, and commonsense understanding \u2014 to contextualize human behavior in relation to its environment. I will present contributions to large-scale multimodal egocentric datasets that capture social interactions and object interactions during activities, a modeling approach and dataset for identifying targets of selective auditory attention during social conversations in noisy environments, a framework for estimating gaze targets in scenes from general visual representations, and a method for efficiently adapting vision-language retrieval models to represent new concepts and recognize them in different contexts. Finally, I will propose new work on integrating visual behavioral cues into understanding conversation transcripts with large language models.\u003Cbr\u003E\u0026nbsp;\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EContextual Behavior Modeling with Computer Vision\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"Contextual Behavior Modeling with Computer Vision"}],"uid":"27707","created_gmt":"2025-06-23 19:28:01","changed_gmt":"2025-06-23 19:28:29","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2025-06-25T15:00:00-04:00","event_time_end":"2025-06-25T17:00:00-04:00","event_time_end_last":"2025-06-25T17:00:00-04:00","gmt_time_start":"2025-06-25 19:00:00","gmt_time_end":"2025-06-25 21:00:00","gmt_time_end_last":"2025-06-25 21:00:00","rrule":null,"timezone":"America\/New_York"},"location":" (Virtual) ","extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"102851","name":"Phd proposal"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78771","name":"Public"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}