{"678282":{"#nid":"678282","#data":{"type":"event","title":"Ph.D. Proposal Oral Exam - Anirudh Sundar","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp; \u003C\/strong\u003E\u003Cem\u003EAugmenting Large Language Models with the Ability to Hold Situated Dialogue Over Structured Knowledge Contained in Scientific Documents\u003C\/em\u003E\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ECommittee:\u0026nbsp;\u003C\/strong\u003E\u003C\/p\u003E\u003Cp\u003EDr.\u0026nbsp;Heck, Advisor\u0026nbsp;\u003C\/p\u003E\u003Cp\u003EDr. Muthukumar, Chair\u003C\/p\u003E\u003Cp\u003EDr. Davenport\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EThe objective of the proposed research is to develop language-model-based methods to address the problem of situated and multimodal interactive conversations in scientific papers. While significant progress has been made in large multimodal language models capable of multi-turn dialogue, creating a conversational assistant that can effectively navigate and discuss structured knowledge sources remains an open challenge, particularly within the domain of scientific literature. Scientific documents present a unique set of challenges due to their inherently multimodal nature. Researchers utilize various formats to convey complex information: figures illustrate key concepts, equations express mathematical principles, and tables summarize experimental setups and results. Moreover, the interconnected nature of these elements\u2014with researchers frequently cross-referencing figures, tables, and equations throughout the text\u2014adds another layer of complexity. This research seeks to address these challenges by developing methods that can seamlessly integrate and interpret these diverse modalities, enabling more sophisticated and context-aware interactions with scientific content.\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"Augmenting Large Language Models with the Ability to Hold Situated Dialogue Over Structured Knowledge Contained in Scientific Documents"}],"uid":"28475","created_gmt":"2024-11-08 08:26:51","changed_gmt":"2024-11-08 08:28:58","author":"Daniela Staiculescu","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2024-11-11T13:30:00-05:00","event_time_end":"2024-11-11T15:30:00-05:00","event_time_end_last":"2024-11-11T15:30:00-05:00","gmt_time_start":"2024-11-11 18:30:00","gmt_time_end":"2024-11-11 20:30:00","gmt_time_end_last":"2024-11-11 20:30:00","rrule":null,"timezone":"America\/New_York"},"location":"Room 509, TSRB","extras":[],"groups":[{"id":"434371","name":"ECE Ph.D. Proposal Oral Exams"}],"categories":[],"keywords":[{"id":"102851","name":"Phd proposal"},{"id":"1808","name":"graduate students"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78771","name":"Public"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}