{"633370":{"#nid":"633370","#data":{"type":"event","title":"PhD Defense by Yash Goyal","body":[{"value":"\u003Cp\u003ETitle: Towards Transparent and Grounded Visual AI Systems\u003C\/p\u003E\r\n\r\n\u003Cp\u003E----------------\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nYash Goyal\u003Cbr \/\u003E\r\nPh.D. Candidate in Computer Science\u003Cbr \/\u003E\r\nSchool of Interactive Computing\u003Cbr \/\u003E\r\nGeorgia Institute of Technology\u003Cbr \/\u003E\r\n\u003Ca href=\u0022https:\/\/www.cc.gatech.edu\/~ygoyal3\/\u0022 id=\u0022LPlnk538818\u0022 target=\u0022_blank\u0022\u003Ehttps:\/\/www.cc.gatech.edu\/~ygoyal3\/\u003C\/a\u003E\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nDate: Monday, March 9th, 2020\u003Cbr \/\u003E\r\nTime: 11:00 am to 1:00 pm (ET)\u003Cbr \/\u003E\r\nLocation: Coda 1215 Midtown\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nCommittee:\u003Cbr \/\u003E\r\n----------------\u003Cbr \/\u003E\r\nDr. Dhruv Batra (Advisor; School of Interactive Computing, Georgia Institute of Technology \u0026amp; Facebook AI Research)\u003Cbr \/\u003E\r\nDr. Devi Parikh (School of Interactive Computing, Georgia Institute of Technology \u0026amp; Facebook AI Research)\u003Cbr \/\u003E\r\nDr. Mark Riedl (School of Interactive Computing, Georgia Institute of Technology)\u003Cbr \/\u003E\r\nDr. Trevor Darrell (University of California, Berkeley)\u003Cbr \/\u003E\r\nDr. Stefan Lee (Oregon State University)\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nAbstract:\u003Cbr \/\u003E\r\n----------------\u003C\/p\u003E\r\n\r\n\u003Cp\u003EMy research goal is to build transparent and grounded AI systems. In my thesis, I try to answer the question -- \u0026quot;Do deep visual models make their decisions for the right reasons?\u0026quot; in two ways:\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E1. Visual grounding. Grounding is essential to build reliable and generalizable systems that are not driven by dataset biases. In the context of the task of Visual Question Answering (VQA), we would expect models to be looking at the right regions in the image while answering a question. We address this issue of visual grounding in VQA by proposing a) two new benchmarking datasets to test visual grounding, and b) a new VQA model that is visually grounded by design.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E2. Transparency. Transparency in AI systems can help system designers find their failure modes and provide guidance to teach humans. We developed techniques for generating explanations from deep models that give us insights into what they are basing their decisions on. Specifically, we generate counterfactual visual explanations and show how we can use such explanations to teach humans.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EMost of the interpretability works rely on correlations to generate explanations which might or might not reflect the true underlying mechanism in the deep model. This can result in disastrous consequences in high-risk domains such as healthcare, ethics, etc. To prevent this, there is a need to reason about the causal relationship between explanations and model decisions. Towards the end of the talk, I will present my recent work on generating causal explanations.\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"Towards Transparent and Grounded Visual AI Systems"}],"uid":"27707","created_gmt":"2020-03-06 20:57:15","changed_gmt":"2020-03-06 20:57:15","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2020-03-09T12:00:00-04:00","event_time_end":"2020-03-09T14:00:00-04:00","event_time_end_last":"2020-03-09T14:00:00-04:00","gmt_time_start":"2020-03-09 16:00:00","gmt_time_end":"2020-03-09 18:00:00","gmt_time_end_last":"2020-03-09 18:00:00","rrule":null,"timezone":"America\/New_York"},"extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"100811","name":"Phd Defense"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"78771","name":"Public"},{"id":"174045","name":"Graduate students"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}