{"657461":{"#nid":"657461","#data":{"type":"event","title":"PhD Defense by Sarah Wiegreffe","body":[{"value":"\u003Cp\u003ETitle: Interpreting Neural Networks for and with Natural Language\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDate: Monday, May 9th, 2022\u003C\/p\u003E\r\n\r\n\u003Cp\u003ETime: 2:00-4:00pm (ET)\u003C\/p\u003E\r\n\r\n\u003Cp\u003ELocation (hybrid): CODA C1108 Brookhaven and\u0026nbsp;\u003Ca href=\u0022https:\/\/gatech.zoom.us\/j\/93819214059?pwd=ZWRvRE8waCtjWkdidXFFdTVuQ3pvUT09\u0022 title=\u0022https:\/\/gatech.zoom.us\/j\/93819214059?pwd=ZWRvRE8waCtjWkdidXFFdTVuQ3pvUT09\u0022\u003EZoom\u003C\/a\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003ESarah Wiegreffe\u003C\/p\u003E\r\n\r\n\u003Cp\u003EPhD Candidate in Computer Science\u003C\/p\u003E\r\n\r\n\u003Cp\u003ESchool of Interactive Computing\u003Cbr \/\u003E\r\nCollege of Computing\u003Cbr \/\u003E\r\nGeorgia Institute of Technology\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nCommittee:\u003Cbr \/\u003E\r\nDr. Mark Riedl (advisor, School of Interactive Computing, Georgia Institute of Technology)\u003Cbr \/\u003E\r\nDr. Alan Ritter (School of Interactive Computing, Georgia Institute of Technology)\u003Cbr \/\u003E\r\nDr. Wei Xu (School of Interactive Computing, Georgia Institute of Technology)\u003Cbr \/\u003E\r\nDr. Noah Smith (Paul G. Allen School of Computer Science \u0026amp; Engineering, University of Washington)\u003Cbr \/\u003E\r\nDr. Sameer Singh (Bren School of Information and Computer Sciences, University of California at Irvine)\u003C\/p\u003E\r\n\r\n\u003Cp\u003EAbstract:\u003C\/p\u003E\r\n\r\n\u003Cp\u003EIn the last decade, real-world applications of NLP technologies have become more widespread and more useful than ever before, in large part thanks to advances in deep learning. The increasing size and nonlinearity of these models results in an opacity that hinders efforts by machine learning practitioners and lay-users alike to understand model internals and derive meaning or trust from their predictions.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe fields of explainable artificial intelligence and more specifically explainable NLP have emerged as an active area for remedying this opacity and for ensuring models\u0026#39; reliability and trustworthiness in high-stakes scenarios.\u0026nbsp;Models that produce justifications can be inspected for the purposes of debugging, quantifying bias and fairness, understanding model behavior, and ascertaining robustness and privacy. Textual explanations, such as highlights and free-text explanations, are uniquely valuable because of the natural communicative affordances language provides over other modalities.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EIn this dissertation, I propose test suites for evaluating the quality of model explanations under two definitions of meaning: faithfulness and human acceptability. I introduce new ways of evaluating faithfulness of highlight explanations with model-based adversarial search and non-contextual probing models, and of free-text explanations with robustness equivalence and feature importance agreement. I show that a natural language bottleneck increases the likelihood of faithful highlights in neural architectures. I introduce new ways of evaluating human acceptability with crowdsourcing methods inspired by the psychology of explanation, and show that an overgeneration-plus-filtration system improves the acceptability of model-generated free-text explanations.\u0026nbsp;This work strives to increase the likelihood of positive use and outcomes when AI systems are deployed in practice. \u0026nbsp;\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"Interpreting Neural Networks for and with Natural Language"}],"uid":"27707","created_gmt":"2022-04-20 12:35:56","changed_gmt":"2022-04-20 12:35:56","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2022-05-09T15:00:00-04:00","event_time_end":"2022-05-09T17:00:00-04:00","event_time_end_last":"2022-05-09T17:00:00-04:00","gmt_time_start":"2022-05-09 19:00:00","gmt_time_end":"2022-05-09 21:00:00","gmt_time_end_last":"2022-05-09 21:00:00","rrule":null,"timezone":"America\/New_York"},"extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"100811","name":"Phd Defense"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"78771","name":"Public"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}