{"674065":{"#nid":"674065","#data":{"type":"event","title":"PhD Defense | Learning with and without human feedback","body":[{"value":"\u003Cp\u003EAustin Xu - Machine Learning PhD Student - School of Electrical and Computer Engineering\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003EApril 15th\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ETime:\u0026nbsp;\u003C\/strong\u003E12:30 PM \u2013 2:00 PM ET\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ELocation\u003C\/strong\u003E: Online\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EMeeting Link\u003C\/strong\u003E: \u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Ca href=\u0022https:\/\/gatech.zoom.us\/j\/9026260477?omn=93570001864\u0022\u003Ehttps:\/\/gatech.zoom.us\/j\/9026260477?omn=93570001864\u003C\/a\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ECommittee\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003EMark Davenport (Advisor), School of Electrical and Computer Engineering, Georgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EChristopher Rozell, School of Electrical and Computer Engineering, Georgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EAshwin Pananjady, School of Industrial and Systems Engineering, Georgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EJustin Romberg, School of Electrical and Computer Engineering, Georgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003EZsolt Kira, School of Interactive Computing, Georgia Institute of Technology\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EAbstract\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003E\u003Cspan\u003ELabels and feedback provided by humans play a central role in training contemporary machine learning models, offering models ground truth annotations from which to extract patterns. However, collecting such feedback from humans is a challenging and time-consuming task. As a result, practitioners must be intentional both in how they choose to query humans for feedback and in the problem settings for which they request feedback. This thesis explores learning from human feedback along two fundamental directions. The first part of the thesis focuses on how we can more effectively learn from human feedback from a mathematically grounded perspective. We first consider how to leverage paired comparisons, a simple mechanism for human feedback, for learning rich models of human preference. We then propose a new mechanism for collecting human feedback aimed at balancing informativeness and cognitive burden. The second part of the thesis focuses on how we can leverage pretrained models to avoid collecting additional human feedback. We consider two specific application settings: retrieval and synthetic dataset generation, and show that existing tools, such as large language models or image editing models, can be used to remove the need for collecting human feedback.\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003ELearning with and without human feedback\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"Austin Xu - Machine Learning PhD Student - School of Electrical and Computer Engineering"}],"uid":"36518","created_gmt":"2024-04-09 13:20:36","changed_gmt":"2024-04-09 13:25:48","author":"shatcher8","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2024-04-15T12:30:00-04:00","event_time_end":"2024-04-15T14:00:00-04:00","event_time_end_last":"2024-04-15T14:00:00-04:00","gmt_time_start":"2024-04-15 16:30:00","gmt_time_end":"2024-04-15 18:00:00","gmt_time_end_last":"2024-04-15 18:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Online: https:\/\/gatech.zoom.us\/j\/9026260477?omn=93570001864","extras":[],"groups":[{"id":"576481","name":"ML@GT"}],"categories":[],"keywords":[],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}