{"675215":{"#nid":"675215","#data":{"type":"event","title":"PhD Defense by Guan-Horng Liu","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003ELarge-Scale Optimization for Deep Neural Network Architecture: A Dynamical System Theory Perspective\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003EWednesday, June 26th, 2024\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ETime:\u0026nbsp;\u003C\/strong\u003E1:00 - 3:00 pm EST (6-8pm London Time)\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELocation\/Remote link\u003C\/strong\u003E: Coda C0915 Atlantic \u003Ca href=\u0022https:\/\/gatech.zoom.us\/j\/3392051118?omn=97259773696\u0022\u003Ehttps:\/\/gatech.zoom.us\/j\/3392051118?omn=97259773696\u003C\/a\u003E\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EGuan-Horng Liu\u003C\/strong\u003E\u003C\/p\u003E\u003Cp\u003EMachine Learning PhD Student\u003C\/p\u003E\u003Cp\u003ESchool of Aerospace Engineering\u003C\/p\u003E\u003Cp\u003EGeorgia Institute of Technology\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003E\u0026nbsp;\u003C\/strong\u003E\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ECommittee\u003C\/strong\u003E\u003C\/p\u003E\u003Cp\u003E1. Dr. Evangelos Theodorou (School of Aerospace Engineering, Georgia Tech; Advisor)\u003C\/p\u003E\u003Cp\u003E2. Dr. Molei Tao (School of Mathematics, Georgia Tech)\u003C\/p\u003E\u003Cp\u003E3. Dr.\u0026nbsp;Yao Xie (School of Industrial and Systems Engineering, Georgia Tech)\u003C\/p\u003E\u003Cp\u003E4. Dr. Justin Romberg (School of Electrical and Computer Engineering, Georgia Tech)\u003C\/p\u003E\u003Cp\u003E5. Dr. Arnaud Doucet (Department of Statistics, University of Oxford; Google DeepMind)\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EAbstract\u003C\/strong\u003E\u003C\/p\u003E\u003Cp\u003EOptimization of deep neural networks (DNNs) has been a driving force in the advancement of modern artificial intelligence. Despite efforts to design DNN architectures that leverage domain-specific knowledge, the development of optimization algorithms\u0026nbsp;has often progressed independently of architectural innovations. This thesis delves into large-scale optimization methods that leverage the underlying deep architectural structures being optimized. Specifically, we demonstrate that the dynamical system and optimal control theory pave a profound foundation for algorithmic characterization in learning various deep architectures, including standard DNNs, Neural ODEs, and SDEs such as diffusion models\/bridges.\u003C\/p\u003E\u003Cp\u003EOptimal control, in its broadest sense, examines the principle of optimization over dynamical systems. This methodological perspective naturally arises in training neural differential equations and can be applied to standard DNNs, with Backpropagation emerging as an approximate dynamic programming. Through development, we emphasize the significance of control-theoretic components such as differential programming and nonlinear Feynman-Kac, unifying existing optimization methods and extending them to handle a broader class of complex dynamics and problem setups that may otherwise be hard to adapt or foresee. The developed methods have been applied to large-scale applications such as image generation, restoration, translation, as well as solving mean-field games and opinion modeling.\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003ELarge-Scale Optimization for Deep Neural Network Architecture: A Dynamical System Theory Perspective\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"Large-Scale Optimization for Deep Neural Network Architecture: A Dynamical System Theory Perspective"}],"uid":"27707","created_gmt":"2024-06-24 20:12:04","changed_gmt":"2024-06-24 20:12:38","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2024-06-26T13:00:00-04:00","event_time_end":"2024-06-26T15:00:00-04:00","event_time_end_last":"2024-06-26T15:00:00-04:00","gmt_time_start":"2024-06-26 17:00:00","gmt_time_end":"2024-06-26 19:00:00","gmt_time_end_last":"2024-06-26 19:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Coda C0915 Atlantic ","extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"100811","name":"Phd Defense"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78771","name":"Public"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}