{"679922":{"#nid":"679922","#data":{"type":"event","title":"CSE Faculty Candidate Seminar - Zhen Dong","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003EName: \u003C\/strong\u003EZhen Dong, Postdoctoral Scholar from University of California, Berkeley\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003ETuesday, February 4, 2024 at 11:00 am\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELocation:\u003C\/strong\u003E\u0026nbsp;Scheller College of Business, Room 200 (\u003Ca href=\u0022https:\/\/maps.app.goo.gl\/32i1a9jczDQb5vJV7\u0022\u003EGoogle Maps link\u003C\/a\u003E)\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELink:\u0026nbsp;\u003C\/strong\u003EThe recording of this in-person seminar will be uploaded to\u0026nbsp;\u003Ca href=\u0022https:\/\/mediaspace.gatech.edu\/channel\/School%2Bof%2BComputational%2BScience%2Band%2BEngineering\/259332602\u0022 target=\u0022_blank\u0022\u003ECSE\u0027s MediaSpace\u003C\/a\u003E\u003C\/p\u003E\u003Cp\u003E\u003Cem\u003ECoffee, drinks, and snacks provided!\u003C\/em\u003E\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003EEfficient AI: Make AI More Accessible and Run Faster\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EAbstract:\u003C\/strong\u003E LLMs and diffusion models have achieved great success in recent years. However, many AI models, particularly those with state-of-the-art performance, have a high computational cost and memory footprint. This impedes the development of pervasive AI in scenarios lacking sufficient computational resources (e.g., IoT devices, lunar rovers), requiring ultra-fast inference (e.g., AI4Science), or demanding real-time interaction under constrained computation (e.g., AR\/VR, Embodied AI). Model compression (quantization, pruning, distillation, etc) and hardware-software co-design are promising approaches to achieving Efficient AI, which makes AI more accessible and run faster.\u0026nbsp;\u003C\/p\u003E\u003Cp\u003EIn this talk, I will first introduce my work on 1) mixed-precision quantization based on Hessian analysis (HAWQv1v2, ZeroQ, Q-BERT) and 2) hardware-software co-design (HAWQv3, CoDeNet, HAO). Then I will talk about my ongoing and future works in the era of LLMs and GenAI, including SqueezeLLM, Q-Diffusion, efficient AI agent systems, advanced CoT distillation, efficient\u0026nbsp;deep thinking for OpenAI-o1 and Deepseek-R1, etc. My research vision is that efficient AI is becoming indispensable both at the edge where increasingly powerful sensors with diverse modalities generate huge volumes of local data, and in the cloud where reducing costs is essential to bridge the speed gap between inference scaling laws and Moore\u2019s law for hardware.\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EBio: \u003C\/strong\u003EDr. Zhen Dong is currently a Postdoc at UC Berkeley. He obtained his Ph.D. from Berkeley AI Research advised by Prof. Kurt Keutzer. Before Berkeley, Zhen received B.E. from Peking University. Zhen\u2019s research includes efficient AI, model compression, hardware-software co-design, and AI systems. Zhen has received Berkeley University Fellowship and SenseTime Scholarship. He won the best paper award at AAAI Practical-DL workshop, and he is also a winner of the DAC PhD forum and CVPR doctoral consortium.\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003E\u003Cstrong\u003EName: \u003C\/strong\u003EZhen Dong, Postdoctoral Scholar from University of California, Berkeley\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003ETuesday, February 4, 2024 at 11:00 am\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELocation:\u003C\/strong\u003E\u0026nbsp;Scheller College of Business, Room 200 (\u003Ca href=\u0022https:\/\/maps.app.goo.gl\/32i1a9jczDQb5vJV7\u0022\u003EGoogle Maps link\u003C\/a\u003E)\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELink:\u0026nbsp;\u003C\/strong\u003EThe recording of this in-person seminar will be uploaded to\u0026nbsp;\u003Ca href=\u0022https:\/\/mediaspace.gatech.edu\/channel\/School%2Bof%2BComputational%2BScience%2Band%2BEngineering\/259332602\u0022 target=\u0022_blank\u0022\u003ECSE\u0027s MediaSpace\u003C\/a\u003E\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003EEfficient AI: Make AI More Accessible and Run Faster\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"Seminar Title: Efficient AI: Make AI More Accessible and Run Faster"}],"uid":"36319","created_gmt":"2025-01-24 15:42:39","changed_gmt":"2025-02-03 18:37:29","author":"Bryant Wine","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2025-02-04T11:00:00-05:00","event_time_end":"2025-02-04T12:00:00-05:00","event_time_end_last":"2025-02-04T12:00:00-05:00","gmt_time_start":"2025-02-04 16:00:00","gmt_time_end":"2025-02-04 17:00:00","gmt_time_end_last":"2025-02-04 17:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Scheller, Room 200","extras":["free_food"],"hg_media":{"676183":{"id":"676183","type":"image","title":"Zhen Dong photo 2.jpg","body":null,"created":"1738360714","gmt_created":"2025-01-31 21:58:34","changed":"1738360714","gmt_changed":"2025-01-31 21:58:34","alt":"CSE Faculty Candidate Seminar Zhen Dong","file":{"fid":"259913","name":"Zhen Dong photo 2.jpg","image_path":"\/sites\/default\/files\/2025\/01\/31\/Zhen%20Dong%20photo%202.jpg","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2025\/01\/31\/Zhen%20Dong%20photo%202.jpg","mime":"image\/jpeg","size":3195228,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2025\/01\/31\/Zhen%20Dong%20photo%202.jpg?itok=Pb44uMH5"}}},"media_ids":["676183"],"groups":[{"id":"47223","name":"College of Computing"},{"id":"50877","name":"School of Computational Science and Engineering"}],"categories":[],"keywords":[{"id":"654","name":"College of Computing"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1795","name":"Seminar\/Lecture\/Colloquium"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"177814","name":"Postdoc"},{"id":"78771","name":"Public"},{"id":"174045","name":"Graduate students"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003EMary High\u003Cbr\u003Emhigh7@gatech.edu\u003C\/p\u003E","format":"limited_html"}],"email":[],"slides":[],"orientation":[],"userdata":""}}}