{"680179":{"#nid":"680179","#data":{"type":"event","title":"HotCSE Seminar: Vijay Thakkar","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003EName: \u003C\/strong\u003ESchool of CSE Ph.D. Student Vijay Thakkar\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003EWednesday, Feb. 12, 2025, at 12:00 p.m.\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELocation:\u003C\/strong\u003E\u0026nbsp;Coda, Room 230 (\u003Ca href=\u0022https:\/\/www.google.com\/maps\/place\/Coda\/@33.7752651,-84.3876426,15z\/data=!4m6!3m5!1s0x88f5046677950223:0x7fd1ad077b382c98!8m2!3d33.7752651!4d-84.3876426!16s%2Fg%2F11c6lvs7sl?entry=ttu\u0022\u003EGoogle Maps link\u003C\/a\u003E)\u003C\/p\u003E\u003Cp\u003E\u003Cem\u003ELunch provided!\u003C\/em\u003E\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003ECUTLASS 3.x: A Microkernel Abstraction for GPU Linear Algebra\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EAbstract:\u0026nbsp;\u003C\/strong\u003EWe have created a micro-kernel abstraction for GPUs robust enough to uniformly represent the tensor core and data movement operations from NVIDIA GPU architectures spanning Maxwell all the way to Blackwell. In this talk, we describe the novel two level microkernel abstraction that allows for this generality. Spatial microkernels described by CuTe layouts and layout algebra allow us to uniformly represent GPU architecture specific operations regardless of the threads and data they operate upon. CUTLASS 3.x\u0027s temporal microkernels allow for a hierarchical organization of synchronization and programmer managed on-chip memory abstracting away architecture specific synchronization. Both of these together result in a robust programming model that is performant, extensible, and simply a joy to use.\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EBio:\u003C\/strong\u003E\u0026nbsp;Vijay is a senior architect in the fast kernels team where he has worked on CUTLASS 3.0 project since its inception as one of its leads. For the past three years he has focused on the development of Blackwell kernels via CuTe and CUTLASS\u0027s programming model and PTX ISA which just released as CUTLASS 3.8 and CUDA 12.8 respectively. He broadly collaborates with the GPU architecture, compiler, and programming model teams on software\/hardware codesign for tensor cores and other DL features of datacenter GPUs. At Georgia Tech, he is registered as a part time Ph.D. student in Rich Vuduc\u0027s HPC garage lab, where he hopes to defend his Ph.D. some day.\u003C\/p\u003E\u003Cp\u003E\u003Cem\u003E\u003Cstrong\u003EAbout HotCSE\u003C\/strong\u003E\u003C\/em\u003E\u003C\/p\u003E\u003Cp\u003EHotCSE is an academic seminar series to bring Ph.D. students in Computational Science and Engineering together to discuss interesting topics. The topics consist of high-performance computing, machine learning, data analysis, simulation, computational sustainability, medical informatics, etc.\u003C\/p\u003E\u003Cp\u003EThe talks have always been enjoyable and have ranged from quite informal to formal conference style talks. Either chalks or slides can be used to help people understand your talk. It is also a great forum to practice conference talks and bounce around new ideas.\u003C\/p\u003E\u003Cp\u003ECurrently the talks are sponsored by the School of Computational Science and Engineering. The goal of CSE is slightly broader than that of these talks - we want to bring more people outside CSE to discuss their related work here.\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003E\u003Cstrong\u003EName: \u003C\/strong\u003ESchool of CSE Ph.D. Student Vijay Thakkar\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003EWednesday, Feb. 12, 2025, at 12:00 p.m.\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ELocation:\u003C\/strong\u003E\u0026nbsp;Coda, Room 230 (\u003Ca href=\u0022https:\/\/www.google.com\/maps\/place\/Coda\/@33.7752651,-84.3876426,15z\/data=!4m6!3m5!1s0x88f5046677950223:0x7fd1ad077b382c98!8m2!3d33.7752651!4d-84.3876426!16s%2Fg%2F11c6lvs7sl?entry=ttu\u0022\u003EGoogle Maps link\u003C\/a\u003E)\u003C\/p\u003E\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003ECUTLASS 3.x: A Microkernel Abstraction for GPU Linear Algebra\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"Seminar Title: CUTLASS 3.x: A Microkernel Abstraction for GPU Linear Algebra"}],"uid":"36319","created_gmt":"2025-02-04 13:36:20","changed_gmt":"2025-02-07 19:03:51","author":"Bryant Wine","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2025-02-12T12:00:00-05:00","event_time_end":"2025-02-12T13:00:00-05:00","event_time_end_last":"2025-02-12T13:00:00-05:00","gmt_time_start":"2025-02-12 17:00:00","gmt_time_end":"2025-02-12 18:00:00","gmt_time_end_last":"2025-02-12 18:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Coda, Room 230","extras":["free_food"],"hg_media":{"676199":{"id":"676199","type":"image","title":"VijayThakkar.png","body":null,"created":"1738676501","gmt_created":"2025-02-04 13:41:41","changed":"1738676501","gmt_changed":"2025-02-04 13:41:41","alt":"HotCSE Seminar Vijay Thakkar","file":{"fid":"259935","name":"VijayThakkar.png","image_path":"\/sites\/default\/files\/2025\/02\/04\/VijayThakkar.png","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2025\/02\/04\/VijayThakkar.png","mime":"image\/png","size":310788,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2025\/02\/04\/VijayThakkar.png?itok=1Ie1hu44"}}},"media_ids":["676199"],"groups":[{"id":"47223","name":"College of Computing"},{"id":"50877","name":"School of Computational Science and Engineering"}],"categories":[],"keywords":[{"id":"166983","name":"School of Computational Science and Engineering"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1795","name":"Seminar\/Lecture\/Colloquium"},{"id":"1791","name":"Student sponsored"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"177814","name":"Postdoc"},{"id":"78771","name":"Public"},{"id":"174045","name":"Graduate students"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003ECSE Graduate Student Association\u003C\/p\u003E\u003Cp\u003Ecse-gsa@cc.gatech.edu\u003C\/p\u003E","format":"limited_html"}],"email":[],"slides":[],"orientation":[],"userdata":""}}}