{"673391":{"#nid":"673391","#data":{"type":"event","title":"SCS Faculty Candidate Seminar- Francisco Romero","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003EName:\u0026nbsp;\u003C\/strong\u003EFrancisco Romero, Ph.D, Stanford University\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003ETuesday, March 12 at 2 p.m.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ELocation:\u0026nbsp;\u003C\/strong\u003EMarcus Nanotechnology Building, Rooms 1117 \u0026amp; 1118\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003E\u003Cem\u003EGeneral Purpose and Interactive Video Analytics\u003C\/em\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EAbstract:\u0026nbsp;\u003C\/strong\u003EThe availability of vast video datasets and the increasing accuracy of machine learning models have made exploration of video data an exciting opportunity. Asking complex questions like \u201cFind cases where a car takes a left turn while a pedestrian is crossing the road on a rainy night\u201d over terabytes of videos should be possible. Recent video analytics research expects users will manually reason about their query, combine optimizations, and occasionally train models to meet their performance and accuracy goals. This is a long way from the experience users have when exploring structured data.\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nIn this talk, I will present the design of a general purpose and interactive video analytics system. First, I will present the VIVA video analytics system. VIVA allows users to express domain knowledge about model relationships. VIVA uses this knowledge to automate complex query optimization by deciding how and when it should be applied. Second, I will present Zelda: a system that uses vision-language models to return both relevant and semantically diverse results for top-K video queries. Zelda prompts the VLM with the user\u2019s query in natural language and additional terms to improve accuracy and identify low-quality frames. Zelda improves result diversity by leveraging the rich semantic information encoded in VLM embeddings.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EBio:\u0026nbsp;\u003C\/strong\u003EFrancisco Romero currently works at a stealth startup that builds automated intelligence technology for evaluating, searching, and analyzing video for law enforcement, private surveillance, and district attorneys. He recently received his PhD in Electrical Engineering at Stanford University, where his research spanned general machine learning inference, serverless computing, databases, and datacenter scheduling. He has several publications in top-tier systems and database conferences, including a best paper at USENIX ATC 2021.\u003C\/p\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003E\u003Cstrong\u003EName:\u0026nbsp;\u003C\/strong\u003EFrancisco Romero, Ph.D, Stanford University\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EDate:\u0026nbsp;\u003C\/strong\u003ETuesday, March 12 at 2 p.m.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ELocation:\u0026nbsp;\u003C\/strong\u003EMarcus Nanotechnology Building, Rooms 1117 \u0026amp; 1118\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ETitle:\u0026nbsp;\u003C\/strong\u003E\u003Cem\u003EGeneral Purpose and Interactive Video Analytics\u003C\/em\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"SCS Faculty Candidate Seminar- Francisco Romero"}],"uid":"36532","created_gmt":"2024-03-07 17:12:59","changed_gmt":"2024-03-07 17:21:46","author":"Morgan Usry","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2024-03-12T14:00:00-04:00","event_time_end":"2024-03-12T15:00:00-04:00","event_time_end_last":"2024-03-12T15:00:00-04:00","gmt_time_start":"2024-03-12 18:00:00","gmt_time_end":"2024-03-12 19:00:00","gmt_time_end_last":"2024-03-12 19:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Marcus Nanotechnology Building, Rooms 1117 \u0026 1118","extras":[],"hg_media":{"673333":{"id":"673333","type":"image","title":"francisco.jpeg","body":null,"created":"1709831550","gmt_created":"2024-03-07 17:12:30","changed":"1709831534","gmt_changed":"2024-03-07 17:12:14","alt":"Francisco Romero","file":{"fid":"256716","name":"fransisco.jpeg","image_path":"\/sites\/default\/files\/2024\/03\/07\/fransisco.jpeg","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2024\/03\/07\/fransisco.jpeg","mime":"image\/jpeg","size":238539,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2024\/03\/07\/fransisco.jpeg?itok=sEa8vRGE"}}},"media_ids":["673333"],"groups":[{"id":"322011","name":"College of Computing Events"}],"categories":[],"keywords":[],"core_research_areas":[],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}