{"590789":{"#nid":"590789","#data":{"type":"event","title":"PhD Proposal by Unaiza Ahsan","body":[{"value":"\u003Cp\u003EPh.D. Thesis Proposal Announcement\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nTitle: Leveraging Mid-Level Representations For Complex Activity Recognition\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nUnaiza Ahsan\u003Cbr \/\u003E\r\nPh.D. Student\u003Cbr \/\u003E\r\nSchool of Interactive Computing\u003Cbr \/\u003E\r\nCollege of Computing\u003Cbr \/\u003E\r\nGeorgia Institute of Technology\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nDate: Friday, April 28, 2017\u003Cbr \/\u003E\r\nTime: 4:30 PM-6:30PM EDT (1:30 PM-3:30PM PDT)\u003Cbr \/\u003E\r\nLocation: MiRC Rm 102A (Pettit Building)\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nCommittee:\u003Cbr \/\u003E\r\nDr. Irfan Essa (Advisor), School of Interactive Computing, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. James Hayes, School of Interactive Computing, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Devi Parikh, School of Interactive Computing, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Munmun De Choudhury, School of Interactive Computing, Georgia Institute of Technology\u003Cbr \/\u003E\r\nDr. Chen Sun, Google\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nAbstract:\u003Cbr \/\u003E\r\nDynamic scene understanding requires learning representations of the components of the scene including objects, environments, actions and events. This understanding leads to activity and event predictions. Automatic aggregation and recognition of activities from images and videos has applications in social media, journalism, automatic browsing and retrieval of multimedia content. One important way to achieve this is to design a mid-level or intermediate feature representation which is useful for cases where strong supervision may not be possible. In this thesis, we propose that such mid-level representations significantly contribute to higher level event and action understanding both in still images and videos.\u003Cbr \/\u003E\r\n\u003Cbr \/\u003E\r\nFirst, we propose an automatic approach to aggregate social event images from different sources and users by leveraging an intermediate joint representation involving images and associated text. Recognizing the events in clusters of images requires us to go beyond recognizing specific objects or scenes hence we next propose an event concept-based intermediate representation which learns concepts via the Web and uses this representation to identify events even with a single labelled example. Next, to demonstrate the strength of the proposed approaches, we contribute two diverse social event datasets to the community. We then present a use case of event concepts as a mid level representation that generalizes to sentiment recognition in diverse social event images. Our proposed work involves training Generative Adversarial Networks (GANs) with video frames (which does not require labels) and then using the trained discriminator from GANs as an intermediate representation and finetuning it on a smaller labelled video activity dataset to recognize actions in videos. This unsupervised pre-training step avoids any manual feature engineering, video frame encoding or searching for the best video frame sampling technique. Our preliminary experiments result in an action recognition performance competitive to the state-of-the-art using only appearance information.\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"Leveraging Mid-Level Representations For Complex Activity Recognition"}],"uid":"27707","created_gmt":"2017-04-24 11:48:18","changed_gmt":"2017-04-24 11:48:18","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2017-04-28T17:30:00-04:00","event_time_end":"2017-04-28T19:30:00-04:00","event_time_end_last":"2017-04-28T19:30:00-04:00","gmt_time_start":"2017-04-28 21:30:00","gmt_time_end":"2017-04-28 23:30:00","gmt_time_end_last":"2017-04-28 23:30:00","rrule":null,"timezone":"America\/New_York"},"extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"102851","name":"Phd proposal"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"78771","name":"Public"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}