{"596869":{"#nid":"596869","#data":{"type":"event","title":"PhD Proposal by Kaivalya Bakshi","body":[{"value":"\u003Cp\u003E\u003Cstrong\u003EPh.D. Thesis Proposal\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EBy\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EKaivalya Bakshi\u003C\/p\u003E\r\n\r\n\u003Cp\u003E(Advisor: Prof. Evangelos Theodorou)\u003C\/p\u003E\r\n\r\n\u003Cp\u003E2:15 PM, Thursday 2 Nov 2017\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cem\u003EMontgomery Knight Building, Room 325\u003C\/em\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EPDE BASED STOCHASTIC CONTROL: SAMPLING ALGORITHMS, OPTIMALITY PRINCIPLES AND STABILITY ANALYSIS\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003EAbstract: \u003C\/strong\u003EContinuous time\u0026nbsp;nonlinear\u0026nbsp;stochastic differential equations (SDEs) with control multiplicative noise are used to model biological motion and sensorimotor systems. Application of the Dynamic Programming Principle (DPP) to the stochastic control problem of such SDEs leads to a fully nonlinear parabolic Hamilton-Jacobi-Bellman (HJB) partial differential equation (PDE) problem. Prior work in stochastic control on solving HJB PDEs, in particular, the linearly solvable framework by Todorov \u003Cem\u003Eet al.\u003C\/em\u003E is fundamentally unequipped to solve this fully nonlinear PDE.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EIn this doctoral thesis a nonlinear Feynman Kac lemma representing the fully nonlinear PDE by a second order Forward Backward SDE (2FBSDE) model is presented. Assumptions necessary for this construction are enunciated. We propose a data efficient sampling algorithm to solve 2FBSDEs which yields the control.\u003C\/p\u003E\r\n\r\n\u003Cp\u003EIf the goal is optimal control of a large ensemble of stochastic agents, the problem is inherently infinite dimensional. The control in these PDE control problems may be open loop or closed loop, in relation to the state of each agent. In the former case, control feedback for each agent is the density of the ensemble. In the latter, control feedback for each agent is the state of the agent, corresponding to the Mean Field Games (MFG) control. Practical examples\u0026nbsp;of MFG control problems are for air traffic, crowds,\u0026nbsp;code division\u0026nbsp;multiple access control, frequency synchronization in microgrids and unmanned aerial vehicle\u0026nbsp;swarms. Stability properties of multiagent feedback MFG controllers have recently garnered interest in the physics, economics and control communities. Stability of simplistic single integrator MFG control systems has been treated recently by Lions \u003Cem\u003Eet al. \u003C\/em\u003Eand Caines \u003Cem\u003Eet. al.\u003C\/em\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003EIn this work, we deduce a sampling algorithm to compute the open loop PDE control of ensembles governed by a general class of SDEs with jumps. This is done by using the Infinite Dimensional Minimum Principle (IDMP) and results from statistical physics. The relationship between the IDMP and DPP is quantitatively explained by showing the relationship between the costate function and infinite dimensional value function. Further, we propose a study to create a generalized methodology for stability analysis of feedback MFG controllers, for systems more general than single integrator systems. These methods would have direct applications in control problems involving non trivial passive dynamics as well as in study of second order synchronization, such as flocking.\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cstrong\u003ECommittee Members:\u003C\/strong\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003EProf. Evangelos Theodorou (Advisor)\u003C\/p\u003E\r\n\r\n\u003Cp\u003EDr. Piyush Grover (Principal Research Scientist, MERL)\u003C\/p\u003E\r\n\r\n\u003Cp\u003EProf. Eric Feron (AE)\u003C\/p\u003E\r\n","summary":null,"format":"limited_html"}],"field_subtitle":"","field_summary":"","field_summary_sentence":[{"value":"PDE BASED STOCHASTIC CONTROL: SAMPLING ALGORITHMS, OPTIMALITY PRINCIPLES AND STABILITY ANALYSIS"}],"uid":"27707","created_gmt":"2017-10-03 15:18:05","changed_gmt":"2017-10-04 13:41:14","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2017-11-02T10:15:00-04:00","event_time_end":"2017-11-02T12:30:00-04:00","event_time_end_last":"2017-11-02T12:30:00-04:00","gmt_time_start":"2017-11-02 14:15:00","gmt_time_end":"2017-11-02 16:30:00","gmt_time_end_last":"2017-11-02 16:30:00","rrule":null,"timezone":"America\/New_York"},"extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"102851","name":"Phd proposal"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78761","name":"Faculty\/Staff"},{"id":"78771","name":"Public"},{"id":"174045","name":"Graduate students"},{"id":"78751","name":"Undergraduate students"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}