{"686354":{"#nid":"686354","#data":{"type":"event","title":"MS Proposal by Lander Wolfgang Schillinger Arana","body":[{"value":"\u003Cp\u003EStudent Name: Lander Wolfgang Schillinger Arana\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Cp\u003EAdvisor: Dr. Sarah Li\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Cp\u003EMilestone: MS Thesis Proposal\u003Cbr\u003E\u003Cbr\u003EDegree Program: Aerospace Engineering\u003Cbr\u003E\u003Cbr\u003ETitle: A Markov Decision Process Framework for Multi-Agent Satellite Collision Avoidance\u003Cbr\u003E\u003Cbr\u003EAbstract: We extend upon a Markov decision process (MDP) framework that autonomously makes guidance decisions for satellite collision avoidance maneuver (CAM) (F. Ferrara et al. 2025). In this framework, a reinforcement learning policy gradient (RL-PG) algorithm is used to enable direct optimization of guidance policy using historic CAM data. In addition to maintaining acceptable collision risks, this approach seeks to minimize the average propellant consumption of CAMs by making early maneuver decisions. To determine propellant consumption, a high-thrust impulsive phasing maneuver is utilized. The CAM is modeled as a continuous state, discrete action and finite horizon MDP, where the critical decision is determining when to initiate the maneuver. The MDP models decision rewards us using analytical models of collision risk, propellant consumption, and transit orbit geometry. By deciding to maneuver earlier than conventional methods, the Markov policy effectively favors CAMs that achieve comparable rates of collision risk reduction while consuming less propellant. In this proposal we verify this framework using historical data of tracked conjunction events and conduct an extensive parameter-sensitivity study. When evaluated on synthetic conjunction events, the trained policy consumes significantly less propellant overall and per maneuver in comparison to a conventional cut-off policy that initiates maneuvers 24 hours before the time of closest approach (TCA). On historical conjunction events, the trained policy consumes more propellant overall but consumes less propellant per maneuver. For both historical and synthetic conjunction events, the trained policy is slightly more conservative in identifying conjunctions events that warrant CAMs in comparison to cutoff policies. Furthermore, we propose a constrained propellant consumption optimization to determine the optimal number of revolutions to optimize the current MDP model and optimize its performance. Additionally, we propose an alternative low-thrust maneuver with a continuous thrust model, and plan to implement it into the MDP model and compare its performance to the high-thrust case. Finally, we propose a multi-agent extension to this single-agent MDP. By employing a stochastic (Markov) game, we propose a method to determine a set of Nash Equilibria (NE) for a variety of communication, coordination and fairness metric settings. From this set, we select the best performing NE.\u003Cbr\u003E\u003Cbr\u003EDate and time: 2025-11-20, 10:00 a.m.\u003Cbr\u003E\u003Cbr\u003ELocation: Montgomery Knight Building 325\u003Cbr\u003E\u003Cbr\u003ECommittee:\u003Cbr\u003EDr. Sarah Li (advisor), School of Aerospace Engineering\u003Cbr\u003EDr. Lakshmi Sankar, School of Aerospace Engineering\u003Cbr\u003EDr. Glenn Lightsey , School of Aerospace Engineering\u003Cbr\u003EDr. Brian C. Gunter, School of Aerospace Engineering\u003Cbr\u003E,\u0026nbsp;\u003Cbr\u003E,\u0026nbsp;\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EA Markov Decision Process Framework for Multi-Agent Satellite Collision Avoidance\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"A Markov Decision Process Framework for Multi-Agent Satellite Collision Avoidance"}],"uid":"27707","created_gmt":"2025-11-11 17:05:42","changed_gmt":"2025-11-11 17:06:32","author":"Tatianna Richardson","boilerplate_text":"","field_publication":"","field_article_url":"","field_event_time":{"event_time_start":"2025-11-20T10:00:00-05:00","event_time_end":"2025-11-20T12:00:00-05:00","event_time_end_last":"2025-11-20T12:00:00-05:00","gmt_time_start":"2025-11-20 15:00:00","gmt_time_end":"2025-11-20 17:00:00","gmt_time_end_last":"2025-11-20 17:00:00","rrule":null,"timezone":"America\/New_York"},"location":"Montgomery Knight Building 325","extras":[],"groups":[{"id":"221981","name":"Graduate Studies"}],"categories":[],"keywords":[{"id":"166866","name":"MS Proposal"}],"core_research_areas":[],"news_room_topics":[],"event_categories":[{"id":"1788","name":"Other\/Miscellaneous"}],"invited_audience":[{"id":"78771","name":"Public"}],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}