{"690553":{"#nid":"690553","#data":{"type":"news","title":"New App Allows Anyone to Operate a Robot From Their Phone","body":[{"value":"\u003Cp\u003ESomeone with no computing experience may soon be able to remotely control a robot from anywhere on the planet using a smartphone, thanks to new technology developed by Georgia Tech.\u003C\/p\u003E\u003Cp\u003EThe new technology is also set to revolutionize the scale of policy training data collection, which is essential to advancing robotic capabilities and meeting growing production demand.\u003C\/p\u003E\u003Cp\u003E\u003Ca href=\u0022https:\/\/cobalt-teleop.github.io\/\u0022\u003ECOBALT\u003C\/a\u003E is a mobile app that turns smartphones into controllers for robot arms. With a secure Wi-Fi connection to a server, users can move their phones in any direction, and the robot arm will mirror the motion \u2014 from anywhere in the world.\u003C\/p\u003E\u003Cp\u003EAyush Agarwal, a Ph.D. student in Georgia Tech\u2019s School of Interactive Computing who leads a research team developing COBALT, said it works like the games people play on smartphones. Users can press a button to have the arm grasp an object, move it, and release it with another button.\u003C\/p\u003E\u003Cp\u003EAgarwal conducted several user studies with participants in nine countries who remotely operated robot arms inside Georgia Tech\u2019s\u0026nbsp;\u003Ca href=\u0022https:\/\/www.pair.toronto.edu\/\u0022\u003EPeople, AI \u0026amp; Robotics (PAIR) Lab\u003C\/a\u003E. The lab is directed by Assistant Professor Animesh Garg, who advises Agarwal.\u003C\/p\u003E\u003Cp\u003E\u201cWe built an entire distribution system for remote teleoperation scaled to where we had people from Indonesia, India, and Pakistan operating for us,\u201d Agarwal said. \u201cThey were novice operators who had never done it before. By collecting data from these new users, we showed that we can train policies to automate certain tasks.\u201d\u003C\/p\u003E\u003Cp\u003EGarg envisions a world where data collection for policy training is done through crowdsourcing. He began working toward this goal 10 years ago as a postdoc at Stanford University, when he developed\u0026nbsp;\u003Ca href=\u0022https:\/\/roboturk.stanford.edu\/\u0022\u003ERoboTurk\u003C\/a\u003E, an earlier version of COBALT.\u003C\/p\u003E\u003Cp\u003E\u201cThere is a large-scale data collection requirement for mass robot production to be possible, and it will not be solved purely through simulation,\u201d Garg said.\u003C\/p\u003E\u003Cp\u003E\u201cOur idea was, what if we could get almost every person on the planet to be a passive source for data collection? There are almost five billion people who have smartphones and know how to use them.\u201d\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Ch4\u003E\u003Cstrong\u003EEducation and Economy Impact\u003C\/strong\u003E\u003C\/h4\u003E\u003Cp\u003EAnother major implication of COBALT could be expanded access to CS and robotics education.\u003C\/p\u003E\u003Cp\u003EStudents can learn to operate a robot remotely in any classroom. In fact, Garg and his lab recently hosted students from Midtown High School in Atlanta to demonstrate COBALT and let them control robot arms from a phone.\u003C\/p\u003E\u003Cp\u003EGarg also sees the possibility of a \u201cgig economy\u201d in which people pay remote operators to control assistive robots in their homes and complete household chores for them.\u003C\/p\u003E\u003Cp\u003E\u201cIt could be Uber for robots,\u201d he said. \u201cPeople who want to log onto the platform can do so at their convenience and for as long as they want.\u201d\u003C\/p\u003E\u003Cp\u003ECompanies with robot-dependent labor tasks could also use the platform to enable human oversight.\u003C\/p\u003E\u003Cp\u003E\u201cIf I deploy a robot in a factory that achieves high autonomy for most tasks, but there are still times it needs help, a human could operate the robot from anywhere in the world,\u201d Garg said.\u003C\/p\u003E\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\u003Ch4\u003E\u003Cstrong\u003EBuilding a Network\u003C\/strong\u003E\u003C\/h4\u003E\u003Cp\u003EAgarwal\u2019s studies showed that people prefer to interact with and control a robot using a smartphone rather than virtual reality (VR) headsets, controllers, keyboards, mice, or other devices.\u003C\/p\u003E\u003Cp\u003E\u201cThe phone is a more intuitive interface and can provide data quality that\u2019s on par with other commonly used devices,\u201d he said.\u003C\/p\u003E\u003Cp\u003EAgarwal also said there is minimal latency in the video feed sent back to operators on the other side of the world. That\u2019s because the amount of data being processed is small.\u003C\/p\u003E\u003Cp\u003EThe data is carried over Web Real-Time Communication (WebRTC), the same technology used by many streaming services and web conferencing platforms such as Zoom and Google Meet.\u003C\/p\u003E\u003Cp\u003E\u201cThere\u2019s a connection from your phone to the teleoperation server, which is connected to the robots,\u201d Agarwal said.\u003C\/p\u003E\u003Cp\u003E\u201cThen there\u2019s another connection from the teleoperation server back to the user, which allows for a video stream. We need low latency on both because you don\u2019t want the user to move their phone and wait 10 seconds to see the visual feed.\u201d\u003C\/p\u003E\u003Cp\u003EAgarwal is the co-lead author of a paper on COBALT that is being presented at the\u0026nbsp;\u003Ca href=\u0022https:\/\/2026.ieee-icra.org\/\u0022\u003EIEEE International Conference on Robotics and Automation\u003C\/a\u003E this week in Vienna. He said the paper stands out because it has moved from theory to the implementation of an entire distribution network.\u0026nbsp;\u003C\/p\u003E\u003Cp\u003E\u201cThe real novelty of our paper is the systems that we build around it to actually support the scaling of remote operation and data collection at a global level,\u201d he said.\u0026nbsp;\u003C\/p\u003E","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003EWith a secure Wi-Fi connection to a server, users can move their phones in any direction, and the robot arm will mirror the motion \u2014 from anywhere in the world.\u003C\/p\u003E","format":"limited_html"}],"field_summary_sentence":[{"value":"A new mobile app turns smartphones into controllers for robot arms. "}],"uid":"36530","created_gmt":"2026-05-29 16:37:15","changed_gmt":"2026-05-29 16:43:09","author":"Nathan Deen","boilerplate_text":"","field_publication":"","field_article_url":"","location":"Atlanta, GA","dateline":{"date":"2026-05-29T00:00:00-04:00","iso_date":"2026-05-29T00:00:00-04:00","tz":"America\/New_York"},"extras":[],"hg_media":{"680381":{"id":"680381","type":"image","title":"Animesh-Garg-lab_86A8356.jpg","body":null,"created":"1780072785","gmt_created":"2026-05-29 16:39:45","changed":"1780072785","gmt_changed":"2026-05-29 16:39:45","alt":"Three men use their phones to control a robot arm","file":{"fid":"264637","name":"Animesh-Garg-lab_86A8356.jpg","image_path":"\/sites\/default\/files\/2026\/05\/29\/Animesh-Garg-lab_86A8356.jpg","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2026\/05\/29\/Animesh-Garg-lab_86A8356.jpg","mime":"image\/jpeg","size":186525,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2026\/05\/29\/Animesh-Garg-lab_86A8356.jpg?itok=8WOofrjN"}}},"media_ids":["680381"],"groups":[{"id":"47223","name":"College of Computing"},{"id":"1188","name":"Research Horizons"},{"id":"50876","name":"School of Interactive Computing"}],"categories":[{"id":"152","name":"Robotics"}],"keywords":[{"id":"188776","name":"go-research"},{"id":"187915","name":"go-researchnews"},{"id":"9153","name":"Research Horizons"},{"id":"168927","name":"smartphones"},{"id":"44461","name":"robot arm"},{"id":"93131","name":"ICRA"}],"core_research_areas":[{"id":"39521","name":"Robotics"}],"news_room_topics":[],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[],"email":[],"slides":[],"orientation":[],"userdata":""}}}