{"672285":{"#nid":"672285","#data":{"type":"news","title":"Digital Inspection Portal Uses AI and Machine Vision to Examine Moving Trains","body":[{"value":"\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Ch3\u003ECollaboration between Norfolk Southern Corporation and the Georgia Tech Research Institute (GTRI) has led to the development of digital train inspection portals that use advanced machine vision and artificial intelligence to examine trains moving at speeds of up to 60 miles per hour to identify mechanical defects that may exist.\u003C\/h3\u003E\r\n\r\n\u003Cp\u003EMachine vision technology in the portals produces images of key components located on the front and back, top, bottom, and sides of train cars, providing a 360-degree view of the complete train. Images produced by the portal are analyzed within minutes of a train\u2019s passage, allowing any issues identified to be reported immediately.\u003C\/p\u003E\r\n\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003ETwo train portals are currently in operation on adjacent tracks in Leetonia, Ohio, and the company plans to have as many as a dozen in service by the end of 2024. Among them will be a train portal already under construction near Jackson, Georgia, which is located south of Atlanta.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u201cNorfolk Southern is deploying Digital Train Inspection Portals to enhance rail safety across the company\u2019s 22-state network,\u201d said Mabby Amouie, chief data scientist for the company. \u201cThe portals feature cutting-edge machine vision inspection technology developed in partnership with GTRI, which engineered the hardware, and Norfolk Southern\u2019s Data Science\/Artificial Intelligence and Mechanical teams, which built the brains behind the program.\u201d\u003C\/p\u003E\r\n\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003EThe machine vision portion uses 38 high-resolution cameras consisting of a mix of area and line scan cameras to photograph critical components of each rail car moving through the portals. Powerful lights comparable to those used in sports stadiums allow the cameras to take approximately a thousand photographs of each moving rail car.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u201cBeing able to look at the train while it\u2019s moving at 60 miles per hour provides visibility into defects that would be difficult to see otherwise,\u201d said Gary McMurray, division chief of GTRI\u2019s Intelligent Sustainable Technologies Division. \u201cYou want to be able to look at a train while it\u2019s in motion because that\u2019s when components are stressed, and you can see other dynamic faults.\u201d\u003C\/p\u003E\r\n\r\n\u003Cp\u003ETo reduce the amount of data that must be analyzed, each camera is aimed at a specific area of the train and takes photographs only when components of interest are visible. \u201cThe high-speed cameras are strategically placed at angles to capture things that are difficult to detect with the human eye during stationary inspections,\u201d said Amouie.\u003C\/p\u003E\r\n\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003ESensors at each portal determine the speed of each train passing through and use that information to precisely control when the photographs are taken.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u201cEven with a train traveling 60 miles per hour, we are able to calculate in real time when to tell each camera to take a picture,\u201d said Colin Usher, a GTRI senior research scientist who led development of the machine vision system. \u201cOnly images of critical components are taken and the other areas of the train that are inconsequential to identifying defects are not captured. That optimizes the image capture and saves space in the computer system.\u201d\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe images produced by the system are analyzed by artificial intelligence algorithms developed by Norfolk Southern. The algorithms were designed to provide a combination of high accuracy and very low rates of false positives. If defects are spotted, the AI systems reports them immediately.\u003C\/p\u003E\r\n\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003E\u201cThe computer transmits the information to Norfolk Southern\u2019s Network Operations Center, where the data is reviewed by subject-matter experts to identify and address issues to proactively ensure the safety of rail operations,\u201d Amouie said. \u201cCritical defects are flagged for immediate handling.\u201d\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe machine vision system uses image compression techniques to reduce the size of the photographs processed by computer servers located in the portals. For a single train, the data analyzed can amount to as much as 500 gigabytes. Because the inspection needs to be done quickly, the image processing is done on-site.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe inspection portals must operate year-round in all kinds of weather conditions and in geographic locations that range from extreme heat to cold. The machine vision system therefore has to operate despite heavy vibration levels, temperature extremes, rain and snow \u2013 and to remain clean as trains pass over.\u003C\/p\u003E\r\n\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cdiv\u003E\r\n\u003Cp\u003ETo protect the cameras, air blown over the camera lenses shields them, while air-conditioned enclosures prevent overheating of the equipment. The system operates in a tunnel structure that helps protect the equipment and control lighting, which must be consistent across the train being inspected.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe project, which began in 2021, involved approximately a dozen researchers in four GTRI laboratories. The research built on imaging work done earlier for a variety of applications, including the food processing industry, which needed to monitor poultry on moving processing lines.\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u201cBy partnering with GTRI, Norfolk Southern is tapping into the best in machine vision technology in any market,\u201d Amouie said. \u201cWe chose GTRI to be a partner because they develop advanced technology solutions and large-scale system prototypes to address the most difficult problems in national security, economic development and the overall human condition.\u201d\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u0026nbsp;\u003C\/p\u003E\r\n\r\n\u003Cp\u003EWriter: \u003Ca href=\u0022mailto:john.toon@gtri.gatech.edu\u0022\u003EJohn Toon\u003C\/a\u003E\u0026nbsp;(john.toon@gtri.gatech.edu)\u003Cbr \/\u003E\r\nGTRI Communications\u003Cbr \/\u003E\r\nGeorgia Tech Research Institute\u003Cbr \/\u003E\r\nAtlanta, Georgia USA\u003C\/p\u003E\r\n\r\n\u003Cp\u003EThe \u003Ca href=\u0022https:\/\/gtri.gatech.edu\u0022\u003EGeorgia Tech Research Institute (GTRI)\u003C\/a\u003E is the nonprofit, applied research division of the Georgia Institute of Technology (Georgia Tech).\u202fFounded in 1934 as the Engineering Experiment Station, GTRI has grown to more than 2,900 employees, supporting eight laboratories in over 20 locations around the country and performing more than $940 million of problem-solving research annually for government and industry.\u202fGTRI\u0027s renowned researchers combine science, engineering, economics, policy, and technical expertise to solve complex problems for the U.S. federal government, state, and industry.\u0026nbsp;\u0026nbsp;\u003C\/p\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n\u003C\/div\u003E\r\n","summary":"","format":"limited_html"}],"field_subtitle":"","field_summary":[{"value":"\u003Cp\u003ECollaboration between Norfolk Southern Corporation and the Georgia Tech Research Institute (GTRI) has led to the development of digital train inspection portals that use advanced machine vision and artificial intelligence to examine trains moving at speeds of up to 60 miles per hour to identify mechanical defects that may exist.\u003C\/p\u003E\r\n","format":"limited_html"}],"field_summary_sentence":[{"value":"Norfolk Southern Corporation and the Georgia Tech Research Institute (GTRI) have developed digital train inspection portals that use advanced machine vision and artificial intelligence to identify mechanical defects that may exist on moving trains."}],"uid":"35832","created_gmt":"2024-01-19 15:14:45","changed_gmt":"2024-01-26 13:49:32","author":"Michelle Gowdy","boilerplate_text":"","field_publication":"","field_article_url":"","dateline":{"date":"2024-01-19T00:00:00-05:00","iso_date":"2024-01-19T00:00:00-05:00","tz":"America\/New_York"},"extras":[],"hg_media":{"672809":{"id":"672809","type":"image","title":"Researchers install a high-speed camera ","body":"\u003Cp\u003EResearchers install a high-speed camera that is part of the portal\u2019s machine vision system. (Credit: John Toon, GTRI)\u003C\/p\u003E\r\n","created":"1705676909","gmt_created":"2024-01-19 15:08:29","changed":"1705676979","gmt_changed":"2024-01-19 15:09:39","alt":"Researchers install a high-speed camera ","file":{"fid":"256128","name":"1train-portal12-lg.jpg","image_path":"\/sites\/default\/files\/2024\/01\/19\/1train-portal12-lg.jpg","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2024\/01\/19\/1train-portal12-lg.jpg","mime":"image\/jpeg","size":641639,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2024\/01\/19\/1train-portal12-lg.jpg?itok=Vc3BWQIm"}},"672808":{"id":"672808","type":"image","title":"A Norfolk Southern locomotive ","body":"\u003Cp\u003EA Norfolk Southern locomotive moves through a train portal operating near Leetonia, Ohio. (Credit: Norfolk Southern)\u003C\/p\u003E\r\n","created":"1705676678","gmt_created":"2024-01-19 15:04:38","changed":"1705676871","gmt_changed":"2024-01-19 15:07:51","alt":"A Norfolk Southern locomotive ","file":{"fid":"256127","name":"IMG_7052.jpg","image_path":"\/sites\/default\/files\/2024\/01\/19\/IMG_7052.jpg","image_full_path":"http:\/\/hg.gatech.edu\/\/sites\/default\/files\/2024\/01\/19\/IMG_7052.jpg","mime":"image\/jpeg","size":1917122,"path_740":"http:\/\/hg.gatech.edu\/sites\/default\/files\/styles\/740xx_scale\/public\/2024\/01\/19\/IMG_7052.jpg?itok=4f_OHXLr"}},"672810":{"id":"672810","type":"video","title":"Digital Inspection Portal Uses AI and Machine Vision to Examine Moving Trains","body":"\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003ECollaboration between Norfolk Southern Corporation and the Georgia Tech Research Institute (GTRI) has led to the development of digital train inspection portals that use advanced machine vision and artificial intelligence to examine trains moving at speeds of up to 60 miles per hour to identify mechanical defects that may exist.\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n","created":"1705677045","gmt_created":"2024-01-19 15:10:45","changed":"1705677141","gmt_changed":"2024-01-19 15:12:21","video":{"youtube_id":"ZEMWWjCRP6M","video_url":"https:\/\/www.youtube.com\/watch?v=ZEMWWjCRP6M\u0026t=2s"}}},"media_ids":["672809","672808","672810"],"groups":[{"id":"1276","name":"Georgia Tech Research Institute (GTRI)"},{"id":"1188","name":"Research Horizons"}],"categories":[{"id":"142","name":"City Planning, Transportation, and Urban Growth"},{"id":"42901","name":"Community"},{"id":"153","name":"Computer Science\/Information Technology and Security"},{"id":"129","name":"Institute and Campus"},{"id":"135","name":"Research"}],"keywords":[{"id":"416","name":"GTRI"},{"id":"365","name":"Research"},{"id":"187915","name":"go-researchnews"},{"id":"166902","name":"science and technology"},{"id":"341","name":"innovation"},{"id":"8073","name":"Norfolk Southern"},{"id":"168","name":"Transportation"},{"id":"12698","name":"Trains"},{"id":"167055","name":"security"},{"id":"7560","name":"inspection"},{"id":"2835","name":"ai"},{"id":"8427","name":"artificialintelligence"},{"id":"193433","name":"railways"},{"id":"167","name":"Rail"},{"id":"193434","name":"machinevision"},{"id":"193435","name":"nationalsecurity"},{"id":"342","name":"Georgia"}],"core_research_areas":[{"id":"39481","name":"National Security"},{"id":"39501","name":"People and Technology"},{"id":"39541","name":"Systems"}],"news_room_topics":[{"id":"106361","name":"Business and Economic Development"}],"event_categories":[],"invited_audience":[],"affiliations":[],"classification":[],"areas_of_expertise":[],"news_and_recent_appearances":[],"phone":[],"contact":[{"value":"\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E(Interim) Director of Communications\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003EMichelle Gowdy\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003EMichelle.Gowdy@gtri.gatech.edu\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n\r\n\u003Cp\u003E\u003Cspan\u003E\u003Cspan\u003E404-407-8060\u003C\/span\u003E\u003C\/span\u003E\u003C\/p\u003E\r\n","format":"limited_html"}],"email":["michelle.gowdy@gtri.gatech.edu"],"slides":[],"orientation":[],"userdata":""}}}