Systems and methods for railway asset management

Patent metadata

Field	Value
Publication number	US-11731676-B2
Application number	US-202217837677-A
Country	US
Kind code	B2
Filing date	Jun 10, 2022
Priority date	Jul 7, 2020
Publication date	Aug 22, 2023
Grant date	Aug 22, 2023

Abstract

Systems and methods for railway asset management. The methods comprise: using a virtual reality device to recognize and collect real world information about railway assets located in a railyard; and using the real world information to (i) associate a railway asset to a data collection unit, (ii) provide an individual with an augmented reality experience associated with the railyard and/or (iii) facilitate automated railyard management tasks.

First claim

We claim:

1. A method for Augmented Reality (AR) based railyard management, comprising:
obtaining real world information collected by a computing device about railway assets located in a railyard;
processing the real world information to recognize a marking on at least one of the railway assets;
generating holographic image data based on content of the recognized marking;
providing an individual with an augmented reality experience by overlaying the holographic image data on a visible real world environment; and
using the content of the recognized marking to facilitate automated railyard management tasks.

2. The method according to claim 1 , wherein the railway asset comprises a train consist, a railcar, a locomotive, a rail maintenance equipment, a container, or an International Standards Organization (ISO) tank.

3. The method according to claim 1 , wherein the automated railyard management tasks comprises at least one of validating a train consist, validating information disposed on the railway assets, detecting locations of the railway assets in the railyard, updating a map of the railyard, monitoring states of the railway assets while in the railyards, detecting damage to the railway assets in the railyards, detecting hazards of the railway assets, predicting future issues with the railway assets based on machine learned information, performing maintenance checks for components of the railway assets, scheduling maintenance for the railway assets, facilitating maintenance of railway assets using a robotic manipulator which is remotely controlled via a virtual reality environment, performing security checks for the railyard, performing security checks for the railway assets, performing compliance checks for the railway assets, and providing notifications to individuals.

4. The method according to claim 1 , wherein the augmented reality experience is provided to the individual by allowing a real world environment of the railyard to be visible to an individual who is wearing the computing device.

5. The method according to claim 1 , wherein the real world information comprises at least one of locations of the railway assets, information disposed on the railway assets, physical conditions of the railway assets, operating states of components of the railway assets, and physical conditions of the components of the railway assets.

6. The method according to claim 1 , further comprising performing a machine learning algorithm using the real world information to predict a future event or condition relating to at least one railway asset of the railway assets.

7. The method according to claim 6 , further comprising causing an action to be taken in relation to the railway asset based on the predicted future event or condition.

8. The method according to claim 1 , further comprising using the real world information to facilitate an inspection of the railway assets by an individual remote from the railyard.

9. The method according to claim 1 , further comprising using real world information to facilitate a remote control of a robotic manipulator located in the railyard.

10. A system, comprising:
a processor;
a non-transitory computer-readable storage medium comprising programming instructions that are configured to cause the processor to implement a method for Augmented Reality (AR) based railyard management, wherein the programming instructions comprise instructions to:
obtain world information about railway assets located in a railyard;
process the real world information to recognize a marking on at least one of the railway assets;
generate holographic image data based on content of the recognized marking;
provide an individual with an augmented reality experience by overlaying the holographic image data on a visible real world environment; and
use the content of the recognized marking to facilitate automated railyard management tasks.

11. The system according to claim 10 , wherein the railway asset comprises a train consist, a railcar, a locomotive, a rail maintenance equipment, a container, or an International Standards Organization (ISO) tank.

12. The system according to claim 10 , wherein the automated railyard management tasks comprises at least one of validating a train consist, validating information disposed on the railway assets, detecting locations of the railway assets in the railyard, updating a map of the railyard, monitoring states of the railway assets while in the railyards, detecting damage to the railway assets in the railyards, detecting hazards of the railway assets, predicting future issues with the railway assets based on machine learned information, performing maintenance checks for components of the railway assets, scheduling maintenance for the railway assets, facilitating maintenance of railway assets using a robotic manipulator which is remotely controlled via a virtual reality environment, performing security checks for the railyard, performing security checks for the railway assets, performing compliance checks for the railway assets, and providing notifications to individuals.

13. The system according to claim 10 , wherein the augmented reality experience is provided to the individual by allowing a real world environment of the railyard to be visible to an individual who is wearing the computing device.

14. The method according to claim 10 , wherein the real world information comprises at least one of locations of the railway assets, information disposed on the railway assets, physical conditions of the railway assets, operating states of components of the railway assets, and physical conditions of the components of the railway assets.

15. The system according to claim 10 , wherein the programming instructions further comprise instructions to perform a machine learning algorithm using the real world information to predict a future event or condition relating to at least one railway asset of the railway assets.

16. The system according to claim 15 , wherein the programming instructions further comprise instructions to cause an action to be taken in relation to the railway asset based on the predicted future event or condition.

17. The system according to claim 10 , wherein the programming instructions further comprise instructions to use the real world information to facilitate an inspection of the railway assets by an individual remote from the railyard.

18. The system according to claim 10 , wherein the programming instructions further comprise instructions to use real world information to facilitate a remote control of a robotic manipulator located in the railyard.

Assignees

• Amsted Rail Co Inc

Inventors

• Weiner Evan
• Myers Brad A

Classifications

• B61L27/57 Primary

  for vehicles or trains, e.g. trackside supervision of train conditions · CPC title

• B25J9/1674

  characterised by safety, monitoring, diagnostic · CPC title

• B25J9/1689

  Teleoperation · CPC title

• B61L27/40

  Handling position reports or trackside vehicle data · CPC title

• B61L27/70

  Details of trackside communication · CPC title