Integrated robotic system and method for autonomous vehicle maintenance

Patent metadata

Field	Value
Publication number	US-11865732-B2
Application number	US-202117246009-A
Country	US
Kind code	B2
Filing date	Apr 30, 2021
Priority date	May 1, 2015
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

A robotic system includes a controller configured to obtain image data from one or more optical sensors and to determine one or more of a location and/or pose of a vehicle component based on the image data. The controller also is configured to determine a model of an external environment of the robotic system based on the image data and to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component. The controller also is configured to assign the tasks to the components of the robotic system and to communicate control signals to the components of the robotic system to autonomously control the robotic system to perform the maintenance on the vehicle component.

First claim

What is claimed is:

1. A robotic system comprising:
a controller configured to obtain image data from one or more sensors, the controller also configured to determine a location and a pose of a vehicle component based on the image data, the controller configured to determine a model of an external environment of the robotic system based on the image data, the controller configured to determine a mapping of a location of the robotic system in the model of the external environment, the model of the external environment providing locations of objects external to the robotic system relative to the location of the robotic system and grades of a surface on which the robotic system is configured to travel,
the controller configured to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component,
the controller configured to determine a sequence of movements of the components of the robotic system based at least in part on the tasks to be performed and the locations of the objects external to the robotic system relative to the location of the robotic system and the grades of the surface on which the robotic system is configured to travel,
the controller configured to communicate control signals to the components of the robotic system to move the components based on the sequence of movements of the components to perform the tasks.

2. The robotic system of claim 1 , wherein the model of the external environment of the robotic system provides obstructions in a moving path of the robotic system relative to the location of the robotic system in the model of the external environment.

3. The robotic system of claim 1 , wherein at least one of the tasks includes at least one of the components of the robotic system actuating the vehicle component.

4. The robotic system of claim 1 , wherein the controller is configured to autonomously move one or more of the components of the robotic system based on the model of the external environment and the sequence of movements of the one or more of the components.

5. The robotic system of claim 1 , wherein the model of the external environment provides a location of objects relative to one or more of the vehicle component or the components of the robotic system.

6. The robotic system of claim 1 , wherein the model of the external environment is a grid-based representation of the external environment based on the image data.

7. The robotic system of claim 1 , wherein the tasks are determined based on one or more of the model of the external environment or the location and pose of the vehicle component.

8. The robotic system of claim 1 , further comprising a propulsion system configured to move the robotic system based on the control signals.

9. The robotic system of claim 8 , wherein the propulsion system is configured to move the robotic system from a first location to a second location, wherein the controller is configured to determine a new model of the external environment based on movement of the robotic system from the first location to the second location, the new model of the external environment providing new locations of the objects external to the robotic system based on the movement of the robotic system to the second location.

10. The robotic system of claim 1 , wherein the model of the external environment is determined for a designated volume around one or more of the robotic system or the vehicle component.

11. The robotic system of claim 1 , wherein the model of the external environment is determined based on one or more of two-dimensional (2D) or three-dimensional (3D) image data from the one or more sensors.

12. A method comprising:
obtaining image data from one or more optical sensors;
determining a location and a pose of a vehicle component based on the image data;
determining a model of an external environment of a robotic system based on the image data;
determining a mapping of a location of the robotic system in the model of the external environment, the model of the external environment providing locations of objects external to the robotic system and grades of a surface on which the robotic system is configured to travel;
determining tasks to be performed by components of the robotic system to perform maintenance on the vehicle component;
determining a sequence of movements of the components of the robotic system based at least in part on the tasks to be performed and the locations of the objects external to the robotic system relative to the location of the robotic system and the grades of the surface on which the robotic system is configured to move; and
communicating control signals to the components of the robotic system to move the components based on the sequence of movements of the components to perform the tasks.

13. The method of claim 12 , wherein at least one of the tasks includes at least one of the components of the robotic system actuating the vehicle component.

14. The method of claim 12 , wherein the model of the external environment of the robotic system provides obstructions in a moving path of the robotic system relative to the location of the robotic system in the model of the external environment.

15. The method of claim 12 , further comprising autonomously moving one or more of the components of the robotic system based on the model of the external environment and the sequence of movements of the one or more of the components.

16. The method of claim 12 , wherein the model of the external environment provides a location of objects relative to one or more of the vehicle component or the components of the robotic system.

17. The method of claim 12 , wherein the model of the external environment is a grid-based representation of the external environment based on the image data.

18. The method of claim 12 , wherein the tasks are determined based on one or more of the model of the external environment or the location and pose of the vehicle component.

19. The method of claim 12 , wherein the model of the external environment is determined for a designated volume around one or more of the robotic system or the vehicle component.

20. A robotic system comprising:
a controller configured to obtain image data from one or more sensors, the controller also configured to determine a location and a pose of a vehicle component based on the image data and to determine a model of an external environment of the robotic system based on the image data, the controller configured to determine a mapping of a location of the robotic system in the model of the external environment, the model of the external environment providing locations of objects external to the robotic system relative to the location of the robotic system, grades of a surface on which the robotic system is configured to travel, and obstructions in a moving path of the robotic system relative to the location of the robotic system, the controller configured to determine tasks to be performed by components of the robotic system to perform maintenance on the vehicle component; and
a propulsion system configured to move the robotic system based on the control signals, wherein the control signals of the propulsion system are based on one or more of the model of the external environment or the location and pose of the vehicle component,
the controller configured to determine a sequence of movements of the components of the robotic system based on one or more of the tasks to be performed by the components, the model of the external environment, or the locat

Assignees

• Transp Ip Holdings Llc

Inventors

• Patrick Romano
• Sen Shiraj
• Jain Arpit
• Tan Huan
• Gefen Yonatan
• Li Shuai
• Liu Shubao
• Sharma Pramod
• Kannan Balajee
• Holovashchenko Viktor
• Forman Douglas
• Lizzi John Michael
• Theurer Charles Burton
• Al Assad Omar
• Baloch Ghulam Ali
• Wheeler Frederick Wilson
• Tian Tai-Peng

Classifications

• B25J9/1697 Primary

  Vision controlled systems · CPC title

• B25J5/007

  mounted on wheels · CPC title

• B25J9/06

  characterised by multi-articulated arms · CPC title

• B25J13/084

  Tactile sensors (in general G01L5/16, G01L5/22) · CPC title

• B25J19/023

  including video camera means · CPC title