Augmented reality based component replacement and maintenance

Patent metadata

Field	Value
Publication number	US-10769410-B2
Application number	US-201816232910-A
Country	US
Kind code	B2
Filing date	Dec 26, 2018
Priority date	Jul 6, 2015
Publication date	Sep 8, 2020
Grant date	Sep 8, 2020

Abstract

Augmented reality (AR) based component replacement and maintenance may include receiving a first wireless signal from a pair of AR glasses worn by a user. An image of a component viewed by the user may be analyzed and compared to a plurality of images of components stored in a database that includes information associated with the plurality of images of the components. Based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, the component viewed by the user may be identified. An inventory of the identified component may be analyzed to determine whether a supplier includes the identified component in stock, and in response to a determination that the supplier includes the identified component in stock, an estimated time of delivery of the identified component to the user may be determined.

First claim

What is claimed is:

1. An augmented reality (AR) based component replacement and maintenance system comprising:
a component identifier, executed by at least one hardware processor, to receive a first wireless signal from a pair of AR glasses worn by a user, wherein the AR glasses include a display viewable by the user and a camera to image a component viewed by the user, wherein the component identifier is to
analyze the image of the component viewed by the user,
compare the image of the component viewed by the user to a plurality of images of components stored in a database, wherein the database includes information associated with the plurality of images of the components, and
based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, identify the component viewed by the user to determine a component detail;

a component inventory analyzer, executed by the at least one hardware processor, to analyze an inventory of the identified component to
determine whether a plurality of suppliers include the identified component in stock,
in response to a determination that the plurality of suppliers include the identified component in stock, sort selected ones of the plurality of suppliers that include the identified component in stock in order of estimated times of delivery of the identified component to the user,
compare the estimated times of delivery for the selected ones of the plurality of suppliers that include the identified component in stock to a minimum required time of delivery, and
in response to a determination that all of the estimated times of delivery for the selected ones of the plurality of suppliers that include the identified component in stock are greater than the minimum required time of delivery, determine a three-dimensional printer that is to be used to print the identified component for the user; and

an AR integrator and controller, executed by the at least one hardware processor, to display, on the AR glasses display, the component detail and order details related to the sorted selected ones of the plurality of suppliers of the identified component to provide user selection of options in the display to perform functions related to the displayed component detail and the order details.

2. The AR based component replacement and maintenance system according to claim 1 , wherein the component detail includes at least one of
a component identification (ID),
a component name, or
a component description.

3. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
sort, in response to the determination that the plurality of suppliers include the identified component in stock, selected ones of the plurality of suppliers that include the identified component in stock in order of distance from the user.

4. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine, in response to a determination that none of the plurality of suppliers include the identified component in stock, the three-dimensional printer that is to be used to print the identified component for the user.

5. The AR based component replacement and maintenance system according to claim 1 , wherein the AR integrator and controller is to
receive, based on selection of an option in the display, an indication from the user to order the identified component from one of the sorted selected ones of the plurality of suppliers.

6. The AR based component replacement and maintenance system according to claim 1 , wherein the AR integrator and controller is to
generate the display including order details related to a supplier of the sorted selected ones of the plurality of suppliers of the identified component by generating at least one of
a map of a location of the supplier of the identified component, or
a map of a location of the three-dimensional printer that is to be used to print the identified component.

7. The AR based component replacement and maintenance system according to claim 1 , wherein the AR integrator and controller is to
determine whether the user is an authorized user to order the identified component from a supplier of the sorted selected ones of the plurality of suppliers, and
in response to a determination that the user is the authorized user to order the identified component from the supplier of the sorted selected ones of the plurality of suppliers, authenticate the user to perform the functions related to ordering of the identified component from the supplier.

8. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine, in response to a determination that the plurality of suppliers do not include the identified component in stock, the three-dimensional printer that is to be used to print the identified component for the user.

9. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine, in response to a determination that the plurality of suppliers do not include the identified component in stock, an estimated time of manufacture of the identified component by the plurality of suppliers,
compare the estimated time of manufacture and the estimated time of delivery for the identified component to another minimum required time, and
in response to a determination that the estimated time of manufacture and the estimated time of delivery for the identified component is greater than the other minimum required time, determine the three-dimensional printer that is to be used to print the identified component for the user.

10. A method for augmented reality (AR) based component replacement and maintenance, the method comprising:
receiving a first wireless signal from an AR device used by a user, wherein the AR device includes a display viewable by the user and a camera to image a component viewed by the user;
analyzing, by a hardware processor, the image of the component viewed by the user;
comparing the image of the component viewed by the user to a plurality of images of components stored in a database, wherein the database includes information associated with the plurality of images of the components;
based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, identifying the component viewed by the user to determine a component detail;
analyzing, based on the component detail, an inventory of the identified component by:
analyzing estimated times of delivery of suppliers that include the identified component in stock; and
based on a determination that all of the estimated times of delivery are greater than a specified time duration, identifying and utilizing a three-dimensional printer to print the identified component; and

displaying, on the AR device display, the component detail and order details related to the identified component to provide user selection of options in the display to perform functions related to the displayed component detail and the order details.

11. The method according to claim 10 , wherein analyzing, based on the component detail, the inventory of the identified component further comprises:
analyzing the estimated times of delivery of suppliers that include the identified

Assignees

• Accenture Global Services Ltd

Inventors

• Guo Ping
• Kaplan Daniel
• Webb Sunny M

Classifications

• G06Q30/0623 Primary

  by investigating goods or services · CPC title

• G06V20/647 Primary

  by matching two-dimensional images to three-dimensional objects · CPC title

• G06V2201/06

  Recognition of objects for industrial automation · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06F16/583

  using metadata automatically derived from the content · CPC title