Augmented reality based component replacement and maintenance

Patent metadata

Field	Value
Publication number	US-10198620-B2
Application number	US-201514792081-A
Country	US
Kind code	B2
Filing date	Jul 6, 2015
Priority date	Jul 6, 2015
Publication date	Feb 5, 2019
Grant date	Feb 5, 2019

Abstract

Augmented reality (AR) based component replacement and maintenance may include receiving a first wireless signal from a pair of AR glasses worn by a user. An image of a component viewed by the user may be analyzed and compared to a plurality of images of components stored in a database that includes information associated with the plurality of images of the components. Based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, the component viewed by the user may be identified. An inventory of the identified component may be analyzed to determine whether a supplier includes the identified component in stock, and in response to a determination that the supplier includes the identified component in stock, an estimated time of delivery of the identified component to the user may be determined.

First claim

What is claimed is:

1. An augmented reality (AR) based component replacement and maintenance system comprising:
a component identifier, executed by at least one hardware processor, to receive a first wireless signal from a pair of AR glasses worn by a user, wherein the AR glasses include a display viewable by the user and a camera to image a component viewed by the user, wherein the component identifier is to
analyze the image of the component viewed by the user,
compare the image of the component viewed by the user to a plurality of images of components stored in a database, wherein the database includes information associated with the plurality of images of the components, and
based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, identify the component viewed by the user to determine a component detail by
determining a confidence of the identification of the component viewed by the user based on a degree of a match of the image of the component viewed by the user to the one of the plurality of images of the components stored in the database, wherein the confidence of the identification of the component increases based on a number of images, including the image of the component viewed by the user, of the component viewed by the user at different angles, and
in response to a determination that the degree of the match of the image of the component viewed by the user to the one of the plurality of images of the components stored in the database exceeds a specified confidence threshold, designating the component viewed by the user as the identified component;

a component inventory analyzer, executed by the at least one hardware processor, to analyze an inventory of the identified component to determine
whether a supplier includes the identified component in stock, and
in response to a determination that the supplier includes the identified component in stock, an estimated time of delivery of the identified component from the supplier to the user; and

an AR integrator and controller, executed by the at least one hardware processor, to display, on the AR glasses display, the component detail and order details related to the supplier of the identified component to provide user selection of options in the display to perform functions related to the displayed component detail and the order details.

2. The AR based component replacement and maintenance system according to claim 1 , wherein the component detail includes at least one of
a component identification (ID),
a component name, or
a component description.

3. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine whether a plurality of suppliers, including the supplier, include the identified component in stock, and
in response to a determination that the plurality of suppliers, including the supplier, include the identified component in stock, sort selected ones of the plurality of suppliers that include the identified component in stock in order of distance from the user.

4. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine whether a plurality of suppliers, including the supplier, include the identified component in stock, and
in response to a determination that the plurality of suppliers, including the supplier, include the identified component in stock, sort selected ones of the plurality of suppliers that include the identified component in stock in order of estimated times of delivery of the identified component to the user.

5. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine whether a plurality of suppliers, including the supplier, include the identified component in stock, and
in response to a determination that none of the plurality of suppliers, including the supplier, include the identified component in stock, determine a three-dimensional printer that is to be used to print the identified component for the user.

6. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine whether a plurality of suppliers, including the supplier, include the identified component in stock,
in response to a determination that the plurality of suppliers, including the supplier, include the identified component in stock, sort selected ones of the plurality of suppliers that include the identified component in stock in order of estimated times of delivery of the identified component to the user,
compare the estimated times of delivery for the selected ones of the plurality of suppliers that include the identified component in stock to a minimum required time of delivery, and
in response to a determination that all of the estimated times of delivery for the selected ones of the plurality of suppliers that include the identified component in stock are greater than the minimum required time of delivery, determine a three-dimensional printer that is to be used to print the identified component for the user.

7. The AR based component replacement and maintenance system according to claim 1 , wherein the AR integrator and controller is to
receive, based on selection of an option in the display, an indication from the user to order the identified component from the supplier.

8. The AR based component replacement and maintenance system according to claim 1 , wherein the AR integrator and controller is to
generate the display including order details related to the supplier of the identified component by generating at least one of
a map of a location of the supplier of the identified component, or
a map of a location of a three-dimensional printer that is to be used to print the identified component.

9. The AR based component replacement and maintenance system according to claim 1 , wherein the AR integrator and controller is to
determine whether the user is an authorized user to order the identified component from the supplier, and
in response to a determination that the user is the authorized user to order the identified component from the supplier, authenticate the user to perform the functions related to ordering of the identified component from the supplier.

10. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
in response to a determination that the supplier does not include the identified component in stock, determine a three-dimensional printer that is to be used to print the identified component for the user.

11. The AR based component replacement and maintenance system according to claim 1 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
in response to a determination that the supplier does not include the identified component in stock, determine an estimated time of manufacture of the identified component by the supplier,
compare the estimated time of manufacture and the estimated time of delivery for the identified component to a minimum required time, and
in response to a determination that the estimated time of manufacture and the estimated time of delivery for the identified component is greater than th

Assignees

• Accenture Global Services Ltd

Inventors

• Guo Ping
• Kaplan Daniel
• Webb Sunny M

Classifications

• G06Q30/0223

  based on inventory · CPC title

• G06K9/00208 Primary

  Physics · mapped topic

• G06K9/00671

  Physics · mapped topic

• G06F17/3028

  Physics · mapped topic

• G06Q30/0639

  Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility · CPC title