Augmented reality based component replacement and maintenance

Patent metadata

Field	Value
Publication number	US-2019130163-A1
Application number	US-201816232910-A
Country	US
Kind code	A1
Filing date	Dec 26, 2018
Priority date	Jul 6, 2015
Publication date	May 2, 2019
Grant date	—

Abstract

Augmented reality (AR) based component replacement and maintenance may include receiving a first wireless signal from a pair of AR glasses worn by a user. An image of a component viewed by the user may be analyzed and compared to a plurality of images of components stored in a database that includes information associated with the plurality of images of the components. Based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, the component viewed by the user may be identified. An inventory of the identified component may be analyzed to determine whether a supplier includes the identified component in stock, and in response to a determination that the supplier includes the identified component in stock, an estimated time of delivery of the identified component to the user may be determined.

First claim

1 - 20 . (canceled)

21 . An augmented reality (AR) based component replacement and maintenance system comprising:
a component identifier, executed by at least one hardware processor, to receive a first wireless signal from a pair of AR glasses worn by a user, wherein the AR glasses include a display viewable by the user and a camera to image a component viewed by the user, wherein the component identifier is to
analyze the image of the component viewed by the user,
compare the image of the component viewed by the user to a plurality of images of components stored in a database, wherein the database includes information associated with the plurality of images of the components, and
based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, identify the component viewed by the user to determine a component detail;
a component inventory analyzer, executed by the at least one hardware processor, to analyze an inventory of the identified component to
determine whether a plurality of suppliers include the identified component in stock, and
in response to a determination that the plurality of suppliers include the identified component in stock, sort selected ones of the plurality of suppliers that include the identified component in stock in order of estimated times of delivery of the identified component to the user; and
an AR integrator and controller, executed by the at least one hardware processor, to display, on the AR glasses display, the component detail and order details related to the sorted selected ones of the plurality of suppliers of the identified component to provide user selection of options in the display to perform functions related to the displayed component detail and the order details.

22 . The AR based component replacement and maintenance system according to claim 21 , wherein the component detail includes at least one of
a component identification (ID), a component name, or a component description.

23 . The AR based component replacement and maintenance system according to claim 21 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
sort, in response to the determination that the plurality of suppliers include the identified component in stock, selected ones of the plurality of suppliers that include the identified component in stock in order of distance from the user.

24 . The AR based component replacement and maintenance system according to claim 21 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine, in response to a determination that none of the plurality of suppliers include the identified component in stock, a three-dimensional printer that is to be used to print the identified component for the user.

25 . The AR based component replacement and maintenance system according to claim 21 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
compare the estimated times of delivery for the selected ones of the plurality of suppliers that include the identified component in stock to a minimum required time of delivery, and in response to a determination that all of the estimated times of delivery for the selected ones of the plurality of suppliers that include the identified component in stock are greater than the minimum required time of delivery, determine a three-dimensional printer that is to be used to print the identified component for the user.

26 . The AR based component replacement and maintenance system according to claim 21 , wherein the AR integrator and controller is to
receive, based on selection of an option in the display, an indication from the user to order the identified component from one of the sorted selected ones of the plurality of suppliers.

27 . The AR based component replacement and maintenance system according to claim 21 , wherein the AR integrator and controller is to
generate the display including order details related to a supplier of the sorted selected ones of the plurality of suppliers of the identified component by generating at least one of
a map of a location of the supplier of the identified component, or
a map of a location of a three-dimensional printer that is to be used to print the identified component.

28 . The AR based component replacement and maintenance system according to claim 21 , wherein the AR integrator and controller is to
determine whether the user is an authorized user to order the identified component from a supplier of the sorted selected ones of the plurality of suppliers, and in response to a determination that the user is the authorized user to order the identified component from the supplier of the sorted selected ones of the plurality of suppliers, authenticate the user to perform the functions related to ordering of the identified component from the supplier.

29 . The AR based component replacement and maintenance system according to claim 21 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine, in response to a determination that the plurality of suppliers do not include the identified component in stock, a three-dimensional printer that is to be used to print the identified component for the user.

30 . The AR based component replacement and maintenance system according to claim 21 , wherein the component inventory analyzer is to analyze the inventory of the identified component to
determine, in response to a determination that the plurality of suppliers do not include the identified component in stock, an estimated time of manufacture of the identified component by the plurality of suppliers, compare the estimated time of manufacture and the estimated time of delivery for the identified component to a minimum required time, and in response to a determination that the estimated time of manufacture and the estimated time of delivery for the identified component is greater than the minimum required time, determine a three-dimensional printer that is to be used to print the identified component for the user.

31 . A method for augmented reality (AR) based component replacement and maintenance, the method comprising:
receiving a first wireless signal from an AR device used by a user, wherein the AR device includes a display viewable by the user and a camera to image a component viewed by the user; analyzing, by a hardware processor, the image of the component viewed by the user; comparing the image of the component viewed by the user to a plurality of images of components stored in a database, wherein the database includes information associated with the plurality of images of the components; based on a match of the image of the component viewed by the user to one of the plurality of images of the components stored in the database, identifying the component viewed by the user to determine a component detail; analyzing, based on the component detail, an inventory of the identified component; and displaying, on the AR device display, the component detail and order details related to the identified component to provide user selection of options in the display to perform functions related to the displayed component detail and the order details.

32 . The method according to claim 31 , wherein analyzing, based on the component detail, the inventory of the identified component further comprises:
analyzing estimated times of delivery of suppliers that include the identified component in stock; and based on a determination that all of th

Assignees

• Accenture Global Services Ltd

Inventors

• Guo Ping
• Kaplan Daniel
• Webb Sunny M

Classifications

• G06K9/00671

  Physics · mapped topic

• G06F16/50

  of still image data · CPC title

• G06Q30/0223

  based on inventory · CPC title

• G06F16/5838

  using colour · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title