Installation of a physical element

Patent metadata

Field	Value
Publication number	US-10210390-B2
Application number	US-201715455256-A
Country	US
Kind code	B2
Filing date	Mar 10, 2017
Priority date	May 13, 2016
Publication date	Feb 19, 2019
Grant date	Feb 19, 2019

Abstract

A computer-implemented method, a computer program product and a computer system for installing a first physical element on or in a second physical element are provided. The method comprises receiving, by an augmented reality system, an indication of at least one of the first physical element and the second physical element. The method further comprises loading, by the augmented reality system and using the indication, a model of the second physical element. The method further comprises recognizing, by the augmented reality system, the second physical element based on the model. The method further comprises projecting, by the augmented reality system, an image corresponding to the first physical element on or in the second physical element.

First claim

What is claimed is:

1. A method, comprising:
scanning, by an augmented reality system, a barcode associated with at least one of a first physical element or a second physical element;
loading, by the augmented reality system and based on scanning the barcode, a model of the second physical element;
recognizing, by the augmented reality system, the second physical element based on the model of the second physical element;
projecting, by the augmented reality system, one or more images, of one or more elements to be installed, on the second physical element;
detecting, by the augmented reality system, the first physical element;
recognizing, by smart glasses of the augmented reality system, a shape of the first physical element;
determining, by the augmented reality system and based on recognizing the shape of the first physical element, an identification of the first physical element,
the first physical element being one of the one or more elements to be installed; and

projecting, by the augmented reality system and based on determining the identification of the first physical element, an image, of the one or more images, corresponding to the first physical element on or in the second physical element.

2. The method of claim 1 , further comprising:
determining whether a user is touching a respective one of the first physical element or the second physical element, or
determining whether a representation of the respective one of the first physical element or the second physical element corresponds to a respective one of a model of the first physical element or the model of the second physical element; and
selecting the first physical element based on:
determining that the user is touching the first physical element, or
determining that the representation of the first physical element corresponds to the model of the first physical element.

3. The method of claim 2 , further comprising:
capturing the representation of the respective one of the first physical element or the second physical element via a sensor; and
wherein determining whether the representation of the respective one of the first physical element or the second physical element corresponds to the respective one of the model of the first physical element or the model of the second physical element comprises:
determining whether the representation of the respective one of the first physical element or the second physical element has a predetermined degree of similarity to the respective one of the model of the first physical element or the model of the second physical element.

4. The method of claim 1 , wherein the augmented reality system comprises one or more of:
a portable device;
a projector for projecting images onto a surface; or
a sensor for recognizing physical elements.

5. The method claim 4 , wherein the augmented reality system comprises the sensor,
the sensor including at least one of a stereo camera or an LED pattern projector.

6. The method of claim 1 , further comprising:
validating whether the first physical element has been correctly installed on the second physical element.

7. The method of claim 1 , wherein at least one of the model of the second physical element or a model of the first physical element is at least one of:
in three dimensions;
vector-based; or
based on raster graphics.

8. The method of claim 1 , wherein the model of the second physical element is a first model;
wherein at least one of the first model or a second model, of the first physical element, conveys one or more of:
support for mechanical surfacing,
underlying materials,
dimension measurements,
kinematics, or
functional tolerances; and

wherein at least one of the first model or the second model is a computer aided three dimensional interactive application.

9. The method of claim 1 , wherein the shape is a first shape,
wherein a second shape, of the image, graphically describes the first physical element,
wherein a location of the image corresponds to a predetermined installation location for the first physical element, and
wherein the predetermined installation location is listed in a work order.

10. The method of claim 6 , wherein validating whether the first physical element has been installed correctly comprises:
receiving an indication from a user that the first physical element has been installed via a voice command; and
recognizing whether the first physical element is in a predetermined installation location on the second physical element.

11. The method of claim 1 , wherein the second physical element is one of:
an artificial satellite intended for spaceflight,
a part of the artificial satellite,
a vehicle,
a part of the vehicle,
a robot,
a box, or
an electronic controller,
a part of the electronic controller.

12. The method of claim 1 , wherein the first physical element is one of:
a component, part, or piece of the second physical element, or
an item to be placed within the second physical element.

13. The method of claim 1 , wherein the first physical element is installed on or in the second physical element as part of a process of assembling the second physical element,
wherein, after installation, the first physical element is to perform one or more functions in connection with other parts of the second physical element.

14. A non-transitory computer-readable medium storing instructions, the instructions comprising;
one or more instructions that, when executed by one or more processors, cause the one or more processors to:
scan a barcode associated with at least one of a first physical element or a second physical element;
load, based on scanning the barcode, a model of the second physical element;
recognize the second physical element based on the model of the second physical element;
project one or more images, of one or more elements to be installed, on the second physical element;
detect the first physical element;
recognize, via smart glasses, a shape of the first physical element;
determine, based on recognizing the shape of the first physical element, an identification of the first physical element,
the first physical element being one of the one or more elements to be installed; and

project, based on determining the identification of the first physical element, an image, of the one or more images, corresponding to the first physical element on or in the second physical element.

15. A system, comprising:
one or more devices to:
scan a barcode associated with at least one of a first physical element or a second physical element;
load, based on scanning the barcode, a model of the second physical element from storage;
recognize the second physical element based on the model of the second physical element;
project one or more images, of one or more elements to be installed, on the second physical element;
detect the first physical element;
recognize, via smart glasses, a shape of the first physical element;
determine, based on recognizing the shape of the first physical element, an identification of the first physical element,
the first physical element being one of the one or more elements to be installed; and

project, based on determining the identification of the first physical element, an image, of the one or more images, corresponding to the first physical element on or in the second physical element.

16. The system of claim 15 , wherein the one or more devices are further to:
determine whether a user is touching a respective one of the first physical element or the second physical element; or
det

Assignees

• Accenture Global Solutions Ltd

Inventors

• Couzinier Nicolas
• Montaigne Manuel

Classifications

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06K9/00671 Primary

  Physics · mapped topic