Augmented reality method and system for measuring and/or manufacturing

Patent metadata

Field	Value
Publication number	US-9870645-B2
Application number	US-201615170716-A
Country	US
Kind code	B2
Filing date	Jun 1, 2016
Priority date	Jun 12, 2015
Publication date	Jan 16, 2018
Grant date	Jan 16, 2018

Abstract

An assembling method, an augmented reality system and a computer program product for measuring and/or manufacturing are provided. A targeting object may be placed in a working space. A distance is measured from the measurement device to the targeting object. The distance measurement is transmitted to the augmented reality system, and the augmented reality system determines whether the distance measurement corresponds to a target distance.

First claim

The invention claimed is:

1. An assembling method, comprising:
positioning a measurement device in a working space such that the measurement device has a specified positional relationship to a reference point in the working space;
determining a position as a determined position of a targeting object in the working space, wherein the determining comprises measuring, by the measurement device, a distance measurement from the measurement device to the targeting object;
transmitting, by the measurement device, the distance measurement to a processor;
determining, by the processor, whether the distance measurement corresponds to a target distance;
determining, by the processor, whether the determined position of the targeting object corresponds to a target position;
outputting information on a display device, the information including at least one of sound, video, graphics, and global positioning system data, wherein the outputted information includes:
whether the distance measurement corresponds to the target distance;
a location in the working space for the targeting object, such that in response to the targeting object being displaced to the outputted location, a determined position of the targeting object corresponds to the target position and the distance measurement corresponds to the target distance; and
an instruction to a user; and

receiving input at an input device, the input including a confirmation of execution of the instruction by the user.

2. The assembling method of claim 1 , wherein the measuring of the distance measurement from the measurement device to the targeting object includes measuring a distance of at least 10 meters with at least millimeter accuracy.

3. The assembling method of claim 1 , wherein the transmitting by the measurement device is carried out wirelessly.

4. The assembling method of claim 1 , wherein the working space an aircraft fuselage.

5. The assembling method of claim 1 , wherein the working space includes at least one attachment area comprising a plurality of points of attachment, and wherein the reference point is located on the attachment area.

6. The assembling method of claim 1 , wherein when the specified positional relationship is not predetermined, and wherein the positioning of the measurement device in the working space comprises:
placing a calibrating object in the working space at the reference point;
determining, by the calibrating object, a calibration distance from the measurement device to the reference point; and
determining the specified positional relationship based on the calibration distance.

7. The assembling method of claim 1 , further comprising:
displaying, via the display device, an indication of points in the working space for at least one of:
where the measurement device should be mounted;
where a calibrating object should be placed; and
where the targeting object should be placed;
wherein each indication of points is overlaid on the working space and/or an image of the working space.

8. The assembling method of claim 7 , wherein the targeting object and the calibrating object are a same object having a predetermined color, and wherein the predetermined color is distinguishable from a color of the working space and/or an image of the working space.

9. The assembling method of claim 1 , wherein the specified positional relationship is predetermined, and positioning the measurement device in the working space further comprises:
placing the measurement device a specified distance from the reference point_according to the predetermined specified positional relationship.

10. The assembling method of claim 1 , wherein the method further comprising:
determining the target distance based on the input.

11. The assembling method of claim 1 , wherein, in response to a determination that the distance measurement does not correspond to the target distance, the method further comprises at least one of displaying on the display device:
at least one indication of where to place the targeting object, such that after the targeting object is placed according to the indication, a distance measured by the measurement device to the targeting object corresponds to the target distance;
at least one indication of a direction to move the targeting object such that after the targeting object is moved in the indicated direction, a distance measured by the measurement device to the targeting object is closer to the target distance; and
an indication of the difference between the distance measurement and the target distance;
wherein each indication is overlaid on the working space and/or an image of the working space.

12. The method of claim 1 , wherein, in response to determining that the distance measurement corresponds to the target distance, the method further comprises:
indicating a location in the working space indicating a point of attachment on an attachment area in the working space; and
making a mark at the indicated location and removing the targeting object.

13. The method of claim 12 , further comprising:
positioning the targeting object at a location of the mark;
measuring, by the measurement device, a distance measurement from the measurement device to the targeting object;
validating whether the distance measurement corresponds to the target distance; and
outputting a result based on the validation.

14. A non-transitory computer program product comprising computer-readable instructions, which, when loaded and executed on a computer system, cause the computer system to perform operations comprising:
position a measurement device in a working space such that the measurement device has a specified positional relationship to a reference point in the working space;
determine a position as a determined position of a targeting object in the working space, including measuring, by the measurement device, a distance measurement from the measurement device to the targeting object;
transmit, by the measurement device, the distance measurement to a processor: determine, by the processor, whether the distance measurement corresponds to a target distance;
determine, by the processor, whether the determined position of the targeting object corresponds to a target position;
output information on a display device, the information including at least one of sound, video, graphics, and global positioning system data, wherein the outputted information includes:
whether the distance measurement corresponds to the target distance;
a location in the working space for the targeting object, such that in response to the targeting object being displaced to the outputted location, a determined position of the targeting object corresponds to the target position and the distance measurement corresponds to the target distance; and
an instruction to a user; and

receive input at an input device, the input including a confirmation of execution of the instruction by the user.

15. A manufacturing system, comprising:
a receiver to receive a distance measurement from a measurement device located in a working space, wherein the measurement device has a specified positional relationship to a reference point in the working space, and wherein the distance measurement is a distance from the measurement device to a targeting object located in the working space;
position determination logic for determining a position as a determined position of the targeting object provided in the working space;
a processor communicatively connected to the receiver, the processor to:
determine whether the distance measurement corresponds to a target distance; and
de

Assignees

• Accenture Global Services Ltd

Inventors

• Montaigne Manuel
• Rossi Teemu

Classifications

• G06F2113/20

  Packaging, e.g. boxes or containers · CPC title

• G06F30/15

  Vehicle, aircraft or watercraft design · CPC title

• G05B19/41805 Primary

  characterised by assembly · CPC title

• G05B2219/32014

  Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command · CPC title

• G05B2219/36167

  Use camera of handheld device, pda, pendant, head mounted display · CPC title