Augmented reality method and system for measuring and/or manufacturing

Patent metadata

Field	Value
Publication number	US-2016364913-A1
Application number	US-201615170716-A
Country	US
Kind code	A1
Filing date	Jun 1, 2016
Priority date	Jun 12, 2015
Publication date	Dec 15, 2016
Grant date	—

Abstract

An assembling method, an augmented reality system and a computer program product for measuring and/or manufacturing are provided. A targeting object may be placed in a working space. A distance is measured from the measurement device to the targeting object. The distance measurement is transmitted to the augmented reality system, and the augmented reality system determines whether the distance measurement corresponds to a target distance.

First claim

1 . An augmented reality assembling method for measuring and/or manufacturing, comprising:
providing an augmented reality system including a receiver, a processor and an output device; providing a targeting object in a working space (WS); arranging a measurement device in the working space (WS) such that the measurement device has a specified positional relationship to a reference point in the working space (WS); determining a position as a determined position of the targeting object, comprising, measuring, by the measurement device, a distance measurement from the measurement device to the targeting object; transmitting, by the measurement device, the distance measurement to the augmented reality system; determining by the augmented reality system whether the distance measurement corresponds to a target distance; determining, by the augmented reality system, whether the determined position of the targeting object corresponds to a target position; and outputting information on at least one of the following via the augmented reality system:
whether the distance measurement corresponds to the target distance,
a location in the working space (WS) for the targeting object, such that when the targeting object is displaced to the outputted location a determined position of the targeting object will correspond to the target position and the distance measurement will correspond to the target distance.

2 . The assembling method of claim 1 , wherein the measurement device is capable of measuring a distance of at least 10 meters with at least millimeter accuracy, wherein the measurement device may comprise a laser.

3 . The assembling method of claim 1 , wherein the augmented reality system includes smart eyewear, and/or wherein the transmitting by the measurement device is carried out wirelessly.

4 . The assembling method of claim 1 , wherein the working space (WS) is inside a vehicle, wherein the working space (WS) may be an aircraft fuselage.

5 . The assembling method of claim 1 , wherein the working space (WS) includes at least one attachment area, wherein the reference point is located on the attachment area.

6 . The assembling method of claim 1 , wherein when the specified positional relationship is not predetermined, arranging the measurement device in the working space (WS) further comprises:
placing the measurement device in the working space (WS); providing a calibrating object in the working space (WS) at the reference point; determining a calibration distance from the measurement device to the reference point via the calibrating object; and determining the specified positional relationship based on the calibration distance.

7 . The assembling method of claim 1 , further comprising:
displaying, via the augmented reality system, an indication of points in the working space (WS) for at least one of the following:
where the measurement device should be mounted;
where a calibrating object should be placed;
where the targeting object should be placed;
wherein each indication is overlaid on the working space (WS) and/or an image of the working space (WS).

8 . The assembling method of claim 1 , wherein the targeting object and/or the calibrating object comprises a reflector, wherein the targeting object and the calibrating object may be the same object, wherein the targeting object and/or the calibrating object may have a predetermined color, wherein the predetermined color may be distinguishable from a color of the working space and/or an image of the working space (WS).

9 . The assembling method of claim 1 , wherein when the specified positional relationship is predetermined, arranging the measurement device in the working space (WS) further comprises:
placing the measurement device a specified distance from the reference point according to the specified positional relationship.

10 . The assembling method of claim 1 , wherein the augmented reality system includes an input device, the method further comprising:
receiving input at the input device; determining the target distance based on the input.

11 . The assembling method of claim 1 , wherein, when the augmented reality system determines that the distance measurement does not correspond to the target distance, the method further comprises at least one of the following:
showing, by the augmented reality system, at least one indication of where to place the targeting object, such that after the targeting object is placed according to the indication, a distance measured by the measurement device to the targeting object will correspond to the target distance; showing, by the augmented reality system, at least one indication of a direction to move the targeting object such that after the targeting object is moved in the indicated direction, a distance measured by the measurement device to the targeting object will be closer to the target distance; showing, by the augmented reality system, an indication of the difference between the distance measurement and the target distance; wherein each indication is overlaid on the working space and/or an image of the working space (WS).

12 . The method of claim 1 , wherein, when the augmented reality system determines that the distance measurement corresponds to the target distance, the method further comprises:
indicating, via the augmented reality system, a location in the working space (WS) at which a mark should be made in relation to the targeting object, wherein the mark may indicate a point of attachment on an attachment area in the working space (WS).

13 . The method of claim 12 , wherein, after a mark has been made at the indicated location and the targeting object has been removed, the method further comprises:
providing the targeting object at the location of the mark; measuring, by the measurement device, a distance measurement from the measurement device to the targeting object; validating whether the distance measurement corresponds to the target distance; and indicating, via the augmented reality system, a result based on the validation.

14 . A computer program product comprising computer-readable instructions, which, when loaded and executed on a computer system, cause the computer system to perform operations according to the method of claim 1 .

15 . An augmented reality system for measuring and/or manufacturing, the system comprising:
a receiver capable of receiving a distance measurement from a measurement device located in a working space (WS), wherein the measurement device has a specified positional relationship to a reference point in the working space (WS), wherein the distance measurement is a distance from the measurement device to a targeting object located in the working space (WS); a position determination module for determining a position as a determined position of the targeting object provided in the working space (WS); a processor, which is communicatively connected to the receiver, and which is capable of determining whether the distance measurement corresponds to a target distance; a determination module for determining whether the determined position of the targeting object corresponds to a target position; and an output module for outputting information on at least one of the following:
whether the distance received from the measurement device corresponds to the target distance,
a location for the targeting object, such that when the targeting object is displaced to the outputted location the determined position will correspond to the target position and the distance measurement will correspond to the target distance.

Assignees

• Accenture Global Services Ltd

Inventors

• Montaigne Manuel
• Rossi Teemu

Classifications

• G06F2113/20

  Packaging, e.g. boxes or containers · CPC title

• G06F30/15

  Vehicle, aircraft or watercraft design · CPC title

• G05B2219/36167

  Use camera of handheld device, pda, pendant, head mounted display · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G05B2219/32014

  Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command · CPC title