In-process fault inspection using augmented reality

Patent metadata

Field	Value
Publication number	US-9916650-B2
Application number	US-201514883001-A
Country	US
Kind code	B2
Filing date	Oct 14, 2015
Priority date	Oct 14, 2014
Publication date	Mar 13, 2018
Grant date	Mar 13, 2018

Abstract

An arrangement for visual fault inspection of at least one component includes a fault identification unit for identifying a structural fault of the component and for determining at least one piece of fault information, and an overlay device connected to the fault identification unit, configured for context-dependent overlay of the fault information in a component image in real-time.

First claim

What is claimed is:

1. An arrangement for visual fault inspection of at least one component, comprising:
a fault identification unit configured to identify a structural fault in the component and to determine at least one item of fault information;
an overlay device connected to the fault identification unit and configured to overlay the at least one item of fault information in a context-dependent manner in a component image in real-time,
a positioning-finding unit configured to determine exact positioning information about a position of the component and about a position of the user;
a processor unit connected to the fault identification unit and to the position-finding unit, the processor unit being configured to process the at least one item of fault information and the positioning information and to integrate the processed information in the component image; and
a visualisation unit connected to the processor unit configured to display the component image containing the integrated information of the processor unit.

2. The arrangement according to claim 1 , further comprising:
a capture unit connected to the processor unit and configured to capture the component image.

3. The arrangement according to claim 1 , wherein the component image corresponds to a real-time image of the component.

4. The arrangement according to claim 1 , wherein the visualisation unit comprises one of a portable computer, eyeglasses, contact lenses, a portable screen, and a portable transparent display.

5. The arrangement according to claim 1 , wherein the at least one item of fault information comprises pinpointing or coordinates of the structural fault.

6. The arrangement according to claim 1 , wherein the at least one item of fault information comprises the severity of the structural fault.

7. The arrangement according to claim 1 , wherein the positioning-finding unit comprises reference markers for calculating the position of the component and of the user.

8. The arrangement according to claim 1 , wherein the processor unit comprises a synchronising unit configured to synchronise the movement of the visualisation unit and/or the direction of view of the visualisation unit with the displayed component image.

9. The arrangement according to claim 1 , wherein the visualisation unit is configured for pinpointing the structural fault on the displayed component image.

10. A method for visual fault inspection of a component, the method comprising:
identifying a structural fault on the component;
determining at least one item of fault information of the structural fault using a fault identification unit;
overlaying the at least one item of fault information in context-dependent manner in a component image in real-time;
determining exact information about a position of the component and a position of the user by a positioning-finding unit;
processing the fault information and the information about the position of the component and the position of the user;
integrating the processed information in a component image by a processor unit; and
displaying the component image containing the integrated information by a visualisation unit in real-time.

11. The method according to claim 10 , wherein the component image is captured in real time.

12. The method according to claim 10 , wherein the displayed component image moves according to the movement of the visualisation unit and/or the direction of view of the visualisation unit.

13. The method according to claim 10 , wherein the processing of the fault information comprises:
categorising the structural fault;
determining whether countermeasures are necessary; and
initiating counter measures depending on the determination.

Assignees

• Airbus Defence & Space Gmbh

Inventors

• Engel Franz

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G01N2021/8893

  providing a video image and a processed signal for helping visual decision · CPC title

• G06T7/0004 Primary

  Industrial image inspection · CPC title

• G06T2207/30164

  Workpiece; Machine component · CPC title

• G01N21/9515

  Objects of complex shape, e.g. examined with use of a surface follower device (measuring contours and curvatures G01B11/24) · CPC title