Method for projecting virtual data and device enabling this projection

Patent metadata

Field	Value
Publication number	US-10044996-B2
Application number	US-201514719307-A
Country	US
Kind code	B2
Filing date	May 21, 2015
Priority date	May 27, 2014
Publication date	Aug 7, 2018
Grant date	Aug 7, 2018

Abstract

A method for projecting information issued from a digital design model. Calibration is performed by acquiring characteristic data originating from a surface of interest and comparing the characteristic data with virtual data issued from the digital design model. A spatial position of a projecting device is determined. The projecting device comprises a video projector and at least two separate image-capturing devices. Depending on the spatial position, information issued from the digital design model is projected by the video projector onto the surface of interest.

First claim

The invention claimed is:

1. A method for projecting information issued from a digital design model, comprising the steps of:
calibrating by acquiring characteristic data originating from a surface of interest, comparing the characteristic data with virtual data issued from the digital design model, and determining a spatial position of a projecting device comprising a single video projector and at least two separate image-capturing devices, the calibrating step further comprises the steps of:
projecting calibration patterns onto the surface of interest;
analyzing the calibration patterns;
generating a set of correspondences between the image-capturing devices and the single video projector;
determining the spatial position of the image-capturing devices and of the single video projector based on a correspondence maximum;

identifying characteristic points on the surface of interest;
matching the characteristic points identified on the surface of interest to the digital design model; and
projecting information issued from the digital design model by the single video projector onto the surface of interest based on the spatial position.

2. The method according to claim 1 , wherein the calibrating step is carried out continuously by:
projecting, in addition to the digital design model, continuously the calibration patterns and tailoring calibration to the surface of interest; and
analyzing the calibration patterns with the image-capturing devices and continuously determining the spatial position of the image-capturing devices and of the single video projector.

3. The method according to claim 1 , further comprising steps of detecting and highlighting differences between the digital design model and reality.

4. The method according to claim 1 , further comprising step of determining the spatial position of and tracking known movable objects in a field of view of the image-capturing devices.

5. The method according to claim 1 , further comprising steps of compensating for vibrations; and generating an alarm in response to non-compensation of the vibrations.

6. The method according to claim 1 , further comprising step of inhibiting shadowing on the surface of interest.

7. The method according to claim 1 , further comprising step of projecting information in three dimensions.

8. A device for projecting information issued from a digital design model, comprising:
a single video projector;
at least two image-capturing devices; and
a computer, comprising a processor and a memory, configured to:
acquire characteristic data originating from a surface of interest;
compare the characteristic data with virtual data issued from the digital design model;
determine a spatial position of the image-capturing devices and of the single video projector;
identify characteristic points on the surface of interest;
match the characteristic points identified on the surface of interest to the digital design model; and

the single video projector is configured to project information issued from the digital design model onto the surface of interest based on the spatial position.

9. The device according to claim 8 , wherein the image-capturing devices are global-shutter video cameras.

10. The device according to claim 8 , further comprising at least two sources of infrared light.

11. The device according to claim 8 , further comprising an adjusting device configured to adjust settings of the image-capturing devices based on vibrations and to emit an alarm signal when the vibrations exceed threshold.

12. The device according to claim 11 , wherein the adjusting device comprises an inertial sensor rigidly fastened to the single video projector.

13. The device according to claim 8 , wherein the single video projector is mounted on an instrumented mechanical system comprising a position sensor.

14. The device according to claim 13 , wherein the instrumented mechanical system is motorized.

15. The device according to claim 8 , further comprising an autonomous power supply system.

16. The device according to claim 8 , wherein all elements of the device are grouped into two housings, the first housing containing the single video projector and the image-capturing devices and the second housing containing the computer and a power supply.

Assignees

• Airbus Group Sas
• Airbus

Inventors

• Chevassus Nicolas
• Marraud Denis
• Tarault Antoine
• Perrotton Xavier

Classifications

• G01N21/8803

  Visual inspection (measuring projectors G01B9/08) · CPC title

• H04N9/3185 Primary

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• G01S5/16 Primary

  using electromagnetic waves other than radio waves · CPC title

• G09F19/18

  involving the use of optical projection means, e.g. projection of images on clouds (projection apparatus per se G03B) · CPC title

• B25H7/00

  Marking-out or setting-out work (measuring, gauging G01; optical apparatus G02B; by photographic means G03C) · CPC title