Method for calibrating an augmented reality visual rendering system comprising at least one display device that is partially transparent with respect to the user thereof, and associated system

Patent metadata

Field	Value
Publication number	US-10415959-B2
Application number	US-201515524988-A
Country	US
Kind code	B2
Filing date	Dec 1, 2015
Priority date	Dec 3, 2014
Publication date	Sep 17, 2019
Grant date	Sep 17, 2019

Abstract

A method for calibrating an augmented reality visual rendering system comprising at least one display device partially transparent with respect to the user thereof, comprises carrying out the steps of: displaying a two-dimensional calibration curve on a partially transparent display device of the partially transparent display device; recording a three-dimensional curve described by the user by a three-dimensional pointing device so that the trajectory described by the three-dimensional pointing device is aligned, according to the viewpoint of the user, with the two-dimensional calibration curve displayed on the display device; and matching the three-dimensional curve and the two-dimensional calibration curve displayed on the display device; and comprising a step of calibrating the augmented reality visual rendering system by determining the parameters of a model to represent the set comprising the eye of the user 1 and the partially transparent display device of the partially transparent display device at which the eye is looking, on the basis of matching.

First claim

The invention claimed is:

1. A method for calibrating an augmented reality visual rendering system comprising at least one display device that is partially transparent with respect to the user thereof, comprising carrying out at least once the steps of:
displaying a two-dimensional calibration curve on a partially transparent display device;
recording a three-dimensional curve described by the user by means of a three-dimensional pointing device so that the trajectory described by the three-dimensional pointing device is aligned, according to the viewpoint of the user, with the two-dimensional calibration curve displayed on the display device; and
matching the three-dimensional curve and the two-dimensional calibration curve displayed on the display device;
and comprising a step of calibrating said augmented reality visual rendering system by determining the parameters of a model making it possible to represent the set comprising the eye of the user and the partially transparent display device of the partially transparent display device at which the eye is looking, on the basis of said matching,
wherein the calibration curve or curves comprise at least one curve whose display on the display device guarantees that no point of the display device is situated at a distance from the curve exceeding 25% of the diagonal of the display device.

2. The method as claimed in claim 1 , wherein the step of matching the three-dimensional curve and the two-dimensional calibration curve displayed on the display device comprises the sub-steps of:
projecting the three-dimensional curve onto the display device so as to provide a two-dimensional projected curve and an association between points of the three-dimensional curve and points of the projected curve; and
projecting said two-dimensional projected curve onto the corresponding calibration curve so as to provide an association between points of the two-dimensional projected curve and points of the corresponding calibration curve.

3. The method as claimed in claim 1 , comprising, furthermore, in an iterative manner, the following steps of:
re-estimating the matching of the three-dimensional curve or curves and the respective two-dimensional calibration curve or curves displayed on the display device, on the basis of the new parameters of the model which were determined during the last calibration step; and
re-calibrating said augmented reality visual rendering system, on the basis of the last matching of the three-dimensional curve or curves and the respective two-dimensional calibration curve or curves displayed on the display device.

4. The method as claimed in claim 3 , wherein said iteration is stopped when a convergence criterion is attained.

5. The method as claimed in claim 1 , wherein the calibration curve or curves comprise at least one curve exhibiting at least one discontinuity, and/or at least one polygonal curve.

6. The method as claimed in claim 1 , wherein the calibration curve or curves comprise at least one Hilbert curve, and/or at least one Peano curve, and/or at least one Lebesque curve.

7. The method as claimed in claim 1 , wherein said calibration is applied to an augmented reality glasses system.

8. The method as claimed in claim 1 , wherein said calibration is applied to an augmented reality windshield system.

9. An augmented reality visual rendering system, adapted to implement the method as claimed in claim 1 .

10. The augmented reality visual rendering system as claimed in claim 9 , being an augmented reality glasses system or an augmented reality windshield system.

11. The method as claimed in claim 1 , wherein the three-dimensional pointing device is a stylus.

Assignees

• Commissariat Energie Atomique

Inventors

• Bourgeois Steve

Classifications

• H04N13/327

  Calibration thereof · CPC title

• G02B27/0179

  Display position adjusting means not related to the information to be displayed · CPC title

• G02B27/01 Primary

  Head-up displays · CPC title

• G01B11/25

  by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50}) · CPC title

• G02B2027/0178

  Eyeglass type (eyeglass details G02C) · CPC title