Depth measurement through display

Patent metadata

Field	Value
Publication number	US-12406384-B2
Application number	US-202318468327-A
Country	US
Kind code	B2
Filing date	Sep 15, 2023
Priority date	Nov 27, 2019
Publication date	Sep 2, 2025
Grant date	Sep 2, 2025

Abstract

Disclosed herein is a display device including
a. at least one illumination source configured for projecting at least one illumination pattern comprising a plurality of illumination features on at least one scene; b. at least one optical sensor having at least one light sensitive area, wherein the optical sensor is configured for determining at least one first image comprising a plurality of reflection features generated by the scene in response to illumination by the illumination features; c. at least one translucent display configured for displaying information, wherein the illumination source and the optical sensor are placed in direction of propagation of the illumination pattern in front of the display; and d. at least one evaluation device for analyzing the first image, wherein the evaluation device is configured for unambiguously matching of reflection features with corresponding illumination features.

First claim

The invention claimed is:

1. A display device comprising
a. at least one illumination source configured for projecting at least one illumination pattern comprising a plurality of illumination features on at least one scene;
b. at least one optical sensor having at least one light sensitive area, wherein the at least one optical sensor is configured for determining at least one first image comprising a plurality of reflection features generated by the at least one scene in response to illumination by the illumination features;
c. at least one translucent display configured for displaying information, wherein the at least one illumination source and the at least one optical sensor are placed in direction of propagation of the at least one illumination pattern in front of the at least one translucent display; and
d. at least one evaluation device for analyzing the at least one first image, wherein the at least one evaluation device is configured for unambiguously matching of reflection features with corresponding illumination features; wherein evaluation of the at least one first image comprises identifying the plurality of reflection features of the at least one first image with corresponding illumination features, determining a brightness of the plurality of reflection features with corresponding illumination features and matching based on the brightness, wherein the evaluation device is configured for classifying a reflection feature being matched with an illumination feature as a real feature and for classifying a reflection feature not being matched with an illumination feature as a false feature, wherein the real feature is a reflection feature of zero order and the false feature is a reflection feature of an order greater than zero.

2. The display device according to claim 1 , wherein the evaluation of the at least one first image further comprises sorting the plurality of reflection features with corresponding illumination features with respect to brightness, and wherein the matching is performed with decreasing brightness of the plurality of reflection features with corresponding illumination features starting with the brightest reflection feature.

3. The display device according to claim 1 , wherein the evaluation device is further configured for rejecting each false feature and for generating a depth map for each real feature by using a longitudinal coordinate.

4. The display device according to claim 1 , wherein the at least one illumination pattern comprises a periodic point pattern.

5. The display device according to claim 4 , wherein the periodic point pattern is a triangular pattern, a hexagonal pattern, or a rectangular pattern.

6. The display device according to claim 5 , wherein the periodic point pattern has ≤2500 points per field of view.

7. The display device according to claim 6 , wherein light emitted by the at least one illumination source has a wavelength of 500 to 1100 nm.

8. The display device according to claim 1 , wherein light emitted by the at least one illumination source has a wavelength of 940 nm.

9. The display device according to claim 1 , wherein the at least one illumination pattern has ≤2500 points per field of view.

10. The display device according to claim 1 , wherein the at least one illumination source is configured for generating at least one light beam having a beam path passing from the at least one illumination source through the at least one translucent display to the scene, wherein the at least one translucent display is configured for functioning as grating such that the light beam experiences diffraction by the at least one translucent display which results in the at least one illumination pattern.

11. The display device according to claim 1 , wherein illumination source comprises an array of vertical cavity surface-emitting lasers.

12. The display device according to claim 1 , wherein illumination source comprises a diffractive optical element.

13. The display device according to claim 1 , wherein the at least one optical sensor is configured for determining at least one second image comprising at least one two-dimensional image of the scene.

14. The display device according to claim 1 , wherein the evaluation of the at least one first image further comprises a selection of at least one region of interest.

15. The display device according to claim 1 , wherein the evaluation of the at least one first image further comprises assigning a reflection feature to an illumination feature using epipolar geometry.

16. The display device according to claim 1 , wherein the evaluation device performs a face recognition.

17. The display device according to claim 1 , wherein the evaluation device is configured for determining at least one material property of an object by evaluating a beam profile of at least one of the plurality of reflection features with corresponding illumination features.

18. The display device according to claim 17 , wherein the at least one material property is a property characterizing the material as biological or non-biological material.

19. The display device according to claim 18 , wherein the evaluation device performs a face recognition.

Assignees

• Trinamix Gmbh

Inventors

• Schindler Patrick
• Rein Benjamin
• Bonsignore Christian
• Eberspach Michael
• Schillen Peter

Classifications

• G06V20/647

  by matching two-dimensional images to three-dimensional objects · CPC title

• G06V10/94

  Hardware or software architectures specially adapted for image or video understanding · CPC title

• G06V10/145

  Illumination specially adapted for pattern recognition, e.g. using gratings · CPC title

• G06V10/147

  Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19) · CPC title

• G06V10/141

  Control of illumination · CPC title