Method of estimating parameter of three-dimensional (3D) display device and 3D display device using the method

Patent metadata

Field	Value
Publication number	US-10271041-B2
Application number	US-201615138627-A
Country	US
Kind code	B2
Filing date	Apr 26, 2016
Priority date	Aug 7, 2015
Publication date	Apr 23, 2019
Grant date	Apr 23, 2019

Abstract

A method of estimating a parameter of a three-dimensional (3D) display device includes estimating a transformation parameter between a camera and a display based on an image displayed on the display and an image reflected by a reflector.

First claim

What is claimed is:

1. A method of estimating a parameter of a display device, the method comprising:
displaying, on a display, a first image comprising a first pattern;
capturing second images generated when the first image is reflected by a reflector at different angles, using a camera combined with the display; and
estimating a first transformation parameter between the camera and the display based on the first image and the second images; and
estimating a second transformation parameter between the display and an optical layer associated with the display based on a second pattern included in the first image and the at least one of the second images.

2. The method of claim 1 , wherein the first transformation parameter comprises at least one of a rotation matrix for performing a transformation between coordinates of the camera and coordinates of the display, and a translation vector for performing a transformation between coordinates of the camera and coordinates of the display.

3. The method of claim 1 , wherein the estimating comprises determining the first transformation parameter as a transformation parameter that minimizes projection errors between the first pattern and virtual patterns corresponding to the second images.

4. The method of claim 3 , wherein each of the virtual patterns is a virtual image generated when the first pattern is focused at a corresponding one of the different angles in the reflector.

5. The method of claim 1 , wherein the estimating comprises:
estimating geometric relationships between the display and the reflector based on the second images;
calculating projection errors between the first pattern and virtual patterns corresponding to the second images based on the geometric relationships; and
updating the first transformation parameter to reduce the projection errors.

6. The method of claim 1 , wherein the first pattern comprises a pattern in which a shape is repeated.

7. The method of claim 1 , further comprising:
estimating an intrinsic parameter of the camera based on the first pattern and at least one of the second images.

8. The method of claim 1 , wherein the estimating the second transformation parameter comprises estimating the second transformation parameter based on a period of the second pattern, a period of a third pattern included in the at least one of the second images, and a gradient of the third pattern.

9. The method of claim 8 , further comprising at least one of:
obtaining the period of the second pattern based on a subpixel structure of the display; and
obtaining the period of the third pattern and the gradient of the third pattern in a Fourier space in which the third pattern is frequency-transformed.

10. The method of claim 7 , wherein the intrinsic parameter comprises at least one of a focal length of the camera, a center position of the camera, and a skewness of the camera.

11. The method of claim 1 , wherein the second transformation parameter comprises at least one of a pitch of the optical layer and a rotation angle between the optical layer and the display.

12. The method of claim 1 , wherein the second pattern comprises at least one of:
a pattern in which continuous lines of an identical brightness are arranged at intervals; and
a pattern comprising areas with an identical color and an identical brightness.

13. The method of claim 1 , wherein the second pattern is included in a shape repeated in the first pattern.

14. A non-transitory computer readable medium including computer readable instructions to cause a computer to perform the method of claim 1 .

15. A three-dimensional (3D) display device comprising:
a camera configured to perform eye tracking for a user;
a display configured to display a 3D image; and
a processor configured to,
control the display to display a first image comprising a first pattern,
control the camera to capture second images, the second images being generated when the first image is reflected by a reflector at different angles,
estimate a first transformation parameter between the camera and the display based on the first image and the second images,
estimate a second transformation parameter between the display and an optical layer associated with the display based on a second pattern included in the first image and at least one second image of the second images,
track eyes of the user based on the first transformation parameter, and
render the 3D image based on the tracked eyes.

16. The device of claim 15 , wherein the first transformation parameter comprises at least one of a rotation matrix for performing a transformation between coordinates of the camera and coordinates of the display, and a translation vector for performing a transformation between coordinates of the camera and coordinates of the display.

17. The device of claim 15 , wherein the processor is configured to determine the first transformation parameter as a transformation parameter that minimizes projection errors between the first pattern and virtual patterns corresponding to the second images.

18. The device of claim 15 , wherein the processor is configured to estimate geometric relationships between the display and the reflector based on the second images, calculate projection errors between the first pattern and virtual patterns corresponding to the second images based on the geometric relationships, and update the first transformation parameter to reduce the projection errors.

19. The device of claim 15 , wherein the processor is configured to render the 3D image based on the second transformation parameter.

20. The device of claim 15 , wherein the second transformation parameter comprises at least one of a pitch of the optical layer and a rotation angle between the optical layer and the display.

21. The device of claim 15 , wherein the processor is configured to estimate the second transformation parameter based on a period of the second pattern, a period of a third pattern included in the at least one second image, and a gradient of the third pattern.

22. The device of claim 15 , wherein the processor is configured to estimate an intrinsic parameter of the camera based on the first pattern and at least one of the second images, and track the eyes of the user based on the intrinsic parameter and the first transformation parameter.

23. The device of claim 22 , wherein the intrinsic parameter comprises at least one of a focal length of the camera, a center position of the camera, and a skewness of the camera.

24. The device of claim 15 , wherein the first pattern comprises a pattern in which a shape is repeated.

25. The device of claim 15 , wherein the second pattern comprises at least one of:
a pattern in which continuous lines of an identical brightness are arranged at intervals; and
a pattern comprising areas with an identical color and an identical brightness.

26. The device of claim 25 , wherein the second pattern is included in a shape repeated in the first pattern.

27. A method of estimating a parameter of a display device, the method comprising:
displaying, on a display, a first image comprising a first pattern and a second pattern;
capturing, a second image generated when the first image is reflected in a reflector, using a camera combined with the display;
estimating a parameter of the camera based on an area corresponding to the first pattern in the second image;
es

Assignees

• Samsung Electronics Co Ltd

Inventors

• Hwang Hyoseok
• Nam Dong Kyung
• Chang Hyun Sung

Classifications

• G06T7/80 Primary

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• H04N2213/006

  Pseudo-stereoscopic systems, i.e. systems wherein a stereoscopic effect is obtained without sending different images to the viewer's eyes · CPC title

• G06T7/74

  involving reference images or patches · CPC title

• H04N13/327

  Calibration thereof · CPC title

• H04N5/225

  Electricity · mapped topic