Image processing method and apparatus

Patent metadata

Field	Value
Publication number	US-9936192-B2
Application number	US-201514715937-A
Country	US
Kind code	B2
Filing date	May 19, 2015
Priority date	Aug 18, 2014
Publication date	Apr 3, 2018
Grant date	Apr 3, 2018

Abstract

An image processing method and apparatus for a three-dimensional (3D) display device that may process image data for a first panel to generate an image for a second panel based 3D display device, is provided.

First claim

What is claimed is:

1. An image processing method comprising:
receiving image data for a first panel; and
processing the image data based on an optical characteristic of a second panel and a subpixel structure of a plurality of subpixels in the second panel, the second panel being configured for a 3D display device, the processing including,
obtaining a point of view corresponding to a selected subpixel in the second panel based on the optical characteristic,
obtaining an area corresponding to the selected subpixel within an image from the point of view based on the optical characteristic, the area including neighboring subpixels around the selected subpixel,
obtaining first panel subpixel values of the selected subpixel and the neighboring subpixels based on the received image data, and
generating a second panel value for the selected subpixel by filtering the obtained first panel subpixel values based on the subpixel structure of the second panel,
the generated second panel value for the selected subpixel being used for a display using the 3D display device, and
wherein the optical characteristic comprises a characteristic associated with a ray direction of the selected subpixel of the plurality of subpixels in the second panel.

2. The method of claim 1 , wherein the optical characteristic is based on at least one of:
a distance between the second panel and an optical layer;
a position of at least one of the plurality of subpixels in the second panel; and
a position of an optical element through with respect to light output by the at least one subpixel, the optical element being in the optical layer.

3. The method of claim 1 , wherein the subpixel structure of the second panel comprises at least one of:
colors of the subpixels in the second panel, each subpixel associated with a color;
an arrangement of the subpixels in the second panel based on the colors;
sizes of the subpixels of each color in the second panel; and
a number of the subpixels of each color in the second panel.

4. The method of claim 1 , wherein the first panel is a red, green, and blue (RGB) stripe panel and the second panel is different from the RGB stripe panel.

5. The method of claim 1 ,
wherein the image data includes a multiview image for the first panel and the obtaining the first panel subpixel values comprises:
extracting the first panel subpixel values of the selected subpixel and the neighboring subpixels based on the multiview image.

6. The method of claim 5 , wherein the obtaining the point of view obtains the point of view from a table and the obtaining the area obtains the area from the table.

7. The method of claim 5 , wherein the obtaining the point of view comprises:
selecting one of a plurality of points of view in the multiview image based on the ray direction of the selected subpixel; and
determining a position corresponding to the selected subpixel from the selected point of view based on a camera parameter for the multiview image.

8. The method of claim 7 , wherein the camera parameter comprises at least one of:
an angle of view of a camera for each of the plurality of points of view;
a photographing direction of the camera for each of the plurality of points of view; and
a distance between a subject and the camera for each of the plurality of points of view.

9. The method of claim 5 , wherein the extracted first panel subpixel values are first panel subpixel values of neighboring pixels having a same color as the selected subpixel.

10. The method of claim 5 ,
wherein, the obtaining the point of view determines a plurality of points of view corresponding to the selected subpixel when the subpixel corresponds to a plurality of points of view, and
the obtaining the area determines a plurality of areas corresponding to the selected subpixel at the plurality of points of view,
each of the plurality of areas including neighboring subpixels around the selected subpixel, the obtained area being one of the plurality of areas.

11. The method of claim 10 , wherein the extracting comprises:
extracting first panel subpixel values of neighboring subpixels having a same color as the selected subpixel in each of the plurality of areas; and
interpolating the first panel subpixel values between the plurality of areas.

12. The method of claim 5 , wherein the generating comprises:
obtaining weights for the extracted first panel subpixel values based on the subpixel structure; and
calculating the second panel value for the selected subpixel by performing a weighted summation on the extracted first panel subpixel values using the weights.

13. The method of claim 5 , further comprising:
obtaining positions of both eyes of a user; and
determining whether the selected subpixel corresponds to a left eye or a right eye based on the positions of the eyes,
wherein the determining of the area includes, selecting one of a plurality of points of view in the multiview image based on the position of the eye corresponding to the selected subpixel; and
determining a position corresponding to the selected subpixel from the selected point of view based on a camera parameter for the multiview image.

14. The method of claim 1 , wherein the image data includes a 3D model, the obtaining the first panel subpixel values comprises: generating first panel subpixel values of the selected subpixel and the neighboring subpixels based on the 3D model.

15. The method of claim 14 , wherein the obtaining the point of view obtains the point of view from a table and obtaining the area obtains the area from the table.

16. The method of claim 14 , wherein the obtaining the point of view comprises:
determining the point of view based on the ray direction of the selected subpixel from which the 3D model is viewed; and
determining a position corresponding to the selected subpixel from the determined point of view based on a position at which a light propagated in the ray direction is incident to a virtual camera for the determined point of view.

17. The method of claim 14 , wherein the generated values are first panel subpixel values of neighboring pixels having a same color as the selected subpixel.

18. The method of claim 14 , wherein the generating comprises:
obtaining weights for the generated first panel subpixel values based on the subpixel structure; and
calculating the second panel value for the subpixel by performing a weighted summation on the generated first panel subpixel values using the weights.

19. An image processing method comprising:
receiving image data for a first panel, the image data including a stereoscopic image for the first panel;
receiving positions of both eyes of a user; and
processing the image data based on an optical characteristic of a second panel and a subpixel structure of a plurality of subpixels in the second panel, the second panel being configured for a 3D display device,
the processing including,
determining whether a selected subpixel in the second panel corresponds to a left image or a right image based on the positions of the eyes;
extracting first panel subpixel values in an area corresponding to the selected subpixel from the image corresponding to the selected subpixel; and
generating a second panel value for the selected subpixel by filtering the extracted first panel subpixel values based on the subpixel structure of the second panel,
the generated second panel value for the selected subpixel being used for a display using the 3D display device, and
wherein the optical characteristi

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Juyong
• Nam Dong Kyung
• Lee Seok

Classifications

• H04N13/302

  for viewing without the aid of special glasses, i.e. using autostereoscopic displays · CPC title

• H04N13/383

  for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes · CPC title

• H04N13/324

  Colour aspects · CPC title

• H04N13/305

  using lenticular lenses, e.g. arrangements of cylindrical lenses · CPC title

• G02B30/27

  involving lenticular arrays · CPC title