Image processing method and image processing apparatus

Patent metadata

Field	Value
Publication number	US-9544580-B2
Application number	US-201314068242-A
Country	US
Kind code	B2
Filing date	Oct 31, 2013
Priority date	Oct 31, 2012
Publication date	Jan 10, 2017
Grant date	Jan 10, 2017

Abstract

An image processing apparatus and method for processing an image using a multi-view image and pixel information are provided. The image processing method includes determining a view image that corresponds to a predetermined display direction of a display pixel of a display, determining at least one view image pixel corresponding to the display pixel in the determined view image based on a position of the display pixel in the display and pixel position information of the determined view image, and determining a pixel value of the display pixel based on a pixel value of the determined at least one view image pixel.

First claim

What is claimed is:

1. An image processing method comprising:
determining, from among plural different-view images, a view image having a closest view to a display direction of a display pixel of a display;
determining a view image pixel corresponding to the display pixel in the determined view image based on a position of the display pixel in the display; and
determining a pixel value of the display pixel based on a pixel value of the determined view image pixel.

2. The image processing method of claim 1 , wherein the determining of the view image includes determining the view image based on different display directions of select display pixels not identically respectively matching view directions of different-view images of the object.

3. The image processing method of claim 1 , wherein the determining of the view image includes determining the view image when photographing information of different-view images of the object indicates that a number of different-view images of the object is different from a number of display directions of select display pixels of the display.

4. An image processing method comprising:
interpolating at least two of plural different-view images having viewing directions close to a predetermined display direction of a display pixel of a display;
determining at least one view image pixel corresponding to the display pixel in an interpolated view image generated by the interpolation based on a position of the display pixel in the display; and
determining a pixel value of the display pixel based on a pixel value of the determined at least one view image pixel.

5. The image processing method of claim 1 , wherein the determining of the view image pixel comprises:
determining the view image pixel using a coordinate corresponding to a position of the display pixel in a display region of the determined view image.

6. The image processing method of claim 5 , wherein the determining of the view image pixel comprises:
determining a view image pixel closest to a position corresponding to the coordinate in the determined view image to be the determined view image pixel.

7. The image processing method of claim 5 , wherein the determining of the view image pixel comprises determining view image pixels close to the position corresponding to the coordinate in the determined view image to be the determined view image pixel,
wherein the determining of the pixel value of the display pixel comprises interpolating pixel values of the determined view image pixels close to the position of the coordinate and determining a result of the interpolation to be the determined pixel value of the display pixel.

8. The image processing method of claim 1 , further comprising recognizing which display pixels of the display are display pixels that a pixel value is to be determined, based on determined positions of user eyes indicating which of the display pixels the user would observe.

9. An image processing method comprising:
recognizing a display pixel, of plural display pixels of a display, to which a pixel value is to be applied, based on positions of user eyes; and
performing a pixel value determination if the display pixel is recognized, including:
determining, from among a plurality of different-view images, a view image having a closest view to a display direction of the recognized display pixel;
determining a view image pixel corresponding to the recognized display pixel in the determined view image based on a position of the recognized display pixel in the display; and
determining a pixel value of the recognized display pixel based on a pixel value of the view image pixel.

10. The image processing method of claim 9 , wherein the determining of the view image includes determining the view image based on different display directions of select display pixels not identically respectively matching view directions of different-view images of the object.

11. The image processing method of claim 9 , wherein the determining of the view image includes determining the view image when photographing information of different-view images of the object indicates that a number of different-view images of the object is different from a number of display directions of select display pixels of the display.

12. The image processing method of claim 9 , wherein the recognizing of the display pixel comprises:
recognizing a display pixel satisfying a condition that a distance between a ray emanating from the recognized display pixel and the positions of the user eyes is less than or equal to a threshold.

13. An image processing method comprising:
recognizing a display pixel, of plural display pixels of a display, to which a pixel value is to be applied, based on positions of user eyes: and
performing a pixel value determination upon the display pixel being recognized, the performing of the pixel value determination including:
interpolating at least two of a plurality of different-view images having viewing directions close to a predetermined display direction of the recognized display pixel;
determining at least one view image pixel corresponding to the recognized display pixel in an interpolated view image generated by the interpolation based on a position of the recognized display pixel in the display; and
determining a pixel value of the recognized display pixel based on a pixel value of the at least one image pixel.

14. The image processing method of claim 9 , wherein the determining of the view image pixel comprises:
determining the view image pixel using a coordinate corresponding to a position of the recognized display pixel in a display region of the determined view image.

15. The image processing method of claim 14 , wherein the determining of the view image pixel comprises:
determining a view image pixel closest to a position corresponding to the coordinate in the determined view image to be the determined view image pixel.

16. The image processing method of claim 14 , wherein the determining of the view image pixel comprises determining view image pixels close to the position corresponding to the coordinate in the determined view image to be the determined view image pixel,
wherein the determining of the pixel value of the display pixel comprises interpolating pixel values of the determined view image pixels close to the position of the coordinate and determining a result of the interpolation to be the determined pixel value.

17. An image processing apparatus comprising:
at least one processor configured to:
determine, from among a plurality of different-view images, a view image having a closest view to a display direction of a display pixel of a display;
determine a view image pixel corresponding to the display pixel in the determined view image based on a position of the display pixel in the display; and
determine a pixel value of the display pixel based on a pixel value of the determined view image pixel.

18. The image processing apparatus of claim 17 ,
wherein the at least one processor is further configured to determine the pixel value of the display pixel by interpolating pixel values of close view image pixels.

19. An image processing apparatus comprising:
at least one processor configured to:
interpolate at least two of plural different-view images having viewing directions close to a predetermined display direction of a display pixel of a display;
determine at least one view image pixel corresponding to the display pixel in an interpolated view image generated by the interpolation based on a posi

Assignees

• Samsung Electronics Co Ltd

Inventors

• Park Ju Yong
• Nam Dong Kyung

Classifications

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N13/351 Primary

  for displaying simultaneously · CPC title

• H04N13/31

  using parallax barriers · CPC title

• H04N13/366

  using viewer tracking · CPC title

• H04N2013/403

  the images being monoscopic · CPC title