Image processing apparatus and image processing method

Patent metadata

Field	Value
Publication number	US-2018316902-A1
Application number	US-201615769143-A
Country	US
Kind code	A1
Filing date	Oct 28, 2016
Priority date	Nov 11, 2015
Publication date	Nov 1, 2018
Grant date	—

Abstract

There is provided an image processing apparatus and an image processing method by which three-dimensional data can be generated with high accuracy on the basis of two-dimensional image data and depth image data. A color shift correction data generation unit generates color shift correction data for correcting a color shift between two-dimensional image data of a base viewpoint and two-dimensional image data of a reference viewpoint. A metadata addition unit transmits color shift correction information including the color shift correction data generated by the color shift correction data generation unit, encoded data of the two-dimensional image data of the base viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object and encoded data of the two-dimensional image data of the reference viewpoint and depth image data. The present disclosure can be applied, for example, to a synthesis apparatus.

First claim

1 . An image processing apparatus, comprising:
a color shift correction data generation unit that generates color shift correction data for correcting a color shift between two-dimensional image data of a first viewpoint and two-dimensional image data of a second viewpoint; and a transmission unit that transmits color shift correction information including the color shift correction data generated by the color shift correction data generation unit, first encoded data that is encoded data of the two-dimensional image data of the first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a third viewpoint and second encoded data that is encoded data of the two-dimensional image data of the second viewpoint and depth image data of a fourth viewpoint.

2 . The image processing apparatus according to claim 1 , wherein
the number of the second viewpoints is a plural number; and the color shift correction data generation unit generates the color shift correction data for each of the second viewpoints.

3 . The image processing apparatus according to claim 2 , wherein
the color shift correction information includes color shift common information indicating whether or not the color shift correction data of all of the second viewpoints with which a color shift occurs are same.

4 . The image processing apparatus according to claim 2 , wherein
in a case where the color shift correction data of all of the second viewpoints with which a color shift occurs are same, the transmission unit transmits color shift correction information including color shift common information indicating that the color shift correction data of all of the second viewpoints with which a color shift occurs are same and the color shift correction data common to all of the second viewpoints.

5 . The image processing apparatus according to claim 1 , wherein
at least part of image pickup objects of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the second viewpoint are same.

6 . The image processing apparatus according to claim 1 , further comprising:
a decoding unit that decodes the first encoded data and the second encoded data; wherein the color shift correction data generation unit generates the color shift correction data on the basis of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the second viewpoint obtained as a result of the decoding by the decoding unit.

7 . An image processing method by an information processing apparatus, comprising:
a color shift correction data generation step of generating color shift correction data for correcting a color shift between two-dimensional image data of a first viewpoint and two-dimensional image data of a second viewpoint; and a transmission step of transmitting color shift correction information including the color shift correction data generated by the process at the color shift correction data generation step, first encoded data that is encoded data of the two-dimensional image data of the first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a third viewpoint and second encoded data that is encoded data of the two-dimensional image data of the second viewpoint and depth image data of a fourth viewpoint.

8 . An image processing apparatus, comprising:
a decoding unit that decodes first encoded data that is encoded data of two-dimensional image data of a first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a second viewpoint and second encoded data that is encoded data of two-dimensional image data of a third viewpoint and depth image data of a fourth viewpoint; and a color correction unit that performs color correction of the two-dimensional image data of the third viewpoint obtained as a result of the decoding by the decoding unit on the basis of color shift correction information including color shift correction data of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the third viewpoint.

9 . The image processing apparatus according to claim 8 , further comprising:
a three-dimensional data generation unit that generates three-dimensional data of the image pickup object on the basis of the two-dimensional image data of the first viewpoint, the depth image data of the second viewpoint, the two-dimensional image data of the third viewpoint for which color correction is performed by the color correction unit and the depth image data of the fourth viewpoint.

10 . The image processing apparatus according to claim 8 , wherein
the number of the third viewpoints is a plural number; and the color correction unit performs color correction on the basis of the color shift correction information including the color shift correction data for each of the third viewpoints.

11 . The image processing apparatus according to claim 10 , wherein
the color shift correction information includes color shift common information indicating whether or not the color shift correction data of all of the third viewpoints with which a color shift occurs are same.

12 . The image processing apparatus according to claim 10 , wherein
the color shift correction information includes color shift common information indicating that the color shift correction data of all of the third viewpoints with which a color shift occurs are same and the color shift correction data common to all of the third viewpoints.

13 . The image processing apparatus according to claim 8 , wherein
at least part of image pickup objects of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the third viewpoint are same.

14 . An image processing method by an image processing apparatus, comprising:
a decoding step of decoding first encoded data that is encoded data of two-dimensional image data of a first viewpoint and depth image data indicative of a position of each of pixels in a depthwise direction of an image pickup object with respect to a second viewpoint and second encoded data that is encoded data of two-dimensional image data of a third viewpoint and depth image data of a fourth viewpoint; and a color correction step of performing color correction of the two-dimensional image data of the third viewpoint obtained as a result of the decoding by the process at the decoding step on the basis of color shift correction information including color shift correction data of the two-dimensional image data of the first viewpoint and the two-dimensional image data of the third viewpoint.

Assignees

• Sony Corp

Inventors

• Tanaka Junichi

Classifications

• H04N2013/0081

  Depth or disparity estimation from stereoscopic image signals · CPC title

• H04N21/235

  Processing of additional data, e.g. scrambling of additional data or processing content descriptors · CPC title

• H04N13/117

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• H04N13/25

  using two or more image sensors with different characteristics other than in their location or field of view, e.g. having different resolutions or colour pickup characteristics; using image signals from one sensor to control the characteristics of another sensor · CPC title

• H04N2213/003

  Aspects relating to the "2D+depth" image format · CPC title