Image processing device which predicts an image by referring a reference image of an allocated index

Patent metadata

Field	Value
Publication number	US-10021386-B2
Application number	US-201214118408-A
Country	US
Kind code	B2
Filing date	May 30, 2012
Priority date	Jun 7, 2011
Publication date	Jul 10, 2018
Grant date	Jul 10, 2018

Abstract

The present technique relates to an image processing device and a method that can improve encoding efficiency in multi-viewpoint encoding. A reference image index allocation unit alternately allocates a reference image index referred by a motion estimator/compensator to predict an image to be processed to a referable image in a view direction and to a referable image in a time direction. In allocation, the reference image index allocation unit refers to time information and view information of the reference image accumulated in a decoded picture buffer, information such as a sequence parameter set and a slice header from a syntax processing unit, and the like.

First claim

The invention claimed is:

1. An image processing device comprising:
circuitry configured to
decode a bit stream to generate an image;
alternately allocate reference image indexes of reference lists to be referred in predicting the image generated by the circuitry to a referable image in a view direction and to a referable image in a time direction one by one by either repeating only a first processing, or repeating only a second processing, the first processing being a processing of allocating the reference image indexes to be referred in predicting the image generated by the circuitry to the referable image in the time direction and then to the referable image in the view direction in this order, the second processing being a processing of allocating the reference image indexes to be referred in predicting the image generated by the circuitry to the referable image in the view direction and then to the referable image in the time direction in this order, such that two reference image indexes are not allocated to the referable image in the view direction in succession and that two reference image indexes are not allocated to the referable image in the time direction in succession; and
refer a reference image of the index allocated by the circuitry to predict the image generated by the circuitry, wherein
the referable image in the view direction is an image of a same time and a different view with respect to the image generated by the circuitry, and
the referable image in the time direction is an image of a different time and a same view with respect to the image generated by the circuitry.

2. The image processing device according to claim 1 , wherein the circuitry repeats a process of allocating the reference image indexes to a referable image in the time direction and to a referable image in the view direction in that order.

3. The image processing device according to claim 1 , wherein the circuitry repeats a process of allocating the reference image indexes to a referable image in the view direction and to a referable image in the time direction in that order.

4. The image processing device according to claim 1 , wherein the circuitry selects either one from a time direction prioritized pattern in which after the reference image index is allocated to a referable image in the time direction, the reference image index is allocated to a referable image in the view direction, and a view direction prioritized pattern in which after the reference image index is allocated to a referable image in the view direction, the reference image index is allocated to a referable image in the time direction, and allocates the reference image index.

5. The image processing device according to claim 4 , wherein the circuitry selects a pattern to allocate the reference image index from a time direction prioritized pattern in which a process of allocating the reference image indexes to a referable image in the time direction and to a referable image in the view direction in that order is repeated, and a view direction prioritized pattern in which a process of allocating the reference image indexes to a referable image in the view direction and to a referable image in the time direction in that order is repeated, and allocates the reference image index.

6. The image processing device according to claim 4 , wherein the circuitry allocates the reference image index according to pattern identification information identifying whether the time direction prioritized pattern is used or the view direction prioritized pattern is used.

7. The image processing device according to claim 1 , wherein the circuitry allocates the reference image index to a referable image in the view direction based on view reference information of a sequence parameter set.

8. The image processing device according to claim 1 , wherein the circuitry allocates the reference image index to a referable image in the time direction based on decoding order in a case of a P-picture, and based on a picture order count (POC) in a case of a B-picture.

9. The image processing device according to claim 1 , wherein the circuitry selects a pattern to allocate the reference image index from a time direction prioritized alternate pattern in which a process of starting allocation of the reference image indexes from a referable image in the time direction, and allocating the reference image indexes to a referable image in the time direction and to a referable image in the view direction in that order is repeated, and a view direction prioritized alternate pattern in which a process of starting allocation of the reference image indexes from a referable image in the view direction, and allocating the reference image indexes to a referable image in the view direction and to a referable image in the time direction in that order is repeated, and allocates the reference image index.

10. The image processing device according to claim 9 , wherein the circuitry allocates the reference image indexes according to pattern identification information identifying whether the time direction prioritized alternate pattern is used or the view direction prioritized alternate pattern is used.

11. An image processing method comprising:
decoding a bit stream to generate an image;
alternately allocating, using circuitry, reference image indexes of reference lists to be referred in predicting the generated image to a referable image in a view direction and to a referable image in a time direction one by one by either repeating only a first processing, or repeating only a second processing, the first processing being a processing of allocating the reference image indexes to be referred in predicting the image generated by the circuitry to the referable image in the time direction and then to the referable image in the view direction in this order, the second processing being a processing of allocating the reference image indexes to be referred in predicting the image generated by the circuitry to the referable image in the view direction and then to the referable image in the time direction in this order, such that two reference image indexes are not allocated to the referable image in the view direction in succession and that two reference image indexes are not allocated to the referable image in the time direction in succession; and
referring to a reference image of the allocated index to predict the generated image, wherein
the referable image in the view direction is an image of a same time and a different view with respect to the generated image, and
the referable image in the time direction is an image of a different time and a same view with respect to the generated image.

12. An image processing device comprising:
circuitry configured to
alternately allocate reference image indexes of reference lists to be referred in predicting an image to a referable image in a view direction and to a referable image in a time direction one by one by either repeating only a first processing, or repeating only a second processing, the first processing being a processing of allocating the reference image indexes to be referred in predicting the image generated by the circuitry to the referable image in the time direction and then to the referable image in the view direction in this order, the second processing being a processing of allocating the reference image indexes to be referred in predicting the image generated by the circuitry to the referable image in the view direction and then to the referable image in the time direction in this order, such that two reference image indexes are not allocated to the referable image in the view direction in succession and that two reference image in

Assignees

• Takahashi Yoshitomo
• Hattori Shinobu
• Sony Corp

Inventors

• Takahashi Yoshitomo
• Hattori Shinobu

Classifications

• H04N19/503

  involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109) · CPC title

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N19/61

  in combination with predictive coding · CPC title

• H04N19/107

  between spatial and temporal predictive coding, e.g. picture refresh · CPC title

• H04N19/46 Primary

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title