Information processing device, information processing method, and program

Patent metadata

Field	Value
Publication number	US-9888260-B2
Application number	US-201314413762-A
Country	US
Kind code	B2
Filing date	Jul 16, 2013
Priority date	Jul 26, 2012
Publication date	Feb 6, 2018
Grant date	Feb 6, 2018

Abstract

A system comprising at least one processor configured to perform: accessing parallax information for a first portion of a first image, the parallax information calculated based on a second image associated with the first image; accessing motion information for the first portion of the first image, the motion information calculated based on a third image captured at a different time than the first image; and generating error correction information for the first portion of the first image based on the parallax information and the motion information.

First claim

The invention claimed is:

1. A system, comprising:
at least one hardware processor configured to perform:
accessing parallax information for a first portion of a first image, the parallax information calculated based on a second image associated with the first image;
accessing motion information, different from the parallax information, for the first portion of the first image, the motion information calculated based on a third image captured at a different time than the first image;
generating error correction information for the first portion of the first image based on the parallax information and the motion information; and
transmitting the error correction information to a second system.

2. The system of claim 1 , wherein the at least one processor is further configured to encode the first portion based on the generated error correction information to obtain a first encoded portion.

3. The system of claim 1 , wherein the at least one processor is further configured to calculate the parallax information for the first portion of the first image.

4. The system of claim 1 , wherein the at least one processor is further configured to calculate the motion information for the first portion of the first image.

5. The system of claim 1 , wherein the first image is obtained by a first camera, and wherein the at least one processor is configured to perform generating error correction information based on information associated with the first camera.

6. The system of claim 5 , wherein information associated with the first camera comprises information about an installation environment in which the first camera obtained the first image.

7. The system of claim 1 , wherein the first image is obtained at a first view point, and wherein generating the error correction information for the first portion comprises weighting the parallax information and the motion information based on information associated with the first view point.

8. The system of claim 1 , further comprising a 3D processing unit configured to calculate a stereo image based on the first image and the second image.

9. The system of claim 1 , wherein the error correction information comprises error correction code (ECC) information.

10. The system of claim 1 , wherein the first image is obtained at a first view point and wherein the second image is obtained at a second view point different from the first view point.

11. The system of claim 10 , wherein the third image is obtained at the first view point.

12. The system of claim 3 , wherein the parallax information is calculated based on a distance between a display position of the first portion and a display position of a second portion of the second image corresponding to the first portion.

13. The system of claim 4 , wherein the motion information is calculated based on a distance between a display position of the first portion and a display position of a third portion of the third image corresponding to the first portion.

14. A system, comprising:
a first system, comprising at least one hardware processor configured to perform:
accessing parallax information for a first portion of a first image, the parallax information calculated based on a second image associated with the first image;
accessing motion information, different from the parallax information, for the first portion of the first image, the motion information calculated based on a third image captured at a different time than the first image; and
generating error correction information for the first portion of the first image based on the parallax information and the motion information;
encoding the first portion of the first image based at least in part on the error correction information to obtain a first encoded portion; and
transmitting the first encoded portion and the error correction information to a second system; and

the second system, configured to perform acts of:
receiving the first encoded portion and the generated error correction information from the first system; and
decoding the first encoded portion to obtain a first decoded portion.

15. The system of claim 14 , wherein the second system is further configured to perform error concealment on the first decoded portion based on the error correction information.

16. A method performed by a transmission device, the method comprising:
using the transmission device to perform:
accessing parallax information for a first portion of a first image, the parallax information calculated based on a second image associated with the first image;
accessing motion information, different from the parallax information, for the first portion of the first image, the motion information calculated based on a third image captured at a different time than the first image; and
generating error correction information for the first portion of the first image based on the parallax information and the motion information; and
transmitting the error correction information to a second system.

17. At least one non-transitory computer-readable storage medium storing a program that, when executed by at least one processor, causes the at least one processor to perform:
accessing parallax information for a first portion of a first image, the parallax information calculated based on a second image associated with the first image;
accessing motion information, different from the parallax information, for the first portion of the first image, the motion information calculated based on a third image captured at a different time than the first image;
generating error correction information for the first portion of the first image based on the parallax information and the motion information; and
transmitting the error correction information to another system.

18. A system, comprising:
at least one hardware processor configured to perform:
receiving, from an external system, a first image, a second image associated with the first image, and a third image captured at a different time than the first image;
accessing parallax information for a first portion of the first image, the parallax information calculated based on the second image associated with the first image;
accessing motion information, different from the parallax information, for the first portion of the first image, the motion information calculated based on the third image captured at different time than the first image; and
executing error concealment processing for the first portion of the first image based on the parallax information and the motion information.

19. The system of claim 18 , wherein the at least one hardware processor is further configured to:
access error correction information for the first portion of the first image, the error correction information generated by another system based on the parallax information and the motion information; and
execute error concealment processing when restoration processing of the first portion of the first image based on the error correction information is not performed.

20. A method performed by a reception device, the method comprising:
using a reception device to perform:
receiving, from an external system, a first image, a second image associated with the first image, and a third image captured at a different time than the first image
accessing parallax information for a first portion of the first image, the parallax information calculated based on the second image associated with the first image;
accessing motion information, different from the parallax information,

Assignees

• Sony Corp

Inventors

• Kosaka Yoshihiro

Classifications

• H04N19/895 Primary

  in combination with error concealment · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/161

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N19/51

  Motion estimation or motion compensation · CPC title

• H04N19/67

  involving unequal error protection [UEP], i.e. providing protection according to the importance of the data · CPC title