Multi-view encoding and decoding technique based on single-view video codecs

Patent metadata

Field	Value
Publication number	US-9635342-B2
Application number	US-201013877560-A
Country	US
Kind code	B2
Filing date	Oct 5, 2010
Priority date	Oct 5, 2010
Publication date	Apr 25, 2017
Grant date	Apr 25, 2017

Abstract

A technique for encoding and decoding data pertaining to multiple video views is presented. A method embodiment of the encoding technique comprises the steps of providing first picture stream belonging to a first view and performing a first encoding operation to encode a picture of the first picture stream. The first encoding operation is based on a single-view video codec and provides encoder state information relevant for the encoding of another picture of the first picture stream. Also provided is a second picture stream belonging to a second video view. A second encoding operation is performed to encode a picture of the second picture stream based on the single-view video codec, wherein the second encoding operation is based on the encoder state information provided by the first encoding operation. On the basis of the encoded picture of the first picture stream and encoded picture of the second picture stream, dedicated video streams are generated.

First claim

The invention claimed is:

1. A method, performed in an encoding apparatus, of encoding data pertaining to at least two video views, the method comprising:
providing a first picture stream belonging to at least one first video view;
performing a first encoding operation to encode at least a portion of a first picture of the first picture stream based on a single-view video codec, wherein the first encoding operation provides encoder state information relating to reference information for predictively encoding at least a portion of a second picture of the first picture stream or of another portion of the first picture of the first picture stream;
generating a first video stream comprising the encoded picture of the first picture stream;
providing a second picture stream belonging to at least one second video view;
performing a second encoding operation to encode at least a portion of a picture of the second picture stream based on the single-view video codec and the encoder state information provided by the first encoding operation; and
generating a second video stream comprising the encoded picture of the second picture stream, wherein the first encoding operation and the second encoding operation are performed by a single encoder, wherein the first picture stream and the second picture stream are multiplexed before performing the encoding operations, and wherein the resulting encoded video stream is de-multiplexed for generating the first video stream and the second video stream.

2. The method of claim 1 , further comprising transmitting the first video stream and the second video stream in a format defined by a multi-view video specification.

3. The method of claim 1 , wherein encoding operations performed in relation to the first picture stream are performed based on encoder state information derived from one or more pictures of the first picture stream only.

4. The method of claim 1 , further comprising transmitting information indicative of at least one of:
the number of video views encoded; and
the number of encoders involved in encoding the video views.

5. The method of claim 1 , further comprising buffering the encoder state information provided by the first encoding operation for transfer to the second encoding operation.

6. The method of claim 1 , further comprising transmitting state transfer information relating to a transfer of the encoder state information provided by the first encoding operation for use by the second encoding operation.

7. The method of claim 6 , further comprising synchronizing transmission of the first video stream and the second video stream with the transmission of the state transfer information.

8. The method of claim 6 , wherein the state transfer information comprises information indicative of at least one of:
the particular picture of the second picture stream that has been encoded in the second encoding operation based on the encoder state information; and
particulars of the first encoding operation that provided the encoder state information.

9. The method of claim 1 , wherein the de-multiplexing operation is synchronized with the multiplexing operation.

10. The method of claim 1 , wherein more than two picture streams belonging to more than two video views are provided, wherein the second encoding operation and any further encoding operation are each performed to encode at least a portion of a picture of the second picture stream and at least a portion of a picture of the respective further picture stream are based on the encoder state information provided by the first encoding operation.

11. The method of claim 1 , wherein more than two picture streams belonging to more than two video views are provided, wherein at least a portion of a picture of a picture stream associated with a video view is encoded based on encoder state information provided by an encoding operation to encode at least a portion of a picture of a picture stream associated with a neighboring video view.

12. A method, performed in a decoding apparatus, of decoding data pertaining to at least two video views, the method comprising:
providing a first video stream comprising encoded pictures belonging to at least one first video view;
performing a first decoding operation to decode at least a portion of a first encoded picture of the first video stream based on a single-view video codec, wherein the first decoding operation provides decoder state information relating to reference picture information for decoding at least a portion of a second encoded picture of the first video stream or another portion of the first encoded picture;
providing a second video stream comprising encoded pictures belonging to at least one second video view; and
performing a second decoding operation to decode at least a portion of an encoded picture of the second video stream based on the single-view video codec and the decoder state information provided by the first decoding operation, wherein the first decoding operation and the second decoding operation are performed by a single decoder, wherein the first video stream and the second video stream are multiplexed into one single video stream before performing the decoding operations, and wherein the recovered decoded picture stream is de-multiplexed for generating a first picture stream and a second picture stream.

13. The method of claim 12 , wherein a transfer of the decoder state information from the first decoding operation to the second decoding operation is synchronized with a transfer of the encoder state information from the first encoding operation pertaining to the first video stream to the second encoding operation pertaining to the second video stream.

14. The method of claim 12 , further comprising buffering the decoder state information provided by the first decoding operation for transfer to the second decoding operation.

15. The method of claim 12 further comprising providing state transfer information relating to a transfer of encoder state information provided by a first encoding operation pertaining to the first video stream for use by a second encoding operation pertaining to the second video stream, wherein the state transfer information, or information derived therefrom, controls a transfer of the decoder state information provided by the first decoding operation to the second decoding operation.

16. The method of claim 15 , wherein the state transfer information is received concurrently with the first video stream and the second video stream.

17. The method of claim 15 , wherein the state transfer information is known a priori.

18. A non-transitory computer readable recording medium storing a computer program product for controlling an encoding apparatus to encode data pertaining to at least two video views, the computer program product comprising software instructions which, when run on a computing device in the encoding apparatus, causes the encoding apparatus to:
provide a first picture stream belonging to at least one first video view;
perform a first encoding operation to encode at least a portion of a first picture of the first picture stream based on a single-view video codec, wherein the first encoding operation provides encoder state information relating to reference information for predictively encoding at least a portion of a second picture of the first picture stream or of another portion of the first picture of the first picture stream;
generate a first video stream comprising the encoded first picture of the first picture stream;
provide a second picture stream belonging to a

Assignees

• Rusert Thomas
• Priddle Clinton
• Wu Zhuangfei
• ERICSSON TELEFON AB L M (publ)

Inventors

• Rusert Thomas
• Priddle Clinton
• Wu Zhuangfei

Classifications

• H04N19/436

  using parallelised computational arrangements · CPC title

• H04N13/0003

  Electricity · mapped topic

• H04N19/196

  being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters (processing of motion vectors H04N19/513) · CPC title

• H04N13/0048 Primary

  Electricity · mapped topic

• H04N19/50

  using predictive coding (H04N19/61 takes precedence) · CPC title