Method and apparatus for generating combined video stream for multiple images

Patent metadata

Field	Value
Publication number	US-2016269684-A1
Application number	US-201615163644-A
Country	US
Kind code	A1
Filing date	May 24, 2016
Priority date	Jan 6, 2014
Publication date	Sep 15, 2016
Grant date	—

Abstract

An apparatus of generating a combined video stream of multiple images, includes: an image acquiring unit to acquire a plurality of individual video streams transmitted over multiple channels; an image information extracting unit to extract individual image codes and individual header information from each of the plurality of the individual video streams; and a bit stream generating unit to generate combined image codes by inserting individual image codes into corresponding respective positions corresponding to each of the plurality of individual video streams in a predetermined layout of a display picture, generate combined header information corresponding to the combined image codes based on respective individual header information, and generate a combined video stream including the combined image codes and the combined header information.

First claim

What is claimed is:

1 . An apparatus of generating a combined video stream of multiple images, the apparatus comprising:
an image acquiring unit configured to acquire a plurality of individual video streams transmitted over multiple channels; an image information extracting unit configured to extract individual image codes and individual header information from each of the plurality of the individual video streams; and a bit stream generating unit configured to
generate combined image codes by inserting individual image codes into corresponding respective positions corresponding to each of the plurality of individual video streams in a predetermined layout of a display picture,
generate combined header information corresponding to the combined image codes based on respective individual header information, and
generate a combined video stream including the combined image codes and the combined header information.

2 . The apparatus of claim 1 , further comprising an audio decoding unit configured to
receive a first selection information, and decode an audio stream corresponding to one of the plurality of individual video streams based on the first selection information.

3 . The apparatus of claim 1 , wherein the combined header information include an information indicating that the combined video stream includes a plurality of tiles.

4 . The apparatus of claim 3 , wherein each of the individual image codes is configured to be reconstructed based on a tile in a predetermined position, the tile included in, and being a part of, the predetermined layout of the display picture.

5 . The apparatus of claim 3 , wherein the respective individual header information include an information indicating an inability to perform a loop filtering across a boundary of slices.

6 . The apparatus of claim 3 , wherein the tile includes one or more slices.

7 . The apparatus of claim 1 , wherein
when a predetermined byte string is parsed in the respective individual video streams when parsing the respective individual video streams, the predetermined byte string having been parsed is converted to a first byte string for generating the combined video stream, and when the first byte string is found when scanning the combined video stream, the first byte string having been found is converted to the predetermined byte string.

8 . The apparatus of claim 1 , wherein the individual header information includes an information indicating an inability, when encoding a motion vector in unit of prediction, to refer to another motion vector of other picture colocated with a current encoding block in the unit of prediction.

9 . The apparatus of claim 3 , wherein the bit stream generating unit is configured to receive a selection information of a user to determine a size of each tile.

10 . The apparatus of claim 3 , wherein the bit stream generating unit is configured to
receive a selection information of a user, and select a screen configuration of the display picture including n tiles.

11 . The apparatus of claim 10 , wherein, when the screen configuration forms no rectangle by selecting the n tiles, the bit stream generating unit is configured to receive a predetermined specific image information as a video stream corresponding to a tile coincided with a specific position in the display picture to allow the screen configuration to be formed as a rectangle.

12 . The apparatus of claim 3 , wherein
the number of samples in a width direction of any one of the tiles is same as the number of samples in a width direction of a tile adjacent vertically thereto, and the number of samples in a height direction of any one of the tiles is same as the number of samples in a height direction of a tile adjacent horizontally thereto.

13 . The apparatus of claim 3 , wherein the combined header information include an information indicating the number of the tiles arranged in a width direction and an information indicating the number of the tiles arranged in a height direction in the layout.

14 . A method performed by an apparatus of generating a combined video stream of multiple images, the method comprising:
acquiring a plurality of individual video streams transmitted over multiple channels; extracting individual image codes and individual header information from each of the plurality of the individual video streams; generating combined image codes by inserting individual image codes into corresponding respective positions corresponding to each of the plurality of individual video streams in a predetermined layout of display picture; generating combined header information corresponding to the combined image codes based on respective individual header information; and generating a combined video stream including the combined image codes and the combined header information.

15 . The method of claim 14 , wherein the combined header information include an information indicating that the combined video stream includes a plurality of tiles.

16 . The method of claim 15 , wherein each of the individual image codes is configured to be reconstructed based on a tile in a predetermined position, the tile included in, and being a part of, the predetermined layout of the display picture.

17 . The method of claim 15 , wherein the respective individual header information include an information indicating an inability to perform a loop filtering across a boundary of slices.

18 . The method of claim 14 , wherein
when a predetermined byte string is parsed in the respective individual video streams when parsing the respective individual video streams, the predetermined byte string having been parsed is converted to a first byte string for generating the combined video stream, and when the first byte string is found when scanning the combined video stream, the first byte string having been found is converted to the predetermined byte string.

19 . The method of claim 14 , wherein the individual header information include an information indicating an inability, when encoding a motion vector in unit of prediction, to refer to another motion vector of other picture colocated with a current encoding block in the unit of prediction.

20 . The method of claim 15 , wherein the combined header information include an information indicating the number of the tiles arranged in a width direction and an information indicating the number of the tiles arranged in a height direction in the layout.

Assignees

• Sk Telecom Co Ltd
• Pixtree Inc

Inventors

• Lim Jeong-Yeon
• Seo Dong-Bum
• Shin Jae-Seob
• Son Se-Hoon
• Kim Hyeong-Duck

Classifications

• H04N7/15 Primary

  Conference systems · CPC title

• H04N7/147 Primary

  Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q) · CPC title

• H04N7/152

  Multipoint control units therefor · CPC title