Transmission device, transmission method and reception device

Patent metadata

Field	Value
Publication number	US-11025930-B2
Application number	US-201916707085-A
Country	US
Kind code	B2
Filing date	Dec 9, 2019
Priority date	Oct 11, 2013
Publication date	Jun 1, 2021
Grant date	Jun 1, 2021

Abstract

An excellent display can be performed even when the frame rate changes dynamically at the reception side. When a switching portion at which a sequence of video streams to be transmitted is switched from a first sequence to a second sequence having a different frame rate from the first sequence is provided, display control information is inserted into at least encoded image data of a picture corresponding to the switching portion or a packet containing the encoded image data. A reception side performs display control of pictures using the display control information and implements an excellent display.

First claim

The invention claimed is:

1. A reception device, comprising:
a receiver configured to receive a container of a predetermined format including a predetermined number of video streams, wherein
the predetermined number of video streams include encoded image data of a plurality of pictures of a predetermined number of layer sets,
the predetermined number of video streams are based on
classification of image data of the plurality of pictures configuring moving image data into a plurality of layers,
encode of the plurality of layers, and
division of the plurality of layers into the predetermined number of layer sets,

at least a video stream among the predetermined number of video streams is encoded such that decoding timings of the encoded image data of the plurality of pictures are at predetermined intervals,
decoding timings of the encoded image data of the plurality of pictures of a first layer set are intermediate timings of decoding timings of the encoded image data of the plurality of pictures of a second layer set, and
a position of the first layer set is higher than a position of the second layer set; and

a processing unit configured to:
extract the encoded image data of the plurality of pictures in the predetermined number of video streams based on a decoding capability of the reception device;
decode the encoded image data of the plurality of pictures at the decoding timings;
detect a switching portion, based on a display period of time of a picture of the plurality of pictures, wherein
the display period of time is a time at which a sequence of the predetermined number of video streams is switched from a first sequence of the plurality of pictures to a second sequence of the plurality of pictures,
the display period of time of the picture is obtained from at least one of clock tick information or time scale information of one of a video parameter set (VPS) or a sequence parameter set (SPS) of the picture of the plurality of pictures, and
a frame rate of the first sequence is different from a frame rate of the second sequence; and

perform display control of the plurality of pictures.

2. The reception device according to claim 1 , wherein the container of the predetermined format is one of a transport stream (TS) that includes MPEG-2 TS or MP4.

3. The reception device according to claim 1 , wherein
the processing unit is further configured to extract the encoded image data of the plurality of pictures included in the predetermined number of video streams based on a packet identifier, and
the packet identifier is associated with the decoding capability of the reception device.

4. The reception device according to claim 1 , wherein the processing unit is further configured to control a post-processing operation, of adjustment in a frame rate of decoded image data of the plurality of pictures, for display.

5. The reception device according to claim 4 , wherein the post-processing operation, includes one of an interpolation process or a sub-sampling process of adjustment in the frame rate, based on a display capability.

6. The reception device according to claim 4 , wherein the processing unit is further configured to control the post-processing operation based on selection information which is generated based on one of a display capability or a user operation.

7. A reception method, comprising
receiving, by a receiver, a container of a predetermined format including a predetermined number of video streams, wherein
the predetermined number of video streams include encoded image data of a plurality of pictures of a predetermined number of layer sets,
the predetermined number of video streams are based on
classifying image data of the plurality of pictures configuring moving image data into a plurality of layers,
encoding the plurality of layers, and
dividing the plurality of layers into the predetermined number of layer sets,

at least a video stream among the predetermined number of video streams is encoded such that decoding timings of the encoded image data of the plurality of pictures are at predetermined intervals,
decoding timings of the encoded image data of the plurality of pictures of a first layer set are intermediate timings of decoding timings of the encoded image data of the plurality of pictures of a second layer set, and
a position of the first layer set is higher than a position of the second layer set,

extracting, by a processing unit, the encoded image data of the plurality of pictures in the predetermined number of video streams based on a decoding capability of a reception device;
decoding, by the processing unit, the encoded image data of the plurality of pictures at the decoding timings;
detecting, by the processing unit, a switching portion, based on a display period of time of a picture of the plurality of pictures, wherein
the display period of time is a time at which a sequence of the predetermined number of video streams is switched from a first sequence of the plurality of pictures to a second sequence of the plurality of pictures,
the display period of time of the picture is obtained from at least one of clock tick information or time scale information of one of a video parameter set (VPS) or a sequence parameter set (SPS) of the picture of the plurality of pictures, and
a frame rate of the first sequence is different from a frame rate of the second sequence; and

performing, by the processing unit, display control of the plurality of pictures.

8. The reception method according to claim 7 , wherein the container of the predetermined format is one of a transport stream (TS) that includes MPEG-2 TS or MP4.

9. The reception method according to claim 7 , further comprising:
extracting, by the processing unit, the encoded image data of the plurality of pictures included in the predetermined number of video streams based on a packet identifier,
wherein the packet identifier is associated with the decoding capability of the reception device.

10. The reception method according to claim 7 , further comprising:
controlling, by the processing unit, a post-processing operation, of adjusting a frame rate of decoded image data of the plurality of pictures, for display.

11. The reception method according to claim 10 , wherein the post-processing operation, includes one of an interpolation process or a sub-sampling process of adjusting the frame rate, based on a display capability.

12. The reception method according to claim 10 , further comprising:
controlling, by the processing unit, the post-processing operation based on selection information which is generated based on one of a display capability or a user operation.

Assignees

• Sony Corp

Inventors

• Tsukagoshi Ikuo

Classifications

• H04N21/236

  Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream {(multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)} · CPC title

• H04N21/234327

  by decomposing into layers, e.g. base layer and one or more enhancement layers · CPC title

• H04N21/6336 Primary

  directed to decoder · CPC title

• H04N19/31 Primary

  in the temporal domain · CPC title

• H04N21/234381

  by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping · CPC title