Method to transmit video data in a data stream and associated metadata

Patent metadata

Field	Value
Publication number	US-9838757-B2
Application number	US-45086308-A
Country	US
Kind code	B2
Filing date	Apr 10, 2008
Priority date	Apr 17, 2007
Publication date	Dec 5, 2017
Grant date	Dec 5, 2017

Abstract

The application concerns a method for transmitting video data in a data stream and associated metadata, said metadata representing associated video data structure. The method comprises the steps of—determining the structure of the video data, —splitting said structure into chunks in an incremental manner, —transmitting said chunks in the data stream at time intervals before the video data it is related to. The application concerns also a method for transmitting fingerprint information associated with video data into a video data stream. The method comprises the steps of: —determining fingerprint associated with at least one frame of said video data, —inserting at least a message into the video stream comprising said fingerprint information.

First claim

The invention claimed is:

1. A method, comprising:
determining a structure of video data content to be transmitted;
splitting said structure into chunks in a hierarchical manner, wherein each said chunk comprises one or more nodes representing metadata for a respective portion of said video data content, a first said chunk comprises a first description of said one or more nodes included in said first chunk and a second said chunk comprises information indicating that a second description of said one or more nodes included in said second chunk is included in a next chunk, said first and second descriptions each comprising one or more node identifiers, a name representing video information in which said one or more nodes is associated, and a timecode indicating a duration of said video information; and
transmitting said chunks in a data stream at successive time intervals such that each said chunk is transmitted before said respective portion of said video data content said chunk is related to.

2. The method according to claim 1 wherein:
each said node comprises a plurality of leaves; and
each said chunk comprises a plurality of nodes and leaves.

3. The method according to claim 1 wherein:
said video data content is encoded to produce encoded video data; and
said chunks are encapsulated into messages in said encoded video data.

4. The method according to claim 3 wherein:
said video data content comprises coded metadata compliant with an ITU-T H.264 standard; and
said metadata is transmitted into at least a Supplemental Enhancement Information (SEI) message.

5. The method according to claim 1 wherein said descriptions each further comprises:
one or more summary segments, and for each said summary segment:
a name representing said summary segment;
a category representing semantic information associated with said summary segment; and
a key description describing a type of segment chosen among a keyframe, a clip or a textual description.

6. A device, comprising:
a processor configured for:
determining a structure of video data content to be transmitted;
splitting said structure into chunks in a hierarchical manner, wherein each said chunk comprises one or more nodes representing metadata for a respective portion of said video data content, a first said chunk comprises a first description of said one or more nodes included in said first chunk and a second said chunk comprises information indicating that a second description of said one or more nodes included in said second chunk is included in a next chunk, said first and second descriptions each comprising one or more node identifiers, a name representing video information in which said one or more nodes is associated, and a timecode indicating a duration of said video information; and
inserting said chunks in a data stream at successive time intervals such that each said chunk is inserted before said respective portion of said video data content said chunk is related to.

7. The device according to claim 6 wherein:
each said node comprises a plurality of leaves; and
each said chunk comprises a plurality of nodes and leaves.

8. The device according to claim 6 wherein:
said video data content is encoded to produce encoded video data; and
said chunks are encapsulated into messages in said encoded video data.

9. The device according to claim 8 wherein:
said video data content comprises coded metadata compliant with an ITU-T H.264 standard; and
said metadata is transmitted into at least a Supplemental Enhancement Information (SEI) message.

10. The device according to claim 6 wherein said descriptions each further comprises:
one or more summary segments, and for each said summary segment:
a name representing said summary segment;
a category representing semantic information associated with said summary segment; and
a key description describing a type of segment chosen among a keyframe, a clip or a textual description.

11. A video decoding device, comprising:
a processor configured for:
decoding encoded video data content and metadata associated with said encoded video data content, wherein said encoded video data content has a structure split into chunks in a hierarchical manner where each said chunk comprises one or more nodes representing metadata for a respective portion of said encoded video data content, a first said chunk comprises a first description of said one or more nodes included in said first chunk and a second said chunk comprises information indicating that a second description of said one or more nodes included in said second chunk is included in a next chunk, said first and second descriptions each comprising one or more node identifiers, a name representing video information in which said one or more nodes is associated, and a timecode indicating a duration of said video information, wherein said chunks are positioned in a data stream at successive time intervals such that each said chunk is positioned before said respective portion of said encoded video data content said chunk is related to; and
rebuilding said structure of said encoded video data content in response to receiving said data stream.

12. The video decoding device according to claim 11 wherein:
each said node comprises a plurality of leaves; and
each said chunk comprises a plurality of nodes and leaves.

13. The video decoding device according to claim 11 wherein:
said video data content is encoded to produce encoded video data; and
said chunks are encapsulated into messages in said encoded video data.

14. The video decoding device according to claim 13 wherein:
said video data content comprises coded metadata compliant with an ITU-T H.264 standard; and
said metadata is transmitted into at least a Supplemental Enhancement Information (SEI) message.

15. The video decoding device according to claim 11 wherein said descriptions each further comprises:
one or more summary segments, and for each said summary segment:
a name representing said summary segment;
a category representing semantic information associated with said summary segment; and
a key description describing a type of segment chosen among a keyframe, a clip or a textual description.

16. A video decoding method, comprising:
decoding encoded video data content and metadata associated with said encoded video data content, wherein said encoded video data content has a structure split into chunks in a hierarchical manner where each said chunk comprises one or more nodes representing metadata for a respective portion of said encoded video data content, a first said chunk comprises a first description of said one or more nodes included in said first chunk and a second said chunk comprises information indicating that a second description of said one or more nodes included in said second chunk is included in a next chunk, said first and second descriptions each comprising one or more node identifiers, a name representing video information in which said one or more nodes is associated, and a timecode indicating a duration of said video information, wherein said chunks are positioned in a data stream at successive time intervals such that each said chunk is positioned before said respective portion of said encoded video data content said chunk is related to; and
rebuilding said structure of said encoded video data content in response to receiving said data stream.

17. The video decoding method according to claim 16 wherein:
each said node comprises a plurality of leaves; and
each said chunk comprises a plurality of nodes and le

Assignees

• Chevallier Louis
• Oisel Lionel
• Le Clerc Francois
• Lefebvre Frederic
• Thomson Licensing

Inventors

• Chevallier Louis
• Oisel Lionel
• Le Clerc Francois
• Lefebvre Frederic

Classifications

• H04N21/8358 Primary

  involving watermark {(protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467)} · CPC title

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/23892

  involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level · CPC title

• H04N7/12 Primary

  Systems in which the television signal is transmitted via one channel or a plurality of parallel channels, the bandwidth of each channel being less than the bandwidth of the television signal (H04N7/24 takes precedence) · CPC title

• H04N7/08

  Systems for the simultaneous or sequential transmission of more than one television signal, e.g. additional information signals, the signals occupying wholly or partially the same frequency band {, e.g. by time division (H04N7/007 takes precedence)} · CPC title