Temporal metadata track

Patent metadata

Field	Value
Publication number	US-9507777-B2
Application number	US-201514830526-A
Country	US
Kind code	B2
Filing date	Aug 19, 2015
Priority date	Oct 20, 2010
Publication date	Nov 29, 2016
Grant date	Nov 29, 2016

Abstract

Methods, data processing systems and machine readable non-transitory storage media are described that can provide, in one embodiment, a non-time based description of types of metadata in a time based metadata track that can be associated with, in time, a time based media track. The description can include a set of keys, or other identifiers, that specify the types of metadata in the metadata track, and the description can also include values describing the structure of each key and values describing how to interpret each key.

First claim

The invention claimed is:

1. A non-transitory program storage device having stored thereon instructions to cause one or more processors to:
receive a time based metadata track associated with a time based media track, the time based media track containing media data, the time based metadata track including a collection of tags, wherein each tag identifies one or more types of metadata in the time based metadata track; and
index the time based metadata track as a non-time based description, the non-time based description including a set of identifiers, the set of identifiers including a first identifier and one or more additional identifiers each of which specify a unique combination, relative to all other identifiers in the set of identifiers, of one or more types of metadata in the time based metadata track,
wherein the first identifier is associated with a first type of metadata during a first time interval of the time based metadata track, the first identifier specifying there is no metadata of the first type in the time based metadata track during the first time interval.

2. The non-transitory program storage device of claim 1 , wherein the first identifier comprises a unique value reserved to specify the absence of metadata for any type of metadata in the time based metadata track and is used to specify, separately for each type of metadata in the time based metadata track, the absence of metadata for any and all types of metadata in the time based metadata track.

3. The non-transitory program storage device of claim 2 :
wherein each of the one or more additional identifiers comprises a key; and
wherein the non-time based description further includes, for a second identifier from the one or more additional identifiers, a keyspace value that describes a structure of the second identifier, and a data type value that describes how to interpret the second identifier's corresponding metadata in the time based metadata track.

4. The non-transitory program storage device of claim 1 , wherein the time based metadata track is configured to store a plurality of different types of metadata including one or more of: geographic location information; camera data; face detection data; temperature data; spatial orientation information; clip name; copyright data; picture quality data; and user added metadata.

5. The non-transitory program storage device of claim 1 :
wherein metadata and corresponding identifiers are stored in the time based metadata track and are accessed, during playback, according to a playback time parameter which progresses with time and which is used to retrieve media from the time based media track; and
wherein each access unit comprises metadata and a corresponding identifier from the set of identifiers or the first identifier and no metadata.

6. A computer system, comprising:
a display;
an audio module;
one or more processors operatively coupled to the display and audio module; and
memory having stored therein instructions that, when executed, are configured to cause the one or more processors to:
obtain from the memory a time based metadata track associated with a time based media track, the time based media track containing media data, the time based metadata track including a collection of tags, wherein each tag identifies one or more types of metadata in the time based metadata track;
index the time based metadata track as a non-time based description, the non-time based description including a set of identifiers, the set of identifiers including a first identifier and one or more additional identifiers, each of the one or more additional identifiers specify a unique combination, relative to all other identifiers in the set of identifiers, of one or more types of metadata in the time based metadata track, wherein the first identifier is associated with a first type of metadata during a first time interval of the time based metadata track, the first identifier specifying there is no metadata of the first type in the time based metadata track during the first time interval; and
store the non-time based description in the memory.

7. The computer system of claim 6 , wherein the first identifier comprises a unique value reserved to specify the absence of metadata for any type of metadata in the time based metadata track and is used to specify, separately for each type of metadata in the time based metadata track, the absence of metadata for any and all types of metadata in the time based metadata track.

8. The computer system of claim 7 :
wherein each of the one or more additional identifiers comprises a key; and
wherein the non-time based description further includes, for a second identifier from the one or more additional identifiers, a keyspace value that describes a structure of the second identifier, and a data type value that describes how to interpret the second identifier's corresponding metadata in the time based metadata track.

9. The computer system of claim 6 , wherein the time based metadata track is configured to store a plurality of different types of metadata including one or more of:
geographic location information; camera data; face detection data; temperature data; spatial orientation information; clip name; copyright data; picture quality data; and user added metadata.

10. The computer system of claim 6 :
wherein metadata and corresponding identifiers are stored in the time based metadata track and are accessed, during playback, according to a playback time parameter which progresses with time and which is used to retrieve media from the time based media track; and
wherein each access unit comprises metadata and a corresponding identifier from the set of identifiers or the first identifier and no metadata.

11. A computer implemented method to process a media file when the media file includes media tracks and corresponding metadata, the method comprising:
receiving a time based metadata track associated with a time based media track, the time based media track containing media data, the time based metadata track including a collection of tags, wherein each tag identifies one or more types of metadata in the time based metadata track; and
indexing the time based metadata track as a non-time based description, the non-time based description including a set of identifiers, the set of identifiers including a first identifier and one or more additional identifiers each of which specify a unique combination, relative to all other identifiers in the set of identifiers, of one or more types of metadata in the time based metadata track,
wherein the first identifier is associated with a first type of metadata during a first time interval of the time based metadata track, the first identifier specifying there is no metadata of the first type in the time based metadata track during the first time interval.

12. The method of claim 11 , wherein the first identifier comprises a unique value reserved to specify the absence of metadata for any type of metadata in the time based metadata track and is used to specify, separately for each type of metadata in the time based metadata track, the absence of metadata for any and all types of metadata in the time based metadata track.

13. The method of claim 12 :
wherein each of the one or more additional identifiers comprises a key; and
wherein the non-time based description further includes, for a second identifier from the one or more additional identifiers, a keyspace value that describes a structure of the second identifier, and a data type value that describes how to interpret the second identifier's corresponding metadata in the time based metadata track.

Assignees

• Apple Inc

Inventors

• Flick christopher
• Singer David

Classifications

• G06F16/787

  using geographical or spatial information, e.g. location · CPC title

• H04N21/4431

  characterized by the use of Application Program Interface [API] libraries · CPC title

• G06F16/78

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F16/14

  Details of searching files based on file metadata · CPC title

• G06F16/487

  using geographical or spatial information, e.g. location · CPC title