Temporal metadata track

Patent metadata

Field	Value
Publication number	US-9009118-B2
Application number	US-201113250535-A
Country	US
Kind code	B2
Filing date	Sep 30, 2011
Priority date	Oct 20, 2010
Publication date	Apr 14, 2015
Grant date	Apr 14, 2015

Abstract

A description of types of metadata can provide, in one embodiment, an index to the types of metadata in a time based metadata track that can be associated with a time based media track having audio or video or both. The description can be non-time based and be separate from the metadata track, and the description can be examined to determine whether a particular type of metadata exists in the time based metadata track without having to search through the track to determine whether the particular type of metadata exists.

First claim

What is claimed is:

1. A machine readable non-transitory storage medium storing instructions that, when executed by a data processing system, cause the data processing system to perform a method comprising:
examining a non-time based sample description that describes an association between a time based metadata track and a time based multimedia track, wherein the time based metadata track is associated in time with the time based multimedia track, further comprising:
sampling a set of key identifiers that each uniquely specify a single type of descriptive metadata from among one or more types of descriptive metadata in the time based metadata track, wherein the time based metadata track is associated in time with the time based media track based on aligning time-based access units that indicate a playback time in the time based multimedia track and that are configured to contain key identifiers in the time based metadata track that correspond to the playback time of the multimedia track;
defining a description indicating the temporal location of access units containing the descriptive metadata specified by the set of key identifiers; and
providing an index describing how to retrieve the key identifiers from the access units and how to interpret the key identifiers; and

retrieving key metadata, identified in the examining, from the time based metadata track, without requiring an examination through the time based metadata track, by using the index to retrieve and interpret the key identifiers.

2. The medium as in claim 1 wherein a first identifier, in the set of identifiers, specifies that a portion in time of the time based metadata track contains no metadata for one type of descriptive metadata and wherein the portion in time is associated with the first identifier by containing, within that portion, the first identifier, and wherein the portion of time is a time range that exists, during playback of the time based media track, in which there is no metadata of the one type of metadata.

3. The medium as in claim 2 wherein the first identifier is a unique value reserved to specify the absence of descriptive metadata associated with a key identifier in the set of key identifiers.

4. The medium as in claim 3 wherein the time based metadata track is configured to provide the capability to store metadata for a plurality of different types of descriptive metadata including at least one of: (a) position information derived from a satellite positioning system or a cellular telephone communication system or both systems; (b) camera data; (c) face detection data; (d) temperature data; (e) spatial orientation information; (f) clip name; (g) copyright data; (h) picture quality data; and (i) user added metadata.

5. A machine implemented method comprising:
examining, using a hardware-based processor, a non-time based sample description that describes an association between a time based metadata track and a time based multimedia track, wherein the time based metadata track is associated in time with the time based multimedia track, further comprising:
sampling a set of identifiers that each uniquely specify a single type of descriptive metadata from among one or more types of descriptive metadata in the time based metadata track, and wherein the time based metadata track is associated in time with the time based media track based on aligning time-based access units that indicate a playback time in the time based multimedia track and that are configured to contain key identifiers in the time based metadata track that correspond to the playback time of the multimedia track;
defining a description indicating the temporal location of access units containing the descriptive metadata specified by the set of key identifiers; and
providing an index describing how to retrieve the key identifiers from the access units and how to interpret the key identifiers; and

retrieving, using a hardware-based processor, key metadata, identified in the examining, from the time based metadata track, without requiring an examination through the time based metadata track, by using the index to retrieve and interpret the key identifiers.

6. The method as in claim 5 wherein a first identifier, in the set of identifiers, specifies that a portion in time of the time based metadata track contains no metadata for one type of metadata and wherein the portion in time is associated with the first identifier by containing, within that portion, the first identifier, and wherein the portion of time is a time range that exists, during playback of the time based media track, in which there is no metadata of the one type of metadata.

7. The method as in claim 6 wherein the first identifier is a unique value reserved to specify the absence of descriptive metadata associated with a key identifier in the set of key identifiers.

8. The method as in claim 7 wherein the time based metadata track is configured to provide the capability to store metadata for a plurality of different types of descriptive metadata including at least one of: (a) position information derived from a satellite positioning system or a cellular telephone communication system or both systems; (b) camera data; (c) face detection data; (d) temperature data; (e) spatial orientation information; (f) clip name; (g) copyright data; (h) picture quality data; and (i) user added metadata.

9. The method as in claim 8 wherein each identifier in the set of identifiers is a key, and wherein the time based metadata track has a track width of zero and a track height of zero and a track volume of zero specified within a header of the time based metadata track and wherein the time based metadata track is associated with the time based media track by a reference that the time based metadata track describes the time based media track; and wherein the non-time based description includes, for at least a second identifier in the set of identifiers, a keyspace value describing a structure of the second identifier and a data type value describing how to interpret the metadata, in the time based metadata track, corresponding to the second identifier; and wherein metadata and corresponding one or more identifiers are stored in the time based metadata track in a series of concatenated access units that are accessed, during playback, in the series over time according to a playback time parameter which progresses with time and which is used to retrieve media from the time based media track, each of the access units containing, when metadata is present in an access unit, metadata and corresponding identifiers.

10. A machine readable non-transitory storage medium storing instructions that, when executed by a data processing system, cause the data processing system to perform a method comprising:
receiving a declaration of types of descriptive metadata prior to storing metadata in the time based metadata track, the declaration indicating the types of descriptive metadata by specifying a set of one or more identifiers, of the types of descriptive metadata, for storage in a non-time based description of the time based metadata track;
recording media content, comprising at least one of audio or video content, in a time based media track;
storing metadata, captured while recording the media content, in the time based metadata track, wherein the time based media track and the time based metadata track are coordinated in time with each other;
determining whether to revise the set of one or more identifiers, specified by the declaration, in the non-time based description based on the types of descriptive metadata were stored in the storing of metadata in the time based metadata track;
revising the non-time based description based on the t

Assignees

• Flick christopher
• Singer David
• Apple Inc

Inventors

• Flick christopher
• Singer David

Classifications

• G06F17/30817 Primary

  Physics · mapped topic

• G06F17/30749

  Physics · mapped topic

• G06F16/78 Primary

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F16/487 Primary

  using geographical or spatial information, e.g. location · CPC title

• G06F16/68

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title