Transition points in an image sequence

Patent metadata

Field	Value
Publication number	US-10264046-B2
Application number	US-201715636224-A
Country	US
Kind code	B2
Filing date	Jun 28, 2017
Priority date	Aug 2, 2013
Publication date	Apr 16, 2019
Grant date	Apr 16, 2019

Abstract

Techniques are proposed for embedding transition points in media content. A transition point system retrieves a time marker associated with a point of interest in the media content. The transition point system identifies a first position within the media content corresponding to the point of interest. The transition point system embeds data associated with the time marker into the media content at a second position that is no later in time than the first position. The transition point system causes a client media player to transition from a first image quality level to a second quality level based on the time marker.

First claim

What is claimed is:

1. A computer-implemented method to reduce noticeability of quality level changes during streaming of media content, based on transition points, the computer-implemented method comprising:
providing a predefined set of values ranging from explicitly characterizing weakest candidacy as a transition point to explicitly characterizing strongest candidacy as a transition point;
retrieving a time marker associated with a point of interest in the media content;
identifying a first position within the media content corresponding to the point of interest;
generating, by operation of one or more computer processors, a transition marker specifying a value that explicitly characterizes a candidacy of the point of interest as a transition point, wherein the specified value is selected from the predefined set of values, wherein the transition marker is embedded into the media content at a second position that is no later in time than the first position; and
during streaming of the media content, causing a client media player to transition from an initial image quality level to a target image quality level at a point in time determined based on the transition marker, in order to reduce noticeability of the transition, wherein the target image quality level is determined based on a measure of available bandwidth.

2. The computer-implemented method of claim 1 , wherein the first position is equal to the second position.

3. The computer-implemented method of claim 1 , wherein the transition marker specifies a location within the media content where a transition is preferred.

4. The computer-implemented method of claim 1 , wherein the transition marker specifies a duration of time within the media content where a transition is not preferred.

5. The computer-implemented method of claim 1 , wherein retrieving the time marker comprises receiving the time marker from a user.

6. The computer-implemented method of claim 1 , wherein the initial image quality level comprises a first image quality level, wherein the target image quality level comprises a second image quality level, wherein the transition marker is generated by a content server operatively connected to the client media player via a communications channel for streaming the media content, wherein the transition marker further specifies an enumerated type explicitly characterizing whether the point of interest is a scene change, slow pan, product placement, key character, whip pan, or key scene; wherein each enumerated type, selected from a scene change, slow pan, product placement, key character, whip pan, and key scene, is specifiable in the transition marker; wherein the second image quality level is different from the first image quality level, wherein the second image quality level is one of: (i) higher than the first image quality level and (ii) lower than the first image quality level; wherein the predefined set of values comprises a predefined set of numerical values ranging from explicitly characterizing weakest candidacy as a transition point to explicitly characterizing strongest candidacy as a transition point, wherein the specified value comprises one of the predefined set of numerical values.

7. The computer-implemented method of claim 6 , wherein the computer-implemented method further comprises:
determining a measure of available bandwidth, based on at least two of: (i) a maximum capacity of the communications channel; (ii) a measure of current utilization of bandwidth of the communications channel; (iii) and a bit rate of the media content;
preemptively transitioning to a first lower image quality level based on the transition marker and despite sufficient bandwidth and processing power being available to avoid transitioning to the first lower image quality level, in order to reduce power consumption and transmission cost associated with streaming the media content;
wherein the client media player is caused to:
in transitioning between image quality levels during streaming of the media content, prioritize a larger reduction in image quality level occurring at higher-candidacy transition point over a smaller reduction in image quality level occurring at a lower-candidacy transition point.

8. The computer-implemented method of claim 7 , wherein the first position is identified based on a time code corresponding to the time marker; wherein each content type, selected from: (i) a cut point within the media content; (ii) an object being visible in a scene of the media content; and (iii) a type of camera move; is identifiable by the transition marker; wherein the computer-implemented method further comprises:
storing the media content on a computer-readable medium, wherein the media content comprises an output of the retrieving, identifying, and generating steps;
wherein the client media player is operable to:
determine a measure of available buffer space on the client media player; and
upon determining that the measure of available buffer space falls below a predefined threshold, transition to a second lower image quality level despite sufficient bandwidth and processing power being available to avoid transitioning to the second lower image quality level.

9. The computer-implemented method of claim 8 , wherein each target type selected from: (i) a location within the media content where a transition is preferred; and (ii) a duration of time within the media content where a transition is not preferred; is specifiable in the transition marker;
wherein the time marker is generable based on each marker element selected from: (i) an edit decision list; (ii) the enumerated type; (iii) audio cues from the media content; and (iv) detection of specified objects in the media content.

10. The computer-implemented method of claim 9 , wherein the predefined set of values includes at least three distinct values, wherein the first position is one of: (ii) equal to the second position and (ii) later in time than the second position; wherein the time marker is generated based on: (i) the edit decision list; (ii) the enumerated type; (iii) the audio cues from the media content; and (iv) the detection of the specified objects in the media content.

11. A non-transitory computer-readable medium including instructions executable to perform an operation to reduce noticeability of quality level changes during streaming of media content, based on transition points, the operation comprising:
providing a predefined set of values ranging from explicitly characterizing weakest candidacy as a transition point to explicitly characterizing strongest candidacy as a transition point;
retrieving a time marker associated with a point of interest in the media content;
identifying a first position within the media content corresponding to the point of interest;
generating, by operation of one or more computer processors when executing the instructions, a transition marker specifying a value that explicitly characterizes a candidacy of the point of interest as a transition point, wherein the specified value is selected from the predefined set of values, wherein the transition marker is embedded into the media content at a second position that is no later in time than the first position; and
during streaming of the media content, causing a client media player to transition from an initial image quality level to a target image quality level at a point in time determined based on the transition marker, in order to reduce noticeability of the transition, wherein the target image quality level is determined based on a measure of available bandwidth.

12. The non-transitory computer-readable medium of claim 11 , wherein the first position is eq

Assignees

• Pixar

Inventors

• Glynn Dominic

Classifications

• H04L65/602

  Electricity · mapped topic

• H04N21/8455

  involving pointers to the content, e.g. pointers to the I-frames of the video stream · CPC title

• H04L65/4084

  Electricity · mapped topic

• H04L65/601

  Electricity · mapped topic

• H04L65/60

  Network streaming of media packets · CPC title