Complexity adaptive rate control

Patent metadata

Field	Value
Publication number	US-10771789-B2
Application number	US-201715600272-A
Country	US
Kind code	B2
Filing date	May 19, 2017
Priority date	May 19, 2017
Publication date	Sep 8, 2020
Grant date	Sep 8, 2020

Abstract

Implementations disclose adaptive rate control technology that selects different encoders for different chunks of a media item based on the complexity of the individual chunks. A method includes accessing a media item comprising a first chunk and a second chunk; determining, by a processing device, a first media complexity measure for the first chunk and a second media complexity measure for the second chunk; selecting, by the processing device, a first encoder and a second encoder from a plurality of encoders, wherein the first encoder is selected based on the first media complexity measure of the first chunk and the second encoder is selected based on the second media complexity measure of the second chunk; and encoding the first chunk using the first encoder and encoding the second chunk using the second encoder.

First claim

What is claimed is:

1. A method comprising:
accessing a media item comprising a first chunk and a second chunk;
determining, by a processing device, an average bit rate of the first chunk based on a storage size of the first chunk and a playback time of the first chunk;
determining, by the processing device executing a complexity measurement module, a first media complexity measure for the first chunk and a second media complexity measure for the second chunk, wherein the first media complexity measure is determined using a mathematical formula that is based on the average bit rate of the first chunk and is determined without performing an analysis of image pixel values of one or more frames of the first chunk;
selecting, by the processing device, a single pass encoder and a multiple pass encoder from a plurality of encoders, wherein the single pass encoder is selected based on the first media complexity measure of the first chunk and the multiple pass encoder is selected based on the second media complexity measure of the second chunk; and
encoding the first chunk of the media item using the single pass encoder and encoding the second chunk of the media item using the multiple pass encoder.

2. The method of claim 1 , wherein each of the plurality of encoders comprise a variable bitrate encoder.

3. The method of claim 1 , wherein each of the first media complexity measure and the second media complexity measure corresponds to a spatial and temporal distribution of a respective chunk.

4. The method of claim 1 , wherein the media item is a video and the first and second media complexity measures are video coding complexity (VCC) measurements, and wherein the determining comprises determining a video coding complexity measurement for the first chunk and a video coding complexity measurement for the second chunk of the media item.

5. The method of claim 1 , wherein determining the second media complexity measure of the second chunk comprises determining, based on metadata of the second chunk, one or more of a bit rate (R), a frame rate (Fps), a chroma factor (CF), a frame width (W), or a frame height (H) in pixels of the second chunk, and further comprises the processing device to execute a complexity measurement module to calculate a value for the first media complexity measure (VCC) based on a mathematical formula comprising: VCC=R/(W*H*Fps*CF).

6. The method of claim 1 , wherein the single pass encoder is a single pass transcoder comprising a video buffering verifier and wherein the multiple pass encoder comprises a two pass transcoder comprising a constrained quality and a bounded bitrate.

7. The method of claim 1 , wherein the single pass encoder is implemented using a leaky bucket model.

8. The method of claim 1 , wherein selecting the single pass encoder comprises:
comparing the first media complexity measure of the first chunk to a predetermined threshold value; and
selecting the single pass encoding responsive to the first media complexity measure being below a predetermined threshold.

9. The method of claim 1 , further comprising:
receiving the media item from a user device that captured and recorded the media item;
segmenting the media item into a plurality of chunks comprising the first chunk and the second chunk; and
combining the first chunk of the media item encoded using the single pass encoder with the second chunk of the media item encoded using the multiple pass encoder to form an encoded media item.

10. A system comprising:
a memory;
a processing device operatively coupled to the memory, the processing device to:
access a media item comprising a first chunk and a second chunk;
determine an average bit rate of the first chunk based on a storage size of the first chunk and a playback time of the first chunk;
determine, by a complexity measurement module, a first media complexity measure for the first chunk and a second media complexity measure for the second chunk, wherein the first media complexity measure is determined using a mathematical formula that is based on the average bit rate of the first chunk and is determined without performing an analysis of image pixel values of one or more frames of the first chunk;
select a single pass encoder and a multiple pass encoder from a plurality of encoders, wherein the single pass encoder is selected based on the first media complexity measure of the first chunk and the multiple pass encoder is selected based on the second media complexity measure of the second chunk; and
encode the first chunk of the media item using the single pass encoder and encoding the second chunk of the media item using the multiple pass encoder.

11. The system of claim 10 , wherein each of the plurality of encoders comprise a variable bitrate encoder.

12. The system of claim 10 , wherein each of the first media complexity measure and the second media complexity measure corresponds to a spatial and temporal distribution of a respective chunk.

13. The system of claim 10 , wherein the media item is a video and the first and second media complexity measures are video coding complexity (VCC) measurements, and wherein to determine comprises the processing device to determine a video coding complexity measurement for the first chunk and a video coding complexity measurement for the second chunk of the media item.

14. The system of claim 10 , wherein to determine the second media complexity measure of the second chunk comprises the processing device to determine, based on metadata of the second chunk, one or more of a bit rate (R), a frame rate (Fps), a chroma factor (CF), a frame width (W), or a frame height (H) in pixels of the second chunk, and further comprises the processing device to execute a complexity measurement module to calculate a value for the second media complexity measure (VCC) based on a mathematical formula comprising: VCC=R/(W*H*Fps*CF).

15. A non-transitory machine-readable storage medium storing instructions which, when executed, cause a processing device to perform operations comprising:
accessing a media item comprising a first chunk and a second chunk;
determine an average bit rate of the first chunk based on a storage size of the first chunk and a playback time of the first chunk;
determining a first media complexity measure for the first chunk and a second media complexity measure for the second chunk, wherein the first media complexity measure is determined using a mathematical formula that is based on the average bit rate of the first chunk and is determined without performing an analysis of image pixel values of one or more frames of the first chunk;
selecting, by the processing device, a single pass encoder and a multiple pass encoder from a plurality of encoders, wherein the single pass encoder is selected based on the first media complexity measure of the first chunk and the multiple pass encoder is selected based on the second media complexity measure of the second chunk; and
encoding the first chunk of the media item using the single pass encoder and encoding the second chunk of the media item using the multiple pass encoder.

16. The non-transitory machine-readable storage medium of claim 15 , wherein each of the plurality of encoders comprise a variable bitrate encoder.

17. The non-transitory machine-readable storage medium of claim 15 , wherein each of the first media complexity measure and the second media complexity measure corresponds to a spatial and temporal distribution of a respective chunk.

18. The non-transitory machine-readable storage medium of claim 15 , wherein t

Assignees

• Google Inc
• Google Llc

Inventors

• John Sam

Classifications

• H04L65/75

  Media network packet handling · CPC title

• H04N19/40 Primary

  using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream · CPC title

• H04N19/194

  involving only two passes · CPC title

• H04N19/169

  characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding · CPC title

• H04N19/152

  by measuring the fullness of the transmission buffer · CPC title