Adaptive multi-pass risk-based video encoding

Patent metadata

Field	Value
Publication number	US-11259040-B1
Application number	US-201916395123-A
Country	US
Kind code	B1
Filing date	Apr 25, 2019
Priority date	Apr 25, 2019
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

Devices and methods are provided for adaptive multi-pass risk-based video encoding. A device may receive a segment of video frames encoded using first encoding parameters. The device may determine a group of pixels in a first video frame of the video frames. The device may determine characteristics associated with the group of pixels and may determine, based on the characteristics and a number of pixels in the group of pixels, a score associated with the segment, wherein the score is indicative of a visibility of banding compression artifact. The device may determine, based on the score, second encoding parameters associated with encoding the segment.

First claim

What is claimed is:

1. A method, comprising:
receiving two or more segments of video frames, wherein the two or more segments of video frames are encoded using first encoding parameters, and wherein the two or more segments of video frames comprise a first video frame associated with a first segment and a second video frame associated with a second segment;
determining a first group of pixels in the first video frame, and wherein respective pixels of the first group of pixels are adjacent to at least one pixel in the first group of pixels;
determining a second group of pixels in the second video frame, and wherein respective pixels of the second group of pixels are adjacent to at least one pixel in the second group of pixels;
determining a first characteristic of a first pixel in the first group of pixels;
determining a second characteristic of a second pixel in the second group of pixels;
determining, based on the first characteristic, a first score, wherein the first score is indicative of a first visibility of a first banding artifact;
determining, based on the second characteristic, a second score, wherein the second score is indicative of a second visibility of a second banding artifact;
determining that the first score exceeds a threshold score;
determining that the second score fails to exceed the threshold score;
determining, based on the first score exceeding the threshold score, second encoding parameters, wherein the second encoding parameters are associated with encoding the first segment; and
determining, based on the second score failing to exceed the threshold score, third encoding parameters, wherein the third encoding parameters are associated with encoding the second segment, wherein the second encoding parameters are associated with a first bit rate, wherein the third encoding parameters are associated with a second bit rate, and wherein the first bit rate is different from the second bit rate.

2. The method of claim 1 , wherein the first group of pixels comprises a first number of pixels, wherein the second group of pixels comprises a second number of pixels, wherein determining the first score is further based on the first number of pixels, wherein the second score is based on the second number of pixels, and wherein the first number of pixels is greater than the second number of pixels.

3. The method of claim 1 , further comprising:
determining a third group of pixels in the first video frame; and
determining a third characteristic of a third pixel in the third group of pixels, wherein determining the first score is further based on the third characteristic.

4. The method of claim 1 , wherein the first banding artifact is a first compression artifact associated with the second encoding parameters, and wherein the second banding artifact is a second compression artifact associated with the third encoding parameters, further comprising determining one or more additional compression artifacts associated with the first video frame, wherein the first score is further based on the one or more additional compression artifacts.

5. A method, comprising:
receiving video data, wherein the video data is associated with an encoded portion of a video segment encoded using first encoding parameters, and wherein the encoded portion of the video segment comprises a first video frame;
determining, based on the video data, a group of pixels in the first video frame, wherein the group of pixels comprises a compression artifact;
determining, based on respective characteristics of two or more pixels in the group of pixels, a score indicative of a visibility of the compression artifact in the first video frame, wherein the respective characteristics comprise at least one of a brightness or a contrast associated with the group of pixels; and
determining, based on the score, second encoding parameters for encoding the video segment.

6. The method of claim 5 , wherein the score is a first score, wherein determining the second encoding parameters comprises determining that the score fails to meet a threshold score, wherein the second encoding parameters are associated with less compression than the first encoding parameters.

7. The method of claim 5 , wherein determining the second encoding parameters comprises determining that the score exceeds a threshold score, wherein the second encoding parameters are associated with more compression than the first encoding parameters.

8. The method of claim 5 , wherein determining the score comprises determining that an average characteristic of the group of pixels fails to exceed a threshold.

9. The method of claim 5 , further comprising:
determining at least one of the brightness or the contrast associated with the group of pixels; and
determining the visibility of the compression artifact based on the at least one of the brightness or the contrast.

10. The method of claim 5 , wherein the video segment is a first video segment of a video file, wherein the video file comprises a second video segment, wherein the second video segment comprises a second video frame, wherein the group of pixels is a first group of pixels, wherein the compression artifact is a first compression artifact, and wherein the score is a first score, the method further comprising:
determining a second group of pixels in the second video frame;
determining, based on respective characteristics of two or more pixels in the second group of pixels, a second score indicative of a second visibility of a second compression artifact in the second video frame;
determining that the first score exceeds a threshold score, wherein determining the second encoding parameters is based on the first score exceeding the threshold score;
determining that the second score fails to exceed the threshold score;
determining third encoding parameters associated with encoding the second video segment, wherein the third encoding parameters are associated with more compression than the second encoding parameters; and
sending an indication of the third encoding parameters.

11. The method of claim 5 , wherein the group of pixels is a first group of pixels, wherein the compression artifact is a first compression artifact, and wherein determining the score further comprises determining a second group of pixels in the first video frame, wherein the second group of pixels comprises a second compression artifact, wherein determining the score is further based on a respective brightness of two or more pixels in the second group of pixels.

12. The method of claim 5 , wherein the video segment is a first video segment of a video file, wherein the video file comprises a second video segment, wherein the first video frame is a keyframe of the first video segment, wherein the keyframe is associated with a scene change between the second video segment and the first video segment.

13. The method of claim 5 , wherein the compression artifact is a first compression artifact associated with the second encoding parameters, further comprising determining one or more additional compression artifacts associated with the first video frame, wherein the first compression artifact is different from the one or more additional compression artifacts, and wherein the score is further based on the one or more additional compression artifacts.

14. The method of claim 5 , wherein the compression artifact is a first compression artifact associated with the second encoding parameters, and wherein the score is a first score, further comprising:
determining one or more additional compression artifacts associated with the first video frame; and
determining, based on the

Assignees

• Amazon Tech Inc

Inventors

• Sabui Arko
• Nandakumar Deepthi

Classifications

• H04N19/174

  the region being a slice, e.g. a line of blocks or a group of blocks · CPC title

• H04N19/115

  Selection of the code volume for a coding unit prior to coding · CPC title

• H04N19/103 Primary

  Selection of coding mode or of prediction mode · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N19/46 Primary

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title