Systems and methods for enhanced video encoding

Patent metadata

Field	Value
Publication number	US-12526428-B2
Application number	US-202418618601-A
Country	US
Kind code	B2
Filing date	Mar 27, 2024
Priority date	Aug 2, 2017
Publication date	Jan 13, 2026
Grant date	Jan 13, 2026

Abstract

Systems and methods for enhanced video encoding identify patterns in sequences of raw digital video frames to extract features and identify the type of content represented by the extracted features. The system simulates many outcomes of encoding the sequence of digital video frames by using various different encoding strategies to find the relative best encoding strategy for each sequence of frames. As the encoder processes video, it passes digital video frames to a modeling system which determines whether the video, or video having that same type of content, has been previously observed by the system. The system then selectively applies a saved encoding strategy that had been determined by the system to be particularly suitable for encoding the same sequence of video frames or that same type of content.

First claim

The invention claimed is:

1 . A non-transitory computer-readable storage medium having computer-executable instructions stored thereon that, when executed, cause at least one processor to perform:
encoding, by a digital video encoder of a digital video encoding system, a sequence of digital video frames using a different encoding strategy than previously used by the video encoding system to encode the sequence of digital video frames; and determining, by the digital video encoding system, that one encoding strategy of a group of various different encoding strategies which includes the different encoding strategy is an encoding strategy particularly suitable for encoding the sequence of digital video frames.

2 . The non-transitory computer-readable storage medium of claim 1 wherein the computer-executable instructions, when executed, further cause at least one processor to perform:
associating, by the digital video encoding system, with an identified type of content the encoding strategy particularly suitable for encoding the sequence of video frames;
saving in an encoding library, by the digital video encoding system, the association of the identified type of content with the encoding strategy; and
saving in the encoding model library, by the digital video encoding system, the encoding strategy associated with the identified type of content.

3 . The non-transitory computer-readable storage medium of claim 2 wherein the computer-executable instructions, when executed, further cause at least one processor to perform:
extracting various features from a plurality of different sequences of digital video frames; and
identifying the extracted various features as being one or more features associated with the identified type of content.

4 . The non-transitory computer-readable storage medium of claim 3 wherein the various features are representations of physical objects throughout a plurality of different sequences of digital video frames associated with the identified type of content.

5 . The non-transitory computer-readable storage medium of claim 4 wherein the physical objects include one or more objects associated with a news broadcast and the identified type of content is news.

6 . The non-transitory computer-readable storage medium of claim 1 wherein the determining that one encoding strategy of the group of various different encoding strategies is the encoding strategy particularly suitable for encoding the sequence of digital video frames includes:
saving results of encoding one or more features associated with an identified type of content from the encoding of a plurality of different sequences of digital video frames using the various different encoding strategies;
comparing, using predetermined criteria, results of encoding the one or more features associated with the identified type of content from the encoding of the plurality of different sequences of digital video frames using the various different encoding strategies; and
selecting, based on the predetermined criteria, one of the various different encoding strategies used to encode the plurality of different sequences of digital video frames as the encoding strategy particularly suitable for encoding the sequence of video frames based on the comparison of, using the predetermined criteria, the results of encoding the one or more features associated with the identified type of content.

7 . A method in a digital video encoding system, the method comprising:
encoding by a digital video encoder of the digital video encoding system, a sequence of digital video frames using a different encoding strategy than previously used by the video encoding system to encode the sequence of digital video frames; and determining, by the digital video encoding system, that one encoding strategy of a group of various different encoding strategies which includes the different encoding strategy is an encoding strategy particularly suitable for encoding the sequence of digital video frames.

8 . The method of claim 7 , further comprising:
associating, by the digital video encoding system, with an identified type of content the encoding strategy particularly suitable for encoding the sequence of video frames; saving in an encoding library, by the digital video encoding system, the association of the identified type of content with the encoding strategy; and saving in the encoding model library, by the digital video encoding system, the encoding strategy associated with the identified type of content.

9 . The method of claim 8 , further comprising:
extracting various features from a plurality of different sequences of digital video frames; and identifying the extracted various features as being one or more features associated with the identified type of content.

10 . The method of claim 9 wherein the various features are representations of physical objects throughout a plurality of different sequences of digital video frames associated with the identified type of content.

11 . The method of claim 10 wherein the physical objects include one or more objects associated with a news broadcast and the identified type of content is news.

12 . The method of claim 7 wherein the determining that one encoding strategy of the group of various different encoding strategies is the encoding strategy particularly suitable for encoding the sequence of digital video frames includes:
saving results of encoding one or more features associated with an identified type of content from the encoding of a plurality of different sequences of digital video frames using the various different encoding strategies;
comparing, using predetermined criteria, results of encoding the one or more features associated with the identified type of content from the encoding of the plurality of different sequences of digital video frames using the various different encoding strategies; and
selecting, based on the predetermined criteria, one of the various different encoding strategies used to encode the plurality of different sequences of digital video frames as the encoding strategy particularly suitable for encoding the sequence of video frames based on the comparison of, using the predetermined criteria, the results of encoding the one or more features associated with the identified type of content.

13 . A digital video encoding system comprising:
at least one processor; at least one memory coupled to the at least one processor, the at least one memory having computer executable instructions stored thereon that, when executed by the at least one processor, cause the at least one processor to perform operations including: encoding by a digital video encoder of the digital video encoding system, a sequence of digital video frames using a different encoding strategy than previously used by the video encoding system to encode the sequence of digital video frames; and determining, by the digital video encoding system, that one encoding strategy of a group of various different encoding strategies, which includes the different encoding strategy is an encoding strategy particularly suitable for encoding the sequence of digital video frames.

14 . The system of claim 13 , wherein the computer executable instructions, when executed by the at least one processor, further cause the at least one processor to perform:
associating, by the digital video encoding system, with an identified type of content the encoding strategy particularly suitable for encoding the sequence of video frames; saving in an encoding library, by the digital video encoding system, the association of the identified type of co

Assignees

• Dish Tech Llc

Inventors

• Day Christopher
• Shah Rima

Classifications

• H04N19/177

  the unit being a group of pictures [GOP] · CPC title

• H04N19/14

  Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06V30/194

  References adjustable by an adaptive method, e.g. learning · CPC title