Multi-hypothesis prediction

Patent metadata

Field	Value
Publication number	US-12143591-B2
Application number	US-202217815200-A
Country	US
Kind code	B2
Filing date	Jul 26, 2022
Priority date	Jul 10, 2018
Publication date	Nov 12, 2024
Grant date	Nov 12, 2024

Abstract

A video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, comprising a hypothesis number control, configured to control a number of prediction hypotheses of the inter predicted blocks within a predetermined portion of the video to meet a predetermined criterion.

First claim

What is claimed is:

1. Video decoder for decoding a video from a data stream using motion compensated prediction for inter predicted blocks, configured to
determine a number of hypotheses for a predetermined inter predicted block dependent on a size or geometry of the block,
wherein the number of hypotheses is determined by comparing an upper limit for the number N of hypotheses dependent on
(m*w*h)/((w+k x )*(h+k y )), wherein
m is a factor, w is a block width of the predetermined inter predicted block, h is a block height of the predetermined inter predicted block and k x and k y indicate the size of an interpolation filter used in the motion compensated prediction.

2. Video decoder according to claim 1 , configure so that the number of prediction hypotheses indicates a maximum number of the hypotheses for the inter predicted block ( 80 ).

3. Video decoder according to claim 1 , configured to insert into the data stream information on the number of prediction hypotheses for the predetermined inter predicted block.

4. Video decoder according to claim 3 , configured to, based on the size or the geometry of the predetermined inter predicted block, determine an allowed number interval, and, using a binarization of the allowed number interval, code the information into the data stream.

5. Video decoder according to claim 4 , configured so that a maximum of the allowed number interval is the lower, the smaller the size of the predetermined inter predicted block is, and the binarization of the allowed number interval comprises a mean codeword length which is the lower, the lower the maximum of the allowed number interval is.

6. Video decoder according to claim 1 , configured so that the number of hypotheses is the larger, the larger the predetermined inter predicted block ( 80 ) is.

7. Method for decoding a video from a data stream using motion compensated prediction for inter predicted blocks, comprising
determining a number of hypotheses for a predetermined inter predicted block dependent on a size or geometry of the block,
wherein the number of hypotheses is determined by comparing an upper limit for the number N of hypotheses dependent on
(m*w*h)/((w+k x )*(h+k y )), wherein
m is a factor, w is a block width of the predetermined inter predicted block, h is a block height of the predetermined inter predicted block and k x and k y indicate the size of an interpolation filter used in the motion compensated prediction.

8. A non-transitory digital storage medium having a computer program stored thereon to perform the method for decoding a video from a data stream using motion compensated prediction for inter predicted blocks, comprising
determining a number of hypotheses for a predetermined inter predicted block dependent on a size or geometry of the block,
wherein the number of hypotheses is determined by comparing an upper limit for the number N of hypotheses dependent on
(m*w*h)/((w+k x )*(h+k y )), wherein
m is a factor, w is a block width of the predetermined inter predicted block, h is a block height of the predetermined inter predicted block and k x and k y indicate the size of an interpolation filter used in the motion compensated prediction,
when said computer program is run by a computer.

9. Video encoder for encoding a video into a data stream using motion compensated prediction for inter predicted blocks, configured to
determine a number of hypotheses for a predetermined inter predicted block dependent on a size or geometry of the block,
wherein the number of hypotheses is determined by comparing an upper limit for the number N of hypotheses dependent on
(m*w*h)/((w+k x )*(h+k y )), wherein
m is a factor, w is a block width of the predetermined inter predicted block, h is a block height of the predetermined inter predicted block and k x and k y indicate the size of an interpolation filter used in the motion compensated prediction.

Assignees

• Fraunhofer Ges Forschung

Inventors

• Winken Martin
• Bartnik Christian
• Helle Philipp
• Siekmann Mischa
• Pfaff Jonathan
• Marpe Detlev
• Schwarz Heiko
• Wiegand Thomas

Classifications

• H04N19/57

  Motion estimation characterised by a search window with variable size or shape · CPC title

• H04N19/137

  Motion inside a coding unit, e.g. average field, frame or block difference · CPC title

• H04N19/577

  Motion compensation with bidirectional frame interpolation, i.e. using B-pictures · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/117

  Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) · CPC title