Systems and methods for block division in video processing

Patent metadata

Field	Value
Publication number	US-12166980-B2
Application number	US-202318170518-A
Country	US
Kind code	B2
Filing date	Feb 16, 2023
Priority date	Jun 24, 2021
Publication date	Dec 10, 2024
Grant date	Dec 10, 2024

Abstract

The present disclosure relates to systems and methods for block division and encoding in video processing. A method may include obtaining a block to be predicted in an image frame. The method may also include determining, based on a plurality of division modes of the block, a target division mode of the block. The plurality of division modes may include an equal division mode that is configured to divide the block into multiple sub-blocks with a same size. The method may further include dividing, based on the target division mode, the block into a plurality of sub-blocks, and encoding the block based on the plurality of sub-blocks.

First claim

What is claimed is:

1. A method, comprising:
obtaining a block to be predicted in an image frame;
determining a division condition based on at least one of a size of the block or a type of the image frame;
determining, based on a plurality of division modes of the block, a target division mode of the block, the plurality of division modes including an equal division mode that is configured to divide the block into multiple sub-blocks with a same size;
dividing, based on the target division mode, the block into a plurality of sub-blocks, includes:
determining whether the target division mode is suitable for the block based on the division condition; and
in response to a determination that the target division model is suitable for the block, dividing the block, based on the target division mode, into the plurality of sub-blocks; and

encoding the block based on the plurality of sub-blocks.

2. The method of claim 1 , wherein the plurality of division modes further include at least one derivative division mode based on the equal division mode, the at least one derivative division mode being formed by removing a count of division boundaries used in the equal division mode, the count being greater than or equal to 1 and less than a difference between a count of the multiple of sub-blocks and 1.

3. The method of claim 1 , wherein the plurality of division modes further include a combination division mode, the combination division mode including a first division mode and a second division mode, and being configured to divide the block into multiple sub-blocks based on the first division mode and further divide at least one of the multiple sub-blocks based on the second division mode, wherein the first division mode and the second division mode are equal division modes or derivative division modes.

4. The method of claim 3 , wherein one of the first division mode and the second division mode is a horizontal division mode that is configured to divide the block in a horizontal direction, the other of the first division mode and the second division mode is a vertical division mode that is configured to divide the block in a vertical direction.

5. The method of claim 1 , wherein the plurality of division modes further include a step division mode with a stepped division boundary.

6. The method of claim 5 , wherein the step division mode is determined based on a beginning position of the division of the block or a division direction of the division of the block.

7. The method of claim 5 , wherein whether the step division mode is used and an index of a division proportion of the step division mode are included in a codec end, wherein the division proportion of the step division mode includes a division proportion in a vertical direction and a division proportion in a horizontal direction.

8. The method of claim 1 , wherein the determining, based on the plurality of division modes of the block, the target division mode of the block includes:
comparing costs of the plurality of division modes; and
designating, from the plurality of division modes, a division mode with a smallest cost as the target division mode.

9. A system, comprising:
at least one storage device storing executable instructions, and
at least one processor in communication with the at least one storage device, when executing the executable instructions, causing the system to perform operations including:
obtaining a block to be predicted in an image frame;
determining a division condition based on at least one of a size of the block or a type of the image frame;
determining, based on a plurality of division modes of the block, a target division mode of the block, the plurality of division modes including an equal division mode that is configured to divide the block into multiple sub-blocks with a same size;
dividing, based on the target division mode, the block into a plurality of sub-blocks, includes:
determining whether the target division mode is suitable for the block based on the division condition; and
in response to a determination that the target division model is suitable for the block, dividing the block, based on the target division mode, into the plurality of sub-blocks; and
encoding the block based on the plurality of sub-blocks.

10. The system of claim 9 , wherein the plurality of division modes further include at least one derivative division mode based on the equal division mode, the at least one derivative division mode being formed by removing a count of division boundaries used in the equal division mode, the count being greater than or equal to 1 and less than a difference between a count of the multiple of sub-blocks and 1.

11. The system of claim 9 , wherein the plurality of division modes further include a combination division mode, the combination division mode including a first division mode and a second division mode, and being configured to divide the block into multiple sub-blocks based on the first division mode and further divide at least one of the multiple sub-blocks based on the second division mode, wherein the first division mode and the second division mode are equal division modes or derivative division modes.

12. The system of claim 11 , wherein one of the first division mode and the second division mode is a horizontal division mode that is configured to divide the block in a horizontal direction, the other of the first division mode and the second division mode is a vertical division mode that is configured to divide the block in a vertical direction.

13. The system of claim 9 , wherein the plurality of division modes further include a step division mode with a stepped division boundary.

14. The system of claim 13 , wherein the step division mode is determined based on a beginning position of the division of the block or a division direction of the division of the block.

15. The system of claim 13 , wherein whether the step division mode is used and an index of a division proportion of the step division mode are included in a codec end, wherein the division proportion of the step division mode includes a division proportion in a vertical direction and a division proportion in a horizontal direction.

16. The system of claim 9 , wherein the determining, based on the plurality of division modes of the block, the target division mode of the block includes:
comparing costs of the plurality of division modes; and
designating, from the plurality of division modes, a division mode with a smallest cost as the target division mode.

17. The system of claim 1 , wherein the operations further include:
encoding the block based on an index of the target division mode.

18. A non-transitory computer readable medium, comprising a set of instructions, wherein when executed by at least one processor, the set of instructions direct the at least one processor to effectuate a method, the method comprising:
obtaining a block to be predicted in an image frame;
determining a division condition based on at least one of a size of the block or a type of the image frame;
determining, based on a plurality of division modes of the block, a target division mode of the block, the plurality of division modes including an equal division mode that is configured to divide the block into multiple sub-blocks with a same size;
dividing, based on the target division mode, the block into a plurality of sub-blocks, includes:
determining whether the target division mode is suitable for the block based on the division condition; and
in response to a determination that the target divis

Assignees

• Zhejiang Dahua Technology Co

Inventors

• Zhang Xue
• Jiang Dong
• Lin Jucai
• Yin Jun

Classifications

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/172

  the region being a picture, frame or field · CPC title

• H04N19/159

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title

• H04N19/156

  Availability of hardware or computational resources, e.g. encoding based on power-saving criteria · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title