Method for image processing and apparatus for implementing the same

Patent metadata

Field	Value
Publication number	US-12388974-B2
Application number	US-202217946442-A
Country	US
Kind code	B2
Filing date	Sep 16, 2022
Priority date	Mar 12, 2019
Publication date	Aug 12, 2025
Grant date	Aug 12, 2025

Abstract

A method of processing an image divided into a plurality of pixel blocks which are processed according to a processing sequence is provided, which comprises, for a current pixel block: determining an application area comprising a set of pixels in blocks preceding the current block in the processing sequence; performing a gradient analysis on at least one pixel of the application area; selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis; determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and generating a predictor of the current pixel block based on the determined plurality of predictors.

First claim

The invention claimed is:

1. A method comprising, by a processor of an encoder side:
performing a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and
providing, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,
wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,
and wherein the DIMD image processing method comprises, for the current pixel block of the image:
determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;
performing a gradient analysis on at least one pixel of the application area;
selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;
determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and
generating a predictor of the current pixel block based on the determined plurality of predictors.

2. A method comprising, by a processor of a decoder side:
receiving, from an encoder side, control information indicating that a Derived Intra Mode at Decoder (DIMD) image processing method has been used by the encoder side for processing a current pixel block of an image; and
performing the DIMD image processing method for processing the current pixel block of the image;
wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,
and wherein the DIMD image processing method comprises, for the current pixel block of the image:
determining an application area comprising a set of pixels in blocks preceding the current pixel block in the processing sequence;
performing a gradient analysis on at least one pixel of the application area;
selecting at least two intra prediction video coding modes among a plurality of intra prediction video coding modes usable for processing the current pixel block, wherein at least one of the selected intra prediction video coding modes is selected based on the gradient analysis;
determining a plurality of predictors of the current pixel block based on the at least two selected intra prediction video coding modes; and
generating a predictor of the current pixel block based on the determined plurality of predictors.

3. The method according to claim 2 , wherein the DIMD image processing method further comprises: determining an application area comprising a plurality of pixels in blocks preceding the current pixel block in the processing sequence; and performing the gradient analysis on at least two pixels of the application area.

4. The method according to claim 2 , wherein the DIMD image processing method further comprises: determining weights that are respectively associated with the selected intra prediction video coding modes, and combining the determined predictors using the determined weights.

5. The method according to claim 2 , wherein the at least two intra prediction video coding modes are selected based on the gradient analysis.

6. The method according to claim 2 , further comprising: discarding at least one duplicate in the selected intra prediction video coding modes.

7. The method according to claim 2 , wherein a plurality of intra prediction video coding modes are selected based on the gradient analysis, the DIMD image processing method further comprising: replacing a discarded intra prediction video coding modes that was selected based on the gradient analysis, by selecting another intra prediction video coding mode based on the gradient analysis.

8. The method according to claim 2 , wherein a number of intra prediction video coding modes selected based on the gradient analysis is based on a size of the current pixel block.

9. The method according to claim 2 , wherein the performing the gradient analysis comprises: for at least one pixel of the application area, computing a gradient representing a directional change of an intensity at the pixel, and wherein the selecting the at least one intra prediction video coding mode based on the gradient analysis is based on at least one of the computed gradients.

10. The method according to claim 1 , wherein the DIMD image processing method is performed by a processor of an image encoder of the encoder side, and further comprises, at the image encoder: encoding, via the processor, the current pixel block according to the at least one intra prediction video coding mode selected based on the gradient analysis.

11. The method according to claim 2 , wherein the DIMD image processing method is performed by a processor of an image decoder of the decoder side, and further comprises, at the image decoder: decoding, via the processor, the current pixel block according to the at least one intra prediction video coding mode selected based on the gradient analysis.

12. The method according to claim 11 , wherein the at least one intra prediction video coding mode selected based on the gradient analysis used at the encoder side for encoding the current pixel block is used at the decoder side for decoding the current pixel block.

13. The method according to claim 2 , wherein the performing the gradient analysis further comprises: computing a first gradient value representing an estimate magnitude of the directional change of the intensity at the at least one pixel, and a second gradient value representing an estimate orientation of the directional change of the intensity at the at least one pixel.

14. The method according to claim 9 , wherein the selecting the at least one intra prediction video coding mode based on the gradient analysis comprises: for the at least one pixel of the application area, mapping the computed gradient to an intra prediction mode among the plurality of intra prediction video coding modes.

15. The method according to claim 2 , wherein the selecting the at least one intra prediction video coding mode based on the gradient analysis further comprises: determining respective weight values for several intra prediction modes among the plurality of intra prediction video coding modes, based on gradients computed for pixels of the application area.

16. The method according to claim 15 , wherein the weight value for an intra prediction video coding mode is determined based on the one or more computed gradient mapped to the intra prediction video coding mode, and wherein at least one of the at least one intra prediction video coding mode selected based on the gradient analysis is selected based on its weight value.

17. An apparatus of an encoder side, the apparatus comprising a processor and a memory operatively coupled to the processor, wherein the processor is configured to:
perform a Derived Intra Mode at Decoder (DIMD) image processing method for processing a current pixel block of an image; and

provide, to a decoder side, control information indicating that the DIMD image processing method has been used by the encoder side for processing the current pixel block of the image,
wherein the image is divided into a plurality of pixel blocks which are processed according to a processing sequence,
and wherein the DIMD image processing method comprises, for the current pixel block of the image:
deter

Assignees

• Ateme

Inventors

• Mora Elie
• Abdoli Mohsen
• Guionnet Thomas

Classifications

• G06N7/01

  Probabilistic graphical models, e.g. probabilistic networks · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• G06F17/16

  Matrix or vector computation {, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization (matrix transposition G06F7/78)} · CPC title

• G06T7/90

  Determination of colour characteristics · CPC title

• G06T7/11

  Region-based segmentation · CPC title