Image processing apparatus and method

Patent metadata

Field	Value
Publication number	US-12375673-B2
Application number	US-202318167903-A
Country	US
Kind code	B2
Filing date	Feb 13, 2023
Priority date	Nov 16, 2018
Publication date	Jul 29, 2025
Grant date	Jul 29, 2025

Abstract

An image processing apparatus (encoder, decoder or the like) and method suppress reduction in encoding efficiency. Encoding of coefficient data is skipped in an invalid transform coefficient region, and the coefficient data is encoded in a valid transform coefficient region. Further, for example, the coefficient data in the valid transform coefficient region is encoded in a scan order corresponding to a block shape of a block to be processed. In addition, decoding of encoded data including encoded coefficient data related to an image is skipped in an invalid transform coefficient region, and the encoded data is decoded in a valid transform coefficient region. Further, for example, the encoded data in the valid transform coefficient region is decoded in a scan order corresponding to the block shape of the block to be processed.

First claim

The invention claimed is:

1. An image processing apparatus comprising:
a transceiver; and
control circuitry configured to encode coefficient data related to an image, the coefficient data related to the image arranged in an M×N block, where M and N are integers, and N is equal to or different from M,
wherein, based on information indicating a K×L block of the M×N block is to be processed, where the K×L block corresponds to a valid transform coefficient region, where K and L are integers, and L is equal to or different from K, where at least one of K or L is less than at least one M or N, the control circuitry encodes the coefficient data related to the image by:
skipping encoding of the coefficient data related to the image in portions of the M×N block that are outside of the K×L block, the portions of the M×N block that are outside of the K×L block corresponding to one or more invalid transform coefficient regions, and
only encoding the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region.

2. The image processing apparatus of claim 1 , wherein the control circuitry is configured to encode the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region by scanning the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region in a predetermined scanning pattern.

3. The image processing apparatus of claim 2 , wherein the predetermined scanning pattern includes a predetermined scanning direction.

4. The image processing apparatus of claim 3 , wherein the predetermined scanning direction corresponds to a block shape of the K×L block.

5. The image processing apparatus of claim 1 , wherein scanning of the coefficient data in the K×L block includes sequentially scanning a plurality of sub-blocks of the K×L block.

6. The image processing apparatus of claim 1 , wherein the coefficient data related to the image in the K×L block comprises at least one of a luminance data or a chroma data.

7. A method of encoding performed by an image processing apparatus that is configured to encode coefficient data related to an image, the coefficient data related to the image arranged in an M×N block, where M and N are integers, and N is equal to or different from M, the method comprising:
based on information indicating a K×L block of the M×N block is to be processed, where the K×L block corresponds to a valid transform coefficient region, where K and L are integers, and L is equal to or different from K, where at least one of K or L is less than at least one M or N, encoding the coefficient data related to the image by:
skipping encoding of the coefficient data related to the image in portions of the M×N block that are outside of the K×L block, the portions of the M×N block that are outside of the K×L block corresponding to one or more invalid transform coefficient regions, and
only encoding the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region.

8. An image processing apparatus comprising:
a transceiver; and
control circuitry configured to decode coefficient data related to an image, the coefficient data related to the image arranged in an M×N block, where M and N are integers, and N is equal to or different from M,
wherein, based on information indicating a K×L block of the M×N block is to be processed, where the K×L block corresponds to a valid transform coefficient region, where K and L are integers, and L is equal to or different from K, where at least one of K or L is less than at least one M or N, the control circuitry decodes the coefficient data related to the image by:
skipping decoding of the coefficient data related to the image in portions of the M×N block that are outside of the K×L block, the portions of the M×N block that are outside of the K×L block corresponding to one or more invalid transform coefficient regions, and
only decoding the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region.

9. The image processing apparatus of claim 8 , wherein the control circuitry is configured to decode the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region by scanning the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region in a predetermined scanning pattern.

10. The image processing apparatus of claim 9 , wherein the predetermined scanning pattern includes a predetermined scanning direction.

11. The image processing apparatus of claim 10 , wherein the predetermined scanning direction corresponds to a block shape of the K×L block.

12. The image processing apparatus of claim 8 , wherein scanning of the coefficient data in the K×L block includes sequentially scanning a plurality of sub-blocks of the K×L block.

13. The image processing apparatus of claim 8 , wherein the coefficient data related to the image in the K×L block comprises at least one of a luminance data or a chroma data.

14. A method of decoding performed by an image processing apparatus that is configured to decode coefficient data related to an image, the coefficient data related to the image arranged in an M×N block, where M and N are integers, and N is equal to or different from M, the method comprising:
based on information indicating a K×L block of the M×N block is to be processed, where the K×L block corresponds to a valid transform coefficient region, where K and L are integers, and L is equal to or different from K, where at least one of K or L is less than at least one M or N, decoding the coefficient data related to the image by:
skipping decoding of the coefficient data related to the image in portions of the M×N block that are outside of the K×L block, the portions of the M×N block that are outside of the K×L block corresponding to one or more invalid transform coefficient regions, and
only decoding the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region.

15. A non-transitory computer-readable medium for storing data associated with a data stream, the data stream comprising coefficient data related to an image, the coefficient data related to the image arranged in an M×N block, where M and N are integers, and N is equal to or different from M, the non-transitory computer-readable medium storing instructions for causing a processor to perform a method comprising:
based on information indicating a K×L block of the M×N block is to be processed, where the K×L block corresponds to a valid transform coefficient region, where K and L are integers, and L is equal to or different from K, where at least one of K or L is less than at least one M or N, encoding the coefficient data related to the image by:
skipping encoding of the coefficient data related to the image in portions of the M×N block that are outside of the K×L block, the portions of the M×N block that are outside of the K×L block corresponding to one or more invalid transform coefficient regions, and
only encoding the coefficient data related to the image in the K×L block that corresponds to the valid transform coefficient region.

16. A non-transitory computer-readable medium for storing data associated with a data stream, the data stream comprising coefficient data related to an image, the coefficient data related to the image arranged in an M×N block, where M and N are integers, and N is equal to or different

Assignees

• Sony Group Corp

Inventors

• Kim Jongdae
• Kudo Tomoaki
• Ikeda Masaru

Classifications

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/60

  using transform coding · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/136

  Incoming video signal characteristics or properties · CPC title

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title