Image processing apparatus and method

Patent metadata

Field	Value
Publication number	US-12200260-B2
Application number	US-202017617492-A
Country	US
Kind code	B2
Filing date	Jun 8, 2020
Priority date	Jun 20, 2019
Publication date	Jan 14, 2025
Grant date	Jan 14, 2025

Abstract

Provided is an image processing apparatus and method for shortening a delay from inputting of a stream till generation of a decoded image. The image processing apparatus generates an encoded stream by adding at least part of header information about a second access unit (AU) to be processed immediately after a first AU or information regarding at least part of the header information, to supplemental enhancement information (SEI) about the first AU.

First claim

The invention claimed is:

1. An image processing apparatus, comprising:
at least one processor configured to:
extract one of a first part of header information of a second access unit (AU) or information regarding a second part of the header information of the second AU;
add, to supplemental enhancement information (SEI) of a first AU, the one of:
the first part of the header information of the second AU, wherein the second AU is processed subsequent to the first AU, or
the information regarding the second part of the header information of the second AU;

add, to the SEI of the first AU, a generation pattern for generation of a part of header information of a third AU, wherein the third AU is processed subsequent to the second AU; and
generate an encoded stream based on
the addition of the generation pattern, and
the addition of the one of the first part of the header information of the second AU or the information regarding the second part of the header information of the second AU.

2. The image processing apparatus according to claim 1 , wherein
the first AU is a top AU in a group of pictures (GOP),
the at least one processor is further configured to add the part of the header information of the third AU to the SEI of the first AU, and
the third AU is subsequent to the second AU in the GOP.

3. The image processing apparatus according to claim 1 , wherein the first AU is a top AU in a GOP.

4. The image processing apparatus according to claim 1 , wherein the first part of the header information of the second AU includes information necessary in a preprocessing operation for a decoding process.

5. The image processing apparatus according to claim 4 , wherein the information necessary in the preprocessing operation includes information necessary in picture order count (POC) generation.

6. The image processing apparatus according to claim 4 , wherein the information necessary in the preprocessing operation includes a parameter that varies with each picture of a plurality of pictures.

7. The image processing apparatus according to claim 4 , wherein the preprocessing operation includes a parsing process for the header information of the second AU, a POC generation process, and a RefPicList generation process.

8. An image processing method by an image processing apparatus, the image processing method comprising:
extracting one of a first part of header information of a second access unit (AU) or information regarding a second part of the header information of the second AU;
adding, to supplemental enhancement information (SEI) of a first AU, the one of:
the first part of the header information of the second AU, wherein the second AU is processed subsequent to the first AU, or
the information regarding the second part of the header information of the second AU;

adding, to the SEI of the first AU, a generation pattern for generation of a part of header information of a third AU, wherein the third AU is processed subsequent to the second AU; and
generating an encoded stream based on
the addition of the generation pattern, and
the addition of the one of the first part of the header information of the second AU or the information regarding the second part of the header information of the second AU.

9. An image processing apparatus, comprising:
at least one processor configured to:
receive an encoded stream that includes header information of a second access unit (AU);
decode the second AU based on the header information of the second AU in the encoded stream, wherein
the encoded stream is based on
extraction of one of a first part of the header information of the second AU or information regarding a second part of the header information of the second AU,
addition of the one of the first part of the header information of the second AU or the information regarding the second part of the header information of the second AU, to supplemental enhancement information (SEI) of a first AU, and
addition of a generation pattern to the SEI of the first AU,

the generation pattern is for generation of a part of header information of a third AU, and
the third AU is processed subsequent to the second AU;

execute a first process on the first AU; and
execute a second process on the second AU subsequent to the execution of the first AU.

10. An image processing method by an image processing apparatus, the image processing method comprising:
receiving an encoded stream that includes header information of a second access unit (AU);
decoding the second AU based on the header information of the second AU in the encoded stream, wherein
the encoded stream is based on
extraction of one of a first part of the header information of the second AU or information regarding a second part of the header information of the second AU,
addition of the one of the first part of the header information of the second AU or the information regarding the second part of the header information of the second AU, to supplemental enhancement information (SEI) of a first AU, and
addition of a generation pattern to the SEI of the first AU,

the generation pattern is for generation of a part of header information of a third AU,
the third AU is processed subsequent to the second AU;

executing a first process on the first AU; and
executing a second process on the second AU subsequent to the execution of the first AU.

Assignees

• Sony Semiconductor Solutions Corp

Inventors

• Kimura Tsuyoshi

Classifications

• H04N19/177

  the unit being a group of pictures [GOP] · CPC title

• H04N19/436

  using parallelised computational arrangements · CPC title

• H04N19/44

  Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder · CPC title

• H04N19/184

  the unit being bits, e.g. of the compressed video stream · CPC title

• H04N19/82

  involving filtering within a prediction loop · CPC title