Image encoding apparatus, image encoding method, and recording medium

Patent metadata

Field	Value
Publication number	US-9986239-B2
Application number	US-201414780114-A
Country	US
Kind code	B2
Filing date	Jan 27, 2014
Priority date	Mar 27, 2013
Publication date	May 29, 2018
Grant date	May 29, 2018

Abstract

Provided is an image encoding apparatus capable of encoding a region important to a user with high quality. An update interval index calculation unit calculates an update interval index representing an index having a long update interval in an entire update tile overlapping the update region for each update region. An importance region specification unit specifies an important region, from each update region by using the update interval index. An quality control unit allocates a code amount, which is larger than a result obtained by dividing the total target code amount per one frame proportionally according to a ratio of an area of an entire important region with respect to an area of an entire update region, as a target code amount of the entire important region and specifies a quality value of the entire important region on the basis of the target code amount.

First claim

The invention claimed is:

1. An image encoding apparatus comprising circuitry configured to:
store an update time of a tile which is a region obtained by dividing a frame of an image into a predetermined size;
detect an update tile, which is a tile in which update occurs between a latest frame and a frame before the latest frame, and an update region, which is a region where update occurs, when the latest frame of the image has been provided;
calculate an update interval index representing an index having a long update interval in an entire update tile overlapping the update region, for each update region;
specify an important region from each update region by using the update interval index;
calculate a proportional division result by dividing a total target code amount, per one frame, proportionally according to a ratio defined as an area of an entirety of the important region to an area of an entirety of the update region;
allocate a code amount, as an amount larger than the proportional division result, to be a target code amount of the entire important region, and specify a quality value of the entire important region on the basis of the target code amount; and
encode the entire important region with the quality value.

2. The image encoding apparatus according to claim 1 , wherein the circuitry is further configured to:
update and hold a quality value of a tile when a quality value for at least a part of regions in the tile has been decided;
select a low quality tile that is a tile having a quality value equal to or less than a threshold value among tiles other than the update tile,
in the specifying an important region, calculate the importance of each update region by using the update interval index, specify an important region from each update region on the basis of the importance, and calculate the importance of each tile, other than the update tile, by using a passage time from an update time,
in the specifying a quality value, decide a quality value of an entire unimportant region when encoding the entire unimportant region, which is a region not related to an important region of the update regions, as an initial value of the quality value of the entire unimportant region by using a code amount obtained by excluding a code amount when encoding the entire important region from a total target code amount per one frame, sequentially reducing a quality value of the entire unimportant region from the initial value,
calculate a number of low quality tiles to be able to be subject to intra update, and
specify the quality value of the entire unimportant region when quality of an unimportant region and an entire low quality tile to be able to be subject to intra update is estimated to be maximum;
encode the entire unimportant region with the quality value; and
encode low quality tiles to be able to be subject to the intra update with a quality value for the intra update in an importance order.

3. The image encoding apparatus according to claim 2 , wherein the circuitry is further configured to:
calculate character likelihood representing likelihood related to a display region of a character for each tile and decides character likelihood of each update region, and
wherein, in the specifying an important region, calculate the importance of each update region by using the update interval index and the character likelihood and calculates the importance of the tile by using the passage time from the update time and the character likelihood.

4. The image encoding apparatus according to claim 2 , wherein the circuitry is further configured to:
calculate a pointer proximity, which is a reciprocal of a distance between a central coordinate of a tile and a predetermined coordinate at a time of update when the update has occurred in the tile within a constant time from an operation from an exterior to the predetermined coordinate, and
wherein, in the specifying an important region, calculate the importance of the tile by using the passage time from the update time and the pointer proximity.

5. The image encoding apparatus according to claim 3 , wherein the circuitry is further configured to:
calculate a pointer proximity, which is a reciprocal of a distance between a central coordinate of a tile and a predetermined coordinate at a time of update when the update has occurred in the tile within a constant time from an operation from an exterior to the predetermined coordinate, and
wherein, in the specifying an important region, calculate the importance of the tile by using the passage time from the update time and the pointer proximity.

6. The image encoding apparatus according to claim 1 , wherein, when the ratio of the area of the entire important region with respect to the area of the entire update region is equal to or more than a predetermined value, in the specifying an important region, the circuitry is further configured to decide the entire update region as an unimportant region.

7. The image encoding apparatus according to claim 2 , wherein, when the ratio of the area of the entire important region with respect to the area of the entire update region is equal to or more than a predetermined value, in the specifying an important region, the circuitry is further configured to decide the entire update region as an unimportant region.

8. The image encoding apparatus according to claim 3 , wherein, when the ratio of the area of the entire important region with respect to the area of the entire update region is equal to or more than a predetermined value, in the specifying an important region, the circuitry is further configured to decide the entire update region as an unimportant region.

9. The image encoding apparatus according to claim 4 , wherein, when the ratio of the area of the entire important region with respect to the area of the entire update region is equal to or more than a predetermined value, in the specifying an important region, the circuitry is further configured to decide the entire update region as an unimportant region.

10. The image encoding apparatus according to claim 1 , wherein, for each update region, in the calculating an update interval index, the circuitry is further configured to calculate, as the update interval index, a long update interval tile occupation rate, which is a rate of a number of tiles having an update interval equal to or more than a threshold value, among a number of update tiles overlapping the update region.

11. The image encoding apparatus according to claim 2 , wherein, for each update region, in the calculating an update interval index, the circuitry is further configured to calculate as the update interval index, a long update interval tile occupation rate, which is a rate of a number of tiles having an update interval equal to or more than a threshold value, among a number of update tiles overlapping the update region.

12. The image encoding apparatus according to claim 3 , wherein, for each update region, in the calculating an update interval index, the circuitry is further configured to calculate as the update interval index, a long update interval tile occupation rate, which is a rate of a number of tiles having an update interval equal to or more than a threshold value, among a number of update tiles overlapping the update region.

13. The image encoding apparatus according to claim 4 , wherein, for each update region, in the calculating an update interval index, the circuitry is further configured to calculate as the update interval index, a long update interval tile occupation rate, which is a rate of a number of tiles having an update interval equal to or more than a threshold value, amon

Assignees

• Nec Corp

Inventors

• Takada Jun

Classifications

• H04N19/115 Primary

  Selection of the code volume for a coding unit prior to coding · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/174

  the region being a slice, e.g. a line of blocks or a group of blocks · CPC title