Image compression method and apparatus, image display method and apparatus, and medium

Patent metadata

Field	Value
Publication number	US-11917167-B2
Application number	US-202117764359-A
Country	US
Kind code	B2
Filing date	May 8, 2021
Priority date	Jul 31, 2020
Publication date	Feb 27, 2024
Grant date	Feb 27, 2024

Abstract

The present disclosure provides an image compression method, including steps of: acquiring a human-eye fixation point on an original image, and determining a fixation region and a non-fixation region of the original image according to the human-eye fixation point; and compressing the non-fixation region, and generating a compressed image according to the fixation region and the compressed non-fixation region. The present disclosure also provides an image display method, an image compression apparatus, an image display apparatus, and a computer readable medium.

First claim

What is claimed is:

1. An image compression method, comprising steps of:
acquiring a human-eye fixation point on an original image, and determining a fixation region and a non-fixation region of the original image according to the human-eye fixation point; and
compressing the non-fixation region by dividing the non-fixation region into a plurality of image blocks which do not overlap with each other, and rearranging the plurality of image blocks to generate a rearranged region; and
compressing the rearranged region by down-sampling a chrominance channel of the rearranged region in a first direction according to a preset first sampling multiple; and
down-sampling a luminance channel and the chrominance channel of the rearranged region in a second direction according to a preset second sampling multiple;
wherein each image block is rectangular, two of its four sides are parallel to a horizontal direction, the other two sides are parallel to a vertical direction, the first direction is one of the horizontal direction and the vertical direction, and the second direction is the other of the horizontal direction and the vertical direction; the first sampling multiple is greater than the second sampling multiple; and
generating a compressed image according to the fixation region and the compressed non-fixation region.

2. The image compression method of claim 1 , wherein the step of acquiring a human-eye fixation point on an original image comprises: acquiring a user-side image comprising eyes of a user, and detecting a state of the eyes according to the user-side image to determine the human-eye fixation point.

3. The image compression method of claim 1 , wherein the step of determining a non-fixation region of the original image according to the human-eye fixation point comprises steps of: determining, as the fixation region, a region with a symmetrical center being the human-eye fixation point and having a predetermined shape with a predetermined size; and determining the remaining portion of the original image as the non-fixation region.

4. The image compression method of claim 3 , wherein the original image is rectangular; and the step of determining, as the fixation region, a region with a symmetrical center being the human-eye fixation point and having a predetermined shape with a predetermined size comprises: determining the fixation region according to a preset length and width by taking the human- eye fixation point as the symmetric center.

5. The image compression method of claim 1 , wherein the original image, the fixation region, each image block, the rearranged region, and the compressed image, each are rectangular.

6. The image compression method of claim 1 , before the step of down-sampling a chrominance channel of the rearranged region in a first direction according to a preset first sampling multiple, further comprising: converting a color space of the rearranged region into a YUV space if the color space of the rearranged region is not the YUV space.

7. An image display method, comprising steps of:
generating a compressed image using the image compression method of claim 1 ;
decompressing the compressed non-fixation region to obtain a restored original image; and
displaying the restored original image.

8. The image display method of claim 7 , between the step of generating a compressed image and the step of decompressing the compressed non-fixation region, further comprising: transmitting, by an application processor of an apparatus for implementing the image display method, the compressed image to a display controller.

9. The image display method of claim 7 , wherein the step of decompressing the compressed non-fixation region comprises: decompressing the compressed non-fixation region through nearest neighbor interpolation or bilinear interpolation.

10. The image display method of claim 7 , wherein after the step of decompressing the compressed non-fixation region, the image display method further comprises: recombining the compressed rearranged region to restore each image block.

11. The image display method of claim 10 , wherein the fixation region is rectangular, two of four sides of the fixation region are parallel to a horizontal direction and the other two sides are parallel to a vertical direction, and each image block is rectangular; the method further comprises steps of: adjusting the restored original image for display, if a display resolution of a display unit is greater than an image resolution of the restored original image; wherein the fixation region is rendered according to the display resolution, down-sampling is performed on the fixation region in the horizontal direction according to a ratio of the image resolution to the display resolution, and display is performed by enabling one row at one time in the vertical direction; image blocks in the same column as the fixation region are rendered according to the display resolution, down-sampling is performed on the image blocks in the horizontal direction according to the ratio of the image resolution to the display resolution, and display is performed by enabling multiple rows at one time in the vertical direction; up-sampling is performed on image blocks in the same row as the fixation region in the horizontal direction according to the ratio of the image resolution to the display resolution, and display is performed by enabling one row at one time in the vertical direction; and up-sampling is performed on remaining image blocks in the horizontal direction according to the ratio of the image resolution to the display resolution, and display is performed by enabling multiple rows at one time in the vertical direction.

12. An image compression apparatus, comprising:
one or more processors; and
a storage unit configured to store one or more programs;
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the image compression method of claim 1 .

13. An image display apparatus, comprising:
one or more processors;
a storage unit configured to store one or more programs; and
a display unit;
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the image display method of claim 7 , such that the display unit displays the restored original image.

14. The image display apparatus of claim 13 , wherein the image display apparatus is a virtual reality apparatus or an augmented reality apparatus.

15. A Non-transitory computer readable medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the image compression method of claim 1 .

16. A Non-transitory computer readable medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the image display method of claim 7 .

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Ji Zhihua
• Shi Tiankuo
• Zhang Xiaomang
• Kung Chingwen
• Liu Rui
• Hou Yifan
• Chu Minglei
• Xi Yanhui
• Sun Yan
• Zhao Chenxi
• Peng Xiangjun
• Zhang Shuo

Classifications

• H04N19/172 Primary

  the region being a picture, frame or field · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/42 Primary

  characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation (H04N19/635 takes precedence) · CPC title

• H04N19/132 Primary

  Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title