Image processing method, image processing device, image processing system and medium

Patent metadata

Field	Value
Publication number	US-11127126-B2
Application number	US-201916500538-A
Country	US
Kind code	B2
Filing date	Mar 13, 2019
Priority date	Mar 19, 2018
Publication date	Sep 21, 2021
Grant date	Sep 21, 2021

Abstract

Disclosed is an image processing method, including: determining coordinate values of one or more target pixels in an image, wherein the target pixels are used for dividing the image; carrying out a mapping operation on the coordinate values of the one or more target pixels to obtain first pixel data; reading the image to obtain second pixel data; and combining the first pixel data and the second pixel data to obtain a combined image.

First claim

What is claimed is:

1. An image processing method, including:
determining a coordinate value of one or more target pixels in an image, wherein the target pixel is used to segment the image;
performing a mapping operation on the coordinate value of the one or more target pixels to obtain first pixel data;
obtaining pixel data of the image as second pixel data;
synthesizing the first pixel data and the second pixel data to obtain a synthetic image, wherein the first pixel data is obtained by:
determining a transformation parameter used for the mapping operation; and
as for a coordinate value of each of the one or more target pixels, transforming the coordinate value into a value within a pixel value scope of the image based on the transformation parameter, to obtain the first pixel data.

2. The image processing method according to claim 1 , wherein determining a coordinate value of one or more target pixels in an image comprises:
obtaining a fixation point coordinate value of a user according to an eyeball tracking algorithm;
determining a boundary of a fixation point area, corresponding to the fixation point coordinate value, in the image; and
determining the coordinate value of the target pixel based on the boundary of the fixation point area.

3. The image processing method according to claim 1 , wherein
the first pixel data comprises a quotient obtained by dividing the coordinate value by the transformation parameter and a remainder obtained by dividing the coordinate value by the transformation parameter.

4. The image processing method according to claim 3 , further comprising:
using two adjacent pixel values to represent the first pixel data, wherein the two adjacent pixel values comprise a first pixel value and a second pixel value, wherein
taking the quotient obtained by dividing the coordinate value by the transformation parameter as the first pixel value of the two adjacent pixel values;
taking the remainder obtained by dividing the coordinate value by the transformation parameter as the second pixel value of the two adjacent pixel values.

5. The image processing method according to claim 4 , wherein synthesizing the first pixel data and the second pixel data to obtain a synthetic image comprises:
establishing a new image;
writing the first pixel data into the new image;
writing the second pixel data after the first pixel data;
taking the new image into which data is written as the synthetic image.

6. The image processing method according to claim 1 , further comprising:
determining optical parameters of a display apparatus used for displaying the image before determining the coordinate value of the one or more target pixels;
performing an anti-distortion operation on the image based on the optical parameters of the display apparatus.

7. The image processing method according to claim 6 , wherein the anti-distortion operation comprises:
determining an anti-distortion grid according to the optical parameters of the display apparatus;
generating an anti-distorted image based on the anti-distortion grid.

8. The image processing method according to claim 1 , further comprising:
segmenting the image into a plurality of sub-images based on the coordinate value of one or more target pixels in the image, and adjusting a resolution of at least one sub-image of the plurality of sub-images, so that the resolution of at least one sub-image of the plurality of sub-images is higher than a resolution of other sub-images.

9. The image processing method according to claim 1 , further comprising:
transmitting the synthetic image to a driving unit of the display apparatus, wherein first pixel data in the synthetic image is read by the driving unit, an inverse mapping operation is performed on the first pixel data to obtain the coordinate value of the one or more target pixels, and the coordinate value is used to segment the image into a plurality of sub-images which are drove and displayed respectively.

10. An image processing apparatus, comprising:
a determining unit, configured to determine a coordinate value of one or more target pixels in an image, wherein the target pixel is used to segment the image;
a transforming unit, configured to perform a mapping operation on the coordinate value of the one or more target pixels determined by the determining unit to obtain first pixel data;
an obtaining unit, configured to obtain pixel data of the image as second pixel data; and
a synthesizing unit, configured to synthesize the first pixel data obtained by the transforming unit and the second pixel data obtained by the obtaining unit to obtain a synthetic image,
wherein to obtain the first pixel data, the transforming unit is configured to:
determine a transformation parameter used for the mapping operation; and
as for each of coordinate values of the one or more target pixels, transform the coordinate value into a value within a pixel value scope of the image based on the transformation parameter, to obtain the first pixel data.

11. The image processing apparatus according to claim 10 , wherein the determining unit obtains a fixation point coordinate value of a user according to an eyeball tracking algorithm; determines a boundary of a fixation point area corresponding to the fixation point coordinate value in the image; and determines the coordinate value of the target pixel based on the boundary of the fixation point area.

12. The image processing apparatus according to claim 10 , wherein
the first pixel data comprises a quotient obtained by dividing coordinate value by the transformation parameter and a remainder obtained by dividing the coordinate value by the transformation parameter.

13. The image processing apparatus according to claim 12 , wherein the transforming unit is further configured to use two adjacent pixel values to represent the first pixel data,
wherein the two adjacent pixel values comprise a first pixel value and a second pixel value, wherein
the quotient obtained by dividing the coordinate value by the transformation parameter is taken as the first pixel value of the two adjacent pixel values;
the remainder obtained by dividing the coordinate value by the transformation parameter is taken as the second pixel value of the two adjacent pixel values.

14. The image processing apparatus according to claim 10 , wherein the synthesizing unit is configured to establish a new image; write the first pixel data into the new image; write the second pixel data after the first pixel data; and take the new image into which data is written as the synthetic image.

15. The image processing apparatus according to claim 10 , further comprising:
an anti-distortion unit, configured to determine optical parameters of a display apparatus used for displaying the image before determining the coordinate value of the one or more target pixels, and perform an anti-distortion operation on the image based on the optical parameters of the display apparatus.

16. The image processing apparatus according to claim 15 , wherein the anti-distortion unit is configured to determine an anti-distortion grid according to the optical parameters of the display apparatuses; and generate an anti-distortion image based on the anti-distortion grid.

17. The image processing apparatus according to claim 10 , further comprising:
a multi-resolution rendering unit, configured to segment the image into a plurality of sub-images according to the target pixels, and adjust a resolution of at least one sub-image of the plurality of sub-images, so that the resolution of at lea

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Li Xi
• Zhang Hao
• Chen Lili
• Sun Yukun
• Miao Jinghua
• Wang Xuefeng
• Peng Jinbao
• Zhao Bin
• Suo Jianwen
• Wang Lixin
• Fan Qingwen
• Li Wenyu
• Lu Yuanjie

Classifications

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T7/11

  Region-based segmentation · CPC title

• G06T15/00

  Three-dimensional [3D] image rendering · CPC title

• G06T3/4053 Primary

  based on super-resolution, i.e. the output image resolution being higher than the sensor resolution · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title