Image processing method and apparatus, virtual reality apparatus, and computer-program product

Patent metadata

Field	Value
Publication number	US-10768879-B2
Application number	US-201816346213-A
Country	US
Kind code	B2
Filing date	Nov 26, 2018
Priority date	Mar 6, 2018
Publication date	Sep 8, 2020
Grant date	Sep 8, 2020

Abstract

An image processing method. The method includes determining a first mapping relationship between first coordinates in a first coordinate system of a Multi-Resolution-Shading image and second coordinates in a second coordinate system of a Multi-Resolution-Shading screen image; and applying an anti-distortion process to the Multi-Resolution-Shading image based on the first mapping relationship, thereby obtaining an anti-distortion image.

First claim

What is claimed is:

1. An image processing method, comprising:
determining a first mapping relationship between first coordinates in a first coordinate system of a Multi-Resolution-Shading image and second coordinates in a second coordinate system of a Multi-Resolution-Shading screen image;
applying an anti-distortion process to the Multi-Resolution-Shading image based on the first mapping relationship, thereby obtaining an anti-distortion image;
sending the anti-distortion image to a display apparatus;
applying an image flattening process by the display apparatus to the anti-distortion image thereby obtaining a flattened anti-distortion image; and
displaying the flattened anti-distortion image;
wherein determining the first mapping relationship comprises:
determining a second mapping relationship between third coordinates in a third coordinate system of an original image and fourth coordinates in a fourth coordinate system of a screen image;
determining a third mapping relationship between the third coordinates of the third coordinate system of the original image and the first coordinates of the first coordinate system of the Multi-Resolution-Shading image;
determining a fourth mapping relationship between the first coordinates of the first coordinate system of the Multi-Resolution-Shading image and the fourth coordinates of the fourth coordinate system of the screen image based on the second mapping relationship and the third mapping relationship;
applying a Multi-Resolution-Shading Process to the fourth coordinates in the fourth coordinate system of the screen image based on the third mapping relationship, thereby obtaining the second coordinates in the second coordinate system of the Multi-Resolution-Shading screen image; and
determining the first mapping relationship using based on the fourth mapping relationship and the second coordinates of the second coordinate system of the Multi-Resolution-Shading screen image;
wherein applying the Multi-Resolution-Shading Process to the fourth coordinates in the fourth coordinate system of the screen image comprises:
determining a gaze position in the screen image;
separating the screen image into a high-resolution region and a plurality of low-resolution regions based on the gaze position in the screen image; and
applying Multi-Resolution-Shading Process to the fourth coordinates in a fourth coordinate system of a plurality of regions of the screen image including the high-resolution region and the plurality of low-resolution regions in the screen image based on the third mapping relationship, thereby obtaining the second coordinates in the second coordinate system of the Multi-Resolution-Shading screen image.

2. The image processing method of claim 1 , wherein the third mapping relationship is expressed as:

{

x
′

=

x
*
Width

+
TopLeftX

W
mrs

y
′

=

y
*
Height

+

TopLeft
⁢

⁢
Y

H
mrs

;

wherein x is a horizontal coordinate value of a pixel in third coordinates of the third coordinate system of the original image, y is a vertical coordinate value of a pixel in the third coordinates of the third coordinate system of the original image, x′ is a horizontal coordinate value of a pixel in first coordinates of the first coordinate system of the Multi-Resolution-Shading image, y′ is a vertical coordinate value of a pixel in the first coordinates of the first coordinate system of the Multi-Resolution-Shading image, Width and Height represent a resolution of a region of the Multi-Resolution-Shading image having the pixel, Wmrs and Hmrs represent a resolution of the Multi-Resolution-Shading image, TopLeftX and TopLeftY are respectively a horizontal coordinate value and a vertical coordinate value of a vertices of a top left corner of the region of the Multi-Resolution-Shading image having the pixel.

3. The image processing method of claim 1 , wherein determining the gaze position in the screen image comprises:
determining the gaze position in the screen image is performed according to:

{

o
=

s
⁡

(

o
⁢

⁢
2

-

o
⁢

⁢
1

)

+

t
⁡

(

o
⁢

⁢
3

-

o
⁢

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Sun Yukun
• Zhang Hao
• Chen Lili
• Miao Jinghua
• Wang Xuefeng
• Li Wenyu
• Zhao Bin
• Li Xi
• Wang Lixin
• Suo Jianwen
• Peng Jinbao
• Fan Qingwen
• Liu Yali
• Lei Yu
• Wang Yakun

Classifications

• G06F3/1415 Primary

  with means for detecting differences between the image stored in the host and the images displayed on the displays · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title

• G06F3/147

  using display panels · CPC title

• G09G2320/08

  Arrangements within a display terminal for setting, manually or automatically, display parameters of the display terminal · CPC title

• G06T15/80

  Shading · CPC title