Display method, display device, display system and storage medium

Patent metadata

Field	Value
Publication number	US-11715425-B2
Application number	US-202117556678-A
Country	US
Kind code	B2
Filing date	Dec 20, 2021
Priority date	Jan 14, 2021
Publication date	Aug 1, 2023
Grant date	Aug 1, 2023

Abstract

A display method, a display device, a display system, and a storage medium are provided. The display method includes: obtaining a first fixation coordinate transmitted by an image acquisition device, and obtaining a second fixation coordinate and a current frame of image that are transmitted by a first processor; performing refresh and display by using the current frame of image; determining a type of the current frame of image, and determining, based on the type, whether the first fixation coordinate changes abnormally; and performing refresh and display by using a previous frame of image for non-fixation region in a case that the first fixation coordinate changes abnormally, and performing refresh and display by using a next frame of image transmitted by the first processor in a case that the first fixation coordinate does not change abnormally.

First claim

What is claimed is:

1. A display method, comprising:
obtaining a first fixation coordinate transmitted by an image acquisition device, and dividing a region of a display panel of a display device into a fixation region and a non-fixation region according to the first fixation coordinate, wherein the first fixation coordinate is an eye fixation coordinate collected through the image acquisition device and transmitted to the display device;
obtaining a second fixation coordinate and a current frame of image that are transmitted by a first processor, wherein the current frame of image is an image for fixation region or an image for non-fixation region generated by the first processor based on the second fixation coordinate, wherein the image for fixation region is an image to be displayed in the fixation region of the display panel or the image for non-fixation region is an image to be displayed in the non-fixation region of the display panel, and the second fixation coordinate is an eye fixation coordinate collected through the image acquisition device and transmitted to the first processor;
performing refresh and display by using the current frame of image;
determining a type of the current frame of image, and determining, based on the type, whether the first fixation coordinate changes abnormally; and
performing refresh and display by using a previous frame of image for non-fixation region in a case that the first fixation coordinate changes abnormally, and performing refresh and display by using a next frame of image transmitted by the first processor in a case that the first fixation coordinate does not change abnormally;
wherein the determining the type of the current frame of image, and determining, based on the type, whether the first fixation coordinate changes abnormally comprises:
in a case that the type of the current frame of image is the image for fixation region, after the number of rows refreshed for display is greater than a first preset value and when a first preset condition is met, determining that the first fixation coordinate changes abnormally;
in a case that the type of the current frame of image is the image for non-fixation region, after the number of rows refreshed for display is greater than a second preset value and when a second preset condition is met, determining that the first fixation coordinate changes abnormally.

2. The display method according to claim 1 , wherein, the determining that the first fixation coordinate changes abnormally when the first preset condition is met comprises:
when the first fixation coordinate is updated and a value of a difference between the updated first fixation coordinate and the second fixation coordinate is greater than a first threshold, determining whether the next frame of image is an image for fixation region; and
when the next frame of image is the image for fixation region, and the value of the difference is greater than a second threshold, determining that the first fixation coordinate changes abnormally.

3. The display method according to claim 2 , wherein the second preset condition comprises: the first fixation coordinate is updated; and the next frame of image is an image for fixation region, and a value of a difference between the updated first fixation coordinate and the second fixation coordinate is greater than a third threshold.

4. The display method according to claim 1 , wherein in a case that the current frame of image is the image for fixation region, the performing refresh and display by using the current frame of image comprises:
scanning, by a row scan controller, pixels in each row for the image for fixation region, and turning off a column scan controller corresponding to an image for non-fixation region in the same row as the image for fixation region.

5. The display method according to claim 1 , wherein in a case that the current frame of image is the image for non-fixation region, the performing refresh and display by using the current frame of image comprises:
scanning, by a row scan controller, according to a preset number of rows simultaneously to perform refresh by using the image for non-fixation region so as to display the image for non-fixation region in pixels in the non-fixation region of the entire display panel of the display device, and storing the current frame of image for non-fixation region.

6. The display method according to claim 1 , wherein in a case that the number of images for fixation region continuously used for performing refresh and display reaches a preset number of frames, performing refresh and display by using a previous frame of image for non-fixation region.

7. A display device, comprising a display panel, a memory, and a second processor, wherein the memory stores a program, and the program, when executed by the second processor, performs the following steps:
obtaining a first fixation coordinate transmitted by an image acquisition device, and dividing a region of the display panel of the display device into a fixation region and a non-fixation region according to the first fixation coordinate, wherein the first fixation coordinate is an eye fixation coordinate collected through the image acquisition device and transmitted to the display device;
obtaining a second fixation coordinate and a current frame of image that are transmitted by a first processor, wherein the current frame of image is an image for fixation region or an image for non-fixation region generated by the first processor based on the second fixation coordinate, wherein the image for fixation region is an image to be displayed in the fixation region of the display panel or the image for non-fixation region is an image to be displayed in the non-fixation region of the display panel, and the second fixation coordinate is an eye fixation coordinate collected through the image acquisition device and transmitted to the first processor;
performing refresh and display by using the current frame of image;
determining a type of the current frame of image, and determining, based on the type, whether the first fixation coordinate changes abnormally; and
performing refresh and display by using a previous frame of image for non-fixation region in a case that the first fixation coordinate changes abnormally, and performing refresh and display by using a next frame of image transmitted by the first processor in a case that the first fixation coordinate does not change abnormally;
wherein the determining the type of the current frame of image, and determining, based on the type, whether the first fixation coordinate changes abnormally comprises:
in a case that the type of the current frame of image is the image for fixation region, after the number of rows refreshed for display is greater than a first preset value and when a first preset condition is met, determining that the first fixation coordinate changes abnormally;
in a case that the type of the current frame of image is the image for non-fixation region, after the number of rows refreshed for display is greater than a second preset value and when a second preset condition is met, determining that the first fixation coordinate changes abnormally.

8. The display device according to claim 7 ,
wherein, the determining that the first fixation coordinate changes abnormally when the first preset condition is met comprises:
when the first fixation coordinate is updated and a value of a difference between the updated first fixation coordinate and the second fixation coordinate is greater than a first threshold, determining whether the next frame of image is an image for fixation region; and
when the next frame of image is the image for fixation region, and the value of the difference is greater than a second threshold, d

Assignees

• Beijing Boe Optoelectronics Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Shi Tiankuo
• Hou Yifan
• Ji Zhihua
• Zhang Xiaomang
• Sun Wei
• Liu Rui
• Chu Minglei
• Dong Xue
• Zhang Hao
• Chen Lili

Classifications

• G09G3/3266 Primary

  Details of drivers for scan electrodes · CPC title

• G09G3/3618

  with automatic refresh of the display panel using sense/write circuits · CPC title

• G09G5/001

  Arbitration of resources in a display system, e.g. control of access to frame buffer by video controller and/or main processor · CPC title

• G09G2360/18

  Use of a frame buffer in a display terminal, inclusive of the display panel · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title