Display control method, display control apparatus and user equipment

Patent metadata

Field	Value
Publication number	US-11256326-B2
Application number	US-201615197687-A
Country	US
Kind code	B2
Filing date	Jun 29, 2016
Priority date	Jun 30, 2015
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

A display control method, a display control apparatus and a user equipment are provided. A method comprises acquiring eye movement information related to that at least one eye of a user gazes a user equipment; and adjusting display of a display content of the user equipment at least according to a non-saccade eye movement part in the eye movement information. A display content of a user equipment can be adjusted according to a non-saccade eye movement part of the user equipment gazed by a user, to enable relative movement between the head of the user and the adjusted display content to disappear or decrease, thus improving the user's reading experience in a scenario of having relative movement with the user equipment.

First claim

What is claimed is:

1. A method, comprising:
acquiring, by a system comprising a processor, eye movement information related to determining that an eye of a user gazes at user equipment, wherein the eye movement information is Electro-Oculogram (EOG) information;
processing, by the system, the eye movement information which comprises a saccade eye movement part and a non-saccade eye movement part according to pre-learned EOG feature information associated with eye movements, to obtain the non-saccade eye movement part, wherein:
the saccade eye movement part corresponds to a process of the eye changing from one observed object to another observed object;
the non-saccade eye movement part comprises:
a smooth pursuit eye movement part that corresponds to a movement of the eye tracking and observing an object moving relative to the user,
a fixation eye movement part that corresponds to an action of the eye observing an object stationary relative to the user, or
both the smooth pursuit eye movement part and the fixation eye movement part; and

the fixation eye movement part and the smooth pursuit eye movement part are eye movement parts corresponding to that the user intentionally gazes the object; and

adjusting, by the system, a display of a display content of the user equipment at least according to the non-saccade eye movement part of the eye movement information, wherein the adjusting the display of the display content of the user equipment at least according to the non-saccade eye movement part comprises:
determining relative movement information between a head of the user and the user equipment at least according to the non-saccade eye movement part; and
adjusting the display of the display content according to the relative movement information, wherein the determining the relative movement information at least according to the non-saccade eye movement part comprises:
determining the relative movement information at least according to the non-saccade eye movement part and movement information of the user equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein the determining the relative movement information at least according to the non-saccade eye movement part and the movement information comprises:
determining eye movement components of the non-saccade eye movement part corresponding to a movement feature of the movement information, comprising:
 determining a part where eye movement information change frequencies in the non-saccade eye movement part match movement change frequency feature of the movement information; and
determining the relative movement information at least according to the eye movement components, wherein the movement feature comprises at least one of: a movement change frequency feature, a movement change amplitude feature or a movement change phase feature wherein the relative movement information comprises a difference between the part of the non-saccade eye movement part and eye movement information corresponding to the movement change frequency feature of the movement information.

2. The method of claim 1 , wherein the adjusting the display of the display content of the user equipment at least according to the non-saccade eye movement part further comprises:
determining a display shifting parameter of the display content of the user equipment at least according to the non-saccade eye movement part; and
displaying the display content according to the display shifting parameter, wherein the display shifting parameter is configured to perform display stabilizing compensation on a relative movement between the head of the user and the user equipment corresponding to the non-saccade eye movement part.

3. The method of claim 1 , wherein the determining the relative movement information at least according to the non-saccade eye movement part further comprises:
determining the relative movement information at least according to the non-saccade eye movement part and at least one reference to non-saccade eye movement information.

4. The method of claim 1 , further comprising:
before the determining the relative movement information at least according to the non-saccade eye movement part, acquiring the movement information.

5. The method of claim 1 , wherein the determining the relative movement information at least according to the non-saccade eye movement part further comprises:
determining the relative movement information at least according to the non-saccade eye movement part and content display information of the user equipment.

6. The method of claim 1 , wherein the adjusting the display further comprises:
in response to determining a display shifting parameter of the display content according to the non-saccade eye movement part, displaying the display content according to the display shifting parameter, wherein the display shifting parameter enables display stabilizing compensation of a relative movement corresponding to the non-saccade eye movement part.

7. The method of claim 1 , wherein the adjusting the display further comprises:
in response to determining the relative movement information between the head of the user and the user equipment at least according to the non-saccade eye movement part, adjusting the display of the display content according to the relative movement information.

8. An apparatus, comprising:
a memory that stores executable modules; and
a processor, coupled to the memory, that executes or facilitates execution of the executable modules, the executable modules comprising:
an eye movement information acquisition module configured to acquire eye movement information related to a determination that at least one eye of a user is gazing at user equipment, wherein the eye movement information is Electro-Oculogram (EOG) information;
an eye movement information processing module configured to process the eye movement information which comprises a saccade eye movement part and a non-saccade eye movement part according to pre-learned EOG feature information associated with eye movements, to obtain the non-saccade eye movement part, wherein:
the saccade eye movement part corresponds to a process of the at least one eye changing from one observed object to another observed object;
the non-saccade eye movement part comprises at least one of:
a smooth pursuit eye movement part that corresponds to a movement of the at least one eye tracking and observing an object moving relative to the user, or
a fixation eye movement part that corresponds to an action of the at least one eye observing an object stationary relative to the user; and

the fixation eye movement part and the smooth pursuit eye movement part are eye movement parts corresponding to that the user intentionally gazes the object; and

a display adjustment module configured to adjust a display of a display content of the user equipment at least according to the non-saccade eye movement part in the eye movement information, wherein the display adjustment module comprises:
a relative movement determination sub-module configured to determine relative movement information between a head of the user and the user equipment at least according to the non-saccade eye movement part; and
a display adjustment sub-module configured to adjust the display of the display content according to the relative movement information, wherein the relative movement determination sub-module comprises:
a determination unit configured to determine the relative movement information at least according to the non-saccade eye movement part and movement information of the user equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein the determination unit comprises:
 a fir

Assignees

• Beijing Zhigu Ruituo Tech Co Ltd

Inventors

• Ding Dayong

Classifications

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title

• G06F3/012

  Head tracking input arrangements · CPC title

• G09G2340/0464

  Positioning · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title