Information processing method, information processing apparatus and user equipment

Patent metadata

Field	Value
Publication number	US-10775883-B2
Application number	US-201615197679-A
Country	US
Kind code	B2
Filing date	Jun 29, 2016
Priority date	Jun 30, 2015
Publication date	Sep 15, 2020
Grant date	Sep 15, 2020

Abstract

An information processing method, an information processing apparatus and a user equipment are provided. A method comprises: acquiring eye movement information related to that at least one eye of a user gazes a user equipment; and determining relative movement information of the user equipment relative to the head of the user at least according to a non-saccade eye movement part in the eye movement information. Relative movement between a user equipment and the head of a user can be determined according to a non-saccade eye movement part(s) of eye movement information related to the user gazes the user equipment, providing a basis for increasing the accuracy of compensation corresponding to the relative movement.

First claim

What is claimed is:

1. A method, comprising:
acquiring, by a system comprising a processor, eye movement information related to determining that an eye of a user gazes at a user equipment, wherein the eye movement information is Electro-Oculogram (EOG) information;
processing the eye movement information according to pre-learned EOG feature information associated with eye movements, to obtain a non-saccade eye movement part, wherein the non-saccade eye movement part comprises:
a smooth pursuit eye movement part corresponding to a smooth pursuit eye movement in the eye movement information, which is a movement of the eye tracking and observing an object moving relative to the user, a fixation eye movement part corresponding to a fixation eye movement in the eye movement information, which is an action of the eye observing an object stationary relative to the user, or both; and

determining relative movement information of the user equipment relative to a head of the user at least according to the non-saccade eye movement part in the eye movement information, wherein the determining the relative movement information at least according to the non-saccade eye movement part comprises:
determining the relative movement information at least according to the non-saccade eye movement part and movement information of the user equipment corresponding to the period corresponding to the non-saccade eye movement part, wherein the determining the relative movement information at least according to the non-saccade eye movement part and the movement information comprises:
determining eye movement components of the non-saccade eye movement part corresponding to a movement feature of the movement information comprising:
determining a part where eye movement information change frequencies in the non-saccade eye movement part match movement change frequency feature of the movement information; and

determining the relative movement information at least according to the eye movement components, wherein the movement feature comprises at least one of: a movement change frequency feature, a movement change amplitude feature or a movement change phase feature,
wherein the relative movement information comprises a difference between the part of the non-saccade eye movement part and eye movement information corresponding to the movement change frequency feature of the movement information.

2. The method of claim 1 , wherein the determining the relative movement information at least according to the non-saccade eye movement part further comprises:
determining the relative movement information at least according to the non-saccade eye movement part and a reference non-saccade eye movement information.

3. The method of claim 1 , further comprising:
before the determining the relative movement information at least according to the non-saccade eye movement part, acquiring the movement information.

4. The method of claim 1 , wherein the determining the relative movement information at least according to the non-saccade eye movement part further comprises:
determining the relative movement information at least according to the non-saccade eye movement part and content display information of the user equipment.

5. The method of claim 1 , further comprising:
adjusting a display of a display content of the user equipment according to the relative movement information.

6. The method of claim 5 , wherein the adjusting the display of the display content of the user equipment according to the relative movement information further comprises:
determining a display shifting parameter of the display content of the user equipment according to the relative movement information; and
displaying the display content according to the display shifting parameter, wherein the display shifting parameter is configured to perform display stabilizing compensation on a relative movement corresponding to the relative movement information.

7. The method of claim 1 , further comprising:
in response to determining that the user equipment is in a self-snapshot image capturing state, adjusting a shooting parameter of the user equipment according to the relative movement information, to perform shooting shake compensation on a relative movement corresponding to the relative movement information.

8. An apparatus, comprising:
a memory that stores executable modules; and
a processor, coupled to the memory, that executes or facilitates execution of the executable modules, the executable modules comprising:
an eye movement information acquisition module configured to acquire eye movement information related to a determination that at least one eye of a user gazes at a user equipment, wherein the eye movement information is Electro-Oculogram (EOG) information;
an eye movement information processing module configured to process the eye movement information according to pre-learned EOG feature information associated with eye movements, to obtain a non-saccade eye movement part, wherein the non-saccade eye movement part comprises a smooth pursuit eye movement part corresponding to a smooth pursuit eye movement in the eye movement information, which is a movement of an eye of the at least one eye tracking and observing an object moving relative to the user, a fixation eye movement part corresponding to a fixation eye movement in the eye movement information, which is an action of the eye observing an object stationary relative to the user, or both; and
a relative movement determination module configured to determine relative movement information of the user equipment relative to a head of the user at least according to the non-saccade eye movement part in the eye movement information, wherein the relative movement determination module comprises:
a determination unit configured to determine the relative movement information at least according to the non-saccade eye movement part and movement information of the user equipment corresponding to a period corresponding to the non-saccade eye movement part, wherein the determination unit comprises:
a first determination sub-unit configured to determine eye movement components of the non-saccade eye movement part corresponding to at least one movement feature of the movement information comprising:
 determine a part where eye movement information change frequencies in the non-saccade eye movement part match movement change frequency feature of the movement information; and
a second determination sub-unit configured to determine the relative movement information at least according to the eye movement components, wherein the at least one movement feature comprises at least one of: a movement change frequency feature, a movement change amplitude feature or a movement change phase feature,
wherein the relative movement information comprises a difference between the part of the non-saccade eye movement part and eye movement information corresponding to the movement change frequency feature of the movement information.

9. The apparatus of claim 8 , wherein the relative movement determination module further comprises:
a determination unit configured to determine the relative movement information at least according to the non-saccade eye movement part and at least one reference non-saccade eye movement information.

10. The apparatus of claim 8 , wherein the executable modules further comprise:
a movement information acquisition module configured to acquire the movement information.

11. The apparatus of claim 8 , wherein the relative movement determination module further comprises:
a determination unit configured to determine the relative movement information at least according to the non-saccade eye m

Assignees

• Beijing Zhigu Ruituo Tech Co Ltd

Inventors

• Ding Dayong

Classifications

• G09G5/00 Primary

  Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) · CPC title

• G09G2340/0464

  Positioning · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title

• G09G2354/00

  Aspects of interface with display user · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title