Interaction method, interaction apparatus and user equipment

Patent metadata

Field	Value
Publication number	US-10108259-B2
Application number	US-201615219731-A
Country	US
Kind code	B2
Filing date	Jul 26, 2016
Priority date	Jul 31, 2015
Publication date	Oct 23, 2018
Grant date	Oct 23, 2018

Abstract

Embodiments of this application disclose an interaction method, an interaction apparatus and a user equipment, where the interaction method comprises: acquiring first gazing information of at least one eye of a user when watching a virtual presentation object on a location in a gazing direction, and second gazing information of the at least one eye of the user when watching a physical object on the location in the gazing direction; and in response to that a difference between the first gazing information and the second gazing information is out of a set error range, executing an operation. In the embodiments of this application, a presentation location of the virtual presentation object may be associated with a location of the physical object in an environment accurately and conveniently by means of gazing of the user.

First claim

What is claimed is:

1. An interaction method, comprising:
acquiring first gazing information of at least one eye of a user when watching a virtual presentation object on a location in a gazing direction, and second gazing information of the at least one eye of the user when watching a physical object on the location in the gazing direction; and
in response to that a difference between the first gazing information and the second gazing information is out of a set error range, executing an operation.

2. The method of claim 1 , wherein the acquiring the first gazing information comprises:
presenting the virtual presentation object to the at least one eye at a virtual presentation distance and in the gazing direction; and
acquiring the first gazing information of the at least one eye.

3. The method of claim 1 , wherein the acquiring the first gazing information and the second gazing information comprises:
presenting the virtual presentation object to the at least one eye at a virtual presentation distance and in a presentation direction;
acquiring the first gazing information and the gazing direction of the at least one eye; and
weakening or eliminating presentation of the virtual presentation object, and acquiring the second gazing information that is of the at least one eye and that is in the gazing direction.

4. The method of claim 1 , wherein the acquiring the first gazing information and the second gazing information comprises:
acquiring the gazing direction and the second gazing information of the at least one eye;
determining a presentation direction of the virtual presentation object corresponding to the gazing direction according to the gazing direction;
presenting the virtual presentation object to the at least one eye at a virtual presentation distance and in the presentation direction; and
acquiring the first gazing information.

5. The method of claim 1 , wherein
the first gazing information comprises: first gazing distance information; and
the second gazing information comprises: second gazing distance information.

6. The method of claim 1 , wherein
the first gazing information comprises: first electro-ocular information; and
the second gazing information comprises: second electro-ocular information.

7. The method of claim 1 , wherein the at least one eye comprises two eyes.

8. The method of claim 7 , wherein
the first gazing information comprises: first gazing angle information; and
the second gazing information comprises: second gazing angle information.

9. The method of claim 1 , wherein the operation comprises:
an operation related to a virtual presentation distance corresponding to the virtual presentation object.

10. The method of claim 1 , wherein the executing the operation comprises:
adjusting a virtual presentation distance corresponding to the virtual presentation object.

11. The method of claim 10 , wherein the executing the operation comprises:
adjusting the virtual presentation distance according to the difference.

12. The method of claim 10 , wherein the method further comprises:
determining a location of the physical object relative to the user according to the gazing direction and the adjusted virtual presentation distance.

13. The method of claim 1 , wherein the executing the operation comprises:
determining a location of the physical object relative to the user according to the gazing direction, a virtual presentation distance corresponding to the virtual presentation object and the difference.

14. The method of claim 1 , wherein the method further comprises:
in response to that the difference is within the error range, determining a location of the physical object relative to the user according to the gazing direction and a virtual presentation distance corresponding to the virtual presentation object.

15. An interaction apparatus, comprising:
an information acquiring module, configured to acquire first gazing information of at least one eye of a user when watching a virtual presentation object on a location in a gazing direction, and second gazing information of the at least one eye of the user when watching a physical object on the location in the gazing direction; and
a first processing execution module, configured to: in response to that a difference between the first gazing information and the second gazing information is out of a set error range, execute an operation.

16. The apparatus of claim 15 , wherein the information acquiring module comprises:
a virtual presentation unit, configured to present the virtual presentation object to the at least one eye at a virtual presentation distance and in the gazing direction; and
an information acquiring unit, configured to acquire the first gazing information of the at least one eye on a condition that the virtual presentation unit presents the virtual presentation object.

17. The apparatus of claim 15 , wherein
the first gazing information comprises: first gazing distance information; and
the second gazing information comprises: second gazing distance information.

18. The apparatus of claim 15 , wherein
the first gazing information comprises: first electro-ocular information; and
the second gazing information comprises: second electro-ocular information.

19. The apparatus of claim 15 , wherein the at least one eye comprises two eyes.

20. The apparatus of claim 19 , wherein
the first gazing information comprises: first gazing angle information; and
the second gazing information comprises: second gazing angle information.

21. The apparatus of claim 15 , wherein the operation comprises:
an operation related to a virtual presentation distance corresponding to the virtual presentation object.

22. The apparatus of claim 15 , wherein the first processing execution module comprises:
a presentation adjustment unit, configured to: in response to that the difference between the first gazing information and the second gazing information is out of the set error range, adjust a virtual presentation distance corresponding to the virtual presentation object.

23. The apparatus of claim 22 , wherein the presentation adjustment unit is further configured to:
in response to that the difference between the first gazing information and the second gazing information is out of the set error range, adjust the virtual presentation distance according to the difference.

24. The apparatus of claim 22 , wherein the first processing execution module further comprises:
a first location determining unit, configured to determine a location of the physical object relative to the user according to the gazing direction and the adjusted virtual presentation distance.

25. The apparatus of claim 15 , wherein the first processing execution module comprises:
a second location determining unit, configured to determine a location of the physical object relative to the user according to the gazing direction, a virtual presentation distance corresponding to the virtual presentation object and the difference.

26. The apparatus of claim 15 , wherein the apparatus further comprises:
a second processing execution module, configured to: in response to that the difference is within the error range, determine a location of the physical object relative to the user according to the gazing direction and a virtual presentation distance corresponding to the virtual presentation object.

Assignees

• Beijing Zhigu Ruituo Tech Co Ltd

Inventors

• Du Lin
• Ding Dayong

Classifications

• G09G2354/00

  Aspects of interface with display user · CPC title

• G06F3/147

  using display panels · CPC title

• G09G2320/0261

  in the context of movement of objects on the screen or movement of the observer relative to the screen · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title