Method and apparatus for multiple mode interface

Patent metadata

Field	Value
Publication number	US-10163264-B2
Application number	US-201414505295-A
Country	US
Kind code	B2
Filing date	Oct 2, 2014
Priority date	Oct 2, 2013
Publication date	Dec 25, 2018
Grant date	Dec 25, 2018

Abstract

Each of a world space, a sphere space, and a display space are adapted to accept at least one entity therein, the entity being a virtual reality entity or an augmented reality entity. For world space, translation by a viewer substantially corresponds with translation with respect to world space, and rotation by the viewer substantially corresponds with rotation with respect to world space. For sphere space, translation by the viewer corresponds with substantially zero translation with respect to sphere space, and rotation by the viewer substantially corresponds with rotation with respect to sphere space. For display space, translation by the viewer corresponds with substantially zero translation with respect to display space, and rotation by the viewer corresponds with substantially zero rotation with respect to display space. Exceptions for translating, rotating, and/or resizing any of world space, sphere space, and display space may be invoked.

First claim

We claim:

1. A method, comprising:
generating, by a processor, a world space, the world space being substantially bound by a portion of a physical world environment relative to a head mounted display, wherein:
translational movement of the world space substantially corresponds to translational movement by the head mounted display from a first point in space to a second point in space, and
rotational movement of the world space substantially corresponds to rotational movement by the head mounted display where the head mounted display remains at the first point in space and rotates about an axis;

generating, by the processor, a sphere space, the sphere space being a finite area substantially surrounding the head mounted display;
translational movement of the sphere space corresponds to the translational movement by the head mounted display from the first point in space to the second point in space;
rotational movement of the sphere space substantially corresponds to the rotational movement by the head mounted display where the head mounted display remains at the first point in space and rotates about the axis;

generating, by the processor, a display space, the display space being a finite plane disposed in front of the head mounted display;
translational movement of the display space does not correspond to the translational movement of the head mounted display from the first point in space to the second point in space;
rotational movement of the display space does not correspond to the rotational movement of the head mounted display where the head mounted display remains at the first point in space and rotates about the axis;

receiving, from a sensor, a first constructive translational movement input representative of a non-translational movement of a body of a user where the body of the user does not move from the first point in space to the second point in space and the non-translational movement mimics a movement of the body of the user translationally moving in the world space;
executing, by the processor, a first translational instruction associated with the first constructive translational movement input, wherein the first translational instruction comprises the moving the body of the user a first distance that corresponds with an actual movement of the body of the user from the first point in space to the second point in space in the world space relative to the head mounted display; and
sensing, by the sensor, a presence of the world space resizing stimulus, the world space resizing stimulus indicating an amount to reduce a size of the world space relative to the head mounted display;
executing, by the processor, a world space resizing instruction to reduce the size of the world space by the amount indicated by the world space resizing stimulus;
receiving, from the sensor, a second constructive translational movement input; and
executing, by the processor, a second translational instruction associated with the second constructive translational movement input, wherein the second translational instruction comprises the moving the body of the user a second distance that corresponds with an actual movement of the body of the user from the first point in space to the second point in space in the reduced-size world space.

2. The method of claim 1 , comprising:
establishing a world space rotation stimulus;
establishing a world space rotation response, the world space rotation response comprising a rotation of the world space relative to the head mounted display not corresponding with the rotation by the head mounted display;
sensing a presence of the world space rotation stimulus; and
executing the world space rotation response if the world space rotation stimulus is present.

3. The method of claim 2 , wherein the world space rotation stimulus comprises a user input.

4. The method of claim 2 , wherein the world space rotation stimulus comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

5. The method of claim 1 , comprising:
establishing a world space translation stimulus;
establishing a world space translation response, the world space translation response comprising a translation of the world space relative to the head mounted display not corresponding with the translation by the head mounted display;
sensing a presence of the world space translation stimulus; and
executing the world space translation response when the world space translation stimulus is present.

6. The method of claim 5 , wherein the world space translation stimulus comprises a user input.

7. The method of claim 5 , wherein the world space translation stimulus comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

8. The method of claim 1 , comprising:
establishing the world space resizing stimulus; and
establishing a world space resizing response, the world space resizing response comprising a change in size of the world space relative to the head mounted display.

9. The method of claim 8 , wherein the world space resizing stimulus comprises a user input.

10. The method of claim 8 , wherein the world space resizing stimulus comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

11. The method of claim 1 , comprising:
establishing a sphere space rotation stimulus;
establishing a sphere space rotation response, the sphere space rotation response comprising a rotation of the sphere space relative to the head mounted display not corresponding with the rotation by the head mounted display;
sensing a presence of the sphere space rotation stimulus; and
executing the sphere space rotation response if the sphere space rotation stimulus is present.

12. The method of claim 11 , wherein the sphere space rotation stimulus comprises a user input.

13. The method of claim 11 , wherein the sphere space rotation stimulus comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

14. The method of claim 1 , comprising:
establishing a sphere space translation stimulus;
establishing a sphere space translation response, the sphere space translation response comprising a translation of the sphere space relative to the head mounted display not corresponding with the translation by the head mounted display;
sensing a presence of the sphere space translation stimulus; and
executing the sphere space translation response if the sphere space translation stimulus is present.

15. The method of claim 14 , wherein the sphere space translation stimulus comprises a user input.

16. The method of claim 14 , wherein the sphere space translation stimulus comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

17. The method of claim 1 , comprising:
establishing a sphere space resizing stimulus;
establishing a sphere space resizing response, the sphere space resizing response comprising a change in size of the sphere space relative to the head mounted display;
sensing a presence of the sphere space resizing stimulus; and
executing the sphere space resizing response if the sphere space resizing stimulus is present.

18. The method of claim 17 , wherein the sphere space resizing stimulus compr

Assignees

• Atheer Inc

Inventors

• Abercrombie Nathan
• Issayeva Iryna
• James Greg
• Itani Sleiman

Classifications

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06T19/006 Primary

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title