Method and apparatus for multiple mode interface

Patent metadata

Field	Value
Publication number	US-10740979-B2
Application number	US-201916514205-A
Country	US
Kind code	B2
Filing date	Jul 17, 2019
Priority date	Oct 2, 2013
Publication date	Aug 11, 2020
Grant date	Aug 11, 2020

Abstract

A method, system, apparatus, and/or device for executing a translation instruction for a constructive movement. The method, system, apparatus, and/or device may include an input device configured to sense a first constructive movement input representative of a non-translational movement of a body of a user that does not move from a first point to a second point in the physical world environment. The method, system, apparatus, and/or device may include a processing device coupled to the input device, where the processing device is configured to execute a translational instruction associated with the first constructive movement input, execute a first resizing instruction to reduce a size of a portion of the physical world environment as displayed by a head-mounted display by an amount indicated by the first resizing stimulus, receive a second constructive movement input, and execute a second translational instruction associated with the second constructive translational movement input.

First claim

The invention claimed is:

1. A method, comprising:
receiving, from an input device, a first constructive movement input representative of a non-translational movement of a body of a user, wherein:
the body does not move from a first point in a physical world environment to a second point in the physical world environment; and
the non-translational movement mimics a movement of the body translationally moving from the first point to the second point;

executing, by a processing device, a translational instruction associated with the first constructive movement input, wherein:
the translational instruction comprises moving the body in a world space of an augmented reality environment from the first point to the second point; and
the world space is a portion of the physical world environment being substantially bound by a portion of a physical world environment relative to a head-mounted display;

receiving, from the input device, a first rotation stimulus;
in response to receiving the first rotation stimulus, executing, by the processing device, a first rotation instruction to rotate:
a portion of the world space as displayed by a head-mounted display by a first amount indicated by the first rotation stimulus;
a portion of a sphere space as displayed by the head-mounted display by the first amount; or
a portion of a display space as displayed by the head-mounted display by the first amount, wherein:
as the world space rotates, the sphere space or the display space is fixed;
as the sphere space rotates, the world space or the display space is fixed; or
as the display space rotates, the world space or the sphere space is fixed;

receiving, from the input device, a second constructive movement input; and
executing, by the processing device, a second translational instruction associated with the second constructive movement input, wherein the second translational instruction comprises moving the body a second distance in the space that corresponds with a first actual movement of the body in the physical world environment.

2. The method of claim 1 , wherein:
the augmented reality environment comprises one or more objects overlaid onto the physical world environment; or
the processing device is adapted to display the physical world environment as a virtual reality environment, wherein the portion of the world space that is rotated is a portion of the physical world environment displayed as the virtual reality environment.

3. The method of claim 1 , wherein:
the first rotation stimulus is a user input;
the user input comprises at least one of a voice command, a hand posture, a hand gesture, a stylus posture, a stylus gesture, an eye gesture, or a brainwave modulation.

4. The method of claim 1 , wherein the second constructive movement input comprises constructive rotational movement that corresponds to rotational movement by the head-mounted display where the head-mounted display remains at the first point and rotates about an axis.

5. The method of claim 1 , wherein the first rotation stimulus is indicative of the body interacting with an augmented reality object displayed in the physical world environment.

6. The method of claim 1 , further comprising:
receiving, from the input device, a resizing stimulus;
executing, by the processing device, a resizing instruction to change a size of the portion of the world space, the sphere space, or the display space as displayed by the head-mounted display by an amount indicated by the resizing stimulus;
receiving, from the input device, a third constructive movement input; and
executing, by the processing device, a third translational instruction associated with the third constructive movement input, wherein the third translational instruction comprises moving the body a third distance in the world space, the sphere space, or the display space that corresponds with a second actual movement of the body in the physical world environment.

7. A method, comprising:
receiving a first constructive movement input representative of a first gesture of a body of a user, wherein:
the body of the user remains in a fixed position between a first point in the physical world environment and a second position in a physical world environment; and
the first gesture mimics a movement of the body translationally moving from the first point to the second point;

executing a translational instruction associated with the first constructive movement input, wherein:
the translational instruction comprises moving the body in a world space of an augmented reality environment from the first point to the second point; and
the world space is a portion of the physical world environment being substantially bound by a portion of a physical world environment relative to a head-mounted display;

in response to receiving a first resizing stimulus, executing a first resizing instruction to change:
a size of a portion of the world space;
a size of a portion of a sphere space; or
a size of a portion of a display space, wherein:
the world space, the sphere space, or the display space is displayed by a head-mounted display;
an amount of the change is indicated by the first resizing stimulus;
as the size of the portion of the world space changes, the size of the portion of the sphere space is constant or the size of the portion of the display space is constant;
as the size of the portion of the sphere space changes, the size of the portion of the world space is constant or the size of the portion of the display space is constant; and
as the size of the portion of the display space changes, the size of the portion of the world space is constant or the size of the portion of the sphere space is constant;

receiving, from the input device, a second constructive movement input; and
executing a second translational instruction associated with the second constructive movement input, wherein the second translational instruction comprises moving the body a second distance in the world space that corresponds with a first actual movement of the body in the physical world environment.

8. The method of claim 7 , further comprising:
receiving, from the input device, a rotation stimulus;
executing a rotation instruction to rotate the world space, the sphere space, or the display space as displayed by the head-mounted display by an amount indicated by the rotation stimulus;
receiving, from the input device, a third constructive movement input; and
executing a third translational instruction associated with the third constructive movement input, wherein the third translational instruction comprises moving the body a third distance in the world space that corresponds with a second actual movement of the body in the physical world environment.

9. The method of claim 8 , wherein:
as the world space rotates, the sphere space remains fixed relative to the user or the display space remains fixed relative to the user;
as the sphere space rotates, the world space remains fixed relative to the user or the display space remains fixed relative to the user; and
as the display space rotates, the world space remains fixed relative to the user or the sphere space remains fixed relative to the user.

10. The method of claim 7 , further comprising:
receiving, from the input device, a space translation stimulus;
executing a space translation instruction to move the world space, the sphere space, or the display space as displayed by the head-mounted display from a third point relative to the physical world environment to a fourth point relative to the physical world environment, as indicated by the space translation stimulus;
receiving, from the input device, a third constructive movemen

Assignees

• Atheer Inc

Inventors

• Abercrombie Nathan
• Issayeva Iryna
• James Greg
• Itani Sleiman

Classifications

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title