Input device for VR/AR applications

Patent metadata

Field	Value
Publication number	US-10817128-B2
Application number	US-201715786614-A
Country	US
Kind code	B2
Filing date	Oct 18, 2017
Priority date	Jul 11, 2017
Publication date	Oct 27, 2020
Grant date	Oct 27, 2020

Abstract

In some embodiments, an input device for interfacing within an VR/AR environment can include a processor, one or more motion tracking sensors to track a motion of the input device in three-dimensional (3D) space, where a cursor in the VR/AR environment moves based on the tracked motion of the input device in 3D space and is limited to tracked motion having three degrees of freedom (DOF). The input device can further include a button that, when activated, selects an application window in the VR/AR environment when the cursor is placed over the application window, where the application window moves in the VR/AR environment based on the tracked motion of the input device in 3D space while the application window is selected. The input device can include a user interface that, when activated, accesses and controls content on the selected application window.

First claim

What is claimed is:

1. A system including:
an input device for interfacing within a virtual reality or augmented reality (VR/AR) environment, the input device comprising:
an inertial motion unit (IMU) configured to track a motion of the input device in three-dimensional (3D) space;
a button;
a touch-sensitive input interface configured to detect touch-based inputs; and
a non-transitory computer-readable medium storing instructions that, when executed by a processor, configures the processor to:
control movement of a cursor in the VR/AR environment based on the tracked motion of the input device in 3D space, wherein the movement of the cursor is limited to a tracked movement of the input device in three degrees of freedom (3-DOF);
in response to moving a position of the cursor via the 3-DOF tracked movement to a location of a virtual object and an actuation of the button, select the virtual object;
while the virtual object is selected:
move the virtual object in the VR/AR environment according to the 3-DOF tracked motion of the input device; and
control movement of the virtual object in the VR/AR environment in an additional 3-DOF based on a user's touch-based input detected via the touch-sensitive input interface, the additional 3-DOF being different than the 3-DOF for the tracked motion of the input device.

2. The system of claim 1 wherein the button and the input interface are configured for independent and simultaneous operation.

3. The system of claim 1 wherein the 3-DOF tracked movement, the button, and the input interface are operable, in combination, to manipulate a virtual object in the VR/AR environment in 6-DOF including movement along an x-axis, a y-axis, a z-axis, yaw, pitch, and roll.

4. A computer-implemented method for operating an input device in a VR/AR environment, the method comprising:
receiving, by a processor, movement data from an IMU disposed in the input device, the movement data corresponding to and limited to 3-DOF movement of the input device in 3D space;
controlling, by the processor, a movement of a cursor in the VR/AR environment based on the received movement data;
receiving, by the processor, first input data from a first input element on the input device indicating that the first input element is activated while the cursor is positioned in relation to a virtual object in the VR/AR environment;
selecting the virtual object in the VR/AR environment in response to the first input element being activated while the cursor is positioned in relation to the virtual object;
moving the virtual object in the VR/AR environment within a first 3-DOF based on the detected 3-DOF movement of the input device while the first input element remains activated;
receiving, by the processor, second input data from a second input element on the input device; and
moving the virtual object in an additional 3-DOF in the VR/AR environment based on the second input data while the first input element remains activated, the additional 3-DOF being different than the first 3-DOF.

5. The computer-implemented method of claim 4 wherein the selected virtual object in the VR/AR environment is moved along a two-dimensional (2D) plane based on the detected 3-DOF movement of the input device while the first input element remains activated, and wherein the second input data causes the virtual object to move in a direction normal to the 2D plane.

6. The computer-implemented method of claim 4 wherein the first input element is a button configured for binary operation including an activated and deactivated state, and wherein the second input element is a touch-sensitive touchpad separate and distinct from the first input element configured to detect touch-based inputs on the touchpad.

Assignees

• Logitech Europe Sa

Inventors

• Murphy Padraig
• Connellan Andreas
• Riviere Olivier
• Corcoran Fergal
• O'Bradaigh Pierce
• Findlater Jan
• Waldron Philip
• Mcglynn Gavin
• O'Keefe Denis
• Ahern Jerry
• Twohig Marcel

Classifications

• G06F3/012

  Head tracking input arrangements · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G02B27/017

  Head mounted · CPC title

• G06F3/04815 Primary

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title