Systems and methods for operating an input device in an augmented/virtual reality environment

Patent metadata

Field	Value
Publication number	US-10754417-B2
Application number	US-201815890165-A
Country	US
Kind code	B2
Filing date	Feb 6, 2018
Priority date	Nov 14, 2016
Publication date	Aug 25, 2020
Grant date	Aug 25, 2020

Abstract

In some embodiments, a system comprising one or more processors configured to track a location of an input device within a physical environment via a three-dimensional (3D) tracking system, and modify a tracking parameter of the 3D tracking system while tracking the location of the input device based on the determined location of the input device within the physical environment. The input device may be coupled to a virtual reality display system and tracking the location of the location of the input device can be used for interacting with the virtual reality display system.

First claim

What is claimed is:

1. A system comprising one or more processors configured to:
track a location of a stylus device within a physical environment via a three-dimensional (3D) tracking system, wherein the stylus device is coupled to a virtual reality display system and wherein the tracking the location of the location of the stylus device is used for interacting with the virtual reality display system; and
modify a tracking parameter of the 3D tracking system while tracking the location of the stylus device based on the tracked location of the stylus device within the physical environment, wherein modifying the tracking parameter of the stylus device further includes:
tracking the location of the stylus device according to a first tracking accuracy profile in response to determining that the stylus device is at a location indicative of the stylus device operating “in-air” in 3D space;
tracking the location of the stylus device according to a second tracking accuracy profile in response to determining that the stylus device is operating along a two-dimensional (2D) surface; and
tracking the location of the stylus device according to a third accuracy tracking profile in response to determining that the stylus device is at a location indicative of a user operating the stylus device “in-air” in 3D space and bracing their arm against a surface.

2. The system of claim 1 wherein the tracking parameter is further modified based on a biometric model of a user of the stylus device.

3. The system of claim 2 wherein the biometric model is used by the one or more processors to determine a location of the stylus device corresponding to the user holding the stylus device with an appendage.

4. The system of claim 1 wherein the two-dimensional surface is a physical surface.

5. The system of claim 1 wherein the first tracking accuracy profile has a lower tracking accuracy than a tracking accuracy of the second tracking accuracy profile.

6. The system of claim 1 wherein the first tracking accuracy profile has a lower tracking accuracy than a tracking accuracy of the second tracking accuracy profile, wherein the third tracking accuracy profile has a higher tracking accuracy than the tracking accuracy of the second tracking accuracy profile, and wherein the third tracking accuracy profile has a lower tracking accuracy than the tracking accuracy of the second tracking accuracy profile.

7. The system of claim 1 wherein determining that the stylus device is at a location indicative of a user operating the stylus device “in-air” in 3D space and bracing their arm against a surface includes at least one of:
using an imaging sensor to detect an orientation of the stylus device or the user;
using a biomechanical model of the user to determine a location indicative of a portion of user being in a determined position while operating the stylus device; or
detecting micro-tremors of the stylus device induced by the user while the stylus device is operated,
wherein micro-tremors at or greater than a threshold amplitude are indicative of the stylus device operating “in-air” and the user operating the stylus device without bracing their arm against the surface, and
wherein micro-tremors below the threshold amplitude are indicative of the stylus device operating “in-air” and the user operating the stylus device bracing their arm against the surface.

8. The system of claim 1 wherein the stylus device is of a list including:
a stylus;
a mobile device;
a computer mouse;
a presenter device; and
a wearable device.

9. The system of claim 1 wherein the 3D tracking system tracks in three axes in a Cartesian coordinate system including a first, second, and third axis, and
wherein in response to determining that the stylus device is operating along the 2D surface, the one or more processors are further configured to:
determine which of the first, second, and third axes substantially define a contour of the 2D surface; and
suspend tracking along any of the first, second, and third axes that does not substantially define the contour of the 2D surface while the stylus device is determined to be operating along the 2D surface.

10. The system of claim 1 wherein the one or more processors are configured to:
determine a distance from the stylus device to a peripheral device, the stylus device and the peripheral device being separate and communicatively coupled to the same computer system; and
modify a tracking precision of the stylus device while tracking the location of the stylus device based on the determined distance from the stylus device to the peripheral device.

11. The system of claim 10 wherein the one or more processors are configured to:
modify the tracking precision of the stylus device according to a first tracking sensitivity profile in response to determining that the stylus device is within a threshold distance from the peripheral device; and
modify the tracking precision of the stylus device according to a second tracking sensitivity profile in response to determining that the stylus device is not within a threshold distance from the peripheral device.

12. The system of claim 11 wherein the first tracking sensitivity profile has a higher precision measurement than a precision measurement of the second tracking sensitivity profile.

13. The system of claim 1 wherein the one or more processors are configured to:
change an operation of the stylus device based on the tracked location of the stylus device within the physical environment.

14. The system of claim 1 wherein modifying the tracking parameter of the stylus device based on the tracked location of the stylus device within the physical environment causes an operation including one of a list of operations including:
changing a function of one or more buttons on the stylus device based on a contextual usage of the stylus device;
changing an operation of the stylus device in response to the stylus device being moved to a same location as a virtual object or physical object;
changing a visual presentation of a virtual feature of the stylus device in response to the stylus device being moved to a same location as the virtual object the physical object; and
initiating a haptic stimulus by a haptic device coupled to the stylus device in response to the stylus device being moved to a same location as the virtual the physical object.

15. A computer implemented method comprising:
tracking a location of an stylus device within a physical environment via a three-dimensional (3D) tracking system, wherein the stylus device is coupled to a virtual reality display system and wherein the tracking the location of the location of the stylus device is used for interacting with the virtual reality display system; and
modifying a tracking parameter of the 3D tracking system while tracking the location of the stylus device based on the tracked location of the stylus device within the physical environment, wherein modifying the tracking parameter of the stylus device further includes:
tracking the location of the stylus device according to a first tracking accuracy profile in response to determining that the stylus device is at a location indicative of the stylus device operating “in-air” in 3D space;
tracking the location of the stylus device according to a second tracking accuracy profile in response to determining that the stylus device is operating along a two-dimensional (2D) surface; and
tracking the location of the stylus device according to a third accuracy tracking profile in response to determining that the stylus device is at a location indicative of a user oper

Assignees

• Logitech Europe Sa

Inventors

• Harvey Stephen
• O'Keeffe Denis
• Kehoe Aidan
• Gutierrez Mario
• O'Sullivan Damien
• Rouvinez Thomas
• Meisser Mathieu
• Curran Noirin
• Zimmermann Remy
• Twohig Marcel
• Onorio Dennin
• O'Bradaigh Pierce
• Riviere Olivier
• Trotman Ciaran
• Connellan Andreas
• Murphy Padraig
• Ahern Jerry

Classifications

• G06F3/0487

  using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser · CPC title

• G02B2027/014

  comprising information/image processing systems · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title

• G06F3/011 Primary

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F3/0426

  tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886) · CPC title