Systems and methods for operating an input device in an augmented/virtual reality environment

Patent metadata

Field	Value
Publication number	US-11366512-B2
Application number	US-202016918977-A
Country	US
Kind code	B2
Filing date	Jul 1, 2020
Priority date	Nov 14, 2016
Publication date	Jun 21, 2022
Grant date	Jun 21, 2022

Abstract

In some embodiments, a system comprising one or more processors configured to track a location of an input device within a physical environment via a three-dimensional (3D) tracking system, and modify a tracking parameter of the 3D tracking system while tracking the location of the input device based on the determined location of the input device within the physical environment. The input device may be coupled to a virtual reality display system and tracking the location of the location of the input device can be used for interacting with the virtual reality display system.

First claim

What is claimed is:

1. A system comprising one or more processors configured to:
track a location of a stylus device within a physical environment via a three-dimensional (3D) tracking system; and
modify a tracking parameter of the 3D tracking system while tracking the location of the stylus device based on the tracked location of the stylus device, wherein modifying the tracking parameter of the stylus device further includes:
tracking the location of the stylus device according to a first tracking profile in response to determining that the stylus device is operating along a two-dimensional (2D) surface;
tracking the location of the stylus device according to a second tracking profile in response to determining the stylus device is operating “in-air” in 3D space; and
tracking the location of the stylus device according to a third tracking profile in response to determining that the stylus is being swung through one of a plurality of arcs.

2. The system of claim 1 wherein the tracking parameter of the third tracking profile is based on a pre-defined model of a user.

3. The system of claim 2 wherein the pre-defined model is used by the one or more processors to determine a location of the stylus device corresponding to the user holding the stylus device with an appendage.

4. The system of claim 1 wherein the two-dimensional surface is a physical surface.

5. The system of claim 1 wherein the first tracking profile has a lower tracking accuracy than a tracking accuracy of the second tracking profile and the third tracking accuracy.

6. The system of claim 1 wherein the 3D tracking system tracks in three axes in a Cartesian coordinate system including a first, second, and third axis, and
wherein in response to determining that the stylus device is operating along the 2D surface, the one or more processors are further configured to:
determine which of the first, second, and third axes substantially define a contour of the 2D surface; and
suspend tracking along any of the first, second, and third axes that does not substantially define the contour of the 2D surface while the stylus device is determined to be operating along the 2D surface.

7. The system of claim 1 wherein the one or more processors are configured to:
determine a distance from the stylus device to a peripheral device, the stylus device and the peripheral device being separate and communicatively coupled to the same computer system; and
modify a tracking precision of the stylus device while tracking the location of the stylus device based on the determined distance from the stylus device to the peripheral device.

8. The system of claim 7 wherein the one or more processors are configured to:
modify the tracking precision of the stylus device according to a first tracking sensitivity profile in response to determining that the stylus device is within a threshold distance from the peripheral device; and
modify the tracking precision of the stylus device according to a second tracking sensitivity profile in response to determining that the stylus device is not within a threshold distance from the peripheral device.

9. The system of claim 8 wherein the first tracking sensitivity profile has a higher precision measurement than a precision measurement of the second tracking sensitivity profile.

10. The system of claim 1 wherein the one or more processors are configured to:
change an operation of the stylus device based on the tracked location of the stylus device within the physical environment.

11. The system of claim 1 wherein modifying the tracking parameter of the stylus device based on the tracked location of the stylus device within the physical environment causes an operation including one of a list of operations including:
changing a function of one or more buttons on the stylus device based on a contextual usage of the stylus device;
changing an operation of the stylus device in response to the stylus device being moved to a same location as a virtual object or physical object;
changing a visual presentation of a virtual feature of the stylus device in response to the stylus device being moved to a same location as the virtual object the physical object; and
initiating a haptic stimulus by a haptic device coupled to the stylus device in response to the stylus device being moved to a same location as the virtual the physical object.

12. A computer implemented method comprising:
tracking a location of an input device within a physical environment via a three-dimensional (3D) tracking system, wherein the input device is coupled to a virtual reality display system and wherein the tracking the location of the location of the input device is used for interacting with the virtual reality display system; and
modifying a tracking parameter of the 3D tracking system while tracking the location of the input device based on the tracked location of the input device within the physical environment, wherein modifying the tracking parameter of the input device includes:
tracking the location of the input device according to a first tracking profile in response to determining that the input device is operating along a two-dimensional (2D) surface;
tracking the location of the input device according to a second tracking profile in response to determining the input device is operating “in-air” in 3D space; and
tracking the location of the input device according to a third tracking profile in response to determining that the input is being swung through one of a plurality of arcs.

13. The method of claim 12 wherein the tracking parameter is further modified based on a pre-defined model of a user of the input device.

14. The method of claim 13 wherein the pre-defined model is used by the one or more processors to determine a location of the input device corresponding to the user holding the input device with an appendage.

15. The method of claim 12 wherein the two-dimensional surface is a physical surface.

16. The method of claim 12 wherein the first tracking profile has a lower tracking accuracy than a tracking accuracy of the second tracking profile and the third tracking accuracy.

17. A system comprising:
one or more processors configured to:
track a location of a stylus device within a physical environment via a three-dimensional (3D) tracking system; and
modify a tracking parameter of the 3D tracking system while tracking the location of the stylus device based on:
the tracked location of the stylus device; and
a biometric model of a user utilizing the stylus device,
wherein modifying the tracking parameter of the stylus device further includes tracking the location of the stylus device according to a tracking profile in response to determining that the stylus is being swung through one of a plurality of arcs as applied to the biometric model of the user.

18. The system of claim 17 , wherein the biometric model includes a motion model of the user's appendage that is holding the stylus device.

19. The system of claim 17 , wherein the 3D tracking system tracks the location of the stylus device within the physical environment along three axes in a Cartesian coordinate system including a first, second, and third axis.

Assignees

• Logitech Europe Sa

Inventors

• Harvey Stephen
• O'Keeffe Denis
• Kehoe Aidan
• Gutierrez Mario
• O'Sullivan Damien
• Rouvinez Thomas
• Meisser Mathieu
• Curran Noirin
• Zimmermann Remy
• Twohig Marcel
• Onorio Dennin
• O'Bradaigh Pierce
• Riviere Olivier
• Trotman Ciaran
• Connellan Andreas
• Murphy Padraig
• Ahern Jerry

Classifications

• G06F3/014

  Hand-worn input/output arrangements, e.g. data gloves · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/016

  Input arrangements with force or tactile feedback as computer generated output to the user · CPC title

• G06F3/038

  Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry · CPC title

• G06F3/0426

  tracking fingers with respect to a virtual keyboard projected or printed on the surface (virtual keyboards on touch screens G06F3/04886) · CPC title