Utilizing totems for augmented or virtual reality systems

Patent metadata

Field	Value
Publication number	US-10008038-B2
Application number	US-201514706875-A
Country	US
Kind code	B2
Filing date	May 7, 2015
Priority date	Apr 18, 2014
Publication date	Jun 26, 2018
Grant date	Jun 26, 2018

Abstract

A method of displaying augmented reality comprises identifying an object as a totem having at least one user input element, capturing at least one image of an interaction of at least one finger of a user of an augmented reality system with the at least one user input element of the totem, detecting at least one characteristic pertaining to the interaction of the finger(s) of the user with the user input element(s) of the totem based on the capture image(s), and determining a user input based at least in part on the at least one determined characteristic.

First claim

What is claimed is:

1. A method of displaying augmented reality, comprising:
identifying a physical object as a totem having at least one visual user input element on a physical surface of the totem;
capturing at least one image of a physical interaction of at least one finger of a user of an augmented reality system with the physical surface of the totem;
mapping locations of the physical interaction of the at least one finger of the user with the physical surface of the totem to a position of each of the at least one input element, thereby determining an interaction of the at least one finger of the user with the at least one visual user input element of the totem;
detecting at least one characteristic pertaining to the interaction of the at least one finger of the user with the at least one user input element of the totem based on the at least one captured image; and
determining a user input based at least in part on the at least one detected characteristic.

2. The method of claim 1 , further comprising storing a correlation map, wherein the correlation map comprises a set of predetermined characteristics of the interaction of the at least one finger of the user with the at least one user input element of the totem and a corresponding set of user input commands, wherein the user input is determined based at least in part on the stored correlation map.

3. The method of claim 1 , wherein the at least one user input element comprises a physical element.

4. The method of claim 1 , wherein the at least one user input element comprises a virtual element.

5. The method of claim 4 , wherein the at least one user input element comprises a virtual element, and wherein the physical object comprises a physical feature that replicates a feel of the virtual element.

6. The method of claim 1 , wherein the at least one detected characteristic comprises a number of interactions, types of interactions, and/or duration of the interactions of the at least one finger of the user with the at least one user input element of the totem.

7. The method of claim 1 , wherein the at least one detected characteristic comprises a single tap, double tap, short tap, long tap, fingertip grip, and/or enveloping grasp of the at least one finger of the user with the at least one user input element of the totem.

8. The method of claim 1 , wherein the at least one detected characteristic comprises a swiping or rocking gesture and/or rotating or scrolling gesture of the at least one finger of the user with the at least one user input element of the totem.

9. The method of claim 1 , wherein the at least on detected characteristic comprises a static position in the at least one finger of the user relative to the at least one user input element of the totem.

10. The method of claim 1 , wherein the at least on detected characteristic comprises a change in position in the at least one finger of the user relative to the at least one user input element of the totem.

11. The method of claim 1 , wherein the totem has a gripping section sized and configured to comfortably fit in a hand of the user.

12. The method of claim 1 , further comprising displaying virtual content in response to the determined user input.

13. The method of claim 1 , wherein the user input is a user input command.

14. The method of claim 1 , further comprising correlating a reference frame of the totem to a world-centric reference frame.

15. The method of claim 1 , wherein the at least one visual user input element is capable of being visually distinguished by the user from a remainder of the totem.

Assignees

• Magic Leap Inc

Inventors

• Miller Samuel A

Classifications

• H04S2400/15

  Aspects of sound capture and related signal processing for recording or reproduction · CPC title

• H04S2400/11

  Positioning of individual sound objects, e.g. moving airplane, within a sound field (H04S2420/13 takes precedence) · CPC title

• H04S7/304

  For headphones · CPC title

• G06Q30/02

  Marketing; Price estimation or determination; Fundraising · CPC title

• A63F13/577

  using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars · CPC title