Systems and methods for augmented reality

Patent metadata

Field	Value
Publication number	US-11619988-B2
Application number	US-202217813442-A
Country	US
Kind code	B2
Filing date	Jul 19, 2022
Priority date	Mar 5, 2015
Publication date	Apr 4, 2023
Grant date	Apr 4, 2023

Abstract

Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. An augmented reality display system comprises a handheld component housing an electromagnetic field emitter, the electromagnetic field emitter emitting a known magnetic field, the head mounted component coupled to one or more electromagnetic sensors that detect the magnetic field emitted by the electromagnetic field emitter housed in the handheld component, wherein a head pose is known, and a controller communicatively coupled to the handheld component and the head mounted component, the controller receiving magnetic field data from the handheld component, and receiving sensor data from the head mounted component, wherein the controller determining a hand pose based at least in part on the received magnetic field data and the received sensor data.

First claim

What is claimed is:

1. A method to display augmented reality, comprising:
emitting, through an electromagnetic field emitter, a known magnetic field;
measuring, through an electromagnetic sensor, a parameter related to a magnetic flux at the electromagnetic sensor as a result of the emitted known magnetic field;
determining pose information relative to the electromagnetic field emitter based at least in part on the measured parameter related to the magnetic flux at the electromagnetic sensor;
capturing image data through one or more cameras coupled to a head-mounted component;
determining head pose information utilizing the image data; and
displaying virtual content on an AR display system to a user based at least in part on both the determined pose information relative to the electromagnetic field emitter and the head pose information.

2. The method of claim 1 , wherein:
the electromagnetic sensor comprises at least three coils to measure magnetic flux in three directions; and
the at least three coils are integrated into the head-mounted component at different locations of the head-mounted component of the AR display system.

3. The method of claim 1 , wherein determining head pose information utilizing the image data is determined based at least in part on a SLAM analysis utilizing the image data.

4. The method of claim 1 , wherein the electromagnetic field emitter resides in a mobile component of the AR display system.

5. The method of claim 4 , wherein the mobile component is a hand-held component.

6. The method of claim 4 , wherein the mobile component is a totem.

7. The method of claim 4 , wherein the mobile component is a head-mounted component of the AR display system.

8. The method of claim 1 , wherein the AR display system is housed in the head-mounted component, and the electromagnetic sensor is operatively coupled to the head-mounted component.

9. The method of claim 1 , further comprising:
determining world coordinates of the electromagnetic sensor based at least in part on the SLAM analysis of the image data utilized to determine head pose information.

10. The method of claim 1 , wherein the electromagnetic sensors comprise one or more inertial measurement units (IMUs).

11. The method of claim 1 , wherein the pose information corresponds to at least a position and orientation of the electromagnetic field emitter relative to the world, and the head pose information corresponds to at least a location and orientation of the user's head relative to the world.

12. The method of claim 1 , wherein the pose information is analyzed to determine world coordinates corresponding to the electromagnetic field emitter.

13. The method of claim 1 , further comprising detecting an interaction with one or more virtual contents based at least in part on the pose information corresponding to the electromagnetic field emitter.

14. The method of claim 13 , further comprising displaying virtual content to the user based at least in part on the detected interaction.

15. The method of claim 1 , further comprising decoupling the magnetic field emitted by the electromagnetic field emitter through a control and quick release module.

16. The method of claim 1 , further comprising determining world coordinates of the electromagnetic field emitter through localization resources other than the electromagnetic sensor, electromagnetic field emitter and image data.

17. The method of claim 16 , wherein the additional localization resources comprises a GPS receiver.

18. The method of claim 16 , wherein the additional localization resources comprises a beacon.

19. The method of claim 1 , wherein the electromagnetic sensor comprises at least one of: a stack of ferrite disks; a plurality of ferrite rods each having a polymer coating; and a time division multiplexing switch.

Assignees

• Magic Leap Inc

Inventors

• Woods Michael

Classifications

• G06F3/017

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06F3/012 Primary

  Head tracking input arrangements · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G02B2027/0187

  slaved to motion of at least a part of the body of the user, e.g. head, eye · CPC title