Systems and methods for multimodal pose and motion tracking for magnetic field measurement or recording systems

Patent metadata

Field	Value
Publication number	US-11766217-B2
Application number	US-202117328271-A
Country	US
Kind code	B2
Filing date	May 24, 2021
Priority date	May 28, 2020
Publication date	Sep 26, 2023
Grant date	Sep 26, 2023

Abstract

A magnetic field recording system includes a headgear to be placed on a user; optically pumped magnetometers (OPMs) disposed in or on the headgear to detect magnetic fields; at least two sensing modalities selected from the following: i) a magnetic sensing modality, ii) an optical sensing modality, or iii) an inertial sensing modality; and a tracking unit configured to receive, from each of the at least two sensing modalities, a corresponding magnetic data stream, optical data stream, or inertial data stream and to track a position or orientation of the headgear or user; and a system controller configured to control operation of the OPMs and to receive, from the tracking unit, the position or orientation of the headgear or user.

First claim

What is claimed as new and desired to be protected by Letters Patent of the United States is:

1. A magnetic field recording system, comprising:
a headgear configured to be placed on a user;
a plurality of optically pumped magnetometers (OPMs) disposed in or on the headgear and configured to detect magnetic fields;
at least two sensing modalities selected from the following:
i) a magnetic sensing modality comprising at least one electromagnetic coil configured to produce magnetic field tones at one or more frequencies and at least one magnetic field sensor configured for placement on the user to detect the magnetic field tones and to produce a magnetic data stream,
ii) an optical sensing modality comprising at least one light source and at least one camera or light detector configured to receive light reflected or directed from the user and to produce an optical data stream, or
iii) an inertial sensing modality comprising at least one inertial sensor configured for placement on a user and to produce an inertial data stream; and

a tracking unit configured to receive, from each of the at least two sensing modalities, the corresponding magnetic data stream, optical data stream, or inertial data stream and to track a position or orientation of the headgear or user; and
a system controller configured to control operation of the OPMs and to receive, from the tracking unit, the position or orientation of the headgear or user.

2. The magnetic field recording system of claim 1 , wherein the at least two sensing modalities comprise the inertial sensing modality.

3. The magnetic field recording system of claim 1 , wherein the at least two sensing modalities comprise the magnetic sensing modality, the optical sensing modality, and the inertial sensing modality.

4. The magnetic field recording system of claim 1 , further comprising a passively shielded enclosure comprising a plurality of walls defining the passively shielded enclosure, each of the plurality of walls comprising passive magnetic shielding material to reduce an ambient background magnetic field within the passively shielded enclosure.

5. The magnetic field recording system of claim 4 , further comprising a plurality of active shield coils distributed within the passively shielded enclosure and configured to further reduce the ambient background magnetic field within the passively shielded enclosure.

6. The magnetic field recording system of claim 5 , wherein at least one of the active shield coils is at least one of the at least one electromagnetic coil configured to produce the magnetic field tones.

7. The magnetic field recording system of claim 1 , wherein the at least one electromagnetic coil is configured to produce the magnetic field tones having a frequency of at least 100 Hz.

8. The magnetic field recording system of claim 1 , wherein the optical sensing modality comprises at least one fiducial marker for placement on the user, the headgear, or the OPM modules and configured to reflect light from the at least one light source.

9. The magnetic field recording system of claim 8 , wherein the at least one fiducial marker is disposed on the headgear or the OPM modules.

10. The magnetic field recording system of claim 1 , wherein at least one of the at least one light source is a fiducial marker for placement on the user, the headgear, or the OPM modules and configured to emit light.

11. The magnetic field recording system of claim 1 , wherein the tracking unit is configured to utilize at least one of the OPM modules as a fiduciary marker for the optical sensing modality.

12. The magnetic field recording system of claim 1 , wherein the tracking unit is configured to utilize at least one feature of the user as a fiduciary marker for the optical sensing modality.

13. The magnetic field recording system of claim 1 , wherein each of the at least one inertial sensor is an accelerometer or a gyroscope.

14. A method of recording biomagnetic fields using the magnetic field recording system of claim 1 , the method comprising:
disposing the headgear on the user;
tracking the position or orientation of the user, headgear, or OPM modules using the at least two sensing modalities and the tracking unit;
recording the biomagnetic fields using the OPMs; and
associating the biomagnetic fields with biological regions of the user using the tracked position or orientation.

15. The method of claim 14 , wherein recording the biomagnetic fields comprises recording the biomagnetic fields at individual first periods of time, wherein the at least two sensing modalities comprise the magnetic sensing modality, wherein tracking the position or orientation of the user comprises generating the magnetic field tones using the at least one electromagnetic coil at second periods of time between the periods of time.

16. The method of claim 14 , wherein the at least two sensing modalities comprise the magnetic sensing modality, wherein tracking the position or orientation of the user, headgear, or OPM modules comprises generating the magnetic field tones at a frequency of at least 100 Hz using the at least one electromagnetic coil.

17. The method of claim 16 , wherein generating the magnetic field tones occurs, at least in part, simultaneously with recording the biomagnetic fields.

18. The method of claim 14 , wherein the at least two sensing modalities comprises the optical sensing modality, wherein tracking the position or orientation of the user, headgear or OPM modules comprises receiving light reflected or directed from the user at the at least one camera or light detector, wherein receiving the light occurs, at least in part, simultaneously with recording the biomagnetic fields.

19. The method of claim 14 , wherein the at least two sensing modalities comprises the inertial sensing modality, wherein tracking the position or orientation of the user, headgear or OPM modules comprises producing an inertial data stream using the at least one inertial sensor, wherein producing the inertial data stream occurs, at least in part, simultaneously with recording the biomagnetic fields.

20. The method of claim 14 , wherein associating the biomagnetic fields with biological regions of the user comprises sending estimates of the position or orientation of the user, headgear, or OPM modules from the tracking unit to the system controller.

Assignees

• Hi Llc

Inventors

• Jiménez-Martínez Ricardo
• Alford Jamu
• Iwata Geoffrey
• Pratt Ethan

Classifications

• A61B5/6803 Primary

  Head-worn items, e.g. helmets, masks, headphones or goggles · CPC title

• A61B5/246

  using evoked responses · CPC title

• G01R33/26 Primary

  using optical pumping · CPC title

• A61B2562/0223

  Magnetic field sensors · CPC title

• G01N24/006

  using optical pumping (magnetometers using optical pumping G01R33/26, optical pumping of lasers H01S3/091) · CPC title