Detection of mental state and reduction of artifacts using functional near infrared spectroscopy (FNIRS)

Patent metadata

Field	Value
Publication number	US-9848812-B1
Application number	US-201414278426-A
Country	US
Kind code	B1
Filing date	May 15, 2014
Priority date	Jul 19, 2013
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

fNIRS may be used in real time or near-real time to detect the mental state of individuals. Phase measurement can be applied to drive an adaptive filter for the removal of motion artifacts in real time or near-real time. In this manner, the application of fNIRS may be extended to practical non-laboratory environments. For example, the mental state of an operator of a vehicle may be monitored, and alerts may be issued and/or an autopilot may be engaged when the mental state of the operator indicates that the operator is inattentive.

First claim

The invention claimed is:

1. A computer-implemented method, comprising:
receiving, by a computing system, data measured using frequency-domain fNIRS instrumentation pertaining to hemoglobin levels in an individual's brain;
determining, by the computing system, presence of a potential artifact based on a phase shift in the data measured using frequency-domain fNIRS instrumentation by comparing a signal intensity of a source signal to a detected signal intensity;
determining, by the computing system, whether changes in the hemoglobin levels and changes in the phase shift are correlated to confirm that the potential artifact is an artifact; and
reducing or removing the artifact, by the computing system, using Kalman filtering when the changes in the hemoglobin levels and changes in the phase shift are correlated.

2. The computer-implemented method of claim 1 , wherein said artifacts are detected on probes and reduced while the probes are measuring optical signals.

3. The computer-implemented method of claim 2 , wherein said artifacts are removed when an absolute value of the correlation exceeds a predetermined number.

4. The computer-implemented method of claim 2 , wherein the artifacts comprise signal contributions from motion, poor probe coupling, or both.

5. The computer-implemented method of claim 2 , further comprising:
filtering, by the computing system, relative hemoglobin changes that are calculated using the modified Beer Lambert law.

6. The computer-implemented method of claim 1 , further comprising:
tuning the Kalman filters, by the computing system, depending on a current state of a process that is being estimated.

7. The computer-implemented method of claim 1 , further comprising:
calculating, by the computing system, values for variances of process noise Q and measurement noise R before implementing the Kalman filters, wherein R is set as a function of phase variance over a window of time prior to a current sample.

8. The computer-implemented method of claim 7 , wherein R is in the range of 0 to 5.

9. The computer-implemented method of claim 1 , further comprising:
analyzing, by the computing system, a mental state of the individual based on measured hemoglobin levels in the individual's brain; and
determining, by the computing system, whether the mental state indicates that the individual is attentive enough to perform a task.

10. The computer-implemented method of claim 9 , wherein when the mental state of the individual is not attentive enough to perform the task, the method further comprises:
sending a signal to a remote individual or entity, generating an audible alarm, or both, by the computing system, indicating that the mental state of the individual is not sufficiently attentive.

11. The computer-implemented method of claim 9 , wherein when the mental state of the individual is not attentive enough to perform the task, the method further comprises:
engaging, by the computing system, an autopilot of a vehicle or disabling operation of the vehicle.

12. A computer program embodied on a non-transitory computer-readable medium, the program configured to cause at least one processor to:
receive data pertaining to hemoglobin levels in an individual's brain; and
determine presence of a potential artifact based on a phase shift in the data measured using the sensor array by comparing a signal intensity of a source signal to a detected signal intensity,
determine whether changes in the hemoglobin levels and changes in the phase shift are correlated to confirm that the potential artifact is an artifact, and
reduce or remove the artifact using Kalman filtering when the changes in the hemoglobin levels and changes in the phase shift are correlated
analyze a mental state of the individual based on [measured hemoglobin levels in the individual's brain] the filtered signals; and
determine whether the mental state indicates that the individual is attentive enough to perform a task.

13. The computer program of claim 12 , wherein when the mental state of the individual is not attentive enough to perform the task, the program is further configured to cause the at least one processor to send a signal to a remote individual or entity, generate an audible alarm, or both, indicating that the mental state of the individual is not sufficiently attentive.

14. The computer program of claim 12 , wherein when the mental state of the individual is not attentive enough to perform the task, the program is further configured to cause the at least one processor to engage an autopilot of a vehicle or disable operation of the vehicle.

15. A system, comprising:
a sensor array configured to provide analog data pertaining to hemoglobin levels in an individual's brain;
a microcontroller configured to receive the analog data from the sensor array and convert the analog data into digital data; and
a computing system configured to receive the digital data from the microcontroller, the computing system configured to:
determine presence of a potential artifact based on a phase shift in the data measured using the sensor array by comparing a signal intensity of a source signal to a detected signal intensity,
determine whether changes in the hemoglobin levels and changes in the phase shift are correlated to confirm that the potential artifact is an artifact, and
reduce or remove the artifact using Kalman filtering when the changes in the hemoglobin levels and changes in the phase shift are correlated.

16. The system of claim 15 , wherein the system is integrated with an aircraft, spacecraft, car, truck, ship, or industrial vehicle.

17. The system of claim 15 , wherein said artifacts are detected on probes and reduced while the probes are measuring optical signals.

18. The system of claim 15 , wherein the computing system is further configured to:
analyze a mental state of the individual based on measured hemoglobin levels in the individual's brain; and
determine whether the mental state indicates that the individual is attentive enough to perform a task.

19. The system of claim 18 , wherein when the mental state of the individual is not attentive enough to perform the task, the computing system is further configured to send a signal to a remote individual or entity, generate an audible alarm, or both, indicating that the mental state of the individual is not sufficiently attentive.

20. The system of claim 18 , wherein when the mental state of the individual is not attentive enough to perform the task, the computing system is further configured to engage an autopilot of a vehicle or disable operation of the vehicle.

Assignees

• Nasa
• The Us Administrator Of National Aeronautics And Space Administration

Inventors

• Harrivel Angela
• Hearn Tristan

Classifications

• G16H80/00

  ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring · CPC title

• A61B5/14553

  specially adapted for cerebral tissue · CPC title

• A61B5/747

  in case of emergency, i.e. alerting emergency services · CPC title

• A61B5/18 Primary

  for vehicle drivers {or machine operators} · CPC title

• A61B5/725

  using specific filters therefor, e.g. Kalman or adaptive filters (specific diagnostics methods using using bioelectric or biomagnetic signals A61B5/316) · CPC title