System and method for determining the perceptual load and the level of stimulus perception of a human brain

Patent metadata

Field	Value
Publication number	US-12102431-B2
Application number	US-201817054189-A
Country	US
Kind code	B2
Filing date	May 25, 2018
Priority date	May 25, 2018
Publication date	Oct 1, 2024
Grant date	Oct 1, 2024

Abstract

A method of determining the perceptual load of a human brain. The perceptual load is induced by a predetermined task carried out by the human. The method includes the steps of: measuring with a functional near-infrared spectroscopy (fNIRS) sensor device a metabolic activity of the human brain while the task is carried out and determining the perceptual load as a function of a measured change in metabolic activity. The invention further relates to a method of determining the level of stimulus perception corresponding systems.

First claim

The invention claimed is:

1. A method of determining perceptual load of a human brain, the perceptual load being induced by a predetermined task carried out by the human, the method comprising:
measuring a metabolic activity of the human brain with a functional near-infrared spectroscopy sensor device while the predetermined task is carried out, wherein the predetermined task comprises a varying complexity inducing a correspondingly varying perceptual load,
determining the perceptual load as a function of a measured change in metabolic activity, and
determining that the human brain was not attentive to the predetermined task in case the complexity decreases and at the same time the measured change in metabolic activity does not decrease below a first upper threshold or does not exceed a predetermined first lower threshold.

2. The method according to claim 1 , further comprising
determining that the human brain is still able to perceive and/or keep control of the task in case the metabolic activity is changing for more than a predetermined amount; and
determining that the perceptual load induced by the predetermined task exceeds a perceptual load threshold and/or that the human brain was not attentive to the task in case the complexity increases and at the same time the measured change in metabolic activity does not exceed a predetermined first upper threshold.

3. A method of determining a level of perception of a stimulus of a second type by a human brain, the method comprising:
period exposing the human brain to a predetermined stimulus of a first type in a first time period, in response to which the human carries out a predetermined task, thereby inducing a perceptual load in the human brain,
exposing the human brain to a predetermined stimulus of the first type and a predetermined stimulus of a second type perceivable by the human brain in a second time period,
measuring a metabolic activity of the human brain with a functional near-infrared spectroscopy sensor device in the first and the second time period, wherein the sensor device is a broadband functional near-infrared spectroscopy sensor device configured to sense in a range of 650 nm to 900 nm, and
determining the level of perception of the stimulus of the second type as a function of a measured change in metabolic activity in the second time period in relation to the first time period.

4. The method according to claim 3 , wherein
the first type is a task-primary type, and the second type is a task-secondary type.

5. The method according to claim 3 , further comprising
determining that the level of perception of the stimulus of the second type exceeds a predetermined minimum perception level in case the measured change in metabolic activity in the second time period in relation to the first time period exceeds a predetermined second upper threshold, and/or
determining that the human brain does not perceive the stimulus of the second type and/or that the human brain did not attend to the stimulus of the second type in case the measured change in metabolic activity in the second time period in relation to the first time period does not exceed the second upper predetermined threshold.

6. The method according to claim 3 , comprising at least one of:
generating the predetermined task to be carried out by the human; and
sensing the predetermined task carried out by the human.

7. The method according to claim 3 , wherein
the predetermined stimulus of the first type comprises a driving scene, and
the predetermined task comprises a driving task.

8. The method according to claim 3 , wherein
the stimulus of the first type is attended by the human when carrying out the task, and/or
the stimulus of the second type is not predetermined by the task such that the stimulus of the second type is an unattended stimulus for the human when carrying out the task.

9. The method according to claim 3 , wherein
the stimuli of the first type are variable such that complexity of the predetermined task varies correspondingly.

10. A system for determining perceptual load of a human brain, the system comprising:
a functional near-infrared spectroscopy sensor device configured to measure a change in metabolic activity of the human brain, and
a control device configured to determine the perceptual load based on the measured change in metabolic activity, wherein
the perceptual load is induced by a predetermined task carried out by the human,
the predetermined task comprises a varying complexity inducing a correspondingly varying perceptual load, and
the control device is configured to determine that the human brain was not attentive to the task in case the complexity decreases and at the same time the measured change in metabolic activity does not decrease below a predetermined first upper threshold or does not exceed a predetermined first lower threshold.

11. The system according to claim 10 , wherein
the perceptual load is induced by a predetermined task carried out by the human, and/or
the system comprises:
a generating and/or sensoring device configured to:
generate a predetermined task to be carried out by the human and/or sense a predetermined task carried out by the human.

12. A system for determining a level of perception of a stimulus by a human brain, the system comprising:
a generating and/or sensoring device configured to:
in a first time period and in a second time period generate a predetermined task to be carried out by the human and/or sense a predetermined task carried out by the human,
in the second time period generate and/or sense a predetermined stimulus perceivable by the human brain,

a broadband functional near-infrared spectroscopy sensor device configured to sense in a range of 650 nm to 900 nm and to measure a metabolic activity of the human brain in the first time period and the second time period, and
a control device configured to determine the level of perception of the stimulus as a function of a measured change in metabolic activity in the second time period in relation to the first time period.

13. The system according to claim 12 , wherein
the broadband functional near-infrared spectroscopy sensor device is configured to measure redox state changes of a mitochondrial enzyme indicative of cellular oxygen metabolism.

14. The system according to claim 13 , wherein
the mitochondrial enzyme indicative of cellular oxygen metabolism is cytochrome c oxidase.

15. The system according to claim 12 , wherein
measured changes in metabolic activity indicate an increase in energy consumption during neural responses of the human brain.

16. The system according to claim 12 , wherein
the broadband functional near-infrared spectroscopy sensor device is further configured to measure concentration changes of oxygenated haemoglobin and/or of deoxygenated haemoglobin.

17. The system according to claim 12 , wherein
the control device is configured to pre-select regions of interest of the brain based on concentration changes of oxygenated haemoglobin and/or of deoxygenated haemoglobin that are measured, and determine perceptual load based on the measured changes in metabolic activity in the pre-select regions of interest of the brain.

18. The system according to claim 12 , wherein
the broadband functional near-infrared spectroscopy sensor device is configured to measure changes in metabolic activity in the medial occipital lobe and/or the right medial occipital gyrus of the human brain, and
the control device is configured to determine perceptual load based

Assignees

• Toyota Motor Europe
• Ucl Business Ltd
• Toyota Motor Co Ltd

Inventors

• Ambeck-Madsen Jonas
• Lavie Nilli
• Bruckmaier Merit
• Tachtsidis Ilias

Classifications

• A61B5/4064

  Evaluating the brain (for intracranial pressure A61B5/031; for cerebral blood gases A61B5/14553; using EEG A61B5/369) · CPC title

• A61B5/18 Primary

  for vehicle drivers {or machine operators} · CPC title

• A61B5/14546

  for measuring analytes not otherwise provided for, e.g. ions, cytochromes · CPC title

• A61B5/0048

  Detecting, measuring or recording by applying mechanical forces or stimuli (A61B5/021, A61B5/4884 and A61B9/00 take precedence) · CPC title

• A61B5/14553 Primary

  specially adapted for cerebral tissue · CPC title