Autonomous driving support systems including vehicle headrest monitoring devices and methods incorporating the same

Patent metadata

Field	Value
Publication number	US-11091168-B2
Application number	US-201916264414-A
Country	US
Kind code	B2
Filing date	Jan 31, 2019
Priority date	Jan 31, 2019
Publication date	Aug 17, 2021
Grant date	Aug 17, 2021

Abstract

A driver support system of a vehicle that includes a neuroimaging sensor and a positioning sensor, the neuroimaging sensor detects neurological signals of an occupant and the positioning sensor detects a position of the occupant. The neuroimaging sensor is configured to be positioned within the vehicle distally from the occupant. The system further includes a processor and non-transitory computer-readable medium storing computer-readable instructions executed by the processor to generate a brainwave map based on the neurological signals, calibrate the brainwave map based on the position of the occupant, and determine a mental state of the occupant based on the calibrated-brainwave map. The processor further actuates vehicle support control in response to determining the mental state of the occupant.

First claim

What is claimed is:

1. A driver support system of a vehicle comprising:
a neuroimaging sensor that detects neurological signals of an occupant of the vehicle, wherein the neuroimaging sensor is configured to be positioned within the vehicle distally from the occupant such that the neuroimaging sensor is adjacent to the occupant;
a positioning sensor that detects a position of the occupant relative to the neuroimaging sensor; and
a processor;
non-transitory computer-readable medium storing computer-readable instructions that, when executed, causes the processor to:
generate a brain activity map of the occupant based on the neurological signals detected by the neuroimaging sensor;
calibrate the brain activity map by reorienting the brain activity map based on the position of the occupant relative to the neuroimaging sensor;
determine a mental state of the occupant based on the calibrated brain activity map; and
actuate vehicle support control in response to determining the mental state of the occupant.

2. The driver support system of claim 1 , wherein the neuroimaging sensor is a magnetoencephalography sensor embedded within a seat of the vehicle.

3. The driver support system of claim 1 , wherein the positioning sensor comprises a pressure sensor that detects a force applied thereto by the occupant or an imaging sensor that captures an image of the occupant within the vehicle.

4. The driver support system of claim 3 , wherein the non-transitory computer-readable medium storing computer-readable instructions that, when executed, causes the processor to determine the position of the occupant relative to the vehicle based on the force detected by the pressure sensor or the image captured by the imaging sensor.

5. The driver support system of claim 4 , wherein the non-transitory computer-readable medium storing computer-readable instructions thereon causes the processor to, when executed, calibrate the brain activity map by reorienting the brain activity map based on the position of the occupant as determined by the detected force or image.

6. The driver support system of claim 1 , wherein the non-transitory computer-readable medium storing computer-readable instructions thereon causes the processor to, when executed, compare the calibrated brain activity map to brain activity pattern data indicative of stored user profiles.

7. The driver support system of claim 1 , wherein the non-transitory computer-readable medium storing computer-readable instructions thereon causes the processor to, when executed, generate one or more visual notifications along a front windshield or a mirror of the vehicle at a location corresponding to an object external to the vehicle.

8. The driver support system of claim 7 , wherein the one or more visual notifications are displayed at varying predetermined frequencies.

9. The driver support system of claim 8 , wherein the non-transitory computer-readable medium storing computer-readable instructions thereon causes the processor to, when executed, determine whether the occupant detects the one or more visual notifications based on identifying the predetermined frequency of the respective visual notification from the neurological signals detected by the neuroimaging sensor.

10. The driver support system of claim 9 , wherein the non-transitory computer-readable medium storing computer-readable instructions thereon causes the processor to, when executed, cease the one or more visual notifications along the front windshield or the mirror in response to determining the occupant detects the predetermined frequency of the respective visual notification.

11. A vehicle comprising:
a seat for supporting an occupant received thereon;
a driver support system including at least one neuroimaging sensor and at least one positioning sensor, the neuroimaging sensor detects neurological signals of the occupant and the positioning sensor detects a position of the occupant relative to the neuroimaging sensor, wherein the neuroimaging sensor is configured to be positioned along the seat and adjacent to the occupant received thereon;
a processor;
non-transitory computer-readable medium storing computer-readable instructions thereon that, when executed, causes the processor to:
generate a brain activity map of the occupant based on the neurological signals detected by the neuroimaging sensor;
calibrate the brain activity map based on the position of the occupant relative to the neuroimaging sensor;
determine an emotional state of the occupant based on the calibrated brain activity map; and
initiate control of a vehicle system in response to determining the emotional state of the occupant.

12. The vehicle of claim 11 , wherein the vehicle system includes vehicle steering, braking, and accelerating.

13. The vehicle of claim 11 , wherein the vehicle system includes an HVAC device of the vehicle.

14. The vehicle of claim 11 , wherein vehicle system includes an audio or visual device of the vehicle.

15. The vehicle of claim 11 , wherein the at least one positioning sensor includes an imaging sensor that captures images of the occupant received on the seat and a pressure sensor that detects forces of occupant when received on the seat.

16. A method of autonomously supporting driver control of a vehicle, comprising:
generating a visual indicator along a surface of the vehicle within a field of view of a driver at a predetermined frequency, wherein the location of the visual indicator corresponds to a relative location of a target object that is to be identified by the occupant;
detecting a neurological signal of the occupant by a neuroimaging sensor positioned within the vehicle proximate to the occupant;
determining whether the occupant identified the visual indicator based on the neurological signal detected by the neuroimaging sensor; and
initiating control of a driver support system in response to determining that the occupant identified the visual indicator.

17. The method of claim 16 , wherein the surface includes a heads-up display, a rearview mirror or a side mirror.

18. The method of claim 17 , wherein the driver support system includes the visual indicator such that the method further comprises:
ceasing the visual indicator along the surface in response to determining the occupant identified the visual indicator; and
repeating the visual indicator along the surface in response to determining the occupant did not identify the visual indicator.

19. The method of claim 16 , wherein the driver support system includes a vehicle start-function, such that the method further comprises:
generating a second visual indicator along the surface of the vehicle at a predetermined frequency;
generating a brain activity map of the occupant based on the neurological signals detected by the neuroimaging sensor in response to determining the occupant identified the second visual indicator;
determining an identity of the occupant by comparing the brain activity map to brain activity pattern data indicative of stored-user profiles; and
determining whether the identity of the occupant corresponds to at least one stored-user profile.

20. The method of claim 16 , wherein the driver support system includes a visual or audio communication device such that the method further comprises:
determining an optimal communication frequency based on the neurological signals detected by the neuroimaging sensor when the occupant perceives the visual or audio communication; and
generating a communication via the visual or a

Assignees

• Toyota Eng & Mfg North America

Inventors

• Chou Chungchih
• Schmalenberg Paul
• Farooq Muhamed Kusay

Classifications

• B60W50/0098 Primary

  Details of control systems ensuring comfort, safety or stability not otherwise provided for · CPC title

• A61B5/05

  Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves (measuring movement of the entire body or parts thereof A61B5/11; detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof A61B5/24) · CPC title

• B60W2720/106

  Longitudinal acceleration · CPC title

• A61B5/165

  Evaluating the state of mind, e.g. depression, anxiety · CPC title

• B60W40/08

  related to drivers or passengers · CPC title