Vehicle driver monitoring system for determining driver workload

Patent metadata

Field	Value
Publication number	US-11488399-B2
Application number	US-201916718860-A
Country	US
Kind code	B2
Filing date	Dec 18, 2019
Priority date	Dec 19, 2018
Publication date	Nov 1, 2022
Grant date	Nov 1, 2022

Abstract

A method for monitoring a driver of a vehicle includes receiving, at a control, driver information based on the driver of the vehicle. A distraction workload of the driver is determined by the control based on the driver information and a driving workload of the driver is estimated by the control based on the driver information. An amount of driver attention is determined by the control based on the determined distraction workload and the determined driving workload.

First claim

The invention claimed is:

1. A method for monitoring a driver of a vehicle, the method comprising:
disposing a control at a vehicle, the control comprising electronic circuitry and associated software, wherein the electronic circuitry comprises a data processor;
receiving, at the control, driver information pertaining to a driver of the vehicle;
at least in part responsive to processing at the control of the received driver information, estimating a distraction workload of the driver based at least in part on the received driver information, wherein the distraction workload is estimated based at least in part on at least one selected from the group consisting of (i) vehicle entertainment information, (ii) driver condition information and (iii) visual distraction information;
at least in part responsive to processing at the control of the received driver information, estimating a driving workload of the driver based at least in part on the received driver information, wherein the driving workload is estimated based at least in part on at least one selected from the group consisting of (i) a visual driving condition, (ii) a traffic condition and (iii) a driver reaction capacity;
at least in part responsive to processing at the control of the estimated distraction workload and the estimated driving workload, determining an amount of driver attention based on the estimated distraction workload and based on the estimated driving workload; and
wherein determining the amount of driver attention comprises weighting the driving workload and the distraction workload based at least in part on driving conditions, and wherein an initial driving workload weight and an initial distraction workload weight are the same, and wherein the initial driving workload weight and the initial distraction workload weight are updated responsive to tendencies extracted from data collected from other vehicles.

2. The method of claim 1 , comprising classifying, by the control, the driver as at least one selected from the group consisting of overloaded, attentive, distracted and drowsy.

3. The method of claim 1 , wherein the driver information comprises vehicle entertainment information, driver condition information and visual distraction information, and wherein the distraction workload is estimated based at least in part on the vehicle entertainment information, the driver condition information and the visual distraction information.

4. The method of claim 1 , wherein the driver information comprises visual driving conditions, traffic conditions and driver reaction capacity, and wherein the driving workload is estimated based at least in part on the visual driving conditions, the traffic conditions and the driver reaction capacity.

5. The method of claim 1 , wherein the initial driving workload weight and the initial distraction workload weight are updated during operation of the vehicle.

6. The method of claim 1 , comprising determining, at least in part responsive to processing at the control of the received driver information, a maximum workload of the driver based at least in part on the received driver information, and wherein determining the amount of driver attention comprises subtracting a sum of the weighted driving workload and the weighted distraction workload from the maximum workload.

7. The method of claim 6 , wherein the determined amount of driver attention comprises a percentage value between zero and one hundred.

8. The method of claim 1 , wherein the driver information is weighted by confidence coefficients.

9. The method of claim 1 , wherein the driver information comprises at least one selected from the group consisting of driver position, driver identification, driver style, driver attention, driver health and driver emotion.

10. The method of claim 1 , comprising processing, at the control, received passenger information based on one or more passengers of the vehicle and adjusting, via the control, the determined amount of driver attention based at least in part on the received passenger information.

11. The method of claim 10 , wherein processing passenger information comprises processing, at the control, image data captured by an interior camera of the vehicle.

12. The method of claim 1 , wherein the received driver information comprises at least one selected from the group consisting of (i) braking behavior, (ii) acceleration behavior, (iii) lane keeping behavior, (iv) entertainment console usage, (v) climate control usage, (vi) image data captured by an interior camera of the vehicle and (vii) audio data captured by an interior microphone of the vehicle.

13. The method of claim 1 , wherein the received driver information comprises vehicle environmental information, and wherein the vehicle environmental information comprises at least one selected from the group consisting of (i) traffic information, (ii) infrastructure information, (iii) weather information and (iv) visibility information.

14. The method of claim 1 , comprising determining, via the control, a maximum workload of the driver based at least in part on the received driver information, and determining, via the control, the amount of driver attention based in part on the determined maximum workload of the driver.

15. A method for monitoring a driver of a vehicle, the method comprising:
disposing a control at a vehicle, the control comprising electronic circuitry and associated software, wherein the electronic circuitry comprises a data processor;
receiving, at the control, driver information pertaining to a driver of the vehicle;
at least in part responsive to processing at the control of the received driver information, determining a maximum workload of the driver based at least in part on the received driver information;
at least in part responsive to processing at the control of the received driver information, estimating a distraction workload of the driver based at least in part on the received driver information, wherein the distraction workload is estimated based at least in part on at least one selected from the group consisting of (i) vehicle entertainment information, (ii) driver condition information, (iii) visual distraction information;
at least in part responsive to processing at the control of the received driver information, estimating a driving workload of the driver based at least in part on the received driver information, wherein the driving workload is estimated based at least in part on at least one selected from the group consisting of (i) a visual driving condition, (ii) a traffic condition, and (iii) a driver reaction capacity;
at least in part responsive to processing at the control of the estimated distraction workload and the estimated driving workload, determining an amount of driver attention based on the estimated distraction workload, the estimated driving workload and the maximum workload;
processing, at the control, received passenger information based on one or more passengers of the vehicle and adjusting, via the control, the determined amount of driver attention based at least in part on the received passenger information;
wherein determining the amount of driver attention comprises weighting the driving workload and the distraction workload based at least in part on driving conditions, and wherein an initial driving workload weight and an initial distraction workload weight are the same; and
updating the initial driving workload weight and the initial distraction workload weight responsive to tendencies extracted from data collected from other vehicles.

16. A method for monitoring a driver of a vehicle,

Assignees

• Magna Electronics Inc

Inventors

• Wacquant Sylvie

Classifications

• G06V40/20

  Movements or behaviour, e.g. gesture recognition (recognition of facial expressions G06V40/16) · CPC title

• B60R11/0247

  for microphones or earphones · CPC title

• G06V40/10

  Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands · CPC title

• G06V40/174

  Facial expression recognition · CPC title

• G06V40/103

  Static body considered as a whole, e.g. static pedestrian or occupant recognition · CPC title