Predictive human-machine interface using eye gaze technology, blind spot indicators and driver experience

Patent metadata

Field	Value
Publication number	US-9650041-B2
Application number	US-201013515249-A
Country	US
Kind code	B2
Filing date	Dec 9, 2010
Priority date	Dec 18, 2009
Publication date	May 16, 2017
Grant date	May 16, 2017

Abstract

A system and method are disclosed for preventing accidents in a vehicle. The system comprises an eye gaze detector for receiving an eye gaze vector from a driver. The system additionally comprises a proximity sensor for detecting locations of nearby objects and their velocities. A vehicle accident risk is determined based on the nearby object location and velocity. Additionally, the driver's knowledge of vehicle circumstances is determined based on the nearby object location and velocity as well as the eye gaze location. Responsive to the driver's knowledge and the vehicle accident risk, a vehicle alert is activated.

First claim

What is claimed is:

1. A method of providing an accident warning alert in a vehicle comprising:
detecting a location of at least one lane marker, a location of an adjacent vehicle, and a location of the vehicle relative to the at least one lane marker based on a proximity sensor;
determining an eye gaze vector based on an eye gaze detector and determining a current pupil size of a driver;
gathering, using the eye gaze vector determined from the eye gaze detector, driver experience information based on an amount of time the driver uses peripheral vision and the driver's reaction time to the adjacent vehicle, wherein the driver experience information is further based on an amount of time the driver has spent driving in a current weather condition;
determining, using a processor, a metric of driver awareness of the vehicle location with respect to the location of the at least one lane marker using the eye gaze vector;
determining, using the processor, a vehicle accident risk based on the relative location of the vehicle and the at least one lane marker;
locking out a vehicle infotainment system, using the processor, the locking out based on the vehicle accident risk, the driver experience level, the current weather condition, a comparison of the current pupil size of the driver to a baseline pupil size for the driver, and the metric of the driver awareness of the vehicle location with respect to the location of the at least one lane marker and the adjacent vehicle; and
activating a vehicle alert, using the processor, the vehicle alert based on the vehicle accident risk, the driver experience level, and the metric of the driver awareness of the vehicle location with respect to the location of the at least one lane marker.

2. The method of claim 1 further comprising:
activating a car control function based on the vehicle accident risk, the driver experience level, and the driver's awareness of the vehicle location.

3. The method of claim 2 wherein the car control function is at least one of a vehicle braking function, a steering wheel function, or an infotainment control function.

4. The method of claim 1 wherein determining the vehicle accident risk further comprises:
determining a location of a nearby object; and
determining whether the location of the nearby object is within a field of view of the eye gaze vector.

5. The method of claim 1 wherein the vehicle alert comprises a first visual alert when the metric of driver awareness of the vehicle location and the vehicle accident risk are above a first threshold.

6. The method of claim 5 wherein the vehicle alert comprises a second visual alert when the metric of driver awareness of the vehicle location and the vehicle accident risk are above a second threshold.

7. The method of claim 6 wherein the vehicle alert comprises an auditory alert when the metric of driver awareness of the vehicle location and the vehicle accident risk are above a third threshold.

8. The method of claim 4 wherein the nearby object is at least one of a second vehicle, or a fixed object.

9. The method of claim 8 further comprising detecting the nearby object velocity using the proximity sensor, and wherein determining the vehicle accident risk is further based on the nearby object velocity.

10. A system of providing an accident warning alert in a vehicle comprising:
an eye gaze detector configured to receive an eye gaze vector from a driver and a current pupil size of the driver, the eye gaze detector further configured to determine driver experience based on an amount of time the driver uses peripheral vision and the driver's reaction time to an adjacent vehicle, wherein the driver experience is further based on an amount of time the driver has spent driving in a current weather condition;
a proximity sensor configured to detect a location of at least one lane marker, a location of the adjacent vehicle, and a location of the vehicle relative to the at least one lane marker;
an electronic control unit configured to determine a vehicle accident risk based on the relative location of the vehicle and the at least one lane marker;
the electronic control unit further configured to lock out a vehicle infotainment system based on the vehicle accident risk, the driver experience level, the current weather condition, a comparison of the current pupil size of the driver to a baseline pupil size for the driver, and the metric of the driver awareness of the vehicle location with respect to the location of the at least one lane marker and the adjacent vehicle; and
the electronic control unit further configured to activate a vehicle alert based on the vehicle accident risk, the driver experience level, and a metric of driver awareness of the vehicle location with respect to the location of the at least one lane marker determined using the eye gaze vector.

11. The system of claim 10 wherein the electronic control unit is further configured to activate a car control function based on the vehicle accident risk, the driver experience level, and the metric of driver awareness of the vehicle location.

12. The system of claim 11 wherein the car control function is at least one of a vehicle braking function, a steering wheel function, or an infotainment control function.

13. The system of claim 10 wherein the determination of the vehicle accident risk is further based on determining a location of a nearby object and determining whether the location of the nearby object is within a field of view of the eye gaze vector.

14. The system of claim 10 wherein the vehicle alert comprises a first visual alert when the metric of driver awareness of the vehicle location and the vehicle accident risk are above a first threshold.

15. The system of claim 14 wherein the vehicle alert comprises a second visual alert when the metric of driver awareness of the vehicle location and the vehicle accident risk are above a second threshold.

16. The system of claim 15 wherein the vehicle alert comprises an auditory alert when the metric of driver awareness of the vehicle location and the vehicle accident risk are above a third threshold.

17. The system of claim 13 wherein the nearby object is at least one of a second vehicle, or a fixed object.

18. The system of claim 17 wherein the proximity sensor is further configured to detect a nearby object velocity, and wherein the vehicle accident risk and is further based on the nearby object velocity.

19. The method of claim 1 wherein the driver experience is determined based on the amount of time the driver uses peripheral vision in relation to an upcoming road feature.

20. A method of providing an accident warning alert in a vehicle comprising:
detecting a location of at least one lane marker, a location of an adjacent vehicle, and a location of the vehicle relative to the at least one lane marker based on a proximity sensor;
determining an eye gaze vector based on an eye gaze detector and determining a current pupil size of a driver;
gathering, using the eye gaze vector determined from the eye gaze detector, driver experience information based on an amount of time the driver uses peripheral vision, the driver's reaction time to the adjacent vehicle, and an amount of time the driver has spent driving in a current weather condition;
determining, using a processor, a metric of driver awareness of the vehicle location with respect to the location of the at least one lane marker using the eye gaze vector;
determining, using the processor, a vehicle accident risk based on

Assignees

• Feit Steven
• Scheufler Nick
• Choi Dave
• Kosterich Michelle
• Miller Ross
• Grebe Cody
• Lin Jason
• Honda Motor Co Ltd

Inventors

• Feit Steven
• Scheufler Nick
• Choi Dave
• Kosterich Michelle
• Miller Ross
• Grebe Cody
• Lin Jason

Classifications

• B60W2554/00

  Input parameters relating to objects · CPC title

• B60W2050/143

  Alarm means · CPC title

• B60W10/18

  including control of braking systems · CPC title

• G01S13/931

  of land vehicles · CPC title

• B60W10/30

  including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps · CPC title