Primary preview region and gaze based driver distraction detection

Patent metadata

Field	Value
Publication number	US-11017249-B2
Application number	US-201815882581-A
Country	US
Kind code	B2
Filing date	Jan 29, 2018
Priority date	Jan 29, 2018
Publication date	May 25, 2021
Grant date	May 25, 2021

Abstract

A computer-implemented method of detecting distracted driving comprises: determining, by one or more processors, a primary preview region (PPR) in a representation of an environment; determining, by the one or more processors, a gaze point for a driver based on a sequence of images of the driver; determining, by the one or more processors, that the gaze point is outside of the PPR; based on the determined gaze point being outside of the PPR, decreasing, by the one or more processors, an attention level for the PPR; based on the attention level for the PPR, generating, by the one or more processors, an alert.

First claim

What is claimed is:

1. A computer-implemented method of detecting distracted driving comprising:
determining, by one or more processors, a primary preview region (PPR) in a representation of an environment;
determining, by the one or more processors, a first gaze point for a driver based on a first sequence of images of the driver;
determining, by the one or more processors, that the first gaze point is inside of the PPR;
based on the first gaze point being inside of the PPR and a reaction coefficient of the driver, increasing, by the one or more processors, an attention level for the PPR using a first function;
determining, by the one or more processors, a second gaze point based on a second sequence of images of the driver;
determining, by the one or more processors, that the second gaze point is outside of the PPR;
based on the second gaze point being outside of the PPR and the reaction coefficient of the driver, decreasing, by the one or more processors, the attention level for the PPR using a second function different from the first function; and
based on the decreased attention level for the PPR, generating, by the one or more processors, an alert.

2. The method of claim 1 , wherein:
the PPR is a first PPR and is one of a plurality of PPRs, each PPR of the plurality of PPRs having a corresponding attention level;
the generating of the alert is further based on the attention level for each PPR of the plurality of PPRs; and
the method further comprises:
estimating a future path using vehicle and road information;
determining that the first PPR is not along the future path; and
based on the determination that the first PPR is not along the future path, removing the first PPR from the plurality of PPRs.

3. The method of claim 2 , further comprising:
determining a priority score for each PPR of the plurality of PPRs; and
wherein the attention level for each PPR of the plurality of PPRs is based on the priority score for the PPR.

4. The method of claim 1 , further comprising:
identifying an object depicted in the representation of the environment by analyzing the representation with a trained machine-learning algorithm.

5. The method of claim 1 , wherein the determining of the PPR comprises:
determining a primary preview point (PPP); and
determining the PPR based on the PPP and a predetermined radius.

6. The method of claim 1 , wherein the determining of the PPR in the representation of the environment comprises identifying a lane of a road.

7. The method of claim 1 , wherein the representation of the environment is generated by a laser scanner.

8. The method of claim 1 , wherein the generating of the alert comprises generating an audio alert.

9. The method of claim 1 , wherein the generating of the alert comprises generating a haptic alert.

10. The method of claim 1 , wherein the generating of the alert comprises activating brakes of a vehicle.

11. The method of claim 1 , wherein the generating of the alert comprises altering a direction of a vehicle.

12. The method of claim 1 , wherein the determining of the attention level for the PPR is based on a skill level of the driver.

13. The method of claim 1 , wherein the generating of the alert is further based on a predetermined threshold.

14. A system for detecting distracted driving, comprising:
a memory storage comprising instructions; and
one or more processors in communication with the memory, wherein the one or more processors execute the instructions to perform:
determining a primary preview region (PPR) in a representation of an environment;
determining a first gaze point for a driver based on a first sequence of images of the driver;
determining that the first gaze point is inside of the PPR;
based on the first gaze point being inside of the PPR and a reaction coefficient of the driver, increasing an attention level for the PPR using a first function;
determining a second gaze point based on a second sequence of images of the driver;
determining that the second gaze point is outside of the PPR;
based on the second gaze point being outside of the PPR and the reaction coefficient of the driver, decreasing the attention level for the PPR using a second function different from the first function; and
based on the decreased attention level for the PPR, generating an alert.

15. A non-transitory computer-readable medium that stores instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
determining a first primary preview region (PPR) in a representation of an environment;
determining a first gaze point for a driver based on a first sequence of images of the driver;
determining that the first gaze point is inside of the PPR;
based on the first gaze point being inside of the PPR and a reaction coefficient of the driver, increasing an attention level for the PPR using a first function;
determining a second gaze point based on a second sequence of images of the driver;
determining that the second gaze point is outside of the PPR;
based on the second gaze point being outside of the PPR and the reaction coefficient of the driver, decreasing the attention level for the PPR using a second function different from the first function; and
based on the decreased attention level for the PPR , generating an alert.

16. The system of claim 14 , wherein:
the PPR is a first PPR and is one of a plurality of PPRs, each PPR of the plurality of PPRs having a corresponding attention level;
the generating of the alert is further based on the attention level for each PPR of the plurality of PPRs; and
the one or more processors further execute the instructions to perform:
estimating a future path using vehicle and road information;
determining that the first PPR is not along the future path; and
based on the determination that the first PPR is not along the future path, removing the first PPR from the plurality of PPRs.

17. The computer-implemented method of claim 1 , wherein:
the first function is a logistic decay function; and
the second function is a logistic growing function.

18. The computer-implemented method of claim 17 , wherein:
a scaling factor of the logistic decay function is different than a scaling factor of the logistic growing function.

19. The computer-implemented method of claim 1 , further comprising:
determining a second PPR in the representation of the environment;
determining that the first gaze point is inside of the second PPR; and
based on the first gaze point being inside of the second PPR, increasing a second attention level for the second PPR using the first function.

Assignees

• Futurewei Technologies Inc

Inventors

• Yu Hai
• Porikli Fatih
• Wu Yuzhu

Classifications

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• G06F3/013 Primary

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• H04N23/20

  for generating image signals from infrared radiation only · CPC title

• H04N5/33

  Transforming infrared radiation (cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20) · CPC title