Apparatus detecting driving incapability state of driver

Patent metadata

Field	Value
Publication number	US-2021158064-A1
Application number	US-202117164868-A
Country	US
Kind code	A1
Filing date	Feb 2, 2021
Priority date	Jun 23, 2014
Publication date	May 27, 2021
Grant date	—

Abstract

Apparatus detecting driving incapability state of a driver includes: a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver's seat captured by an imaging device mounted in a vehicle; and an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle.

First claim

1 . An apparatus detecting driving incapability state of a driver of a vehicle, the apparatus comprising:
a head detection portion that detects a position of a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in a vehicle; a facial orientation detection portion that detects a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat; a state detection portion that detects that the driver is incapable of driving, when, during traveling of the vehicle, (i) the position of the head portion of the driver detected by the head detection portion is out of a predetermined scope and (ii) the facial orientation of the driver with respect to the front of the vehicle detected by the facial orientation detection portion is oriented downward further than a threshold; and a human machine interface (HMI) that notifies of detection by the state detection portion that the driver is incapable of driving.

2 . An apparatus detecting driving incapability state of a driver of a vehicle, the apparatus comprising:
a head detection portion that detects a position of a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in the vehicle; a facial orientation detection portion that detects a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat; a state detection portion that detects that the driver is incapable of driving, when, during traveling of the vehicle, (i) the position of the head portion of the driver detected by the head detection portion is out of a predetermined scope and (ii) the facial orientation of the driver with respect to the front of the vehicle detected by the facial orientation detection portion is oriented upward further than a threshold; and a human machine interface (HMI) that notifies of detection by the state detection portion that the driver is incapable of driving.

3 . The apparatus according to claim 1 , wherein
the state detection portion detects that the driver is incapable of driving, on condition that, during the traveling of the vehicle, (i) the detected position of the head portion of the driver is out of the predetermined scope over a determination time and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented further than the threshold over an orientation collapse determination time.

4 . The apparatus according to claim 2 , wherein
the state detection portion detects that the driver is incapable of driving, on condition that, during the traveling of the vehicle, (i) the detected position of the head portion of the driver is out of the predetermined scope over a determination time and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented further than the threshold over an orientation collapse determination time.

5 . The apparatus according to claim 1 , wherein:
the HMI includes a plurality of displays; and a detection result of the driving incapability state is notified to an occupant by the plurality of displays.

6 . The apparatus according to claim 2 , wherein:
the HMI includes a plurality of displays; and a detection result of the driving incapability state is notified to an occupant by the plurality of displays.

7 . The apparatus according to claim 1 , wherein:
the HMI includes a display and a speaker; and the display is a display of a car navigator.

8 . The apparatus according to claim 2 , wherein:
the HMI includes a display and a speaker; and the display is a display of a car navigator.

9 . The apparatus according to claim 1 , wherein:
the HMI includes a speaker; and the speaker is a vehicle-mounted speaker shared by a car navigator or audio equipment.

10 . The apparatus according to claim 2 , wherein:
the HMI includes a speaker; and the speaker is a vehicle-mounted speaker shared by a car navigator or audio equipment.

11 . A system comprising:
a detection apparatus that detects driving incapability state of a driver of a vehicle; and a vehicle controller that causes the vehicle to safely stop when there is no response to inquiring the driver whether the driver is incapable of driving, wherein the detection apparatus includes:
a head detection portion that detects a position of a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in the vehicle;
a facial orientation detection portion that detects a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat;
a state detection portion that detects that the driver is incapable of driving, when, during traveling of the vehicle, (i) the position of the head portion of the driver detected by the head detection portion is out of a predetermined scope and (ii) the facial orientation of the driver with respect to the front of the vehicle detected by the facial orientation detection portion is oriented downward further than a threshold; and
a human machine interface (HMI) that notifies of detection by the state detection portion that the driver is incapable of driving.

12 . A system comprising:
a detection apparatus that detects driving incapability state of a driver of a vehicle; and a vehicle controller that causes the vehicle to safely stop when there is no response to inquiring the driver whether the driver is incapable of driving, wherein the detection apparatus includes:
a head detection portion that detects a position of a head portion, which is higher than a neck of the driver, based on an image of a driver seat captured by an imaging device mounted in the vehicle;
a facial orientation detection portion that detects a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat;
a state detection portion that detects that the driver is incapable of driving, when, during traveling of the vehicle, (i) the position of the head portion of the driver detected by the head detection portion is out of a predetermined scope and (ii) the facial orientation of the driver with respect to the front of the vehicle detected by the facial orientation detection portion is oriented upward further than a threshold; and
a human machine interface (HMI) that notifies of detection by the state detection portion that the driver is incapable of driving.

13 . The apparatus according to claim 1 , wherein
a processor executing a program performs each of the head detection portion, the facial orientation detection portion, and the state detection portion.

14 . The apparatus according to claim 2 , wherein
a processor executing a program performs each of the head detection portion, the facial orientation detection portion, and the state detection portion.

15 . The system according to claim 11 , wherein
a processor executing a program performs each of the head detection portion, the facial orientation detection portion, and the state detection portion.

16 . The system according to claim 12 , wherein
a processor executing a program performs each of the head detection portion, the facial orientation detection portion, and the state detection portion.

Assignees

• Denso Corp

Inventors

• Banno Hiroto
• Omi Takuhiro
• Munaoka Yutaka
• Enya Takeshi

Classifications

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• B60W40/08 Primary

  related to drivers or passengers · CPC title

• B60W2540/223

  Posture, e.g. hand, foot, or seat position, turned or inclined · CPC title

• B60W2554/804

  Relative longitudinal speed · CPC title

• B60W2554/802

  Longitudinal distance · CPC title