Apparatus detecting driving incapability state of driver

Patent metadata

Field	Value
Publication number	US-10936888-B2
Application number	US-201916665044-A
Country	US
Kind code	B2
Filing date	Oct 28, 2019
Priority date	Jun 23, 2014
Publication date	Mar 2, 2021
Grant date	Mar 2, 2021

Abstract

Apparatus detecting driving incapability state of a driver includes: a head detection portion that successively detects a head portion, which is higher than a neck of the driver, based on an image of a driver's seat captured by an imaging device mounted in a vehicle; and an out-of-frame state detection portion that detects that the driver is incapable of driving, when the head portion detected by the head detection portion is out of a predetermined scope in the image during travelling of the vehicle.

First claim

The invention claimed is:

1. An apparatus for detecting a driving incapability state of a driver of a vehicle, the apparatus comprising:
a computer including a processor and a memory,
the computer is configured to:
three-dimensionally detect a position of a head portion of the driver based on an image of a driver seat captured by an imaging device mounted in the vehicle, wherein the head portion of the driver is higher than a neck of the driver;
detect a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat; and
detect that the driver is incapable of driving, when, during traveling of the vehicle, (i) the detected position of the head portion of the driver is out of a predetermined three-dimensional scope and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented downward further than a threshold.

2. The apparatus according to claim 1 , wherein
the computer detects that the driver is incapable of driving, when, during the traveling of the vehicle, (i) the detected position of the head portion of the driver is out of the predetermined three-dimensional scope over an out-of-frame determination time and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented downward further than the threshold over an orientation collapse determination time.

3. An apparatus for detecting a driving incapability state of a driver of a vehicle, the apparatus comprising:
a computer including a processor and a memory,
the computer is configured to:
three-dimensionally detect a position of a head portion of the driver based on an image of a driver seat captured by an imaging device mounted in the vehicle, wherein the head portion of the driver is higher than a neck of the driver;
detect a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat; and
detect that the driver is incapable of driving, when, during traveling of the vehicle, (i) the detected position of the head portion of the driver is out of a predetermined three-dimensional scope and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented upward further than a threshold.

4. The apparatus according to claim 3 , wherein
the computer detects that the driver is incapable of driving, when, during the traveling of the vehicle, (i) the detected position of the head portion of the driver is out of the predetermined three-dimensional scope over an out-of-frame determination time and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented upward further than the threshold over an orientation collapse determination time.

5. A method for detecting a driving incapability state of a driver of a vehicle, the method comprising:
capturing, by a camera, a driver seat of the vehicle;
three-dimensionally detecting, by a processor, a position of a head portion of the driver higher than a neck of the driver based on an image of the driver seat captured by the camera;
detecting, by the processor, a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat; and
detecting, by the processor, that the driver is incapable of driving, when, during traveling of the vehicle, (i) the detected position of the head portion of the driver is out of a predetermined three-dimensional scope and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented downward further than a threshold.

6. The method according to claim 5 , wherein:
when, during the traveling of the vehicle, (i) the detected position of the head portion of the driver is out of the predetermined three-dimensional scope over an out-of-frame determination time and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented downward further than the threshold over an orientation collapse determination time, it is detected that the driver is incapable of driving.

7. A method for detecting a driving incapability state of a driver of a vehicle, the method comprising:
capturing, by a camera, a driver seat of the vehicle;
three-dimensionally detecting, by a processor, a position of a head portion of the driver higher than a neck of the driver based on an image of the driver seat captured by the camera;
detecting, by the processor, a facial orientation of the driver with respect to a front of the vehicle based on the image of the driver seat; and
detecting, by the processor, that the driver is incapable of driving, when, during traveling of the vehicle, (i) the detected position of the head portion of the driver is out of a predetermined three-dimensional scope and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented upward further than a threshold.

8. The method according to claim 7 , wherein
when, during the traveling of the vehicle, (i) the detected position of the head portion of the driver is out of the predetermined three-dimensional scope over an out-of-frame determination time and (ii) the detected facial orientation of the driver with respect to the front of the vehicle is oriented upward further than the threshold over an orientation collapse determination time, it is detected that the driver is incapable of driving.

Assignees

• Denso Corp

Inventors

• Banno Hiroto
• Omi Takuhiro
• Munaoka Yutaka
• Enya Takeshi

Classifications

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• B60W40/08 Primary

  related to drivers or passengers · CPC title

• B60W2540/223

  Posture, e.g. hand, foot, or seat position, turned or inclined · CPC title

• B60W2554/804

  Relative longitudinal speed · CPC title

• B60W2554/802

  Longitudinal distance · CPC title