Apparatus and method for monitoring vehicle operation

Patent metadata

Field	Value
Publication number	US-11420637-B2
Application number	US-201917278264-A
Country	US
Kind code	B2
Filing date	Aug 22, 2019
Priority date	Sep 19, 2018
Publication date	Aug 23, 2022
Grant date	Aug 23, 2022

Abstract

Embodiments of the present invention provide a control system for a vehicle, the vehicle (800) being operable in an at least partly autonomous mode and a manual mode, the control system comprising input means (291, 292) for receiving a gaze signal (211) indicative of a direction of a gaze of an occupant of the vehicle (800), and a contact signal (212) indicative of physical contact between the occupant and a control of the vehicle, control means (250, 260, 270, 280, 290) configured to determine an estimate of the occupant's attention to a driving task in the at least partly autonomous mode in dependence on the gaze signal (211) and to determine when the occupant is at least partly obscured relative to the at least one imaging means (150, 220), wherein the control means (250, 260, 270, 280, 290) is configured to determine the estimate of the occupant's attention to the driving task in dependence on the contact signal when it is determined that the occupant is at least partly obscured.

First claim

The invention claimed is:

1. A control system for a vehicle, the vehicle being operable in an at least partly autonomous mode and a manual mode, the control system comprising one or more controllers, the control system being configured to:
receive a gaze signal indicative of a direction of a gaze of an occupant of the vehicle, said gaze signal being determined in dependence on image data relating to at least a portion of the occupant, the image data being output by at least one imaging device, and a contact signal indicative of physical contact between the occupant and a control of the vehicle;
determine an estimate of the occupant's attention to a driving task in the at least partly autonomous mode in dependence on the gaze signal and to determine when the occupant is at least partly obscured relative to the at least one imaging device, wherein the control system is configured to determine the estimate of the occupant's attention to the driving task in dependence on the contact signal when it is determined that the occupant is at least partly obscured relative to the at least one imaging device; and
output a signal for initiating one or more actions;
wherein the control system is configured to output the signal in dependence on the estimate of the driver's attention to the driving task and one or more predetermined threshold values.

2. The control system of claim 1 , configured to determine the estimate of the occupant's attention to the driving task in dependence on the gaze signal being indicative of the occupant's gaze being directed to a driving region or a non-driving region.

3. The control system of claim 2 , wherein the control system being configured to determine the estimate of the occupant's attention to the driving task in dependence on the gaze signal comprises the control system being arranged to determine a gaze-duration measure indicative of a duration of time for which the occupant's gaze is directed to the driving region and the non-driving region respectively.

4. The control system of claim 3 , configured to update the gaze-duration measure in a first direction in dependence on the gaze signal being indicative of the driver's gaze being directed to a primary driving region, update the gaze-duration measure in a second direction at a first rate in dependence on the gaze signal being indicative of the driver's gaze being directed to a secondary driving region, and to update the gaze-duration measure in the second direction at a second rate in dependence on the gaze signal being indicative of the driver's gaze being directed to the non-driving region.

5. The control system of claim 2 , wherein the control system being configured to determine the estimate of the occupant's attention to the driving task in dependence on the gaze signal comprises the control system being configured to determine a gaze-distance measure indicative of a distance of travel ahead of the vehicle to which the occupant is deemed attentive.

6. The control system of claim 5 , configured to update the gaze-distance measure indicative of the occupant's gaze being directed to the driving region and the non-driving region, respectively, said updating being in dependence on a velocity of the vehicle.

7. The control system of claim 5 configured to update the gaze-distance measure in a first direction in dependence on the gaze signal being indicative of the driver's gaze being directed to a primary driving region, for a predetermined period of time, to update the gaze-distance measure in a second direction in dependence on the gaze signal being indicative of the driver's gaze being directed to one of a secondary driving region, or the non-driving region for a predetermined period of time.

8. The control system of claim 1 , wherein the determining the estimate of the occupant's attention to the driving task in dependence on the contact signal comprises the control system being configured to determine a contact value at least partly representing the estimate of the driver's attention to the driving task and to update the contact value in dependence on the contact signal.

9. The control system of claim 8 , configured to update the contact value in a first direction in dependence on the contact signal being indicative of physical contact between the driver and the control of the vehicle and to update the contact value in a second direction in dependence on the contact signal being indicative of an absence of physical contact between the driver and the control of the vehicle.

10. A method for a vehicle operable in an at least partly autonomous mode and a manual mode, the method comprising:
receiving a gaze signal indicative of a direction of a gaze of an occupant of a vehicle, said gaze signal being determined in dependence on image data relating to at least a portion of the occupant, the image data being output by at least one imaging device;
receiving a contact signal indicative of physical contact between the occupant and a control of the vehicle;
determining an estimate of the occupant's attention to a driving task in the at least partly autonomous mode in dependence on the gaze signal;
determining when the occupant is at least partly obscured relative to the at least one imaging device and, when so determined, determining the estimate of the occupant's attention to the driving task in dependence on the contact signal;
initiating one or more actions in dependence on the estimate of the occupant's attention to the driving task and one or more predetermined threshold values.

11. A system, comprising:
the control system according to claim 1 ;
at least one imaging device configured to provide image data relating to at least a portion of an occupant of a vehicle; and
a contact detection device configured to provide a contact signal indicative of physical contact between the occupant and a control of the vehicle.

12. A vehicle comprising the control system of claim 1 .

13. A non-transitory computer-readable medium having stored hereon computer software which, when executed, is arranged to perform the method according to claim 10 .

Assignees

• Jaguar Land Rover Ltd

Inventors

• Fairgrieve Andrew
• King Paul
• Matthias Rebecca
• Simlett John
• Iacovou Nicolas

Classifications

• B60W60/0053

  from vehicle to occupant · CPC title

• B60W2540/223

  Posture, e.g. hand, foot, or seat position, turned or inclined · CPC title

• B60W60/0059

  Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity · CPC title

• B60W2540/229

  Attention level, e.g. attentive to driving, reading or sleeping · CPC title

• B60W2540/225

  Direction of gaze · CPC title