Apparatus and method for monitoring vehicle operation

Patent metadata

Field	Value
Publication number	US-11738758-B2
Application number	US-202217893115-A
Country	US
Kind code	B2
Filing date	Aug 22, 2022
Priority date	Sep 19, 2018
Publication date	Aug 29, 2023
Grant date	Aug 29, 2023

Abstract

Embodiments of the present invention provide a control system for a vehicle, the vehicle ( 800 ) being operable in an at least partly autonomous mode and a manual mode, the control system comprising input means ( 291, 292 ) for receiving a gaze signal ( 211 ) indicative of a direction of a gaze of an occupant of the vehicle ( 800 ), and a contact signal ( 212 ) indicative of physical contact between the occupant and a control of the vehicle, control means ( 250, 260, 270, 280, 290 ) configured to determine an estimate of the occupant's attention to a driving task in the at least partly autonomous mode in dependence on the gaze signal ( 211 ) and to determine when the occupant is at least partly obscured relative to the at least one imaging means ( 150, 220 ), wherein the control means ( 250, 260, 270, 280, 290 ) is configured to determine the estimate of the occupant's attention to the driving task in dependence on the contact signal when it is determined that the occupant is at least partly obscured.

First claim

The invention claimed is:

1. A control system for a vehicle, the control system comprising one or more controllers, the control system being configured to:
receive a gaze signal indicative of a direction of a gaze of an occupant of a vehicle, wherein said gaze signal is indicative of an occupant's gaze being directed to a primary driving region, PDR, a secondary driving region, SDR, or a non-driving region, NDR;
determine an attention value indicative of an estimate of the occupant's attention to a driving task, wherein said attention value is changed in a first direction in dependence on the gaze signal being indicative of the occupant's gaze being directed to the PDR, said attention value is changed in a second direction at a first rate in dependence on the gaze signal being indicative of the occupant's gaze being directed to the SDR and said attention value is changed in the second direction at a second rate in dependence on the gaze signal being indicative of the occupant's gaze being directed to the NDR; and
output a signal to cause one or more actions to be performed in dependence on the attention value being equal to or exceeding a predetermined threshold value.

2. The control system of claim 1 , wherein the control system being configured to determine the attention value indicative of the estimate of the occupant's attention to the driving task comprises the control system being arranged to determine a gaze-duration measure indicative of a duration of time for which the occupant's gaze is directed to the primary driving region, the secondary driving region and the non-driving region respectively.

3. The control system of claim 2 , wherein the gaze signal is determined in dependence on image data relating to at least a portion of the occupant, the image data being output by at least one imaging means, and the control system is configured to suspend updating of the gaze-duration measure when the occupant is at least partly obscured relative to the at least one imaging means.

4. The control system of claim 2 , configured to output the signal when the gaze-duration measure reaches the predetermined threshold.

5. The control system of claim 2 , configured to update the gaze-duration measure in a first direction in dependence on the gaze signal being indicative of a driver's gaze being directed to the PDR, update the gaze-duration measure in a second direction at a first rate in dependence on the gaze signal being indicative of the driver's gaze being directed to the SDR, and to update the gaze-duration measure in the second direction at a second rate in dependence on the gaze signal being indicative of the driver's gaze being directed to the NDR.

6. The control system of claim 5 , wherein the second rate for updating the gaze-duration measure is greater than the first rate for updating the gaze-duration measure.

7. The control system of claim 2 , wherein the control system being configured to determine the estimate of the occupant's attention to the driving task in dependence on the gaze signal comprises the control system being configured to determine a gaze-distance measure indicative of a distance of travel ahead of the vehicle to which the occupant is deemed attentive.

8. The control system of claim 7 , configured to update the gaze-distance measure indicative of the occupant's gaze being directed to a driving region and the non-driving region, respectively, said updating being in dependence on a velocity of the vehicle.

9. The control system of claim 8 , configured to update the gaze-distance measure in dependence on the velocity of the vehicle and a predetermined gain value.

10. The control system of claim 7 , configured to update the gaze-distance measure in a first direction in dependence on the gaze signal being indicative of a driver's gaze being directed to the PDR, for a predetermined period of time, to update the gaze-distance measure in a second direction in dependence on the gaze signal being indicative of the driver's gaze being directed to one of the SDR, or the NDR for a predetermined period of time.

11. The control system of claim 7 , wherein the control system is configured to output the signal in dependence both the gaze-duration measure and the gaze distance measure reaching respective predetermined thresholds.

12. The control system of claim 1 , wherein the determining the attention value indicative of the estimate of the occupant's attention to the driving task comprises the control system being configured to determine a contact value at least partly representing the estimate of a driver's attention to the driving task and to update the contact value in dependence on a contact signal.

13. The control system of claim 12 , wherein:
the control system being configured to determine the attention value indicative of the estimate of the occupant's attention to the driving task comprises the control system being arranged to determine a gaze-duration measure indicative of a duration of time for which the occupant's gaze is directed to the primary driving region, the secondary driving region and the non-driving region respectively;
the control system being configured to determine the estimate of the occupant's attention to the driving task in dependence on the gaze signal comprises the control system being configured to determine a gaze-distance measure indicative of a distance of travel ahead of the vehicle to which the occupant is deemed attentive; and
the control system is configured to output the signal in dependence on both the gaze-duration measure and the contact value.

14. The control system of claim 1 , configured to update the attention value indicative of the estimate of a driver's attention to the driving task at periodic intervals.

15. The control system of claim 1 , configured to:
output a suspend signal to initiate an at least partial suspension of operation of the vehicle in an autonomous mode in dependence on the estimate of the occupant's attention to the driving task and the predetermined threshold value, and
output a resume signal to resume operation of the vehicle in the autonomous mode dependence on a contact signal being indicative of physical contact between a driver and the control of the vehicle.

16. The control system of claim 12 , configured to update the contact value in a first direction in dependence on the contact signal being indicative of physical contact between the driver and the control of the vehicle and to update the contact value in a second direction in dependence on the contact signal being indicative of an absence of physical contact between the driver and the control of the vehicle.

17. The control system of claim 1 , wherein the one or more controllers collectively comprise:
at least one electronic processor having an electrical input for receiving the gaze signal and a contact signal; and
at least one electronic memory device operatively coupled to the at least one electronic processor and having instructions stored therein;
and wherein the at least one electronic processor is configured to access the at least one memory device and execute the instructions thereon so as to cause the at least one electronic processor to:
determine the estimate of the occupant's attention to a driving task in an at least partly autonomous mode in dependence on the gaze signal, and output the signal for initiating the one or more actions; or
determine an attention value indicative of an estimate of the occupant's attention to a driving task and output the signal to cause the one or more actions to be performed in dependence on the atte

Assignees

• Jaguar Land Rover Ltd

Inventors

• Fairgrieve Andrew
• King Paul
• Matthias Rebecca
• Simlett John
• Iacovou Nicolas

Classifications

• B60W60/0053

  from vehicle to occupant · CPC title

• B60W2540/223

  Posture, e.g. hand, foot, or seat position, turned or inclined · CPC title

• B60W60/0059

  Estimation of the risk associated with autonomous or manual driving, e.g. situation too complex, sensor failure or driver incapacity · CPC title

• B60W2540/229

  Attention level, e.g. attentive to driving, reading or sleeping · CPC title

• B60W2540/225

  Direction of gaze · CPC title