Vehicular control system with handover procedure for driver of controlled vehicle

Patent metadata

Field	Value
Publication number	US-2022026904-A1
Application number	US-202117449824-A
Country	US
Kind code	A1
Filing date	Oct 4, 2021
Priority date	Sep 29, 2016
Publication date	Jan 27, 2022
Grant date	—

Abstract

A vehicular control system includes at least one processor that processes image data captured by a forward viewing camera and radar data captured by a forward sensing radar sensor. With the system controlling driving of the vehicle, the system determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point, and the system (i) determines a total action time until the vehicle encounters the event, (ii) estimates a driver take over time for the driver to take over control and (iii) estimates a handling time for the driver to control the vehicle to avoid encountering the event point. Based on the determined and estimated times, the system (i) requests the driver take over control of the vehicle or (ii) controls the vehicle to slow down and stop the vehicle before the event point.

First claim

1 . A vehicular control system, said vehicular control system comprising:
a forward viewing camera disposed at a windshield of a vehicle equipped with said vehicular control system, said forward viewing camera viewing through the windshield forward of the vehicle, said forward viewing camera capturing image data; a forward sensing radar sensor sensing forward of the vehicle, said forward sensing radar sensor capturing radar data; an electronic control unit (ECU) comprising electronic circuitry, the electronic circuitry of said ECU comprising at least one processor for processing image data captured by said forward viewing camera and sensor data captured by said forward sensing radar sensor; wherein said vehicular control system is operable to control driving of the vehicle at least in part responsive to processing at said ECU of image data captured by said forward viewing camera and sensor data captured by said forward sensing radar sensor; wherein, with said vehicular control system controlling driving of the vehicle, and responsive at least in part to processing at said ECU of image data captured by said forward viewing camera and sensor data captured by said forward sensing radar sensor, said vehicular control system determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point associated with the determined triggering event; wherein, responsive at least in part to determination of the triggering event, said vehicular control system (i) determines a total action time available before the vehicle encounters the event point, (ii) estimates a driver takeover time for the driver to take over control of the vehicle and (iii) estimates a handling time for the driver to control the vehicle to avoid encountering the event point; wherein, responsive to said vehicular control system determining that the estimated driver takeover time is greater than the difference between the determined total action time and the estimated handling time, said vehicular control system maneuvers the vehicle to a stopping location; and wherein, responsive to said vehicular control system determining that the estimated driver takeover time is less than the difference between the determined total action time and the estimated handling time, said vehicular control system requests the driver take over control of the vehicle.

2 . The vehicular control system of claim 1 , wherein the stopping location comprises an emergency stopping lane of a road that the vehicle is travelling along or a shoulder of a road that the vehicle is travelling along.

3 . The vehicular control system of claim 1 , wherein the stopping location comprises a parking bay or a parking lot.

4 . The vehicular control system of claim 1 , wherein, responsive to said vehicular control system requesting the driver take over control of the vehicle, and responsive to the driver not taking over control of the vehicle within a time period constituting the difference between the determined total action time and the estimated handling time, said vehicular control system maneuvers the vehicle to the stopping location.

5 . The vehicular control system of claim 4 , wherein the stopping location comprises an emergency stopping lane of a road the vehicle is travelling along or a shoulder of a road the vehicle is travelling along.

6 . The vehicular control system of claim 4 , wherein the stopping location comprises a parking bay or a parking lot.

7 . The vehicular control system of claim 1 , wherein said vehicular control system estimates the driver takeover time for the driver to take over control of the vehicle based at least in part monitoring of driver attentiveness via an in-cabin sensor.

8 . The vehicular control system of claim 1 , wherein the event point comprises an event that cannot be handled by said vehicular control system when said vehicular control system is operating to control driving of the vehicle.

9 . The vehicular control system of claim 1 , wherein the triggering event comprises detection of an object ahead of the vehicle and in a current path of travel of the vehicle, and wherein the event point comprises the detected object.

10 . The vehicular control system of claim 9 , wherein the detected object comprises another vehicle ahead of the vehicle and in the current path of travel of the vehicle.

11 . The vehicular control system of claim 9 , wherein the detected object comprises a pedestrian ahead of the vehicle and in the current path of travel of the vehicle.

12 . The vehicular control system of claim 1 , wherein the triggering event comprises a condition ahead of the vehicle that is hazardous to driving of the vehicle, and wherein the event point is the location of the determined hazardous condition.

13 . The vehicular control system of claim 1 , comprising a plurality of radar sensors disposed at the vehicle and having fields of sensing exterior of the vehicle, wherein said plurality of radar sensors includes said forward sensing radar sensor, and wherein said vehicular control system maneuvers the vehicle at least in part responsive to processing at said ECU of sensor data captured by said plurality of radar sensors, and wherein said vehicular control system determines the triggering event responsive at least in part to processing at said ECU of sensor data captured by said plurality of radar sensors.

14 . The vehicular control system of claim 1 , comprising a plurality of lidar sensors disposed at the vehicle and having fields of sensing exterior of the vehicle, wherein said vehicular control system maneuvers the vehicle at least in part responsive to processing at said ECU of sensor data captured by said plurality of lidar sensors, and wherein said vehicular control system determines the triggering event responsive at least in part to processing at said ECU of sensor data captured by said plurality of lidar sensors.

15 . A vehicular control system, said vehicular control system comprising:
a forward viewing camera disposed at a windshield of a vehicle equipped with said vehicular control system, said forward viewing camera viewing through the windshield forward of the vehicle, said forward viewing camera capturing image data; a forward sensing radar sensor sensing forward of the vehicle, said forward sensing radar sensor capturing radar data; an electronic control unit (ECU) comprising electronic circuitry, the electronic circuitry of said ECU comprising at least one processor for processing image data captured by said forward viewing camera and sensor data captured by said forward sensing radar sensor; wherein said vehicular control system is operable to control driving of the vehicle at least in part responsive to processing at said ECU of image data captured by said forward viewing camera and sensor data captured by said forward sensing radar sensor; wherein, with said vehicular control system controlling driving of the vehicle, and responsive at least in part to processing at said ECU of image data captured by said forward viewing camera and sensor data captured by said forward sensing radar sensor, said vehicular control system determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point associated with the determined triggering event; wherein the triggering event comprises detection of an object ahead of the vehicle and in a current path of travel of the vehicle, and wherein the event point comprises the detected object; wherein, responsive at least in part to de

Assignees

• Magna Electronics Inc

Inventors

• Latotzki Ralph
• Goseberg Frank

Classifications

• B60W2540/045

  Occupant permissions · CPC title

• B60W60/0057 Primary

  Estimation of the time available or required for the handover · CPC title

• B60W2540/043

  Identity of occupants · CPC title

• B60W60/007

  Emergency override (Handing over between remote control and on-board control or handing over between remote control arrangements G05D1/227) · CPC title

• B60W2540/221

  Physiology, e.g. weight, heartbeat, health or special needs · CPC title