Vehicular control system with handover procedure for driver of controlled vehicle

Patent metadata

Field	Value
Publication number	US-11927954-B2
Application number	US-202318151533-A
Country	US
Kind code	B2
Filing date	Jan 9, 2023
Priority date	Sep 29, 2016
Publication date	Mar 12, 2024
Grant date	Mar 12, 2024

Abstract

A vehicular control system includes a forward-viewing camera, a forward-sensing sensor and an in-cabin-sensing sensor. With the system controlling driving of the vehicle, the system determines a triggering event that triggers handing over driving of the vehicle to a driver of the vehicle before the vehicle encounters an event point associated with the triggering event. The vehicular control system (i) determines a total action time available before the vehicle encounters the event point, (ii) estimates a driver takeover time for the driver to take over control of the vehicle and (iii) estimates a handling time for the driver to control the vehicle to avoid encountering the event point. Responsive to the vehicular control system determining that the estimated driver takeover time is less than the difference between the determined total action time and the estimated handling time, control of the vehicle is handed over to the driver of the vehicle.

First claim

The invention claimed is:

1. A vehicular control system, the vehicular control system comprising:
a forward-viewing camera disposed at a windshield of a vehicle equipped with the vehicular control system, the forward-viewing camera viewing through the windshield forward of the vehicle, the forward-viewing camera capturing image data;
a forward-sensing sensor disposed at the vehicle and sensing forward of the vehicle, the forward-sensing sensor capturing sensor data, wherein the forward-sensing sensor comprises one selected from the group consisting of (i) a forward-sensing radar sensor sensing forward of the vehicle, and (ii) a forward-sensing lidar sensor sensing forward of the vehicle;
a cabin-sensing sensor disposed in a cabin of the vehicle and sensing interior of the cabin of the vehicle, the cabin-sensing sensor capturing in-cabin data;
an electronic control unit (ECU) comprising electronic circuitry, the electronic circuitry of the ECU processing (i) the image data captured by the forward-viewing camera and (ii) the sensor data captured by the forward-sensing sensor;
wherein the vehicular control system is operable to control driving of the vehicle at least in part responsive to processing by the vehicular control system of (i) the image data captured by the forward-viewing camera, (ii) the sensor data captured by the forward-sensing sensor and (iii) the in-cabin data captured by the cabin-sensing sensor;
wherein, with the vehicular control system controlling driving of the vehicle, and responsive at least in part to processing at the ECU of the image data captured by the forward-viewing camera and the sensor data captured by the forward-sensing sensor, the vehicular control system determines a triggering event that triggers handing over driving of the vehicle to a driver of the vehicle before the vehicle encounters an event point associated with the triggering event;
wherein, responsive at least in part to determination of the triggering event, the vehicular control system (i) determines a total action time available before the vehicle encounters the event point, (ii) estimates a driver takeover time for the driver to take over control of the vehicle and (iii) estimates a handling time for the driver to control the vehicle to avoid encountering the event point;
wherein, responsive to the vehicular control system determining that the estimated driver takeover time is greater than the difference between the determined total action time and the estimated handling time, the vehicular control system maneuvers the vehicle to a stopping location; and
wherein, responsive to the vehicular control system determining that the estimated driver takeover time is less than the difference between the determined total action time and the estimated handling time, control of the vehicle is handed over to the driver of the vehicle.

2. The vehicular control system of claim 1 , wherein the cabin-sensing sensor comprises an imaging sensor.

3. The vehicular control system of claim 1 , wherein the cabin-sensing sensor comprises a radar sensor.

4. The vehicular control system of claim 1 , wherein the cabin-sensing sensor comprises a lidar sensor.

5. The vehicular control system of claim 1 , wherein the cabin-sensing sensor comprises an ultrasonic sensor.

6. The vehicular control system of claim 1 , wherein the vehicular control system estimates the driver takeover time based at least in part on processing by the vehicular control system of the in-cabin data captured by the cabin-sensing sensor.

7. The vehicular control system of claim 1 , wherein the stopping location comprises one selected from the group consisting of (i) an emergency stopping lane of a road that the vehicle is travelling along and (ii) a shoulder of the road that the vehicle is travelling along.

8. The vehicular control system of claim 1 , wherein the stopping location comprises one selected from the group consisting of (i) a parking bay and (ii) a parking lot.

9. The vehicular control system of claim 1 , wherein, responsive to the vehicular control system requesting the driver take over control of the vehicle, and responsive to the driver not taking over control of the vehicle within a time period constituting the difference between the determined total action time and the estimated handling time, the vehicular control system maneuvers the vehicle to the stopping location.

10. The vehicular control system of claim 9 , wherein the stopping location comprises one selected from the group consisting of (i) an emergency stopping lane of a road the vehicle is travelling along and (ii) a shoulder of the road the vehicle is travelling along.

11. The vehicular control system of claim 9 , wherein the stopping location comprises one selected from the group consisting of (i) a parking bay and (ii) a parking lot.

12. The vehicular control system of claim 1 , wherein the vehicular control system estimates the driver takeover time for the driver to take over control of the vehicle based at least in part on monitoring of driver attentiveness via processing by the vehicular control system of the in-cabin data captured by the cabin-sensing sensor.

13. The vehicular control system of claim 1 , wherein the event point comprises an event that cannot be handled by the vehicular control system when the vehicular control system is operating to control driving of the vehicle.

14. The vehicular control system of claim 1 , wherein determination of the triggering event comprises detection of an object ahead of the vehicle and in a current path of travel of the vehicle, and wherein the event point comprises location of the detected object.

15. The vehicular control system of claim 14 , wherein the detected object comprises another vehicle ahead of the vehicle and in the current path of travel of the vehicle.

16. The vehicular control system of claim 14 , wherein the detected object comprises a pedestrian ahead of the vehicle and in the current path of travel of the vehicle.

17. The vehicular control system of claim 1 , wherein the triggering event comprises a hazardous condition ahead of the vehicle that is hazardous to driving of the vehicle, and wherein the event point is the location of the hazardous condition.

18. The vehicular control system of claim 1 , comprising a plurality of radar sensors disposed at the vehicle and having fields of sensing exterior of the vehicle, and wherein the plurality of radar sensors includes the forward-sensing sensor, and wherein the vehicular control system maneuvers the vehicle at least in part responsive to processing at the ECU of radar data captured by the plurality of radar sensors, and wherein the vehicular control system determines the triggering event responsive at least in part to processing at the ECU of the radar data captured by the plurality of radar sensors.

19. The vehicular control system of claim 1 , comprising a plurality of lidar sensors disposed at the vehicle and having fields of sensing exterior of the vehicle, and wherein the plurality of lidar sensors includes the forward-sensing sensor, and wherein the vehicular control system maneuvers the vehicle at least in part responsive to processing at the ECU of lidar data captured by the plurality of lidar sensors, and wherein the vehicular control system determines the triggering event responsive at least in part to processing at the ECU of the lidar data captured by the plurality of lidar sensors.

20. A vehicular control system, the vehicular control system comprising:
a forward-viewing camera di

Assignees

• Magna Electronics Inc

Inventors

• Latotzki Ralph
• Goseberg Frank

Classifications

• B60W60/0053

  from vehicle to occupant · CPC title

• B60W60/0057 Primary

  Estimation of the time available or required for the handover · CPC title

• G05D1/0061 Primary

  for transition from automatic pilot to manual pilot and vice versa · CPC title

• B60W30/095

  Predicting travel path or likelihood of collision · CPC title

• G05D1/0246

  using a video camera in combination with image processing means · CPC title