Handover procedure for driver of controlled vehicle

Patent metadata

Field	Value
Publication number	US-11137760-B2
Application number	US-201916699905-A
Country	US
Kind code	B2
Filing date	Dec 2, 2019
Priority date	Sep 29, 2016
Publication date	Oct 5, 2021
Grant date	Oct 5, 2021

Abstract

A vehicular control system includes a control having a processor that processes image data captured by a forward viewing camera. When the control system is controlling driving of the vehicle, the control determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point. Responsive to determination of the triggering event, the control (i) determines a total action time until the vehicle encounters the event, (ii) estimates a driver take over time for the driver to take over control and (iii) estimates a handling time for the vehicle to be controlled to avoid encountering the event point, and, responsive to the determination and estimations, the control system (i) allows the driver to take over control of the vehicle or (ii) controls the vehicle to slow down and stop the vehicle before the event point.

First claim

The invention claimed is:

1. A vehicular control system, said vehicular control system comprising:
a forward viewing camera disposed behind a windshield of a vehicle equipped with said vehicular control system, said forward viewing camera viewing through the windshield forward of the vehicle, said forward viewing camera capturing image data;
a control comprising electronic circuitry, the electronic circuitry of said control comprising at least one processor operable to process image data captured by said forward viewing camera;
wherein said vehicular control system is operable to control driving of the vehicle at least in part responsive to processing via said at least one processor of image data captured by said forward viewing camera;
wherein, with said vehicular control system controlling driving of the vehicle, and responsive at least in part to processing by said at least one processor of image data captured by said forward viewing camera, said vehicular control system determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point associated with the determined triggering event;
wherein, responsive at least in part to determination of the triggering event, said vehicular control system (i) determines a total action time available before the vehicle encounters the event point, (ii) estimates a driver take over time for the driver to take over control of the vehicle and (iii) estimates a handling time for the vehicle to be controlled to avoid encountering the event point; and
wherein, responsive to the determined total action time, the estimated driver take over time and the estimated handling time, one selected from the group consisting of (i) said vehicular control system allows the driver to take over control of the vehicle and (ii) said vehicular control system controls the vehicle to slow down and stop the vehicle before the event point.

2. The vehicular control system of claim 1 , wherein, responsive to the estimated driver takeover time being greater than a time period constituting the difference between the determined total action time and the estimated handling time, said vehicular control system controls the vehicle to slow down and stop the vehicle at a stopping location.

3. The vehicular control system of claim 2 , wherein the stopping location comprises an emergency stopping lane of a road that the vehicle is travelling along or a shoulder of a road that the vehicle is travelling along.

4. The vehicular control system of claim 2 , wherein the stopping location comprises a parking bay or parking lot.

5. The vehicular control system of claim 1 , wherein, responsive to the estimated driver takeover time being less than a time period constituting the difference between the determined total action time and the estimated handling time, said vehicular control system allows the driver to take over control of the vehicle.

6. The vehicular control system of claim 5 , wherein, responsive to the driver not taking over control of the vehicle within a time period constituting the difference between the determined total action time and the estimated handling time, said vehicular control system controls the vehicle to slow down and stop the vehicle at a stopping location.

7. The vehicular control system of claim 6 , wherein the stopping location comprises an emergency stopping lane of a road the vehicle is travelling along or a shoulder of a road the vehicle is travelling along.

8. The vehicular control system of claim 6 , wherein the stopping location comprises a parking bay or parking lot.

9. The vehicular control system of claim 1 , wherein the event point comprises an event that cannot be handled by said vehicular control system when said vehicular control system is operating to control driving of the vehicle.

10. The vehicular control system of claim 1 , wherein the triggering event comprises detection of an object ahead of the vehicle and in a current path of travel of the vehicle, and wherein the event point comprises the detected object.

11. The vehicular control system of claim 10 , wherein the detected object comprises another vehicle ahead of the vehicle and in the current path of travel of the vehicle.

12. The vehicular control system of claim 10 , wherein the detected object comprises a pedestrian ahead of the vehicle and in the current path of travel of the vehicle.

13. The vehicular control system of claim 1 , wherein the triggering event comprises a condition ahead of the vehicle that is hazardous to driving of the vehicle, and wherein the event point is the location of the determined hazardous condition.

14. The vehicular control system of claim 1 , comprising an electronic control unit, and wherein said electronic control unit comprises said control.

15. The vehicular control system of claim 1 , comprising a plurality of radar sensors disposed at the vehicle and having fields of sensing exterior of the vehicle, wherein said vehicular control system controls driving of the vehicle at least in part responsive to processing via said at least one processor of sensor data captured by said plurality of radar sensors, and wherein said vehicular control system determines the triggering event responsive at least in part to processing by said at least one processor of sensor data captured by said plurality of radar sensors.

16. The vehicular control system of claim 1 , comprising a plurality of lidar sensors disposed at the vehicle and having fields of sensing exterior of the vehicle, wherein said vehicular control system controls driving of the vehicle at least in part responsive to processing via said at least one processor of sensor data captured by said plurality of lidar sensors, and wherein said vehicular control system determines the triggering event responsive at least in part to processing by said at least one processor of sensor data captured by said plurality of lidar sensors.

17. A vehicular control system, said vehicular control system comprising:
a forward viewing camera disposed behind a windshield of a vehicle equipped with said vehicular control system, said forward viewing camera viewing through the windshield forward of the vehicle, said forward viewing camera capturing image data;
an electronic control unit comprising electronic circuitry, the electronic circuitry of said electronic control unit comprising at least one processor operable to process image data captured by said forward viewing camera;
wherein said vehicular control system is operable to control driving of the vehicle at least in part responsive to processing via said at least one processor of image data captured by said forward viewing camera;
wherein, with said vehicular control system controlling driving of the vehicle, and responsive at least in part to processing by said at least one processor of image data captured by said forward viewing camera, said vehicular control system determines a triggering event that requires driving of the vehicle to be handed over to a driver of the vehicle before the vehicle encounters an event point associated with the determined triggering event;
wherein, responsive at least in part to determination of the triggering event, said vehicular control system (i) determines a total action time available before the vehicle encounters the event point, (ii) estimates a driver take over time for the driver to take over control of the vehicle and (iii) estimates a handling time for the vehicle to be controlled to avoid encountering the event point;
wherein, responsive to t

Assignees

• Magna Electronics Inc

Inventors

• Latotzki Ralph
• Goseberg Frank

Classifications

• B60W2540/043

  Identity of occupants · CPC title

• B60W2555/20

  Ambient conditions, e.g. wind or rain · CPC title

• B60W60/0053

  from vehicle to occupant · CPC title

• B60W2540/22

  Psychological state; Stress level or workload · CPC title

• B60W60/0057 Primary

  Estimation of the time available or required for the handover · CPC title