System and method in lane departure warning with full nonlinear kinematics and curvature

Patent metadata

Field	Value
Publication number	US-11891060-B2
Application number	US-202117305705-A
Country	US
Kind code	B2
Filing date	Jul 13, 2021
Priority date	Jul 13, 2021
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

An apparatus includes at least one camera configured to capture an image of a traffic lane in front of a vehicle. The apparatus also includes a vehicle behavior prediction controller configured to determine lane boundaries and road curvature for a segment of a traffic lane occupied by the vehicle from the captured image and prior captured images; determine lateral distances of the vehicle from the lane boundaries and a rate of departure of the vehicle from the occupied traffic lane that is accurate for the determined road curvature; determine a time to line crossing for the vehicle from the lateral distances and the rate of departure; and activate a lane departure warning indicator based on the determined time to line crossing.

First claim

What is claimed is:

1. An apparatus, comprising:
at least one camera configured to capture an image of a traffic lane in front of a vehicle; and
a vehicle behavior prediction controller configured to:
determine lane boundaries for a segment of a traffic lane occupied by the vehicle from the captured image of the traffic lane in front of the vehicle and prior captured images of the traffic lane in front of the vehicle,
determine a rate of road curvature for the segment of the traffic lane occupied by the vehicle from the captured image of the traffic lane in front of the vehicle and prior captured images of the traffic lane in front of the vehicle,
determine lateral distances of the vehicle from the lane boundaries and a rate of departure of the vehicle from the occupied traffic lane that is accurate for the determined road curvature,
determine a time to line crossing for the vehicle from the lateral distances and the rate of departure, and
activate a lane departure warning indicator based on the determined time to line crossing.

2. The apparatus according to claim 1 , wherein the vehicle behavior prediction controller is configured to determine the rate of departure using first and second terms for effect of road curvature on lane departure for different radii of curvature.

3. The apparatus according to claim 2 , wherein the vehicle behavior prediction controller is configured to determine the rate of departure V depart from:
V depart =v ·sin(θ)+ c l ·{dot over (θ)},

where v is a speed of the vehicle, θ is a heading offset for the vehicle, {dot over (θ)} is a first derivative of θwith respect to traveled distance, c l is a length of the vehicle, v·sin(θ) represents effect of road curvature on lane departure for a first range of radii of curvature, and c l ·{dot over (θ)} represents effect of road curvature on lane departure for a second range of radii of curvature.

4. The apparatus according to claim 3 , wherein the vehicle behavior prediction controller is configured to determine {dot over (θ)} from:

θ
˙

=

ω
-

v
⁢
κ
⁢

cos
⁡
(
θ
)

1
-

κ
⁢
r

,

where ω is vehicle yaw rate, κ is the road curvature, and r is a lateral offset of the vehicle to a lane boundary.

5. The apparatus according to claim 1 , wherein the vehicle behavior prediction controller is configured to activate the lane departure warning indicator based on the lateral distances, the rate of departure, and a road curvature.

6. The apparatus according to claim 5 , wherein the vehicle behavior prediction controller is configured to activate the lane departure warning indicator based on:
LDW=function( D threshold , V threshold , κ threshold ),

where D threshold is a threshold for distance of the vehicle from a lane boundary being approached, V threshold is a threshold for vehicle speed, and κ threshold is a threshold for road curvature.

7. The apparatus according to claim 1 , wherein the vehicle behavior prediction controller is configured to determine the time to line crossing TTLC from a lateral distance d L , to a left lane boundary, a lateral distance d R to a right lane boundary, and the rate of departure V depart based on:

if
⁢

d
L

<

d
R

,

TTLC
=

d
L

V
depart

,

else
⁢

d
L

>

d
R

,

TTLC
=

d
R

V
depart

.

8. The apparatus according to claim 1 , further comprising:
a vehicle motion controller configured to activate at least one of a braking control and a steering control based on the lane departure warning indicator.

9. A vehicle comprising the apparatus according to claim 1 , the vehicle further comprising:
a motor configured to drive wheels of the vehicle;
a chassis supporting axles on which the wheels are mounted;
a steering control configured to generate a steering command to control the wheels based on activation of the lane departure warning indicator;
a brake actuator configured to actuate brakes for one or more of the wheels; and
a braking control configured to generate a braking command to control the brake actuator based on activation of the lane departure warning indicator.

10. The vehicle according to claim 9 , wherein the vehicle is an electric vehicle and the motor is an electric motor.

11. A method, comprising:
capturing an image of a traffic lane in front of a vehicle using at least one camera;
determining lane boundaries for a segment of a traffic lane occupied by the vehicle from the captured image of the traffic lane in front of the vehicle and prior captured images of the traffic lane in front of the vehicle;
determining a rate of road curvature for the segment of the traffic lane occupied by the vehicle from the captured image of the traffic lane in front of the vehicle and prior captured images of the traffic lane in front of the vehicle;
determining lateral distances of the vehicle from the lane boundaries and a rate of departure of the vehicle from the occupied traffic lane that is accurate for the determined road curvature;
determining a time to line crossing for the vehicle from the lateral distances and the rate of departure; and
activating a lane departure warning indicator based on the determined time to line crossing.

12. The method according to claim 11 , further comprising:
determining the rate of departure using first and second terms for effect of road curvature on la

Assignees

• Canoo Tech Inc

Inventors

• Kim Kilsoo
• Choi Jongmoo
• Cao Lei
• Sattiraju Mayukh
• Uppalapati Dheemanth
• Singh Aviral

Classifications

• B60W30/12 Primary

  Lane keeping · CPC title

• B60K1/00

  Arrangement or mounting of electrical propulsion units (B60K7/00 takes precedence; arrangement or mounting of plural diverse prime-movers for mutual or common propulsion B60K6/00) · CPC title

• B60W10/18

  including control of braking systems · CPC title

• B60W10/20

  including control of steering systems · CPC title

• B60W50/14

  Means for informing the driver, warning the driver or prompting a driver intervention · CPC title