Apparatus for assisting driving and method thereof

Patent metadata

Field	Value
Publication number	US-12365332-B2
Application number	US-202217718698-A
Country	US
Kind code	B2
Filing date	Apr 12, 2022
Priority date	Apr 20, 2021
Publication date	Jul 22, 2025
Grant date	Jul 22, 2025

Abstract

Disclosed herein an apparatus for assisting driving of a vehicle includes a camera installed in the vehicle, the camera having a field of view around the vehicle and obtaining image data; and a controller configured to process the image data. The controller may identify at least one object located around the vehicle based on processing the image data, update a trajectory of the vehicle based on an interference between a trajectory of the at least one object and the trajectory of the vehicle, control at least one of a driving device, a braking device, and a steering device of the vehicle based on the updated trajectory of the vehicle.

First claim

What is claimed is:

1. An apparatus for assisting driving of a vehicle, comprising:
a camera installed in the vehicle, the camera having a field of view around the vehicle and obtaining image data; and
a controller configured to process the image data;
wherein the controller is configured to:
generate an ego trajectory of the vehicle based on a route to a destination obtained from a navigation device of the vehicle,
determine whether the vehicle is going to change the vehicle's lane based on the ego trajectory,
identify at least one object located around the vehicle based on processing the image data,
determine whether the at least one object is going to change the at least one object's lane based on a lateral position, a lateral speed, and an align angle, the align angle being an angle between a direction of the object lane and a direction in which the at least one object moves,
predict a lateral trajectory of the at least one object based on at least one of the lateral speed, a lateral acceleration, and the align angle of the at least one object,
predict a longitudinal trajectory of the at least one object based on a longitudinal speed and a longitudinal acceleration of the at least one object, and
predict an object trajectory of the at least one object based on at least one of the lateral trajectory and the longitudinal trajectory, and
project the ego trajectory and the predicted object trajectory on one coordinate system,
identify, when it is determined that the vehicle is going to change the vehicle's lane to a target lane and the at least one object is going to change the at least one object's lane to the same target lane, whether the ego trajectory and the object trajectory interfere each other on the one coordinate system,
update the ego trajectory of the vehicle based on an interference between the predicted object trajectory of the at least one object and the ego trajectory of the vehicle, and
control at least one of a driving device, a braking device, and a steering device of the vehicle based on the updated trajectory of the vehicle.

2. The apparatus of claim 1 , wherein the controller is further configured to:
identify at least one of the lateral speed, the lateral acceleration, the align angle, the longitudinal speed, and the longitudinal acceleration of the at least one object based on the processing of the image data.

3. The apparatus of claim 1 , wherein the controller is further configured to predict the ego trajectory of the vehicle based on at least one of a speed, an acceleration, or an angular velocity of the vehicle.

4. The apparatus of claim 1 , wherein the controller is further configured to update the ego trajectory of the vehicle to avoid the object trajectory of the at least one object in response to that the ego trajectory of the vehicle interferes with the object trajectory of the at least one object.

5. The apparatus of claim 1 , further comprising a radar installed in the vehicle, the radar having a field of view around the vehicle and obtaining radar data;
wherein the controller is further configured to:
identify at least one object located around the vehicle based on processing the radar data, and
integrate the at least one object based on the processing the image data and the at least one object based on the processing the radar data.

6. The apparatus of claim 5 , wherein, when a plurality of objects are detected based on processing the image data, the controller selects, from among the plurality of detected objects, objects traveling in the vehicle's lane or in an adjacent lane to the vehicle's lane as the at least one object located around the vehicle.

7. A method of assisting driving of a vehicle, the method comprising:
obtaining image data by a camera installed in the vehicle and having a field of view around the vehicle;
generating an ego trajectory of the vehicle based on a route to a destination obtained from a navigation device of the vehicle,
determining whether the vehicle is going to change the vehicle's lane based on the ego trajectory,
identifying at least one object located around the vehicle based on processing of the image data by a processor installed in the vehicle; and
determining whether the at least one object is going to change the at least one object's lane based on a lateral position, a lateral speed, and an align angle, the align angle being an angle between a direction of the object lane and a direction in which the at least one object moves,
predicting a lateral trajectory of the at least one object based on at least one of the lateral speed, a lateral acceleration, and the align angle of the at least one object,
predicting a longitudinal trajectory of the at least one object based on a longitudinal speed and a longitudinal acceleration of the at least one object, and
predicting an object trajectory of the at least one object based on at least one of the lateral trajectory and the longitudinal trajectory, and
projecting the ego trajectory and the predicted object trajectory on one coordinate system,
identifying, when it is determined that the vehicle is going to change the vehicle's lane to a target lane and the at least one object is going to change the at least one object's lane to the same target lane, whether the ego trajectory and the object trajectory interfere each other on the one coordinate system,
updating the ego trajectory of the vehicle based on an interference between the predicted object trajectory of the at least one object and the ego trajectory of the vehicle; and
controlling at least one of a driving device, a braking device, or a steering device of the vehicle based on the updated trajectory of the vehicle.

8. The method of claim 7 , further comprising:
identifying at least one of the lateral speed, the lateral acceleration, the align angle, the longitudinal speed, and the longitudinal acceleration of the at least one object based on the processing of the image data.

9. The method of claim 7 , further comprising:
predicting the ego trajectory of the vehicle based on at least one of a speed, an acceleration, or an angular velocity of the vehicle.

10. The method of claim 7 , further comprising:
updating the ego trajectory of the vehicle to avoid the object trajectory of the at least one object in response to that the ego trajectory of the vehicle interferes with the object trajectory of the at least one object.

11. The method of 10 , further comprising:
obtaining radar data by a radar installed in the vehicle and having a field of view around the vehicle;
identifying at least one object located around the vehicle by the processor based on processing the radar data, and
integrate the at least one object based on the processing the image data and the at least one object based on the processing the radar data.

12. A computer-readable storage medium storing a program for executing the method of claim 7 .

Assignees

• Mando Mobility Solutions Corp
• Hl Klemove Corp

Inventors

• Kim Inhan

Classifications

• B60W2420/408

  Radar; Laser, e.g. lidar · CPC title

• B60W2420/403

  Image sensing, e.g. optical camera · CPC title

• G06V20/58 Primary

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• B60W2554/4045

  Intention, e.g. lane change or imminent movement · CPC title

• B60W2554/4043

  Lateral speed · CPC title