Blind area processing for autonomous driving vehicles

Patent metadata

Field	Value
Publication number	US-2021027629-A1
Application number	US-201916522515-A
Country	US
Kind code	A1
Filing date	Jul 25, 2019
Priority date	Jul 25, 2019
Publication date	Jan 28, 2021
Grant date	—

Abstract

According to one embodiment, a driving environment surrounding an ADV is perceived based on sensor data obtained from various sensors mounted on the ADV including detecting one or more obstacles. The obstacles of the detected obstacles are determined and tracked based on the perception process, where the obstacle states of the obstacles may be maintained in an obstacle state buffer associated with the obstacles. When it is detected that a first moving obstacle is blocked by an object by the sensors, the further movement of the first moving obstacle is predicted based on the prior obstacle states of the first moving obstacle, while the first moving obstacle is blocked in view by the object. A trajectory is planned for the ADV in view of the predicted movement of the first moving obstacle while the first moving obstacle is in the blind area.

First claim

What is claimed is:

1 . A computer-implemented method for operating an autonomous driving vehicle (ADV), the method comprising:
perceiving a driving environment surrounding the ADV based on sensor data obtained from a plurality of sensors, including detecting one or more moving obstacles; determining and tracking obstacle states of the one or more moving obstacle for a predetermined period of time; determining that a first moving obstacle of the one or more moving obstacles is blocked by an object based on further sensor data obtained from the sensors; predicting movement of the first moving obstacle based on prior obstacle states associated with the first moving obstacle while the first moving obstacle is blocked by the object; and planning a trajectory for the ADV in view of the predicted movement of the first movement obstacle to drive the ADV to avoid collision with the first moving obstacle.

2 . The method of claim 1 , wherein tracking obstacle states of the one or more moving obstacle comprises:
for each of the one or more moving obstacles perceived, allocate an obstacle buffer; and storing in the allocated obstacle state buffer obstacle states of the moving obstacle at different points in time.

3 . The method of claim 1 , wherein each obstacle state comprises a location, a speed, and heading direction of the corresponding moving obstacle at a particular point in time.

4 . The method of claim 1 , wherein predicting movement of the first moving obstacle comprises:
reconstructing a moving trajectory of the first moving obstacles based on the obstacle states of the first moving obstacle; and predicting further movement of the first moving obstacle based on the reconstructed moving trajectory of the first moving obstacle.

5 . The method of claim 1 , further comprising determining lane configuration of one or more lanes based on obstacle states of the one or more moving obstacles, wherein the movement of the first moving obstacle is predicted further based on the lane configuration.

6 . The method of claim 1 , further comprising determining traffic flows of the driving environment based on obstacle states of the one or more moving obstacles, wherein the movement of the first moving obstacle is predicted further based on the traffic flows.

7 . The method of claim 1 , wherein predicting the movement of the first moving obstacle is performed further based on map information and traffic rules.

8 . The method of claim 1 , wherein predicting the movement of the first moving obstacle includes predicting slowing or stopping of the first moving obstacle based on a traffic light, stop sign, or intersection perceived in the driving environment.

9 . A non-transitory machine-readable medium having instructions stored therein, which when executed by a processor, cause the processor to perform operations, the operations comprising:
perceiving a driving environment surrounding the ADV based on sensor data obtained from a plurality of sensors, including detecting one or more moving obstacles; determining and tracking obstacle states of the one or more moving obstacle for a predetermined period of time; determining that a first moving obstacle of the one or more moving obstacles is blocked by an object based on further sensor data obtained from the sensors; predicting movement of the first moving obstacle based on prior obstacle states associated with the first moving obstacle while the first moving obstacle is blocked by the object; and planning a trajectory for the ADV in view of the predicted movement of the first movement obstacle to drive the ADV to avoid collision with the first moving obstacle.

10 . The machine-readable medium of claim 9 , wherein tracking obstacle states of the one or more moving obstacle comprises:
for each of the one or more moving obstacles perceived, allocate an obstacle buffer; and storing in the allocated obstacle state buffer obstacle states of the moving obstacle at different points in time.

11 . The machine-readable medium of claim 9 , wherein each obstacle state comprises a location, a speed, and heading direction of the corresponding moving obstacle at a particular point in time.

12 . The machine-readable medium of claim 9 , wherein predicting movement of the first moving obstacle comprises:
reconstructing a moving trajectory of the first moving obstacles based on the obstacle states of the first moving obstacle; and predicting further movement of the first moving obstacle based on the reconstructed moving trajectory of the first moving obstacle.

13 . The machine-readable medium of claim 9 , wherein the operations further comprise determining lane configuration of one or more lanes based on obstacle states of the one or more moving obstacles, wherein the movement of the first moving obstacle is predicted further based on the lane configuration.

14 . The machine-readable medium of claim 9 , wherein the operations further comprise determining traffic flows of the driving environment based on obstacle states of the one or more moving obstacles, wherein the movement of the first moving obstacle is predicted further based on the traffic flows.

15 . The machine-readable medium of claim 9 , wherein predicting the movement of the first moving obstacle is performed further based on map information and traffic rules.

16 . The machine-readable medium of claim 9 , wherein predicting the movement of the first moving obstacle includes predicting slowing or stopping of the first moving obstacle based on a traffic light, stop sign, or intersection perceived in the driving environment.

17 . A data processing system, comprising:
a processor; and a memory coupled to the processor to store instructions, which when executed by the processor, cause the processor to perform operations, the operations including
perceiving a driving environment surrounding the ADV based on sensor data obtained from a plurality of sensors, including detecting one or more moving obstacles,
determining and tracking obstacle states of the one or more moving obstacle for a predetermined period of time,
determining that a first moving obstacle of the one or more moving obstacles is blocked by an object based on further sensor data obtained from the sensors,
predicting movement of the first moving obstacle based on prior obstacle states associated with the first moving obstacle while the first moving obstacle is blocked by the object, and
planning a trajectory for the ADV in view of the predicted movement of the first movement obstacle to drive the ADV to avoid collision with the first moving obstacle.

18 . The system of claim 17 , wherein tracking obstacle states of the one or more moving obstacle comprises:
for each of the one or more moving obstacles perceived, allocate an obstacle buffer; and storing in the allocated obstacle state buffer obstacle states of the moving obstacle at different points in time.

19 . The system of claim 17 , wherein each obstacle state comprises a location, a speed, and heading direction of the corresponding moving obstacle at a particular point in time.

20 . The system of claim 17 , wherein predicting movement of the first moving obstacle comprises:
reconstructing a moving trajectory of the first moving obstacles based on the obstacle states of the first moving obstacle; and predicting further movement of the first moving obstacle based on the reconstructed moving trajectory of the first moving obstacle.

Assignees

• Baidu Usa Llc

Inventors

• Tao Jiaming
• Jiang Yifei
• Zhang Yajia
• Hu Jiangtao
• Pan Jiacheng
• Zhou Jinyun
• Sun Hongyi

Classifications

• G06V10/273

  removing elements interfering with the pattern to be recognised · CPC title

• B60W30/0956 Primary

  the prediction being responsive to traffic or environmental parameters · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G08G1/166 Primary

  for active traffic, e.g. moving vehicles, pedestrians, bikes · CPC title

• B60W2555/60

  Traffic rules, e.g. speed limits or right of way · CPC title