Sharing occlusion data

Patent metadata

Field	Value
Publication number	US-11513519-B1
Application number	US-201916562311-A
Country	US
Kind code	B1
Filing date	Sep 5, 2019
Priority date	Sep 5, 2019
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

Techniques are discussed for controlling a vehicle, such as an autonomous vehicle, based on occluded areas in an environment. An occluded area can represent areas where sensors of the vehicle are unable to sense portions of the environment due to obstruction by another object or sensor limitation. An occluded region for an object is determined by the vehicle as part of an occlusion grid, from the perspective of the vehicle. The vehicle may receive another occlusion grid from another source, such as another vehicle or a remote computing device that stores and distributes occlusion grids. The other occlusion grid may be from a different perspective than the occlusion grid generated by the vehicle, and may include occupancy data for the region that is otherwise occluded from the perspective of the vehicle. The vehicle can be controlled to traverse the environment based on the occupancy data received from the other source.

First claim

What is claimed is:

1. A system comprising:
one or more processors; and
one or more non-transitory computer-readable media storing instructions executable by the one or more processors, wherein the instructions, when executed, cause the system to perform operations comprising:
receiving sensor data of an environment captured by a sensor on a first vehicle, the first vehicle being at a first location in the environment;
detecting, based at least in part on the sensor data, an object in the environment;
generating, based at least in part on the sensor data, a first occlusion grid associated with a region of the environment and comprising a plurality of individual occlusion fields, one or more individual occlusion fields of the plurality of individual occlusion fields indicative of an occluded region;
receiving a second occlusion grid associated with at least a portion of the occluded region from a second vehicle in the environment; and
controlling the first vehicle to traverse the environment based at least in part on the first occlusion grid and the second occlusion grid associated with the at least the portion of the occluded region.

2. The system of claim 1 , wherein the second occlusion grid is received from the second vehicle at a second location, the operations further comprising sending a request from the first vehicle to the second vehicle for the second occlusion grid responsive to determining the occluded region.

3. The system of claim 1 , the operations further comprising:
evaluating a cost function based at least in part on the first occlusion grid, wherein evaluating the cost function is based at least in part on a time associated with receiving the second occlusion grid or a size of the portion relative to the occluded region included in the second occlusion grid, and
wherein controlling the first vehicle is further based on evaluating the cost function.

4. The system of claim 1 , the operations further comprising:
determining a first stop position for the first vehicle at a junction prior to receiving the second occlusion grid; and
determining a second stop position for the first vehicle at the junction based at least in part on the second occlusion grid,
wherein controlling the first vehicle to traverse the environment comprises controlling the first vehicle to stop at the second stop position.

5. The system of claim 1 , the operations further comprising:
determining a first speed for the first vehicle to traverse the environment prior to receiving the second occlusion grid from the second vehicle; and
determining a second speed for the first vehicle to traverse the environment based at least in part on the second occlusion grid, the second speed being faster than the first speed,
wherein controlling the first vehicle to traverse the environment comprises controlling the first vehicle to traverse the environment at the second speed.

6. The system of claim 1 , wherein the second occlusion grid comprises a time stamp associated with a time that the second occlusion grid was generated.

7. A method comprising:
receiving sensor data of an environment captured by a sensor on a vehicle;
generating, based at least in part on the sensor data, a first occlusion grid associated with a region of the environment and comprising a plurality of individual occlusion fields, one or more individual occlusion fields of the plurality of individual occlusion fields indicative of a portion of the region being an occluded region;
receiving a second occlusion grid for at least a portion of the occluded region, wherein the second occlusion grid comprises a time stamp associated with a time that the second occlusion grid was generated; and
controlling the vehicle based at least in part on the first occlusion grid and the second occlusion grid associated with the at least the portion of the occluded region.

8. The method of claim 7 , further comprising:
evaluating a cost function based at least in part on the second occlusion grid, wherein evaluating the cost function is based at least in part on the time stamp, and
wherein controlling the vehicle is further based on evaluating the cost function.

9. The method of claim 7 , wherein the vehicle is a first vehicle, the method further comprising receiving the second occlusion grid from a second vehicle in the environment.

10. The method of claim 9 , further comprising sending, to the second vehicle, an instruction to alter a trajectory of the second vehicle in order to alter the at least the portion of the occluded region.

11. The method of claim 10 , wherein the instruction to alter the trajectory comprises at least one of:
an instruction to change a position of the second vehicle within a lane,
an instruction to move the second vehicle from the lane to another lane, or
an instruction to change a speed of the second vehicle.

12. The method of claim 7 , wherein the vehicle is located at a junction, and wherein controlling the vehicle comprises controlling the vehicle to traverse the junction based at least in part on the second occlusion grid for the at least the portion of the occluded region.

13. The method of claim 7 , wherein the vehicle is located in a traffic lane, and wherein controlling the vehicle comprises controlling the vehicle to traverse the traffic lane or change to another traffic lane based at least in part on the second occlusion grid for the at least the portion of the occluded region.

14. The method of claim 7 , wherein the vehicle is located proximate a construction zone, and wherein controlling the vehicle comprises controlling the vehicle to traverse the environment proximate the construction zone based at least in part on the second occlusion grid for the at least the portion of the occluded region.

15. One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more processors, perform operations comprising:
receiving sensor data of an environment captured by a sensor on a vehicle;
generating, based at least in part on the sensor data, a first occlusion grid associated with a region of the environment and comprising a plurality of individual occlusion fields, one or more individual occlusion fields of the plurality of individual occlusion fields indicative of a portion of the region being an occluded region;
receiving a second occlusion grid for at least a portion of the occluded region, wherein the second occlusion grid comprises a time stamp associated with a time that the second occlusion grid was generated; and
controlling the vehicle based at least in part on the first occlusion grid and the second occlusion grid.

16. The one or more non-transitory computer-readable storage media of claim 15 , wherein the vehicle is a first vehicle, the operations further comprising sending a request from the first vehicle for the second occlusion grid, the second occlusion grid being associated with a second vehicle and received from the second vehicle.

17. The one or more non-transitory computer-readable storage media of claim 16 , the operations further comprising:
evaluating a cost function based at least in part on the second occlusion grid, wherein evaluating the cost function is based at least in part on a time associated with receiving the second occlusion grid or a size of the portion relative to the occluded region included in the second occlusion grid, and
wherein controlling the vehicle is further based on evaluating the cost function.

18. The one or more non-transitory computer-readable storage media of claim 1

Assignees

• Zoox Inc

Inventors

• Akella Abishek Krishna
• Silva William Anthony
• Wimmershoff Marc

Classifications

• G05D1/0088 Primary

  characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00) · CPC title

• G05D2201/0213

  Physics · mapped topic

• G05D1/0276

  using signals provided by a source external to the vehicle (involving a plurality of vehicles G05D1/0287; automatically controlling vehicle speed responsive to externally generated signals B60K31/0058) · CPC title

• B60W30/18154

  Approaching an intersection · CPC title

• B60W30/181

  Preparing for stopping · CPC title