Detecting a road structure change by a lead autonomous vehicle (AV) and updating routing plans for the lead AV and following AVs

Patent metadata

Field	Value
Publication number	US-11987261-B2
Application number	US-202017021963-A
Country	US
Kind code	B2
Filing date	Sep 15, 2020
Priority date	Sep 15, 2020
Publication date	May 21, 2024
Grant date	May 21, 2024

Abstract

A lead autonomous vehicle (AV) includes a sensor configured to observe a field of view in front of the lead AV. Following AVs are on the same road behind the lead AV. A processor of the lead AV is configured to detect a road structural change on the particular road. The processor updates driving instructions of the lead AV to navigate through the structural change using driving instructions related to the structural change. The processor sends a first message to the operation server indicating that the structural change is detected. The operation server updates the first portion of the map data, reflecting the structural change. The operation server sends the updated map data to the one or more following AVs.

First claim

The invention claimed is:

1. A system, comprising:
a lead autonomous vehicle comprising at least one vehicle sensor located on the lead autonomous vehicle and configured to observe a first field-of-view comprising a region in front of the lead autonomous vehicle;
one or more following autonomous vehicles, different from the lead autonomous vehicle, wherein:
the lead autonomous vehicle is on a particular road heading toward a destination using a first routing plan and map data previously received from an operation server;
the one or more following autonomous vehicles are on the particular road behind the lead autonomous vehicle; and
the lead autonomous vehicle and the one or more following autonomous vehicles are communicatively coupled with the operation server;

a first control subsystem, associated with the lead autonomous vehicle, communicatively coupled with the lead autonomous vehicle, the one or more following autonomous vehicles, and the operation server, the first control subsystem comprising a first processor configured to:
receive sensor data from the at least one vehicle sensor of the lead autonomous vehicle, wherein the sensor data comprises location coordinates of any object on the particular road within the first field-of-view of the lead autonomous vehicle;
compare the sensor data with a first portion of the map data, wherein the first portion of the map data comprises location coordinates of expected objects on the particular road within the first field-of-view of the lead autonomous vehicle;
based at least in part upon comparing the sensor data with the first portion of the map data, determine whether a structural change in the particular road is detected by identifying one or more objects in the sensor data that correspond to the structural change and that are not among the expected objects in the map data, wherein the structural change comprises a particular structural change associated with an object that is not behaving as expected from the map data;
in response to a determination that the structural change is detected in the particular road:
update driving instructions of the lead autonomous vehicle to navigate through the structural change using driving instructions related to the structural change;
send a first message to the operation server indicating that the structural change is detected; and

the operation server comprising a second processor configured to:
based at least in part upon the first message, update the first portion of the map data, reflecting the structural change;
send the updated map data to the one or more following autonomous vehicles,
for a following autonomous vehicle from among the one or more following autonomous vehicle:
determine a location of the following autonomous vehicle;
determine whether the structural change causes a first driving time including navigating through the structural change to become more than second driving times associated with alternative routes that reach the destination based at least in part upon the determined location of the following autonomous vehicle;
in response to determining that the structural change causes the first driving time to become more than the second driving times:
 identify a particular alternative route that is associated with less driving time compared to the first driving time; and
 send a re-routing plan to the following autonomous vehicle, wherein the re-routing plan comprises instructions to re-route to the particular alternative route, wherein in response to receiving the re-routing plan, the following autonomous vehicle is autonomously navigated according to the re-routing plan;
access traffic data that indicate traffic along each of the alternative routes;
determine whether each of the first driving time and the second driving times is more than a threshold driving time; and
in response to determining that each of the first driving time and the second driving times is more than the threshold driving time, send a pulling over instructions to the following autonomous vehicle, wherein the following autonomous vehicle is autonomously navigated according to the pulling over instructions.

2. The system of claim 1 , wherein updating the driving instructions of the lead autonomous vehicle comprises entering a safety mode by:
reducing a speed of the lead autonomous vehicle according to speeds of surrounding vehicles;
increasing distances from the surrounding vehicles; or
avoiding autonomous driving parallel to the surrounding vehicles.

3. The system of claim 1 , wherein the structural change comprises at least one of: a change in a lane marking, a change in an intersection, a change in a stop traffic light junction, a new road sign, a lack of a road sign, one or more new lanes, and a lack of one or more lanes.

4. The system of claim 1 , further comprising:
a second control subsystem, associated with any of the one or more following autonomous vehicles, comprising a third processor configured to:
determine whether the structural change is changed back to a previous state; and
in response to a determination that the structural change is changed back to the previous state, send a second message to the operation server indicating that the structural change is changed back to the previous state, wherein in response to receiving the second message, the operation server updates the first portion of the map data indicating that the structural change is changed back to the previous state and sends the updated map data to the one or more following autonomous vehicles.

5. The system of claim 1 , wherein the at least on vehicle sensor comprises one or more of cameras, LiDAR sensors, motion sensors, and infrared sensors.

6. The system of claim 1 , wherein the sensor data comprises one or more of optical sensor data, LiDAR sensor data, motion sensor data, and infrared sensor data.

7. The system of claim 1 , wherein the first message is sent to the operation server at a first time after detecting the structure change.

8. A method, comprising:
receiving sensor data from at least one vehicle sensor of a lead autonomous vehicle, wherein:
the sensor data comprises location coordinates of any object on a particular road within a first field-of-view of the lead autonomous vehicle;
the lead autonomous vehicle is on a particular road heading toward a destination using a routing plan and map data previously received from an operation server; and
one or more following autonomous vehicles, different from the lead autonomous vehicle, are on the particular road behind the lead autonomous vehicle;

comparing the sensor data with a first portion of the map data, wherein the first portion of the map data comprises location coordinates of expected objects on the particular road within the first field-of-view of the lead autonomous vehicle;
based at least in part upon comparing the sensor data with the first portion of the map data, determining whether a structural change in the particular road is detected by identifying one or more objects in the sensor data that correspond to the structural change and that are not among the expected objects in the map data, wherein the structural change comprises a particular structural change associated with an object that is not behaving as expected from the map data;
in response to determining that the structural change is detected in the particular road:
updating driving instructions of the lead autonomous vehicle to navigate through the structural change using driving instructions related to the structural change;
sending a first message to the operation server indicating that the structural change is detected;

based at least in part upon the first message, updating the first portion of the map data, r

Assignees

• Tusimple Inc

Inventors

• Brown Robert Patrick
• Foster Scott Douglas
• Tam Joyce

Classifications

• B60W60/001 Primary

  Planning or execution of driving tasks · CPC title

• B60W30/143

  Speed control (B60W30/16 takes precedence) · CPC title

• B60W30/16

  Control of distance between vehicles, e.g. keeping a distance to preceding vehicle · CPC title

• G01C21/32

  Structuring or formatting of map data · CPC title

• G01C21/3407

  specially adapted for specific applications · CPC title