System for remotely relocating autonomous vehicles using multi-point maneuvers

Patent metadata

Field	Value
Publication number	US-2024416952-A1
Application number	US-202318336690-A
Country	US
Kind code	A1
Filing date	Jun 16, 2023
Priority date	Jun 16, 2023
Publication date	Dec 19, 2024
Grant date	—

Abstract

It may be desirable for a remote advisor to request an AV to relocate to a target relocation pose. In some cases, reaching a target relocation pose may involve a multi-point maneuver. Ability to perform relocation that involves a multi-point maneuver offers flexibility for the AV to maneuver around double-parked vehicles, to avoid obstacles, to aid a reroute when a route becomes unnavigable, etc. To support relocation that involves performing multi-point maneuvers, the planning stack may be modified to include a motion planner that can generate output plans that involve the AV going forward and in reverse. Moreover, the vehicle control stack may publish vehicle controls information as feedback information to the motion planner and the remote requestor, so that the motion planner and the remote requestor can be informed of the state of the AV.

First claim

What is claimed is:

1 . A vehicle comprising:
vehicle actuators; one or more processors; and one or more storage media storing instructions executable by the one or more processors to implement a software stack, wherein the software stack includes:
a planning stack comprising:
a remote vehicle interface to receive relocation commands from a remote requestor; and
a plurality of motion planners, wherein the motion planners comprise at least a freespace planner that produces an output plan involving the vehicle moving forward and in reverse in response to the remote vehicle interface receiving relocation commands, wherein the output plan is provided to the remote requestor; and

a vehicle control stack to:
receive the output plan from the freespace planner,
output commands to the vehicle actuators to carry out the received output plan; and
output vehicle controls information, wherein the vehicle controls information is provided to the remote requestor.

2 . The vehicle of claim 1 , wherein the vehicle controls information is provided to the freespace planner, and the freespace planner produces the output plan based on the vehicle controls information.

3 . The vehicle of claim 1 , wherein the motion planners further include a structured planner that has more constraints than the freespace planner.

4 . The vehicle of claim 1 , wherein the output plan comprises timing information.

5 . The vehicle of claim 4 , wherein the timing information is computed by the freespace planner based on the vehicle controls information received from the vehicle control stack.

6 . The vehicle of claim 1 , wherein the vehicle controls information comprises one or more of: a current gear of the vehicle, a target gear of the vehicle, a current speed of the vehicle, gear shifting readiness of the vehicle, and estimate of gear shifting duration of the vehicle.

7 . A computer-implemented remote assistance platform for relocating a vehicle using a multi-point maneuver, comprising:
one or more processors; and one or more storage media storing instructions executable by the one or more processors to implement:
a graphical user interface to:
display information to a remote advisor, and
receive user input from the remote advisor for a relocation session of the vehicle; and

a relocation command generator to generate relocation commands based on the user input and to transmit the relocation commands to a remote vehicle interface implemented on the vehicle;
wherein the graphical user interface is to further:
receive an output plan computed by a planner of the vehicle, wherein the output plan includes the vehicle moving forward and in reverse,
display a first shape corresponding to a first segment of the output plan, and
display a second shape visually different from the first shape corresponding to a second segment of the output plan.

8 . The computer-implemented remote assistance platform of claim 7 , wherein the graphical user interface is further to:
display a third shape visually different from the first shape and the second shape corresponding to a transition between the first segment and the second segment.

9 . The computer-implemented remote assistance platform of claim 7 , wherein the graphical user interface is further to:
display a first sequence number corresponding to the first segment of the output plan; and display a second sequence number corresponding to the second segment of the output plan.

10 . The computer-implemented remote assistance platform of claim 9 , wherein the graphical user interface is further to:
display a third sequence number corresponding to a transition between the first segment and the second segment.

11 . The computer-implemented remote assistance platform of claim 7 , wherein:
the instructions further implement an execution time estimator to determine an expected duration for the vehicle to traverse and complete the output plan computed for the relocation session; and the graphical user interface further displays the expected duration to the remote advisor.

12 . The computer-implemented remote assistance platform of claim 7 , wherein:
the instructions further implement an execution time estimator to determine respective expected durations for the vehicle to complete the first and second segments of the output plan computed for the relocation session; and the graphical user interface further displays the respective expected durations adjacent to respective shapes in the graphical user interface that correspond to the first and second segments of the output plan.

13 . The computer-implemented remote assistance platform of claim 7 , wherein:
the instructions further implement an execution time estimator to determine expected durations for the vehicle to complete a transition between the first segment and the second segment of the output plan computed for the relocation session; and the graphical user interface further displays the expected durations adjacent to a shape in the graphical user interface that correspond to the transition.

14 . The computer-implemented remote assistance platform of claim 7 , wherein the graphical user interface is further to:
display a first semicircular shape indicating possible target relocation poses in front of the vehicle, and display a second semicircular shape indicating possible target relocation poses behind the vehicle.

15 . The computer-implemented remote assistance platform of claim 7 , wherein the graphical user interface is further to:
display a camera feed corresponding to a camera with a field of view behind the vehicle in response to receiving an indication that the vehicle is about to shift to a reverse gear.

16 . The computer-implemented remote assistance platform of claim 7 , wherein the graphical user interface is further to:
remove a camera feed corresponding to a camera with a field of view behind the vehicle in response to receiving an indication that the vehicle is about to shift to a drive gear from a reverse gear.

17 . The computer-implemented remote assistance platform of claim 7 , wherein the graphical user interface is further to:
display a visual indicator conveying information from one or more ultrasonic sensors with a field of view behind the vehicle when the vehicle is in a reverse gear.

18 . The computer-implemented remote assistance platform of claim 7 , wherein:
the instructions further implement a relocation command validation to determine whether the relocation commands generated by the relocation command generator are valid.

19 . The computer-implemented remote assistance platform of claim 7 , wherein:
the instructions further implement a target pose checker to determine whether a target relocation pose is valid.

20 . A computer-implemented method to visualize and manage a relocation session for a vehicle, the method comprising:
displaying, through a graphical user interface, information to a remote advisor, receiving, through the graphical user interface, user input from the remote advisor for the relocation session; generating, by a relocation command generator, relocation commands based on the user input; transmitting the relocation commands to a remote vehicle interface implemented on the vehicle; receiving an output plan computed by a planner of the vehicle, wherein the output plan involves the vehicle moving forward and in reverse; displaying a first shape corresponding to a first segment of the output plan; and displaying a second s

Assignees

• Gm Cruise Holdings Llc

Inventors

• Maniatopoulos Spyros
• Fasola Juan
• Zhou Xiaoyu
• Gillespie Iii Arthur L

Classifications

• B60W2420/403

  Image sensing, e.g. optical camera · CPC title

• B60W2556/45

  External transmission of data to or from the vehicle · CPC title

• B60W60/001 Primary

  Planning or execution of driving tasks · CPC title

• G05D1/0044

  by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps (maps used for automatic navigation G05D1/0274; flight directors G01C23/005) · CPC title

• G05D1/0038

  by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation (images analyzed by a computer and used for automatic navigation G05D1/0246) · CPC title