Systems and methods for remote status detection of autonomous vehicles

Patent metadata

Field	Value
Publication number	US-11614735-B1
Application number	US-201816220406-A
Country	US
Kind code	B1
Filing date	Dec 14, 2018
Priority date	May 18, 2018
Publication date	Mar 28, 2023
Grant date	Mar 28, 2023

Abstract

Systems and methods are provided for remotely detecting a status associated with an autonomous vehicle and generating control actions in response to such detections. In one example, a computing system can access a third-party communication associated with an autonomous vehicle. The computing system can determine, based at least in part on the third-party communication, a predetermined identifier associated with the autonomous vehicle. The computing system can determine, based at least in part on the third-party communication, a status associated with the autonomous vehicle, and transmit one or more control messages to the autonomous vehicle based at least in part on the predetermined identifier and the status associated with the autonomous vehicle.

First claim

What is claimed is:

1. A computing system, comprising:
one or more processors; and
one or more non-transitory computer-readable media that store instructions that, when executed by the one or more processors, cause the computing system to perform operations, the operations comprising:
accessing a third-party communication associated with an autonomous vehicle;
determining a predetermined identifier of the autonomous vehicle;
inputting imagery data from the third-party communication to a machine-learned model trained to analyze the imagery data to identify a condition of an external surface of the autonomous vehicle and to generate as an output a status associated with the condition of the external surface of the autonomous vehicle based on the imagery data, wherein the machine-learned model is located remotely from the autonomous vehicle;
receiving an indication of the status associated with the condition of the external surface of the autonomous vehicle from the machine-learned model; and
transmitting one or more control messages to the autonomous vehicle based at least in part on the predetermined identifier and the status associated with the condition of the external surface of the autonomous vehicle.

2. The computing system of claim 1 , wherein:
the third-party communication includes imagery depicting at least a portion of the autonomous vehicle, the imagery having been captured at a client computing device by a user of the client computing device; and
determining the predetermined identifier includes detecting the predetermined identifier based at least in part on an analysis of the imagery.

3. The computing system of claim 2 , wherein:
determining the status associated with the autonomous vehicle is based at least part on the analysis of the imagery.

4. The computing system of claim 1 , wherein:
the status associated with the autonomous vehicle includes a condition of the autonomous vehicle.

5. The computing system of claim 1 , wherein accessing the third-party communication comprises:
receiving, from a remote client device, the third-party communication.

6. The computing system of claim 5 , wherein the third-party communication includes at least one of a short messaging service (SMS) message, an e-mail message, or a web-based message.

7. The computing system of claim 6 , further comprising:
transmitting one or more reply messages to the remote client device based on the third-party communication.

8. The computing system of claim 1 , wherein accessing the third-party communication comprises:
accessing one or more third-party computing systems that provide third-party content.

9. The computing system of claim 8 , wherein the operations further comprise:
analyzing an image from the third-party content to detect the predetermined identifier.

10. The computing system of claim 1 , wherein:
accessing the third-party communication includes receiving the third-party communication via an application provided by a service entity associated with the autonomous vehicle.

11. The computing system of claim 1 , wherein:
the one or more control messages include instructions for the autonomous vehicle to execute a controlled stop in a safe state.

12. The computing system of claim 1 , wherein:
the one or more control messages include instructions for the autonomous vehicle to proceed toward a predetermined location.

13. The computing system of claim 1 , wherein:
the one or more control messages include instructions for the autonomous vehicle to transmit sensor data from the autonomous vehicle to the computing system.

14. The computing system of claim 1 , wherein:
the predetermined identifier comprises a code provided on an external surface of the autonomous vehicle.

15. The computing system of claim 1 , wherein the one or more control messages comprise instructions for the autonomous vehicle to initiate travel according to a backup motion plan.

16. One or more tangible, non-transitory computer-readable media storing computer-readable instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:
accessing a third-party communication associated with an autonomous vehicle;
determining a predetermined identifier of the autonomous vehicle;
inputting imagery data from the third-party communication to a machine-learned model trained to analyze the imagery data to identify a condition of an external surface of the autonomous vehicle and to generate as an output a status associated with the condition of the external surface of the autonomous vehicle based on the imagery data, wherein the machine-learned model is located remotely from the autonomous vehicle;
receiving an indication of the status associated with the condition of the external surface of the autonomous vehicle from the machine-learned model; and
transmitting one or more control messages to the autonomous vehicle based at least in part on the predetermined identifier and the status associated with the condition of the external surface of the autonomous vehicle.

17. A computer-implemented method, comprising:
accessing a third-party communication associated with an autonomous vehicle;
determining a predetermined identifier of the autonomous vehicle;
inputting imagery data from the third-party communication to a machine-learned model trained to analyze the imagery data to identify a condition of an external surface of the autonomous vehicle and to generate as an output a status associated with the condition of the external surface of the autonomous vehicle based on the imagery data, wherein the machine-learned model is located remotely from the autonomous vehicle;
receiving an indication of the status associated with the condition of the external surface of the autonomous vehicle from the machine-learned model; and
transmitting one or more control messages to the autonomous vehicle based at least in part on the predetermined identifier and the status associated with the condition of the external surface of the autonomous vehicle.

18. The one or more tangible, non-transitory computer-readable media of claim 16 , wherein:
the third-party communication includes imagery depicting at least a portion of the autonomous vehicle, the imagery having been captured at a client computing device by a user of the client computing device; and
determining the predetermined identifier includes detecting the predetermined identifier based at least in part on an analysis of the imagery.

19. The computer-implemented method of claim 17 , wherein:
the third-party communication includes imagery depicting at least a portion of the autonomous vehicle, the imagery having been captured at a client computing device by a user of the client computing device; and
determining the predetermined identifier includes detecting the predetermined identifier based at least in part on an analysis of the imagery.

Assignees

• Uatc Llc

Inventors

• Poeppel Scott C
• Zych Noah
• Wood Matthew Shaw
• Vandenberg Iii Dirk John

Classifications

• G06N3/08

  Learning methods · CPC title

• G05D1/226

  Communication links with the remote-control arrangements · CPC title

• G05D1/227

  Handing over between remote control and on-board control; Handing over between remote control arrangements · CPC title

• G08G1/202

  Dispatching vehicles on the basis of a location, e.g. taxi dispatching · CPC title

• G08G1/20

  Monitoring the location of vehicles belonging to a group, e.g. fleet of vehicles, countable or determined number of vehicles · CPC title