Human assisted live operations systems and methods

Patent metadata

Field	Value
Publication number	US-12207166-B2
Application number	US-202217946895-A
Country	US
Kind code	B2
Filing date	Sep 16, 2022
Priority date	Sep 16, 2022
Publication date	Jan 21, 2025
Grant date	Jan 21, 2025

Abstract

There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call.

First claim

What is claimed is:

1. A method of operating an autonomous vehicle (AV) fleet for a ride-hail service, comprising:
receiving information from a first AV, the information including: an indication of an external condition occurring, and a non-recoverable characterization of the external condition by an onboard assistant of the first AV:
in response to the information of the external condition occurring, notifying a rider service agent of the external condition;
generating a graphical user interface that displays AVs in a fleet of AVs providing the ride-hail service;
receiving a selection of a second AV through the graphical user interface;
creating a case for the second AV in response to the selection;
streaming information of the second AV to the rider service agent for display via the graphical user interface, including a recoverable characterization of the external condition by an onboard assistant of the second AV; and
causing a resolution to be executed to address an incident of the second AV caused by the external condition, the resolution including modifying an autonomous vehicle driving behavior of the second AV.

2. The method of claim 1 , wherein creating the case for the second AV comprises creating the case in absence of a reported problem with the second AV.

3. The method of claim 1 , wherein creating the case for the second AV comprises creating the case while the second AV operates normally.

4. The method of claim 1 , wherein the information of the second AV includes a vehicle identification number.

5. The method of claim 1 , wherein the information of the second AV includes a license plate number.

6. The method of claim 1 , wherein the information of the second AV includes a camera feed from an interior camera of the second AV or an exterior camera of the second AV.

7. The method of claim 1 , wherein the information of the second AV includes trip information and/or passenger data.

8. The method of claim 1 , wherein the external condition comprises weather circumstances, and/or social upheaval.

9. An autonomous vehicle (AV) operator for a ride-hail service, comprising a processor circuit, a memory, and instructions encoded within the memory to instruct the processor circuit to:
receive information from a first autonomous vehicle (AV), the information including: an indication of an external condition occurring, and a non-recoverable characterization of the external condition by an onboard assistant of the first AV;
in response to the information of the external condition occurring, notify a rider service agent of the external condition;
generate a graphical user interface that displays AVs in a fleet of AVs providing the ride-hail service;
receive a selection of a second AV through the graphical user interface;
create a case for the second AV in response to the selection;
stream information of the second AV to the rider service agent for display via the graphical user interface, including a recoverable characterization of the external condition by an onboard assistant of the second AV; and
cause a resolution to be executed to address an incident of the second AV caused by the external condition, the resolution including modifying an autonomous vehicle driving behavior of the second AV.

10. The AV operator of claim 9 , wherein creating the case for the second AV comprises creating the case in absence of a reported problem with the second AV.

11. The AV operator of claim 9 , wherein creating the case for the second AV comprises creating the case while the second AV operates normally.

12. The AV operator of claim 9 , wherein the information of the second AV includes a vehicle identification number.

13. The AV operator of claim 9 , wherein the information of the second AV includes a license plate number.

14. The AV operator of claim 9 , wherein the information of the second AV includes a camera feed from an interior camera of the second AV or an exterior camera of the second AV.

15. The AV operator of claim 9 , wherein the information of the second AV includes trip information and/or passenger data.

16. The AV operator of claim 9 , wherein the external condition comprises weather circumstances, and/or social upheaval.

17. One or more non-transitory computer-readable storage media having stored thereon executable instructions to cause a processor to:
receive information from a first autonomous vehicle (AV), the information including: an indication of an external condition occurring, a non-recoverable characterization of the external condition by an onboard assistant of the first AV, an alternative destination location determined by the onboard assistant of the first AV, and a preferred alternative destination location of a passenger of the first AV:
in response to the information of the external condition occurring, notify a rider service agent of the external condition;
generate a graphical user interface that displays AVs in a fleet of AVs providing a ride-hail service;
receive a selection of a second AV through the graphical user interface;
create a case for the second AV in response to the selection;
stream information of the second AV to the rider service agent for display via the graphical user interface, including a recoverable characterization of the external condition by an onboard assistant of the second AV; and
cause a resolution to be executed to address an incident of the second AV caused by the external condition, the resolution including modifying an autonomous vehicle driving behavior of the second AV.

18. The one or more non-transitory computer-readable storage media of claim 17 , wherein creating the case for the second AV comprises creating the case in absence of a reported problem with the second AV.

19. The one or more non-transitory computer-readable storage media of claim 17 , wherein creating the case for the second AV comprises creating the case while the second AV operates normally.

20. The one or more non-transitory computer-readable storage media of claim 17 , wherein the external condition comprises weather circumstances, and/or social upheaval.

Assignees

• Gm Cruise Holdings Llc

Inventors

• Li Qingxuan
• Foy Theresa
• Warren Christopher
• Johanna Livia
• Patel Bharatkumar
• Meyerholtz Leah
• Shuckerow David J
• Tong Minjie
• Dattatraya Vinayaka
• Sparks Kendal
• Morey Mckenna

Classifications

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• B60W2050/146

  Display means · CPC title

• B60W2555/20

  Ambient conditions, e.g. wind or rain · CPC title