Human assisted live operations systems and methods

Patent metadata

Field	Value
Publication number	US-12418779-B2
Application number	US-202217946741-A
Country	US
Kind code	B2
Filing date	Sep 16, 2022
Priority date	Sep 16, 2022
Publication date	Sep 16, 2025
Grant date	Sep 16, 2025

Abstract

There is disclosed a method of operating an autonomous vehicle (AV), including: detecting an alert condition within the AV via data from an electronic sensor suite of the AV; based at least in part on detecting the alert condition, automatically initiating a call with another party; and communicatively coupling a passenger of the AV to the call, whereby the passenger can communicate with the other party via the call.

First claim

What is claimed is:

1. A method of operating an autonomous vehicle (AV) for a ride-hail service, comprising:
determining an alert condition within the AV via electronic sensor data of the AV, wherein the alert condition is non-disabling, and the alert condition is inferred from the electronic sensor data of the AV;
based at least in part on detecting the alert condition, automatically initiating a conference call with a representative of the ride-hail service, the conference call managed by a system associated with the representative; and
communicatively coupling a passenger of the AV to the conference call, whereby the passenger can communicate with the representative via the conference call, wherein termination of the conference call is controlled by the system associated with the representative.

2. The method of claim 1 , wherein the alert condition comprises a law enforcement interaction.

3. The method of claim 1 , wherein the alert condition comprises adverse weather conditions.

4. The method of claim 1 , wherein the alert condition comprises tampering or attempted tampering of the AV.

5. The method of claim 1 , wherein the alert condition comprises presence of an unexpected person or animal in the AV.

6. The method of claim 1 , further comprising playing a pre-recorded audio message or chime at a beginning of the conference call.

7. The method of claim 1 , wherein managing the conference call comprises selectively adding at least one third party to the conference call based on the alert condition while maintaining communication with the passenger.

8. The method of claim 1 , further comprising terminating or pausing non-essential applications provided in the AV for a duration of the conference call.

9. An autonomous vehicle (AV) operator for a ride-hail service, comprising a processor circuit, a memory, and instructions encoded within the memory to instruct the processor circuit to:
determine an alert condition within the AV via data from an electronic sensor suite of the AV, wherein the alert condition is a non-disabling alert condition, and the alert condition is inferred from data from the electronic sensor suite of the AV;
based at least in part on detecting the alert condition, automatically initiate a conference call with another party, the conference call managed by a system associated with the other party; and
communicatively couple a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call, wherein termination of the conference call is controlled by the system associated with the other party.

10. The AV operator of claim 9 , wherein the alert condition comprises a law enforcement interaction.

11. The AV operator of claim 9 , wherein the alert condition comprises adverse weather conditions.

12. The AV operator of claim 9 , wherein the alert condition comprises tampering or attempted tampering of the AV.

13. The AV operator of claim 9 , wherein the alert condition comprises presence of an unexpected person or animal in the AV.

14. The AV operator of claim 9 , wherein the processor circuit is further instructed to play a pre-recorded audio message or chime at a beginning of the conference call.

15. The AV operator of claim 9 , wherein managing the conference call comprises selectively adding at least one third party to the conference call based on the alert condition while maintaining communication with the passenger.

16. The AV operator of claim 9 , wherein the processor circuit is further instructed to terminate or pause non-essential applications provided in the AV for a duration of the conference call.

17. One or more non-transitory computer-readable storage media having stored thereon executable instructions to cause a processor to:
determine an alert condition within an autonomous vehicle (AV) via data from an electronic sensor suite of the AV, wherein the AV belongs to a ride-hail fleet, and wherein the alert condition is non-disabling, and the alert condition is inferred from electronic sensor data of the AV;
based at least in part on detecting the alert condition, automatically initiate a conference call with another party, the conference call managed by a system associated with the other party; and
communicatively couple a passenger of the AV to the conference call, whereby the passenger can communicate with the other party via the conference call, wherein termination of the conference call is controlled by the system associated with the other party.

18. The one or more non-transitory computer-readable storage media of claim 17 , wherein the executable instructions are to further cause the processor to play a pre-recorded audio message or chime at a beginning of the conference call.

19. The one or more non-transitory computer-readable storage media of claim 17 , wherein managing the conference call comprises selectively adding at least one third party to the conference call based on the alert condition while maintaining communication with the passenger.

20. The one or more non-transitory computer-readable storage media of claim 17 , wherein the executable instructions are to further cause the processor to terminate or pause non-essential applications provided in the AV for a duration of the conference call.

Assignees

• Gm Cruise Holdings Llc

Inventors

• Foy Theresa
• Warren Christopher
• Johanna Livia
• Patel Bharatkumar
• Meyerholtz Leah
• Li Qingxuan
• Shuckerow David J
• Tong Minjie
• Dattatraya Vinayaka
• Sparks Kendal
• Morey Mckenna

Classifications

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• B60W2050/146

  Display means · CPC title

• B60W2555/20

  Ambient conditions, e.g. wind or rain · CPC title