Contingent device actions during loss of network connectivity

Patent metadata

Field	Value
Publication number	US-11626117-B2
Application number	US-202016775246-A
Country	US
Kind code	B2
Filing date	Jan 28, 2020
Priority date	Dec 17, 2013
Publication date	Apr 11, 2023
Grant date	Apr 11, 2023

Abstract

A speech-based system includes a local device in a user premises and a network-based control service that directs the local device to perform actions for a user. The control service may specify a first action that is to be performed upon detection by the local device of a stimulus. In some cases, performing the first action may rely on the availability of network communications with the control service or with another service. In these cases, the control service also specifies a second, fallback action that does not rely upon network communications. Upon detecting the stimulus, the local device performs the first action if network communications are available. If network communications are not available, the local device performs the second, fallback action.

First claim

What is claimed is:

1. A device comprising:
one or more network communications interfaces;
one or more microphones;
one or more speakers;
one or more memories;
one or more processors; and
one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
generating, using the one or more microphones, first audio data based at least on speech captured by the one or more microphones, the speech specifying a notification time at which the device is to request second audio data from a network source;
sending, via the one or more network communications interfaces, the first audio data to one or more network-based computing devices for recognition of the speech specifying the notification time;
receiving, via the one or more network communications interfaces and from the one or more network-based computing devices, a command indicating the notification time at which the device is to request the second audio data from the network source;
sending, via the one or more network communications interfaces to the network source and at or approximately at the notification time, a request for the second audio data;
determining that the second audio data has not been received by the device; and
causing output of third audio data using the one or more speakers.

2. The device of claim 1 , wherein the command comprises data that causes the device to request the second audio data from the network source at the notification time.

3. The device of claim 1 , wherein the second audio data comprises music or synthesized speech.

4. The device of claim 1 , wherein the network source comprises a network-accessible music repository.

5. The device of claim 1 , wherein the one or more non-transitory computer-readable media further store computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform an act comprising storing the third audio data in the one or more memories prior to the notification time.

6. The device of claim 1 , wherein the third audio data comprises at least one of music, synthesized speech, a cached report, an error message, an alert, a preconfigured tone, a preconfigured tune, an audio cue that indicates an error, or an initial portion of the second audio data.

7. The device of claim 1 , wherein:
the second audio data comprises a first weather forecast provided from the network source or another network source; and
the third audio data comprises a second weather forecast that was stored in the one or more memories prior to the notification time.

8. The device of claim 1 , wherein determining that the second audio data has not been received comprises determining at least one of that:
the request timed out;
a threshold time has passed since sending the request; or
an error message was received.

9. The device of claim 1 , wherein the command further indicates a uniform resource locator (URL) at which to retrieve the second audio data at the notification time.

10. A device comprising:
one or more network communications interfaces;
one or more microphones;
one or more speakers;
one or more memories; one or more processors; and
one or more non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:
generating, using the one or more microphones, first audio data based at least on speech captured by the one or more microphones, the speech specifying a time for obtaining second audio data from a network source;
sending, via the one or more network communications interfaces, the first audio data to one or more network-based computing devices for recognition of the speech specifying the time;
receiving, via the one or more network communications interfaces from the one or more network-based computing devices, a command indicating the time for obtaining the second audio data from the network source;
attempting to obtain the second audio data from the network source at or approximately at the time;
determining that the second audio data has not been obtained; and
causing the device to perform a contingent action.

11. The device of claim 10 , wherein attempting to obtain the second audio data from the network source comprises instructing another device to attempt to obtain the second audio data.

12. The device of claim 10 , wherein the time is a recurring time that occurs on multiple days.

13. The device of claim 10 , wherein the command further indicates a uniform resource locator (URL) and attempting to obtain the second audio data comprises sending a request for the second audio data to the URL.

14. The device of claim 10 , wherein determining that the second audio data has not been obtained comprises determining that at least one of that the second audio data has not been received within a threshold amount of time or that an error message has been received.

15. The device of claim 10 , wherein the command further indicates the contingent action to perform in response to determining that the second audio data has not been obtained.

16. The device of claim 10 , wherein the one or more non-transitory computer-readable media further store computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform an act comprising generating, using the one or more microphones, third audio data indicating the contingent action to perform in response to determining that the second audio data has not been obtained.

17. The device of claim 10 , wherein the command comprises a first command, and wherein the contingent action comprises at least one of monitoring a local sensor, caching monitored data, sending a second command to another device, or outputting a notification.

18. The device of claim 10 , wherein causing the device to perform the contingent action comprises causing the device to output third audio data using the one or more speakers.

19. A method comprising:
generating, using one or more microphones associated with a device, first audio data based at least on speech captured by the one or more microphones, the speech specifying a notification time at which the device is to request second audio data from a network source;
sending, via one or more network communications interfaces of the device to one or more network-based computing devices, the first audio data for recognition of the speech specifying the notification time;
receiving, via the one or more network communications interfaces and from the one or more network-based computing devices, a command indicating the notification time;
determining that second audio data has not been received by the notification time; and
causing output of third audio data using one or more speakers associated with the device.

20. The method of claim 19 , further comprising storing the third audio data in one or more memories associated with the device prior to the notification time.

21. The method of claim 19 , wherein the second audio data is to be received from a remote service that receives a second command to deliver the second audio data at the notification time.

22. A method comprising:
generating, using one or more microphones associated with a device, first audio data based at least on speech captured by the one or more micropho

Assignees

• Amazon Tech Inc

Inventors

• Torok Fred
• Mutagi Rohan
• Gundeti Vikram Kumar
• Deramat Frederic Johan Georges

Classifications

• G10L21/06

  Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids (G10L15/26 takes precedence) · CPC title

• H04L12/2825

  Reporting to a device located outside the home and the home network (access arrangements H04L12/2856; for remote control or remote monitoring of applications H04L67/025; telephonic communication systems adapted for combination with telemetering systems H04M11/002) · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L15/30 Primary

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title