Network scheduling of stimulus-based actions

Patent metadata

Field	Value
Publication number	US-11132173-B1
Application number	US-201414185356-A
Country	US
Kind code	B1
Filing date	Feb 20, 2014
Priority date	Feb 20, 2014
Publication date	Sep 28, 2021
Grant date	Sep 28, 2021

Abstract

A speech-based service platform includes a local device in a user premises and a network-based control service that directs the local device to perform actions for a user. The user may at times request that the service schedule a notification or other action at a specified future time or in response to other stimuli that may occur in the future. Upon receiving a request from the user, the control service immediately instructs the local device to schedule the notification or other action. If the control service is unable to contact the local device, however, the request is canceled and the user is notified that the action has not been scheduled. Non-priority actions requested by the user may be accepted and implemented at the local device when communications become available.

First claim

What is claimed is:

1. A system, comprising:
a network-based control service configured to (a) receive an audio signal using an audio interface device, (b) recognize user speech in the audio signal, (c) determine user intent from the user speech, and (d) generate directive data based at least in part on the user intent;
a graphical interface accessible through a device other than the audio interface device, the graphical interface configured to receive a request that specifies a future time at which an action is to be performed by the audio interface device;
the network-based control service being further configured to:
determine that the audio interface device is inaccessible by the network-based control service;
determine that the request is unfulfilled based at least in part on determining that the audio interface device is inaccessible by the network-based control service;
determine, based at least in part on determining that the request is unfulfilled, that the request represents at least one of an informational request or a home-automation request;
cause the graphical interface to display a request acknowledgement indicating the request is scheduled for fulfillment at a time at or after when the audio interface device becomes accessible by the network-based control service;
determine that the audio interface device has become available to the network-based control service; and
send, to the audio interface device and based at least in part on determining that the audio interface device has become available to the network-based control service, a command to perform the action at the future time.

2. The device of claim 1 , wherein the at least one of the informational request or the home-automation request are associated with a non-priority classification of requests predefined by a user associated with the device.

3. The device of claim 1 , the network-based control service configured to provide a notification that the request has been accepted based at least in part on sending the command.

4. A system comprising:
one or more processors; and
one or more non-transitory computer-readable media storing computer-executable instructions that, when executed, cause the one or more processors to perform acts comprising:
receiving a request to perform, at an audio device, an action in response to a specified stimulus;
determining that communications with a control service are unavailable;
determining that the request is unsuccessful based at least in part on the determining that the communications with the control service are unavailable;
determining, based at least in part on determining that the request is unsuccessful, that the request represents at least one of an information request or a home-automation request;
causing a graphical interface to display a request acknowledgement indicating the request is scheduled for fulfillment at a time at or after when the audio device becomes accessible by the control service;
determining that the audio device has become available to the control service; and
sending, to the audio device and based at least in part on determining that the audio device has become available to the control service, a command to perform the action in response to the specified stimulus.

5. The system of claim 4 , wherein the specified stimulus comprises a time in the future.

6. The system of claim 4 , wherein the action comprises an audio notification.

7. The system of claim 4 , wherein communicating with the control service is performed using a wide-area network.

8. The system of claim 4 , wherein the request is received from the audio device.

9. The system of claim 4 , wherein:
the audio device includes a speech-based interface; and
the device includes at least one of a text-based or graphics-based interface.

10. The system of claim 4 , wherein determining that communications with the control service are unavailable comprises determining that communications with the control service are unavailable based at least in part on an indication that a connection between a network and the audio device is absent.

11. The system of claim 4 , wherein:
the informational request corresponds to a first intent to obtain information requested by a user in response to the specified stimulus; and
the home-automation request corresponds to a second intent to initiate a home-automation action in response to the specified stimulus.

12. The system of claim 4 , the acts further comprising receiving priority data indicating that the at least one of the informational request or the home-automation request are classified as non-priority actions by a user, and wherein causing the graphical interface to display the indication that the request is pending is based at least in part on receiving the priority data.

13. The system of claim 4 , the acts further comprising receiving priority data indicating that the at least one of the informational request or the home-automation request are classified as non-priority actions by the control service based at least in part on historical data associated with a user and another user, and wherein causing the graphical interface to display the indication that the request is pending is based at least in part on receiving the priority data.

14. The system of claim 4 , the acts further comprising receiving priority data indicating that the at least one of the informational request or the home-automation request are classified as non-priority actions by the control service based at least in part on machine learning techniques utilizing data associated with previous requests by a user of the audio device.

15. A method, comprising:
receiving, at a first device from a second device including a user interface, a request that specifies a stimulus and an action that is to be initiated by the first device in response to the stimulus;
determining that communications between the first device and a remote system are unavailable;
determining that the request is unfulfilled based at least in part on determining that communications between the first device and the remote system are unavailable;
determining, based at least in part on determining that the request is unfulfilled, that the request represents at least one of an informational request or a home-automation request;
displaying, via the second device, a request acknowledgement indicating the request is scheduled to be fulfilled at a time at or after when communication between the first device and the remote system are available.

16. The method of claim 15 , wherein the request comprises a first request, the stimulus comprises a first stimulus, the action comprises a first action, and further comprising:
receiving a second request that specifies a second stimulus and a second action that is to be initiated by the first device in response to the second stimulus;
determining that the second request is unsuccessful based at least in part on determining that the communications between the first device and the remote system are unavailable;
receiving third data indicating that the second request represents a set-alarm request; and
canceling the request based at least in part on the third data indicating that the second request represents the set-alarm request.

17. The method of claim 15 , wherein the informational request and the home-automation request are associated with a request type predefined by a user of the first device.

18. The method of claim 15 , wherein the informational request and the home-automation request are associated with a request type bas

Assignees

• Amazon Tech Inc

Inventors

• Borelli Adam Frederick
• Karp Grady Thomas
• Typrin Marcello

Classifications

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/048

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• G10L21/10

  Transforming into visible information · CPC title