Remote execution of secondary-device drivers

Patent metadata

Field	Value
Publication number	US-11429345-B2
Application number	US-201916657938-A
Country	US
Kind code	B2
Filing date	Oct 18, 2019
Priority date	Mar 17, 2015
Publication date	Aug 30, 2022
Grant date	Aug 30, 2022

Abstract

Techniques for remotely executing a secondary-device driver for generating commands for a secondary device are described herein. For instance, a secondary device (or “appliance”) may reside within an environment, along with a device to which the secondary device communicatively couples. The device may be configured to send control signals to the secondary device for causing the secondary device to perform certain operations. For instance, a user in the environment may provide, to the device, a request that the secondary device perform a certain operation. The device, which may lack some or all of a device driver associated with the secondary device, may then work with a remote service that executes the device driver for the purpose of receiving a command from the device driver and sending the command along to the secondary device. Upon receiving the command, the secondary device may perform the operation.

First claim

What is claimed is:

1. A method comprising:
receiving, at a first device in an environment, first data that represents sound in the environment;
at least partly in response to identifying a wake word associated with the first device, sending the first data to one or more network-based devices that are remote from the environment to perform speech processing on the first data and to determine a second device in the environment;
receiving, at the first device, second data generated by a device driver associated with the second device and stored on the one or more network-based devices, the second data representing one or more commands to be executed by the second device and indicating a communication protocol utilized by the second device;
determining the communication protocol indicated by the second data; and
sending, from the first device and using the communication protocol, third data to the second device, wherein the third data represents the one or more commands represented by the second data.

2. The method as recited in claim 1 , further comprising:
identifying a user account associated with the first device; and
identifying the second device based, at least in part, on the user account.

3. The method as recited in claim 1 , further comprising:
identifying a location in the environment where the first data was received; and
identifying the second device based, at least in part, on the location being associated with the second device.

4. The method as recited in claim 1 , further comprising identifying the second device from a plurality of devices that reside in the environment, based, at least in part, on a location of the first device within the environment.

5. The method as recited in claim 1 , further comprising identifying the second device based, at least in part, on the sound that includes a verbal description of the second device.

6. The method as recited in claim 1 , wherein the communication protocol utilized by the second device is a short-range wireless communication protocol.

7. The method as recited in claim 1 , wherein the second device comprises a light, a television, an audio system, a lock, a garage door opener, a washing machine, a dryer, a dishwasher, a coffee maker, a refrigerator, a door, or a motorized window shade.

8. The method as recited in claim 1 , further comprising receiving fourth data from the second device that represents that the one or more commands were executed by the second device.

9. The method as recited in claim 1 , further comprising generating, by the one or more network-based devices, the second data via the device driver associated with the second device.

10. A system comprising:
one or more processors; and
one or more computer-readable media storing computer-executable instructions that, when executed on the one or more processors, cause the one or more processors to perform acts comprising:
receiving first data that represents sound in an environment;
at least partly in response to identifying a wake word, sending at least a portion of the first data to one or more network-based devices, that are remote from the environment, to perform speech processing on the at least the portion of the first data and to determine a device in the environment;
receiving second data generated by a device driver associated with the device and stored on the one or more network-based devices, the second data representing one or more commands to be executed by the device and indicating a communication protocol utilized by the device;
determining the communication protocol indicated by the second data; and
sending, via the communication protocol, third data to the device, wherein the third data represents the one or more commands represented by the second data.

11. The system as recited in claim 10 , wherein the communication protocol is a short-range wireless communication protocol.

12. The system as recited in claim 10 , the acts further comprising identifying a user account associated with the system, and identifying the device based, at least in part, on the user account.

13. The system as recited in claim 10 , the acts further comprising further comprising:
identifying a location in the environment where the first data was received; and
identifying the device based, at least in part, on the location being associated with the device.

14. The system as recited in claim 10 , wherein the device is identified based at least in part on the sound that includes a verbal description of the device.

15. The system as recited in claim 10 , the acts further comprising identifying the device from a plurality of devices that reside in the environment, based, at least in part, on a location within the environment of the device.

16. The system as recited in claim 10 , wherein the device comprises a light, a television, an audio system, a lock, a garage door opener, a washing machine, a dryer, a dishwasher, a coffee maker, a refrigerator, a door, or a motorized window shade.

17. The system as recited in claim 10 , further comprising a speaker, and the acts further comprising outputting at least one of a first indication that the system has received a request to execute the one or more commands by the device or a second indication that the one or more commands were executed by the device.

Assignees

• Amazon Tech Inc

Inventors

• Mutagi Rohan
• Whiteley Michael Dale
• Lu He
• Butler Brian James
• Torok Fred
• Lew Yuk Vong Willy
• Bronaugh David Ross
• Nies Christopher Ryan
• Sitoke Shikher

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• H04L12/2816

  Controlling appliance services of a home automation network by calling their functionalities (arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station; in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom H04Q9/00) · CPC title

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• G10L15/02

  Feature extraction for speech recognition; Selection of recognition unit · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title