Device configuration by natural language processing system

Patent metadata

Field	Value
Publication number	US-10623246-B1
Application number	US-201815937727-A
Country	US
Kind code	B1
Filing date	Mar 27, 2018
Priority date	Mar 27, 2018
Publication date	Apr 14, 2020
Grant date	Apr 14, 2020

Abstract

Systems and methods for device control by a natural language processing system are disclosed. A user may desire to utilize a voice-enabled device to associate an accessory device with a hub device without having to utilize third-party software associated with the accessory device and/or the hub device. The user may provide a user utterance to associate the accessory device with the hub device. Audio data corresponding to the user utterance may be analyzed and utilized to generate and send directive data to a third-party remote system to transition the hub device to a join mode. Upon association completion, audio may be output confirming that the association has been established successfully.

First claim

What is claimed is:

1. A system comprising:
one or more processors; and
non-transitory computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
receiving, from a voice-controlled device, audio data representing a user utterance;
determining that the audio data corresponds to a request to associate an accessory device with a hub device;
determining that a hub-associated skill is enabled for use with the voice-enabled device;
generating, in response to determining that the hub-associated skill is enabled, first directive data representing a first directive to associate the accessory device with the hub device;
sending, to a remote system associated with the hub device, the first directive data to cause the remote system to instruct the hub device to transition to a join mode;
receiving, from the remote system, confirmation data indicating that the accessory device was successfully associated with the hub device;
generating second directive data representing a second directive to output audio:
that confirms the accessory device has been associated with the hub device; and
requests that an association-check operation be performed by a user; and

sending, to the voice-enabled device, the second directive data.

2. The system of claim 1 , wherein the hub device is a first hub device, the audio comprises first audio, the audio data comprises first audio data, the user utterance comprises a first user utterance, and the operations further comprising:
identifying a second hub device associated with the voice-enabled device;
sending, to the voice-enabled device, third directive data representing a third directive to output second audio representing a request to select between the first hub device and the second hub device for associating with the accessory device;
receiving, from the voice-enabled device, second audio data representing a second user utterance;
determining that the second user utterance corresponds to a response indicating the accessory device is to be associated with the first hub device; and
wherein generating the first directive data is based on determining that the second user utterance corresponds to the response indicating the accessory device is to be associated with the first hub device.

3. The system of claim 1 , the operations further comprising:
receiving, from the remote system, accessory-device identification data indicating a device identifier of the accessory device;
receiving contextual data associated with the accessory device, the contextual data comprising at least one of:
device-location data indicating a location of the accessory device within an environment;
device-association data indicating an identifier of another device within the environment; or
device-type data indicating a device type of the accessory device;

determining a naming indicator for the accessory device based on the contextual data; and
associating the device identifier of the accessory device with the naming indicator.

4. The system of claim 1 , wherein the audio data comprises first audio data, the audio comprises first audio, the user utterance comprises a first user utterance, and the operations further comprising:
in response to determining that the first audio data corresponds to the request to associate the accessory device with the hub device, generating third directive data representing a third directive to output, via the voice-enabled device, second audio requesting identification information associated with the accessory device;
receiving, from the voice-enabled device, second audio data representing a second user utterance;
determining that the second audio data represents, at least in part, the identification information;
identifying, from the identification information, a device type of the accessory device; and
causing output, via the voice-enabled device and based on the device type, of third audio representing a request to put the accessory device into the join mode.

5. A method, comprising:
receiving, from a first device, input data indicating a request to associate a second device with a hub device;
determining that hub-associated functionality is enabled for use with the first device;
generating, based at least in part on determining that the hub-associated functionality is enabled, directive data representing a directive to associate the second device with the hub device;
sending, to a remote system associated with the hub device, the directive data to cause the remote system to instruct the hub device to transition to a mode to enable associating the second device with the hub device; and
receiving, from the remote system, confirmation data indicating that the second device has been associated with the hub device.

6. The method of claim 5 , wherein the hub device is a first hub device, the directive data comprises first directive data, the directive comprises a first directive, the input data comprises first input data, the request comprises a first request, and further comprising:
identifying a second hub device associated with the first device;
sending, to the first device, second directive data representing a second directive to output audio representing a second request to select between the first hub device and the second hub device for associating with the second device;
receiving, from the first device, second input data representing a response to the second request;
determining that the response indicates that the second device is to be associated with the first hub device; and
wherein generating the first directive data is based at least in part on determining that the response indicates that the second device is to be associated with the first hub device.

7. The method of claim 5 , wherein the directive data comprises first directive data, the directive comprising a first directive, and further comprising:
receiving, from the remote system, a naming indicator of the second device;
generating second directive data representing a second directive to output audio:
indicating the naming indicator; and
requesting performance of a pairing-check operation with the second device; and

sending the second directive data to the first device.

8. The method of claim 5 , further comprising:
receiving, from the remote system, device-identification data indicating a device identifier of the second device;
receiving contextual data associated with the second device, the contextual data comprising at least one of:
device-location data indicating a location of the second device within an environment;
device-association data indicating an identifier of a third device within the environment; or
device-type data indicating a device type of the accessory device;

determining a naming indicator for the second device based at least in part on the contextual data; and
associating the device identifier of the second device with the naming indicator.

9. The method of claim 5 , wherein the input data comprises first input data, the request comprises a first request, and further comprising:
determining that the first input data indicates identification information associated with the second device;
determining, based at least in part on the identification information, that an action is required to put the second device into a join mode;
causing output, via the first device, of audio representing a second request to perform the action;
receiving second input data indicating that the action has been performed; and
wherein sending the directive data is based at least in part on receiving the second input data.

10

Assignees

• Amazon Tech Inc

Inventors

• Iyer Hersh Sridhar
• Lew Yuk Vong Willy
• Krishnamoorthy Venkatesh
• Lehman Gregg Taylor
• Kamasamodram Ramesh

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• H04W84/18

  Self-organising networks, e.g. ad-hoc networks or sensor networks · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• H04W8/005

  Discovery of network devices, e.g. terminals · CPC title

• H04W76/14

  Direct-mode setup · CPC title