Systems and methods for routing content to an associated output device

Patent metadata

Field	Value
Publication number	US-11356730-B2
Application number	US-202117358515-A
Country	US
Kind code	B2
Filing date	Jun 25, 2021
Priority date	Jun 27, 2016
Publication date	Jun 7, 2022
Grant date	Jun 7, 2022

Abstract

Devices and methods for routing content are provided herein. In some embodiments, a method for routing content include receiving audio data representing a command from a first electronic device, determining content that is associated with the command, sending responsive audio data to the first electronic device, and sending instructions to the second electronic device to output the content associated with the command. In some embodiments, a method for routing contents includes determining a state of the second electronic device and sending instructions to output the content to a selected one of the first and second electronic devices based on the state of the second electronic device.

First claim

What is claimed is:

1. A computer-implemented method performed by a networked computing device connected to a first electronic device over a network, the computer-implemented method comprising:
receiving, from the first electronic device, first data representing a natural language input;
determining, based at least in part on the first data, a second electronic device associated with the first electronic device;
determining second data representing a first response to the natural language input;
determining third data representing a second response to the natural language input;
sending, to the first electronic device, the second data, such that the first response is output by a speaker of the first electronic device; and
sending, to the second electronic device, the third data, such that the second response is output by the second electronic device.

2. The computer-implemented method of claim 1 , further comprising:
performing text-to-speech processing to determine output audio data representing the second response,
wherein the first data comprises the output audio data.

3. The computer-implemented method of claim 1 , wherein the first response indicates that the second electronic device is to output data responsive to the natural language input.

4. The computer-implemented method of claim 1 , further comprising:
determining the third data comprises image data; and
determining the second electronic device comprises a display component;
wherein sending the third data to the second electronic device is based at least in part on the third data comprising image data and the second electronic device comprising a visual display component.

5. The computer-implemented method of claim 1 , further comprising:
determining the third data comprises image data; and
determining the first electronic device does not comprise a display component;
wherein sending the third data to the second electronic device is based at least in part on the third data comprising image data and the first electronic device not comprising a visual display component.

6. The computer-implemented method of claim 1 , wherein determining the second electronic device is associated with the first electronic device comprises:
processing stored data to determine an association between the first electronic device and the second electronic device.

7. The computer-implemented method of claim 1 , further comprising:
processing the first data to determine a portion of the first data representing a response destination; and
determining the portion corresponds to the second electronic device.

8. The computer-implemented method of claim 1 , further comprising:
determining the third data based at least in part on the second electronic device.

9. The computer-implemented method of claim 1 , further comprising:
determining state data corresponding to the second electronic device,
wherein sending the third data to the second electronic device is based at least in part on the state data.

10. The computer-implemented method of claim 1 , wherein the method is performed by a backend computing system connected to the first electronic device over a network.

11. A network accessible computing system comprising:
at least one communication component configured to communicate with a first electronic device over a computing network;
at least one processor; and
at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:
receive, from the first electronic device, first data representing a natural language input;
determine, based at least in part on the first data, a second electronic device associated with the first electronic device;
determine second data representing a first response to the natural language input;
determine third data representing a second response to the natural language input;
send, to the first electronic device, the second data, such that the first response is output by a speaker of the first electronic device; and
send, to the second electronic device, the third data, such that the second response is output by the second electronic device.

12. The network accessible computing system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
perform text-to-speech processing to determine output audio data representing the second response,
wherein the first data comprises the output audio data.

13. The network accessible computing system of claim 11 , wherein the first response indicates that the second electronic device is to output data responsive to the natural language input.

14. The network accessible computing system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine the third data comprises image data; and
determine the second electronic device comprises a display component,
wherein the instructions that cause the system to send the third data to the second electronic device are based at least in part on the third data comprising image data and the second electronic device comprising a visual display component.

15. The network accessible computing system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine the third data comprises image data; and
determine the first electronic device does not comprise a display component;
wherein the instructions that cause the system to send the third data to the second electronic device are based at least in part on the third data comprising image data and the first electronic device not comprising a visual display component.

16. The network accessible computing system of claim 11 , wherein the instructions that cause the system to determine the second electronic device is associated with the first electronic device comprise instructions that, when executed by the at least one processor, further cause the system to:
process stored data to determine an association between the first electronic device and the second electronic device.

17. The network accessible computing system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
process the first data to determine a portion of the first data representing a response destination; and
determine the portion corresponds to the second electronic device.

18. The network accessible computing system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine the third data based at least in part on the second electronic device.

19. The network accessible computing system of claim 11 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine state data corresponding to the second electronic device,
wherein sending the third data to the second electronic device is based at least in part on the state data.

20. The network accessible computing system of claim 11 , wherein the system comprises a backend computing system connected to the first electronic device over a network.

Assignees

• Amazon Tech Inc

Inventors

• Jobanputra Soniya
• Typrin Marcello
• Trudell Mallory

Classifications

• H04N21/4516

  involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available · CPC title

• H04N21/439 Primary

  Processing of audio elementary streams · CPC title

• G06F16/3329

  Natural language query formulation · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• H04N21/835

  Generation of protective data, e.g. certificates {(protecting software against unauthorised usage in a vending or licensing environment G06F21/10)} · CPC title