Signal processing coordination among digital voice assistant computing devices

Patent metadata

Field	Value
Publication number	US-11823704-B2
Application number	US-202117205895-A
Country	US
Kind code	B2
Filing date	Mar 18, 2021
Priority date	Dec 8, 2017
Publication date	Nov 21, 2023
Grant date	Nov 21, 2023

Abstract

Coordinating signal processing among computing devices in a voice-driven computing environment is provided. A first and second digital assistant can detect an input audio signal, perform a signal quality check, and provide indications that the first and second digital assistants are operational to process the input audio signal. A system can select the first digital assistant for further processing. The system can receive, from the first digital assistant, data packets including a command. The system can generate, for a network connected device selected from a plurality of network connected devices, an action data structure based on the data packets, and transmit the action data structure to the selected network connected device.

First claim

What is claimed is:

1. A system to coordinate signal processing among computing devices in a voice-driven computing environment, comprising:
a data processing system comprising one or more processors and memory to;
receive data packets corresponding to an input audio signal detected by a sensor of a digital assistant computing device, the data processing system to control a plurality of network connected devices via the digital assistant computing device;
receive second data packets corresponding to a second input audio signal;
identify a characteristic of the input audio signal based on an amplitude of the input audio signal;
identify a second amplitude of the second input audio signal greater than the amplitude of the input audio signal;
select, based on a distance between the plurality of network connected devices and the digital assistant computing device less than or equal to a distance threshold between the digital assistant computing device and the plurality of network connected devices, a network connected device from the plurality of network connected devices to control;
select, based on the second amplitude of the second input audio signal, at least two network connected devices from the plurality of network connected devices for execution of a second action data structure;
generate, for the network connected device selected based on the distance and the distance threshold, an action data structure based on the data packets received from the digital assistant computing device; and
transmit the action data structure to the network connected device to control the network connected device.

2. The system of claim 1 , comprising:
the data processing system to receive the data packets responsive to the digital assistant computing device determining the input audio signal satisfies a signal processing threshold.

3. The system of claim 1 , comprising:
the data processing system to determine the distance threshold based on the characteristic of the input audio signal.

4. The system of claim 1 , comprising:
the data processing system to determine the distance threshold based on the amplitude of the input audio signal.

5. The system of claim 1 , comprising:
the data processing system to select the network connected device separated by the digital assistant computing device by the distance less than or equal to the distance threshold.

6. The system of claim 1 , comprising:
the data processing system to determine, based on the amplitude of the input audio signal, to select one network connected device from the plurality of network connected devices to execute a command based on the data packets.

7. The system of claim 1 , comprising the data processing system to:
receive second data packets corresponding to a second input audio signal;
identify a second amplitude of the second input audio signal;
determine, based on the second amplitude of the second input audio signal greater than the amplitude of the input audio signal, a second threshold greater than the distance threshold; and
select, based on the second threshold greater than the distance threshold, a second network connected device from the plurality of network connected devices to execute a second action data structure, the second network connected device separated from the digital assistant computing device by a second distance less than or equal to the second threshold, the second distance greater than the distance threshold.

8. The system of claim 1 , wherein the second amplitude of the second input audio signal is indicative of a yell.

9. The system of claim 1 , comprising the data processing system to:
receive second data packets corresponding to a second input audio signal;
identify a second amplitude of the second input audio signal greater than the amplitude of the input audio signal; and
select, based on the second amplitude of the second input audio signal, each of the plurality of network connected devices located within a house for execution of a second action data structure.

10. A method of coordinating signal processing among computing devices in a voice-driven computing environment, comprising:
receiving, by a data processing system comprising one or more processors and memory, data packets corresponding to an input audio signal detected by a sensor of a digital assistant computing device, the data processing system to control a plurality of network connected devices via the digital assistant computing device;
receiving, by the data processing system, second data packets corresponding to a second input audio signal;
identifying, by the data processing system, a characteristic of the input audio signal based on an amplitude of the input audio signal;
identifying, by the data processing system, a second amplitude of the second input audio signal greater than the amplitude of the input audio signal;
selecting, by the data processing system, based on a distance between the plurality of network connected devices and the digital assistant computing device less than or equal to a distance threshold between the digital assistant computing device and the plurality of network connected devices, a network connected device from the plurality of network connected devices to control;
selecting, by the data processing system, based on the second amplitude of the second input audio signal, at least two network connected devices from the plurality of network connected devices for execution of a second action data structure;
generating, by the data processing system, for the network connected device selected based on the distance and the distance threshold, an action data structure based on the data packets received from the digital assistant computing device; and
transmitting, by the data processing system, the action data structure to the network connected device to control the network connected device.

11. The method of claim 10 , comprising:
receiving, by the data processing system, the data packets responsive to the digital assistant computing device determining the input audio signal satisfies a signal processing threshold.

12. The method of claim 10 , comprising:
determining, by the data processing system, the distance threshold based on the characteristic of the input audio signal.

13. The method of claim 10 , comprising:
determining, by the data processing system, the distance threshold based on the amplitude of the input audio signal.

14. The method of claim 10 , comprising:
selecting, by the data processing system, the network connected device separated by the digital assistant computing device by the distance less than or equal to the distance threshold.

15. The method of claim 10 , comprising:
determining, by the data processing system, based on the amplitude of the input audio signal, to select one network connected device from the plurality of network connected devices to execute a command based on the data packets.

16. The method of claim 10 , comprising:
receiving, by the data processing system, second data packets corresponding to a second input audio signal;
identifying, by the data processing system, a second amplitude of the second input audio signal;
determining, by the data processing system, based on the second amplitude of the second input audio signal greater than the amplitude of the input audio signal, a second threshold greater than the distance threshold; and
selecting, by the data processing system, based on the second threshold greater than the distance threshold, a second network connected device from the plurality of network connected devices to execute a

Assignees

• Google Llc

Inventors

• Kothari Anshul
• Bhaya Gaurav
• Jain Tarun

Classifications

• G10L25/60 Primary

  for measuring the quality of voice signals · CPC title

• G06N20/00

  Machine learning · CPC title

• G10L25/03

  characterised by the type of extracted parameters · CPC title

• H04L12/282 Primary

  based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204) · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title