Signal Processing Coordination Among Digital Voice Assistant Computing Devices

Patent metadata

Field	Value
Publication number	US-2024119958-A1
Application number	US-202318488623-A
Country	US
Kind code	A1
Filing date	Oct 17, 2023
Priority date	Dec 8, 2017
Publication date	Apr 11, 2024
Grant date	—

Abstract

Coordinating signal processing among computing devices in a voice-driven computing environment is provided. A first and second digital assistant can detect an input audio signal, perform a signal quality check, and provide indications that the first and second digital assistants are operational to process the input audio signal. A system can select the first digital assistant for further processing. The system can receive, from the first digital assistant, data packets including a command. The system can generate, for a network connected device selected from a plurality of network connected devices, an action data structure based on the data packets, and transmit the action data structure to the selected network connected device.

First claim

1 .- 20 . (canceled)

21 . A system to coordinate signal processing among computing devices in a voice-driven computing environment, comprising:
a data processing system comprising one or more processors and memory to:
receive data packets corresponding to an input audio signal detected by a sensor of a digital assistant computing device, the data processing system to communicate with a plurality of network connected devices via the digital assistant computing device;
identify a characteristic of the input audio signal;
select, based on a distance between the plurality of network connected devices and the digital assistant computing device and the characteristic of the input audio signal, a first network connected device from the plurality of network connected devices to control;
generate, for the first network connected device, an action data structure based on the data packets received from the digital assistant computing device; and
transmit the action data structure to the first network connected device to control the first network connected device.

22 . The system of claim 21 , wherein the first network connected device is selecting using a machine learning technique.

23 . The system of claim 21 , wherein the characteristic of the input audio signal is identified based on an amplitude of the input audio signal.

24 . The system of claim 21 , wherein the first network connected device is selected based on first network connected device being less than than a distance threshold to the digital assistant computing device.

25 . The system of claim 21 , comprising:
the data processing system to identify the plurality of network connected devices associated with an electronic account, the plurality of digital assistant devices comprising the first network connected device and a second network connected device.

26 . The system of claim 21 , comprising:
the data processing system to receive the data packets responsive to the digital assistant computing device determining the input audio signal satisfies a signal processing threshold.

27 . The system of claim 21 , comprising:
the data processing system to determine a distance threshold based on the characteristic of the input audio signal.

28 . The system of claim 21 , comprising:
the data processing system to determine a distance threshold based on an amplitude of the input audio signal.

29 . The system of claim 28 , comprising the data processing system to:
receive second data packets corresponding to a second input audio signal; identify a second amplitude of the second input audio signal; determine, based on the second amplitude of the second input audio signal greater than a second amplitude of the input audio signal, a second threshold greater than the distance threshold; and select, based on the second threshold, a second network connected device from the plurality of network connected devices to execute a second action data structure, the second network connected device separated from the digital assistant computing device by a second distance less than the second threshold, the second distance greater than the distance threshold.

30 . The system of claim 21 , comprising:
the data processing system to determine, based on an amplitude of the input audio signal, to select two or more network connected device from the plurality of network connected devices to execute a command based on the data packets.

31 . The system of claim 21 , comprising the data processing system to:
receive second data packets corresponding to a second input audio signal; identify a second amplitude of the second input audio signal greater than a first amplitude of the input audio signal; and select, based on the second amplitude of the second input audio signal, at least two network connected devices from the plurality of network connected devices for execution of a second action data structure.

32 . The system of claim 31 , wherein the second amplitude is indicative of a yell, and the first amplitude is indicative of a whisper.

33 . The system of claim 21 , comprising the data processing system to:
receive second data packets corresponding to a second input audio signal; identify a second amplitude of the second input audio signal greater than an amplitude of the input audio signal; and select, based on the second amplitude of the second input audio signal, each of the plurality of network connected devices located within a house for execution of a second action data structure.

34 . A method of coordinating signal processing among computing devices in a voice-driven computing environment, comprising:
receiving, by a data processing system, data packets corresponding to an input audio signal detected by a sensor of a digital assistant computing device, the data processing system to communicate with a plurality of network connected devices via the digital assistant computing device; identify a characteristic of the input audio signal; selecting, based on a distance between the plurality of network connected devices and the digital assistant computing device and the characteristic of the input audio signal, a first network connected device from the plurality of network connected devices to control; generating, for the first network connected device, an action data structure based on the data packets received from the digital assistant computing device; and transmitting the action data structure to the first network connected device to control the first network connected device.

35 . The method of claim 34 , wherein the first network connected device is selecting using a machine learning technique.

36 . The method of claim 34 , wherein the characteristic of input audio signal is identified based on an amplitude of the input audio signal.

37 . The method of claim 34 , comprising:
receiving, by the data processing system, the data packets responsive to the digital assistant computing device determining the input audio signal satisfies a signal processing threshold.

38 . The method of claim 34 , comprising:
determining, by the data processing system, a distance threshold based on an amplitude of the input audio signal.

39 . The method of claim 34 , comprising:
receiving, by the data processing system, second data packets corresponding to a second input audio signal; identifying, by the data processing system, a second amplitude of the second input audio signal greater than a first amplitude of the input audio signal; and selecting, by the data processing system, based on the second amplitude of the second input audio signal, at least two network connected devices from the plurality of network connected devices for execution of a second action data structure.

40 . One or more computer storage media that store program instructions that, when executed by a data processing system, cause the data processing system to perform operations, the operations comprising:
receiving data packets corresponding to an input audio signal detected by a sensor of a digital assistant computing device, the data processing system to communicate with a plurality of network connected devices via the digital assistant computing device; identify a characteristic of the input audio signal; selecting, based on a distance between the plurality of network connected devices and the digital assistant computing device and the characteristic of the input audio signal, a first network connected device from the plurality of network connecte

Assignees

• Google Llc

Inventors

• Kothari Anshul
• Bhaya Gaurav
• Jain Tarun

Classifications

• G10L25/60 Primary

  for measuring the quality of voice signals · CPC title

• G06N20/00

  Machine learning · CPC title

• G10L25/03

  characterised by the type of extracted parameters · CPC title

• H04L12/282 Primary

  based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204) · CPC title

• G10L2015/226

  using non-speech characteristics · CPC title