Detection of duplicate packetized data for selective transmission into one of a plurality of a user's devices

Patent metadata

Field	Value
Publication number	US-11798555-B2
Application number	US-202117393258-A
Country	US
Kind code	B2
Filing date	Aug 3, 2021
Priority date	Dec 8, 2017
Publication date	Oct 24, 2023
Grant date	Oct 24, 2023

Abstract

A system of reducing transmissions of packetized data in a voice activated data packet based computer network environment is provided. A natural language processor component can parse an input audio signal to identify a request and a trigger keyword. Based on the input audio signal, a direct action application programming interface can generate a first action data structure, and a content selector component can select a content item. An interface management component can identify candidate interfaces and determine if prior instances of the packetized data was transmitted to the candidate interfaces. The interface management component can prevent the transmission of the packetized data if determined to be redundant, such as having previously received the data, and instead transmit it to a separate client device of a different device type.

First claim

What is claimed is:

1. A system to transmit packetized data in voice-activated packet-based computer networked environments, comprising:
a data processing system having one or more processors coupled with memory to:
identify, from a data packet including an input audio signal acquired via a first interface of a client device, a request;
select a digital component based on the request identified from the data packet;
identify a plurality of candidate interfaces associated with the client device;
determine a plurality of utilization values corresponding to the plurality of candidate interfaces;
select, from the plurality of candidate interfaces, a second interface based on the plurality of utilization values, the second interface on a second client device different from the client device; and
transmit the digital component to the second interface associated with the client device to output the digital component.

2. The system of claim 1 , comprising the data processing system to:
generate an action data structure based on the request identified from the request, the action data structure comprising a response to the input audio signal and separate from the digital component; and
select, from the plurality of candidate interfaces, a third interface to which to transmit the action data structure based on the plurality of utilization values.

3. The system of claim 1 , comprising the data processing system to:
determine an availability of the second interface for output of the digital component based on a utilization value corresponding to the second interface; and
determine to transmit the digital component to the second interface based on the availability of the second interface.

4. The system of claim 1 , comprising the data processing system to:
determine an availability of a third interface for output based on a utilization value corresponding to the third interface; and
determine to not transmit the digital component to the third interface based on the availability of the third interface.

5. The system of claim 1 , comprising the data processing system to:
rank the plurality of candidate interfaces based on the corresponding plurality of utilization values; and
select, from the plurality of candidate interfaces, the second interface based on the ranking of the plurality of utilization values.

6. The system of claim 1 , comprising the data processing system to:
determine a distance between the second interface and the first interface of the client device at which the input audio signal is acquired; and
determine an availability of the second interface to present based on a comparison between the distance and a threshold.

7. The system of claim 1 , comprising the data processing system to set, subsequent to transmission of the digital component, a time out period for the second interface before which a second digital component is permitted to be transmitted to the second interface associated with the client device.

8. The system of claim 1 , comprising the data processing system to transmit the digital component to the second interface associated with the client device to output an audio output.

9. The system of claim 1 , comprising the data processing system to determine the plurality of utilization values corresponding to the plurality of candidate interfaces, each utilization value of the plurality of utilization values indicating at least one of a processing power, a power requirement, a battery status, a memory utilization, or network bandwidth use on a corresponding candidate interface of the plurality of candidate interfaces.

10. A method of transmitting packetized data in voice-activated packet-based computer networked environments, comprising:
identifying, by a data processing system, from a data packet including an input audio signal acquired via a first interface of a client device, a request;
selecting, by the data processing system, a digital component based on the request identified from the data packet;
identifying, by the data processing system, a plurality of candidate interfaces associated with the client device;
determining, by the data processing system, a plurality of utilization values corresponding to the plurality of candidate interfaces;
selecting, by the data processing system, from the plurality of candidate interfaces, a second interface based on the plurality of utilization values, the second interface on a second client device different from the client device; and
transmitting, by the data processing system, the digital component to the second interface associated with the client device to output the digital component.

11. The method of claim 10 , comprising:
generating, by the data processing system, an action data structure based on the request identified from the request, the action data structure comprising a response to the input audio signal and separate from the digital component; and
selecting, by the data processing system, from the plurality of candidate interfaces, a third interface to which to transmit the action data structure based on the plurality of utilization values.

12. The method of claim 10 , comprising:
determining, by the data processing system, an availability of the second interface for output based on a utilization value corresponding to the second interface; and
determining, by the data processing system, to transmit the digital component to the second interface based on the availability of the second interface.

13. The method of claim 10 , comprising:
determining, by the data processing system, an availability of a third interface for output based on a utilization value corresponding to the third interface; and
determining, by the data processing system, to not transmit the digital component to the third interface based on the availability of the third interface.

14. The method of claim 10 , comprising:
ranking, by the data processing system, the plurality of candidate interfaces based on the corresponding plurality of utilization values; and
selecting, by the data processing system, from the plurality of candidate interfaces, the second interface based on the ranking of the plurality of utilization values.

15. The method of claim 10 , comprising the data processing system to:
determining, by the data processing system, a distance between the second interface and the first interface of the client device at which the input audio signal is acquired; and
determining, by the data processing system, an availability of the second interface to present based on a comparison between the distance and a threshold.

16. The method of claim 10 , comprising setting, by the data processing system, subsequent to transmission of the digital component, a time out period for the second interface before which a second digital component is permitted to be transmitted to the second interface associated with the client device.

17. The method of claim 10 , comprising transmitting, by the data processing system, the digital component to the second interface associated with the client device to output as at least one of an audio output, an image output, or a text output.

18. The method of claim 10 , comprising determining, by the data processing system, the plurality of utilization values corresponding to the plurality of candidate interfaces, each utilization value of the plurality of utilization values indicating at least one of a processing power, a power requirement, a battery status, a memory utilization, or network bandwidth use on a corresponding candidate interface of the

Assignees

• Google Llc

Inventors

• Bhaya Gaurav
• Jain Tarun
• Kothari Anshul

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L15/1822 Primary

  Parsing for meaning understanding · CPC title

• H04L47/12

  Avoiding congestion; Recovering from congestion · CPC title

• G10L2015/088

  Word spotting · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title