Selective sensor polling

Patent metadata

Field	Value
Publication number	US-11627065-B2
Application number	US-202117152246-A
Country	US
Kind code	B2
Filing date	Jan 19, 2021
Priority date	Dec 30, 2016
Publication date	Apr 11, 2023
Grant date	Apr 11, 2023

Abstract

A selective sensor polling system for a voice activated data packet based computer network environment is provided. A system can receive audio signals detected by a microphone of a device. The system can parse the audio signal to identify trigger keyword and request. The system can select a template for an action data structure with a plurality of fields. The system can determine to poll a first sensor for data for the first field. The system can determine to obtain data in memory previously collected by the second sensor. The system can generate and transmit the action data structure with the data from the sensor and memory, and transmit the action data structure to a third party device.

First claim

The invention claimed is:

1. A system, comprising:
a data processing system comprising memory and one or more processors to:
receive, via an interface of the data processing system, data packets comprising an input audio signal detected by a microphone of a client device associated with an end user account;
parse the input audio signal to identify a request and a keyword corresponding to the request;
select, based on the keyword, a template for an action data structure responsive to the request, the action data structure to package one or more parameters used by a third party provider device to perform an operation to provide a type of service or a type of product, the template comprising a first field;
identify a plurality of available sensors configured to obtain information for the first field of the action data structure and that are coupled to one or more client devices different from the client device, the one or more client devices being associated with the end user account;
determine that a first sensor of the plurality of available sensors of a second client device of the one or more client devices is already obtaining data corresponding to the first field of the action data structure, and that a second sensor of the plurality of available sensors is lacking the data corresponding to the first field of the action data structure;
based on the determination, select the first sensor of the plurality of available sensors of a second client device of the one or more client devices rather than the second sensor to provide the data to perform the operation;
generate the action data structure with the data received from the first sensor to provide the type of service or the type of product based on the first field of the template; and
transmit the action data structure to the third party provider device to cause the third party provider device to perform one or more actions that provide the type of service or the type of product based on the one or more parameters packaged in the action data structure.

2. The system of claim 1 , comprising:
the data processing system to determine not to use a sensor of the client device, wherein the first sensor selected for the data is not coupled to the client device.

3. The system of claim 1 , comprising the data processing system to:
determine a status of each of the plurality of available sensors; and
select the first sensor of the second client device based on the status of the first sensor.

4. The system of claim 1 , comprising the data processing system to:
poll the first sensor for data corresponding to the first field of the action data structure.

5. The system of claim 1 , comprising the data processing system to:
transmit the action data structure to the third party provider device to invoke an operation session between the third party provider device and the client device.

6. The system of claim 1 , comprising the data processing system to:
receive, from the third party provider device, an indication of performance of the one or more actions.

7. The system of claim 1 , comprising the data processing system to:
identify a second plurality of available sensors configured to obtain location information, the second plurality of available sensors comprising the first sensor and a second sensor;
determine a battery status of each of the plurality of available sensors; and
select, based on the battery status of each of the plurality of available sensors, the first sensor of the plurality of available sensors.

8. The system of claim 1 , comprising the data processing system to:
receive the data from the first comprising location information;
select a second sensor of the plurality of available sensors; and
receive additional location information from the second sensor.

9. The system of claim 1 , comprising the data processing system to:
identify a second plurality of available sensors configured to obtain location information, the second plurality of available sensors comprising the first sensor and a second sensor;
determine that the first sensor detected current location information of the client device prior to a request for location information from the data processing system; and
obtain the current location information from the first sensor.

10. The system of claim 1 , comprising the data processing system to:
identify a second plurality of available sensors configured to obtain location information, the second plurality of available sensors comprising the first sensor and a second sensor;
determine that the second sensor is in an offline state and lacks current location information; and
obtain the current location information from the first sensor, wherein the second sensor is in the offline state.

11. The system of claim 1 , comprising the data processing system to:
performing a handshaking process with the second client device using credentials of the end user account.

12. The system of claim 1 , comprising the data processing system to:
determine to use the second client device based on a resource reduction policy.

13. The system of claim 12 , comprising the data processing system to:
determine to use the second client device, instead of the client device, because the second client device has more battery remaining or greater resource availability.

14. The system of claim 12 , comprising the data processing system to:
determine to use the second client device, instead of the client device, because the second client device is configured to provide higher quality or more accurate data that results in fewer subsequent requests for sensor information.

15. A method, comprising:
receiving, by a data processing system comprising one or more processors and memory, via an interface of the data processing system, data packets comprising an input audio signal detected by a microphone of a client device associated with an end user account;
parsing, by the data processing system, the input audio signal to identify a request and a keyword corresponding to the request;
selecting, by the data processing system based on the keyword, a template for an action data structure responsive to the request, the action data structure to package one or more parameters used by a third party provider device to perform an operation to provide a type of service or a type of product, the template comprising a first field;
identifying, by the data processing system, a plurality of available sensors configured to obtain information for the first field of the action data structure and that are coupled to one or more client devices different from the client device, the one or more client devices being associated with the end user account;
determining that a first sensor of the plurality of available sensors of a second client device of the one or more client devices is already obtaining data corresponding to the first field of the action data structure, and that a second sensor of the plurality of available sensors is lacking the data corresponding to the first field of the action data structure;
based on the determination, selecting, by the data processing system, the first sensor of the plurality of available sensors of a second client device of the one or more client devices rather than the second sensor to provide the data to perform the operation to provide the type of service or the type of product;
generating, by the data processing system, the action data structure with the data received from the first sensor to provide the type of service or the type of product based on the first field of the template; and
transmitting, by the data proce

Assignees

• Google Llc

Inventors

• Bhaya Gaurav
• Stets Robert

Classifications

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• H04W52/02

  Power saving arrangements · CPC title

• G06F16/3344

  using natural language analysis · CPC title

• H04W4/02

  Services making use of location information · CPC title

• G10L15/18

  using natural language modelling · CPC title