Generating IoT-based notification(s) and provisioning of command(s) to cause automatic rendering of the IoT-based notification(s) by automated assistant client(s) of client device(s)

Patent metadata

Field	Value
Publication number	US-11538477-B2
Application number	US-202017110732-A
Country	US
Kind code	B2
Filing date	Dec 3, 2020
Priority date	Mar 14, 2018
Publication date	Dec 27, 2022
Grant date	Dec 27, 2022

Abstract

Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification. The remote automated assistant component(s) can then transmit a corresponding command to each of the assistant client device(s) it determines should render a corresponding client device notification, where each transmitted command causes the corresponding assistant client device to render the corresponding client device notification.

First claim

What is claimed is:

1. A method comprising:
receiving, via one or more network interfaces of an automated assistant computing system, an IoT state change notification, the IoT state change notification transmitted to the automated assistant computing system in response to determining a change in a state associated with at least one IoT device and comprising:
a unique identifier,
an indication of the at least one IoT device, and
a state indication that indicates the change in the state associated with the at least one IoT device;

identifying, by the automated assistant computing system based on the unique identifier, a plurality of assistant client devices that are each associated with the unique identifier and that each have a corresponding automated assistant client;
selecting a subset of the assistant client devices, wherein selecting the subset is based at least in part on one or both of: the indication of the at least one IoT device, and the state indication that indicates the change in the state associated with the at least one IoT device;
transmitting, to only each of the assistant client devices of the selected subset, a corresponding command that causes the automated assistant client of the assistant client device to:
automatically render a corresponding notification that is tailored to the IoT state change notification.

2. The method of claim 1 , wherein the at least one IoT device is a smart doorbell.

3. The method of claim 1 , further comprising:
receiving, via one or more of the network interfaces of the automated assistant computing system, an additional IoT state change notification, the additional IoT state change notification transmitted to the automated assistant computing system in response to determining an additional change in an additional state associated with an additional IoT device that is disparate from the at least one IoT device, the additional IoT state change notification comprising:
an additional unique identifier,
an additional indication of the additional IoT device, and
an additional state indication that indicates the additional change in the additional state associated with the additional IoT device;

selecting, from the plurality of assistant client devices, an additional subset of the assistant client devices, the additional subset being different from the subset, wherein selecting the additional subset is based at least in part on one or both of: the additional indication of the additional IoT device, and the additional state indication that indicates the additional change in the additional state associated with the additional IoT device;
transmitting, to only each of the assistant client devices of the additional selected subset, a corresponding additional command that causes the automated assistant client of the assistant client device to:
automatically render a corresponding additional notification that is tailored to the additional IoT state change notification.

4. The method of claim 3 , wherein the at least one IoT device is a first smart doorbell and the additional IoT device is a second smart doorbell.

5. The method of claim 3 , wherein the at least one IoT device is a first smart appliance and the additional IoT device is a second smart appliance.

6. The method of claim 1 , wherein selecting the subset is based at least in part on both of: the indication of the at least one IoT device, and the state indication that indicates the change in the state associated with the at least one IoT device.

7. The method of claim 1 , wherein selecting the subset is further based at least in part on current properties of the plurality of assistant client devices.

8. The method of claim 1 , wherein selecting the subset is further based at least in part on a time of day or a day of the week.

9. The method of claim 1 , wherein the assistant client devices of the selected subset comprises a first assistant client device and a second assistant client device, and wherein the corresponding notification that is automatically rendered by the automated assistant client of the first assistant client device is less obtrusive than the corresponding notification that is automatically rendered by the automated assistant client of the second assistant client device.

10. The method of claim 9 , further comprising:
determining, based on a current state of the first assistant client device, to automatically render, at the first assistant client device, the corresponding notification that is less obtrusive than the corresponding notification that is automatically rendered by the automated assistant client of the second assistant client device.

11. The method of claim 1 , wherein the assistant client devices of the selected subset comprises a first assistant client device and a second assistant client device, and wherein the corresponding notification that is automatically rendered by the automated assistant client of the first assistant client device is an audible only notification and wherein the corresponding notification that is automatically rendered by the automated assistant client of the second assistant client device is audible and visual.

12. The method of claim 1 , wherein the at least one IoT device is a smart appliance and the change in the state indicates an error condition of the smart appliance.

13. A method comprising:
receiving, via one or more network interfaces of an automated assistant computing system at a first time:
a first IoT state change notification from a first third-party system, the first IoT state change notification transmitted to the automated assistant computing system indicating a change to a first state associated with a first group of one or more IoT devices and comprising: a unique identifier, an indication of the first group of one or more IoT devices, and a first state indication that indicates the first state associated with the first group of one or more IoT devices;

identifying, by the automated assistant computing system based on the unique identifier, a plurality of candidate assistant client devices that are each associated with the unique identifier and that each have a corresponding automated assistant client;
selecting a first subset of the candidate assistant client devices, wherein selecting the first subset is based at least in part on one or both of: the indication of the first group of one or more IoT devices, and the first state indication that indicates the first state associated with the first group of one or more IoT devices;
transmitting, to only each of the candidate assistant client devices of the first subset, a corresponding command that causes the automated assistant client of the candidate assistant client device to:
automatically render a corresponding notification that is tailored to the first IoT state change notification;

receiving, via one or more network interfaces of the automated assistant computing system at a second time:
a second IoT state change notification from a second third-party system, the second IoT state change notification transmitted to the automated assistant computing system indicating a change to a second state associated with a second group of one or more IoT devices and comprising: the unique identifier or an additional unique identifier, an indication of the second group of one or more IoT devices, and a second state indication that indicates the second state associated with the second group of one or more IoT devices;

identifying, by the automated assistant computing system based on the unique identifier or the additional unique identifier, the plurality of candidate assistant client devices;
selecting a second subset of the

Assignees

• Google Llc

Inventors

• Schairer David Roy
• Mohammed Sumer
• Spates Iv Mark
• Kumar Prem
• Ng Chi Yeung Jonathan
• Zhu Di
• Clark Steven

Classifications

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• H04W4/70

  Services for machine-to-machine communication [M2M] or machine type communication [MTC] · CPC title

• G10L15/08

  Speech classification or search · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title