Generating IoT-based notification(s) and provisioning of command(s) to cause automatic rendering of the IoT-based notification(s) by automated assistant client(s) of client device(s)

Patent metadata

Field	Value
Publication number	US-12100398-B2
Application number	US-202218085867-A
Country	US
Kind code	B2
Filing date	Dec 21, 2022
Priority date	Mar 14, 2018
Publication date	Sep 24, 2024
Grant date	Sep 24, 2024

Abstract

Remote automated assistant component(s) generate client device notification(s) based on a received IoT state change notification that indicates a change in at least one state associated with at least one IoT device. The generated client device notification(s) can each indicate the change in state associated with the at least one IoT device, and can optionally indicate the at least one IoT device. Further, the remote automated assistant component(s) can identify candidate assistant client devices that are associated with the at least one IoT device, and determine whether each of the one or more of the candidate assistant client device(s) should render a corresponding client device notification. The remote automated assistant component(s) can then transmit a corresponding command to each of the assistant client device(s) it determines should render a corresponding client device notification, where each transmitted command causes the corresponding assistant client device to render the corresponding client device notification.

First claim

What is claimed is:

1. A method comprising:
receiving, via one or more network interfaces of an automated assistant computing system:
a first IoT state notification from a first third-party system, the first IoT state notification: transmitted to the automated assistant computing system, indicating a first state associated with a first group of one or more IoT devices, and comprising: a unique identifier and a first state indication that indicates the first state associated with the first group of one or more IoT devices;
a second IoT state notification from a second third-party system, the second IoT state notification transmitted to the automated assistant computing system and indicating a second state associated with a second group of one or more IoT devices and comprising: the unique identifier or an additional unique identifier, and a second state indication that indicates the second state associated with the second group of one or more IoT devices;

determining to transmit a combined notification that is based on both the first IoT state notification and the second IoT state notification, wherein determining to transmit the combined notification is based on determining, based on the first IoT state notification and the second IoT state notification, that the first state and the second state are co-occurring;
identifying, by the automated assistant computing system based at least in part on the unique identifier, a plurality of candidate assistant client devices that each have a corresponding automated assistant client and that are each associated with both the first group of one or more IoT devices and the second group of one or more IoT devices;
selecting at least one of the candidate assistant client devices; and
transmitting, to the at least one of the candidate assistant client devices, a command that includes the combined notification and that causes the automated assistant client of the at least one of the candidate assistant client devices to:
automatically render the combined notification via at least one user interface output device of the at least one of the candidate assistant client devices.

2. The method of claim 1 , wherein the combined notification comprises a prompt and wherein the command further causes the automated assistant client to monitor for a response to the prompt.

3. The method of claim 2 , wherein the prompt recommends a change to the first state associated with the first group of one or more IoT devices, and further comprising:
in response to receiving an affirmative response to prompt:
transmitting an IoT command that causes the change to the first state associated with the first group of one or more IoT devices.

4. The method of claim 3 , wherein the combined notification comprises a graphical interface and the prompt is a selectable element of the graphical interface.

5. The method of claim 4 , wherein the affirmative response to the prompt is a selection of the selectable element of the graphical interface.

6. The method of claim 1 , wherein the first IoT state notification is received at a first time and wherein the second IoT state notification is received at a second time that is after the first time, and further comprising:
determining, after the first time and prior to the second time, to not transmit any commands that cause automatic rendering of any notifications that are based on the first IoT state notification.

7. The method of claim 1 , wherein the first group of one or more IoT devices comprises a smart door lock and wherein the first state is an unlocked state of the smart door lock.

8. A method comprising:
receiving, via one or more network interfaces of an automated assistant computing system at a first time:
a first IoT state change notification from a first third-party system, the first IoT state change notification transmitted to the automated assistant computing system indicating a change to a first state associated with a first group of one or more IoT devices and comprising: a unique identifier, an indication of the first group of one or more IoT devices, and a first state indication that indicates the first state associated with the first group of one or more IoT devices;

identifying, by the automated assistant computing system based on the unique identifier, an assistant client device that is associated with the unique identifier and that includes an automated assistant client;
determining to transmit a first command that causes the automated assistant client of the assistant client device to automatically and immediately audibly render first output that is tailored to the first IoT state change notification,
wherein determining to transmit the first command that causes the automated assistant client of the assistant client device to automatically and immediately audibly render the first output that is tailored to the first IoT state change notification is based at least in part on one or both of: the indication of the first group of one or more IoT devices, and the first state indication that indicates the first state associated with the first group of one or more IoT devices;

receiving, via one or more network interfaces of an automated assistant computing system at a second time:
a second IoT state change notification from a second third-party system, the second IoT state change notification transmitted to the automated assistant computing system indicating a change to a second state associated with a second group of one or more IoT devices and comprising: the unique identifier or an additional unique identifier, an indication of the second group of one or more IoT devices, and a second state indication that indicates the second state associated with the second group of one or more IoT devices;

identifying, by the automated assistant computing system based on the unique identifier or the additional unique identifier, the assistant client device that includes the automated assistant client;
determining to transmit a second command that causes the automated assistant client of the assistant client device to render second output that is tailored to the second IoT state change notification, but to render the second output non-audibly and/or non-immediately,
wherein determining to transmit the second command that causes the automated assistant client of the assistant client device to render the second output non-audibly and/or non-immediately is based at least in part on one or both of: the indication of the second group of one or more IoT devices, and the second state indication that indicates the second state associated with the second group of one or more IoT devices.

9. The method of claim 8 , wherein determining to transmit the first command that causes the automated assistant client of the assistant client device to automatically and immediately audibly render the first output is based at least in part on: the indication of the first group of one or more IoT devices.

10. The method of claim 9 , wherein determining to transmit the second command that causes the automated assistant client of the assistant client device to render the second output non-audibly and/or non-immediately is based at least in part on: the indication of the second group of one or more IoT devices.

11. The method of claim 8 , wherein determining to transmit the first command that causes the automated assistant client of the assistant client device to automatically and immediately audibly render the first output is based at least in part on: the first state indication that indicates the first state associated with the first group of one or more IoT devices.

12. The method of claim 11 , wherein determining to transmit the f

Assignees

• Google Llc

Inventors

• Schairer David Roy
• Mohammed Sumer
• Spates Iv Mark
• Kumar Prem
• Ng Chi Yeung Jonathan
• Zhu Di
• Clark Steven

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• H04L12/282

  based on user interaction within the home (receiver circuitry for displaying additional information being controlled by a remote control apparatus H04N21/42204) · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L2015/088

  Word spotting · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title