Using user input to adapt search results provided for presentation to the user

Patent metadata

Field	Value
Publication number	US-11875086-B2
Application number	US-202117363350-A
Country	US
Kind code	B2
Filing date	Jun 30, 2021
Priority date	Aug 30, 2016
Publication date	Jan 16, 2024
Grant date	Jan 16, 2024

Abstract

Methods, apparatus, and computer readable media related to interaction between a user and an automated assistant during a dialog between the user and the automated assistant. Some implementations are directed to adapting a graphical and/or audible presentation of search results provided by the automated assistant for presentation to the user. The adaptation may be in response to attribute(s), of one or more of the search results, referenced in spoken and/or typed textual input provided by the user during the dialog. Some of those implementations may enable a user to provide textual input to navigate the search results within the dialog and within resource and/or interface constraints associated with the dialog. Some of those implementations may additionally and/or alternatively enable adapting, based on textual input provided by a user to the automated assistant, when and/or whether search results having certain attributes are provided to the user by the automated assistant.

First claim

What is claimed is:

1. A method implemented by one or more processors, comprising:
receiving a spoken input of a user, the spoken input being detected, via at least one microphone of a client device, as part of dialog between the user and an automated assistant implemented at least in part by the client device;
obtaining a plurality of groups of lighting commands that are responsive to the spoken input, wherein each of the groups of lighting commands, when implemented, cause one or more corresponding lighting components of a lighting system of the user to be controlled in a manner that is different relative to other of the groups of lighting commands;
sequentially causing the groups of lighting commands to be implemented by the lighting system of the user to control one or more of the corresponding lighting components;
receiving an additional spoken input of the user, the spoken input being detected, via the at least one microphone of the client device, as part of the dialog between the user and the automated assistant during the sequentially implementing of the groups of lighting commands;
determining that at least one term of the additional spoken input matches an attribute of a previously implemented group of lighting commands, wherein the attribute is a reference to an implementation order of the previously implemented group of lighting commands in the sequentially implementing or is a reference to a lighting scene of the previously implemented group of lighting commands in the sequentially implementing; and
in response to determining that the at least one term of the additional spoken input matches the attribute of the previously implemented group of lighting commands:
causing one or more of the corresponding lighting components of the lighting system to be controlled based on the previously implemented group of lighting commands.

2. The method of claim 1 , wherein the reference to the lighting scene of the previously implemented group of lighting commands in the sequentially implementing includes a reference to a color of one or more of the corresponding lighting components of the lighting system.

3. The method of claim 2 , wherein causing one or more of the corresponding lighting components of the lighting system to be controlled based on the previously implemented group of lighting commands is counter to an order of the groups of lighting commands being sequentially implemented.

4. The method of claim 1 , further comprising:
receiving a further additional spoken input of the user, the further spoken input being detected, via the at least one microphone of the client device, as part of the dialog between the user and the automated assistant during the sequentially implementing of the groups of lighting commands;
determining, based on processing the further additional spoken input of the user, that the further additional spoken input references:
the attribute of a given implemented group of lighting commands, and
a sentiment expressed by the user towards the attribute; and

in response to determining that the further additional spoken input references the attribute of the given implemented group of lighting commands and the sentiment expressed by the user towards the attribute:
determining, based on the attribute and the sentiment expressed by the user towards the attribute, whether or when to provide, as part of the dialog, an additional group of lighting commands that also has the attribute.

5. The method of claim 4 , further comprising:
as part of subsequent dialog between the user and the automated assistant implemented at least in part by the client device that is subsequent to the dialog:
determining, based on the attribute and the sentiment expressed by the user towards the attribute, whether or when to provide, as part of the subsequent dialog, an additional group of lighting commands that also has the attribute.

6. The method of claim 1 , wherein sequentially causing each of the groups of lighting commands to be implemented by the lighting system of the user comprises:
receiving a further additional spoken input of the user, the further spoken input being detected, via the at least one microphone of the client device, as part of the dialog between the user and the automated assistant during the sequentially implementing of the groups of lighting commands; and
determining, based on processing the further additional spoken input of the user, to implement a next group of lighting commands.

7. At least one non-transitory computer-readable medium storing instructions that, in response to execution by one or more processors, cause the one or more processors to perform the following operations:
receiving a spoken input of a user, the spoken input being detected, via at least one microphone of a client device, as part of dialog between the user and an automated assistant implemented at least in part by the client device;
obtaining a plurality of groups of lighting commands that are responsive to the spoken input, wherein each of the groups of lighting commands, when implemented, cause one or more corresponding lighting components of a lighting system of the user to be controlled in a manner that is different relative to other of the groups of lighting commands;
sequentially causing the groups of lighting commands to be implemented by the lighting system of the user to control one or more of the corresponding lighting components;
receiving an additional spoken input of the user, the spoken input being detected, via the at least one microphone of the client device, as part of the dialog between the user and the automated assistant during the sequentially implementing of the groups of lighting commands;
determining that at least one term of the additional spoken input matches an attribute of a previously implemented group of lighting commands, wherein the attribute is a reference to an implementation order of the previously implemented group of lighting commands in the sequentially implementing or is a reference to a lighting scene of the previously implemented group of lighting commands in the sequentially implementing; and
in response to determining that the at least one term of the additional spoken input matches the attribute of the previously implemented group of lighting commands:
causing one or more of the corresponding lighting components of the lighting system to be controlled based on the previously implemented group of lighting commands.

8. The at least one non-transitory computer-readable medium of claim 7 , wherein the reference to the lighting scene of the previously implemented group of lighting commands in the sequentially implementing includes a reference to a color of one or more of the corresponding lighting components of the lighting system.

9. The at least one non-transitory computer-readable medium of claim 8 , wherein causing one or more of the corresponding lighting components of the lighting system to be controlled based on the previously implemented group of lighting commands is counter to an order of the groups of lighting commands being sequentially implemented.

10. The at least one non-transitory computer-readable medium of claim 7 , wherein the instructions further cause the one or more processors to perform the following operations:
receiving a further additional spoken input of the user, the further spoken input being detected, via the at least one microphone of the client device, as part of the dialog between the user and the automated assistant during the sequentially implementing of the groups of lighting commands;
determining, based on processing the further additional spoken input of the user, that the further additional spoken input references:
the

Assignees

• Google Llc

Inventors

• Kogan David
• Horling Bryan

Classifications

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F16/248

  Presentation of query results · CPC title

• G06F16/285

  Clustering or classification · CPC title

• G06F16/338

  Presentation of query results · CPC title