Determining whether to automatically resume first automated assistant session upon cessation of interrupting second session

Patent metadata

Field	Value
Publication number	US-2023402035-A1
Application number	US-202318238898-A
Country	US
Kind code	A1
Filing date	Aug 28, 2023
Priority date	May 7, 2018
Publication date	Dec 14, 2023
Grant date	—

Abstract

Determining whether, upon cessation of a second automated assistant session that interrupted and supplanted a prior first automated assistant session: (1) to automatically resume the prior first automated assistant session, or (2) to transition to an alternative automated assistant state in which the prior first session is not automatically resumed. Implementations further relate to selectively causing, based on the determining and upon cessation of the second automated assistant session, either the automatic resumption of the prior first automated assistant session that was interrupted, or the transition to the state in which the first session is not automatically resumed.

First claim

What is claimed is:

1 . A method implemented using one or more processors, the method comprising:
receiving, over multiple dialog turns of a first dialog session that is between a user and an automated assistant, spoken utterance data indicative of multiple spoken utterances of a user detected via one or more microphones of a client device; identifying, based on the spoken utterance data, multiple instances of first content that are each responsive to a corresponding one of the multiple spoken utterances of the user; causing the client device to render the first content during the first dialog session; receiving interruption data during rendering of at least part of the first content by the client device during the first dialog session, the interruption data received in response to further user interface input of the user that is detected during rendering of the at least part of the first content during the first dialog session; in response to receiving the interruption data:
storing session data, for the first dialog session, in local memory of the client device or in remote memory of a remote server in network communication with the client device,
wherein the session data indicates a state of the first dialog session when the interruption data was received;

causing the client device to render alternative content during a second dialog session that at least temporarily replaces the first dialog session, wherein the alternative content is different from the first content, and wherein causing the client device to render the alternative content during the second dialog session comprises causing the client device to render the alternative content in lieu of the first content;
determining whether to cause the client device to automatically resume the first dialog session; in response to determining to cause the client device to automatically resume the first dialog session:
retrieving the stored session data for the first dialog session, and
automatically resuming the first dialog session in the state indicated by the session data; and
in response to determining to not cause the client device to resume the first dialog session:
causing the client device to transition to an alternative state in which the client device does not automatically resume the first session.

2 . The method of claim 1 , wherein determining whether to cause the client device to resume the first dialog session is based on one or more properties of the first dialog session.

3 . The method of claim 2 , wherein the one or more properties of the first dialog session comprise a classification assigned to the first content.

4 . The method of claim 3 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

5 . The method of claim 1 , wherein determining whether to cause the client device to resume the first dialog session is based on one or more properties of the first dialog session and is further based on one or more properties of the second dialog session.

6 . The method of claim 1 , wherein storing the session data, for the first dialog session, comprises storing the session data in the local memory without storing the session data in the remote memory.

7 . The method of claim 1 , wherein the alternative state in which the client device does not automatically resume the first dialog session comprises display of a home screen or an ambient screen.

8 . The method of claim 7 , wherein the display of the home screen or the ambient screen lacks any reference to the first dialog session.

9 . The method of claim 7 , wherein the display of the home screen or the ambient screen includes a selectable graphical interface element that can be selected to resume the first dialog session.

10 . A system comprising:
one or more processors; memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:
receive, over multiple dialog turns of a first dialog session that is between a user and an automated assistant, spoken utterance data indicative of multiple spoken utterances of a user detected via one or more microphones of a client device;
identify, based on the spoken utterance data, multiple instances of first content that are each responsive to a corresponding one of the multiple spoken utterances of the user;
cause the client device to render the first content during the first dialog session;
receive interruption data during rendering of at least part of the first content by the client device during the first dialog session, the interruption data received in response to further user interface input of the user that is detected during rendering of the at least part of the first content during the first dialog session;
in response to receiving the interruption data:
store session data, for the first dialog session, in local memory of the client device or in remote memory of a remote server in network communication with the client device,
wherein the session data indicates a state of the first dialog session when the interruption data was received;

cause the client device to render alternative content during a second dialog session that at least temporarily replaces the first dialog session, wherein the alternative content is different from the first content, and wherein in causing the client device to render the alternative content during the second dialog session one or more of the processors are to cause the client device to render the alternative content in lieu of the first content;
determine whether to cause the client device to automatically resume the first dialog session;
in response to determining to cause the client device to automatically resume the first dialog session:
retrieve the stored session data for the first dialog session, and
automatically resume the first dialog session in the state indicated by the session data; and

in response to determining to not cause the client device to resume the first dialog session:
cause the client device to transition to an alternative state in which the client device does not automatically resume the first session.

11 . The system of claim 10 , wherein in determining whether to cause the client device to resume the first dialog session one or more of the processors are to determine whether to cause the client device to resume the first dialog session based on one or more properties of the first dialog session.

12 . The system of claim 11 , wherein the one or more properties of the first dialog session comprise a classification assigned to the first content.

13 . The system of claim 12 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

14 . The system of claim 10 , wherein in determining whether to cause the client device to resume the first dialog session one or more of the processors are to determine whether to cause the client device to resume the first dialog session based on one or more properties of the first dialog session and further based on one or more properties of the second dialog session.

15 . The system of claim 10 , wherein in storing the session data, for the first dialog session, one or more of the processors are to store the session data in the local memory without storing the session data in the remote memory.

16 . The system of claim 10 , wherein the alternative state in which the client device does not automatically resume the f

Assignees

• Google Llc

Inventors

• Van Scheltinga Andrea Terwisscha
• D'Ercole Nicolo
• Sabur Zaheed
• Xu Bibo
• Knight Megan
• Abdagic Alvin
• Lamecki Jan
• Zhang Bo

Classifications

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title