Determining whether to automatically resume first automated assistant session upon cessation of interrupting second session

Patent metadata

Field	Value
Publication number	US-11830491-B2
Application number	US-202117552887-A
Country	US
Kind code	B2
Filing date	Dec 16, 2021
Priority date	May 7, 2018
Publication date	Nov 28, 2023
Grant date	Nov 28, 2023

Abstract

Determining whether, upon cessation of a second automated assistant session that interrupted and supplanted a prior first automated assistant session: (1) to automatically resume the prior first automated assistant session, or (2) to transition to an alternative automated assistant state in which the prior first session is not automatically resumed. Implementations further relate to selectively causing, based on the determining and upon cessation of the second automated assistant session, either the automatic resumption of the prior first automated assistant session that was interrupted, or the transition to the state in which the first session is not automatically resumed.

First claim

What is claimed is:

1. A method implemented using one or more processors, comprising:
receiving spoken utterance data indicative of a spoken utterance of a user detected via one or more microphones of a client device;
identifying, based on the spoken utterance data, first content that is responsive to the spoken utterance of the user;
in response to receiving the spoken utterance data, causing the client device to render at least part of the first content during a first session;
receiving interruption data during rendering of the first content by the client device during the first session, the interruption data received in response to further user interface input of the user that is detected during rendering of the first content during the first session;
in response to receiving the interruption data:
storing session data, for the first session, in local memory of the client device or in remote memory of a remote server in network communication with the client device,
wherein the session data indicates a state of the first session when the interruption data was received;

causing the client device to render alternative content during a second session that at least temporarily replaces the first session, wherein the alternative content is different from the first content, and wherein causing the client device to render the alternative content during the second session comprises causing the client device to render the alternative content in lieu of the first content;

determining whether to cause the client device to resume the first session;
in response to determining to cause the client device to resume the first session:
retrieving the stored session data for the first session, and
resuming the first session in the state indicated by the session data; and

in response to determining to not cause the client device to resume the first session:
causing the stored session data, for the first session, to be cleared from the local memory of the client device or from the remote memory of the remote server in network communication with the client device.

2. The method of claim 1 , wherein resuming the first session in the state indicated by the session data comprises automatically resuming the first session upon cessation of the second session.

3. The method of claim 2 , wherein determining whether to cause the client device to resume the first session is based on one or more properties of the first session.

4. The method of claim 3 , wherein the one or more properties of the first session comprise a classification assigned to the first content.

5. The method of claim 4 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

6. The method of claim 1 , wherein determining whether to cause the client device to resume the first session is based on one or more properties of the first session.

7. The method of claim 6 , wherein determining whether to cause the client device to resume the first session is further based on one or more properties of the second session.

8. The method of claim 1 , wherein storing the session data, for the first session, comprises storing the session data in the local memory without storing the session data in the remote memory.

9. A method implemented using one or more processors, comprising:
receiving spoken utterance data indicative of a spoken utterance of a user detected via one or more microphones of a client device;
identifying, based on the spoken utterance data, first content that is responsive to the spoken utterance of the user;
in response to receiving the spoken utterance data, causing the client device to render at least part of the first content during a first session;
receiving interruption data during rendering of the first content by the client device during the first session, the interruption data received in response to further user interface input of the user that is detected during rendering of the first content during the first session;
in response to receiving the interruption data, causing the client device to render alternative content during a second session that at least temporarily replaces the first session, wherein the alternative content is different from the first content, and wherein causing the client device to render the alternative content during the second session comprises causing the client device to render the alternative content in lieu of the first content;
determining whether, upon cessation of the second session:
to cause the client device to automatically resume the first session, or
to cause the client device to transition to an alternative state in which the client device does not automatically resume the first session,
wherein the determining is based on one or more properties of the first session;

upon cessation of the second session, selectively causing the client device to either automatically resume the first session or to transition to the alternative state in which the first session is not automatically resumed, wherein the selectively causing is dependent on the determining;
wherein, in the alternative state, resumption suggestion output is rendered that suggests resumption of the first session and wherein the first session is resumed in response to receiving affirmative user interface input that is directed to the resumption suggestion output in the alternative state.

10. The method of claim 9 , wherein, in the alternative state, one or more upcoming events are rendered along with the resumption suggestion output.

11. The method of claim 9 , wherein, in the alternative state, a local weather forecast is rendered along with the resumption suggestion output.

12. The method of claim 9 , wherein the resumption suggestion output that is rendered is a selectable graphical element that is visually rendered.

13. The method of claim 12 , wherein the affirmative user interface input is a touch input selection of the selectable graphical element.

14. The method of claim 9 , wherein determining whether, upon cessation of the second session, to cause the client device to automatically resume the first session or to cause the client device to transition to the alternative state is based on one or more properties of the first session.

15. The method of claim 14 , wherein the one or more properties of the first session comprise a classification assigned to the first content.

16. The method of claim 15 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

17. A client device comprising:
one or more microphones;
one or more processors;
memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:
identify, based on the spoken utterance data, first content that is responsive to a spoken utterance, of the user, detected via the one or more microphones;
in response to the spoken utterance data, render at least part of the first content during a first session;
receive interruption data during rendering of the first content by the client device during the first session, the interruption data received in response to further user interface input of the user that is detected during rendering of the first content during the first session;
in response to receiving the interruption data:
store session data, for the first session, in the memory,
wherein the session data indicates a state of the first session when the int

Assignees

• Google Llc

Inventors

• Van Scheltinga Andrea Terwisscha
• D'Ercole Nicolo
• Sabur Zaheed
• Xu Bibo
• Knight Megan
• Abdagic Alvin
• Lamecki Jan
• Zhang Bo

Classifications

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title