Determining whether to automatically resume first automated assistant session upon cessation of interrupting second session

Patent metadata

Field	Value
Publication number	US-11217247-B2
Application number	US-201916618920-A
Country	US
Kind code	B2
Filing date	May 1, 2019
Priority date	May 7, 2018
Publication date	Jan 4, 2022
Grant date	Jan 4, 2022

Abstract

Determining whether, upon cessation of a second automated assistant session that interrupted and supplanted a prior first automated assistant session: (1) to automatically resume the prior first automated assistant session, or (2) to transition to an alternative automated assistant state in which the prior first session is not automatically resumed. Implementations further relate to selectively causing, based on the determining and upon cessation of the second automated assistant session, either the automatic resumption of the prior first automated assistant session that was interrupted, or the transition to the state in which the first session is not automatically resumed.

First claim

What is claimed is:

1. A method implemented using one or more processors, comprising:
receiving spoken utterance data indicative of a spoken utterance of a user detected via one or more microphones of a client device;
identifying, based on the spoken utterance data, first content that is responsive to the spoken utterance of the user;
in response to receiving the spoken utterance data, causing the client device to render at least part of the first content during a first session;
receiving interruption data during rendering of the first content by the client device during the first session, the interruption data received in response to further user interface input of the user that is detected during rendering of the first content during the first session;
in response to receiving the interruption data, causing the client device to render alternative content during a second session that at least temporarily replaces the first session, wherein the alternative content is different from the first content, and wherein causing the client device to render the alternative content during the second session comprises causing the client device to render the alternative content in lieu of the first content;
determining whether, upon cessation of the second session:
to cause the client device to automatically resume the first session, or
to cause the client device to transition to an alternative state in which the client device does not automatically resume the first session,
wherein the determining is based at least on one or more properties of the first session;
wherein at least one property of the first session includes an entity embodied by the first content, and the determining comprises determining to cause the client device to automatically resume the first session based on determining a relationship between the alternative content and the entity embodied by the first content; and

upon cessation of the second session, selectively causing the client device to either automatically resume the first session or to transition to the alternative state in which the first session is not automatically resumed, wherein the selectively causing is dependent on the determining.

2. The method of claim 1 , wherein at least one property of the first session on which the determining is based includes a classification assigned to the first content.

3. The method of claim 2 , wherein the classification assigned to the first content indicates whether the first content is transient or enduring.

4. The method of claim 3 , wherein the determining comprises determining to cause the client device to transition to the alternative state, in which the client device does not automatically resume the first session, based on the classification assigned to the first content indicating the first content is transient.

5. The method of claim 3 , wherein the determining is further based on one or more properties of the second session.

6. The method of claim 5 , wherein at least one property of the second session indicates whether the alternative content is transient or enduring.

7. The method of claim 6 , wherein the determining comprises determining to cause the client device to automatically resume the first session based on the classification assigned to the first content indicating the first content is enduring and at least one property of the second session indicating the alternative content is transient.

8. The method of claim 6 , wherein the determining comprises determining to cause the client device to transition to the alternative state, in which the client device does not automatically resume the first session, based on the classification assigned to the first content indicating the content is enduring and at least one property of the second session indicating the alternative content is enduring.

9. The method of claim 1 , wherein the further user interface input is a further spoken utterance of the user, and further comprising:
determining the further spoken input is interruption data based on the further spoken input including a request for the alternative content and the alternative content being different than the first content of the first session.

10. The method of claim 1 , further comprising:
receiving, during rendering of the first content by the client device during the first session, a notification to be rendered at the client device;
in response to receiving the notification, causing the client device to render the notification;
wherein the further user interface input is an affirmative touch or spoken input of the user that is provided in response to the client device rendering the notification,
wherein the affirmative input of the user indicates a desire of the user to interact with the notification, and
wherein the alternative content is based on the notification.

11. The method of claim 1 , further comprising:
storing first session state data, for the first session, that indicates a state of the first session when the interruption data was received;
wherein causing the client device to automatically resume the first session comprises using the first session state data to resume the first session in the state of the first session when the interruption data was received.

12. The method of claim 1 , wherein the determining comprises determining to cause the client device to transition to the state in which the client device does not automatically resume the first session, and further comprising:
clearing session data, for the first session, from memory of the client device or a remote server in network communication with the client device.

13. The method of claim 1 , wherein the client device includes a display and at least one speaker, and wherein rendering the content comprises rendering the content via the display and the at least one speaker.

14. The method of claim 1 , wherein the alternative state in which the client device does not automatically resume the first session comprises display of a home screen or an ambient screen.

15. The method of claim 14 , wherein the display of the home screen or the ambient screen lacks any reference to the first session.

16. The method of claim 14 , wherein the display of the home screen or the ambient screen includes a selectable graphical interface element that can be selected to resume the first session.

17. A system comprising one or more processors and memory operably coupled with the one or more processors, wherein the memory stores instructions that, in response to execution of the instructions by one or more processors, cause the one or more processors to:
receive spoken utterance data indicative of a spoken utterance of a user detected via one or more microphones of a client device;
identify, based on the spoken utterance data, first content that is responsive to the spoken utterance of the user;
in response to receiving the spoken utterance data, cause the client device to render at least part of the first content during a first session;
receive interruption data during rendering of the first content by the client device during the first session, the interruption data received in response to further user interface input of the user that is detected during rendering of the first content during the first session;
in response to receiving the interruption data, cause the client device to render alternative content during a second session that at least temporarily replaces the first session, wherein the alternative content is different from the first content, and wherein causing the client device to render the alternative co

Assignees

• Google Llc

Inventors

• Van Scheltinga Andrea Terwisscha
• D'Ercole Nicolo
• Sabur Zaheed
• Xu Bibo
• Knight Megan
• Abdagic Alvin
• Lamecki Jan
• Zhang Bo

Classifications

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/0484

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title