Context-sensitive handling of interruptions

Patent metadata

Field	Value
Publication number	US-9368114-B2
Application number	US-201414199860-A
Country	US
Kind code	B2
Filing date	Mar 6, 2014
Priority date	Mar 14, 2013
Publication date	Jun 14, 2016
Grant date	Jun 14, 2016

Abstract

A speech output to be provided to a user of a device is received. Thereafter, it is determined if the device is currently receiving speech input from a user. Upon determining that the device is not currently receiving speech input from the user, the speech output to the user is provided. On the other hand, upon determining that the device is receiving speech input from the user it is determined if provision of the speech output is urgent. When the speech output is urgent, the speech output is provided to the user. When the speech output is not urgent, provision of the speech output to the user is stayed.

First claim

What is claimed is:

1. A computer-implemented method of operating a digital assistant, comprising:
at a device having one or more processors, a display, and memory:
receiving a speech output to be provided to a user of the device;
determining if the device is currently receiving speech input from a user,
upon determining that the device is not currently receiving speech input from the user, providing the speech output to the user;
upon determining that the device is receiving speech input from the user:
determining if provision of the speech output is urgent;
upon determining that provision of the speech output is urgent, providing the speech output to the user; and
upon determining that provision of the speech output is not urgent, staying providing the speech output to the user, and providing a displayed output corresponding to the speech output.

2. The method of claim 1 , further comprising, prior to receiving the speech output:
receiving a request from the user to perform a digital assistant task.

3. The method of claim 1 , wherein upon determining that provision of the speech output is urgent, providing the speech output to the user without delay.

4. The method of claim 1 , wherein the device is a telephone, and wherein determining if the device is currently receiving speech input from the user comprises determining if the user is participating in a telephone conversation with a remote user.

5. The method of claim 4 , wherein upon determining that the device is not currently receiving speech input from the user, audio data received from the remote user and the speech output to the user are provided contemporaneously without staying provision of the speech output due to the received audio data.

6. The method of claim 1 , further including, upon determining that the device is no longer receiving speech input from the user, providing the speech output to the user.

7. The method of claim 1 , wherein determining if the device is currently receiving speech input from the user includes determining if a last speech input was received within a predetermined period of time, wherein the predetermined period of time is a function of a measure of an urgency of the output.

8. The method of claim 1 , further including:
determining if the output meets message skipping criteria; and
upon determining that the speech output meets message skipping criteria, forgoing providing the output altogether.

9. The method of claim 8 , wherein the message skipping criteria are met when a measure of the urgency is lower than a predefined threshold.

10. The method of claim 8 , wherein the message skipping criteria are met when the speech output is a navigational command in a set of turn-by-turn directions and the device is scheduled to give a corresponding navigational command at a later time.

11. The method of claim 1 , further including, during provision of the speech output:
receiving speech input from the user; and
discontinuing speech output.

12. The method of claim 1 , further comprising:
upon determining that provision of the speech output is urgent, providing the speech output to the user without providing a displayed output corresponding to the speech output.

13. A non-transitory computer readable medium having instructions stored thereon, the instructions, when executed by one or more processors, cause the processors to:
receive a speech output to be provided to a user of a device;
determine if the device is currently receiving speech input from the user,
upon determining that the device is not currently receiving speech input from the user, provide the speech output to the user;
upon determining that the device is receiving speech input from the user:
determine if provision of the speech output is urgent;
upon determining that provision of the speech output is urgent, provide the speech output to the user; and
upon determining that provision of the speech output is not urgent, stay providing the speech output to the user, and provide a displayed output corresponding to the speech output.

14. The non-transitory computer readable medium of claim 13 , further comprising instructions for causing the processor to, prior to receiving the speech output:
receive a request from the user to perform a digital assistant task.

15. The non-transitory computer readable medium of claim 13 , wherein upon determining that provision of the speech output is urgent, provide the speech output to the user without delay.

16. The non-transitory computer readable medium of claim 13 , wherein the device is a telephone, and wherein determining if the device is currently receiving speech input from the user comprises determining if the user is participating in a telephone conversation with a remote user.

17. The non-transitory computer readable medium of claim 16 , wherein upon determining that the device is not currently receiving speech input from the user, audio data received from the remote user and the speech output to the user are provided contemporaneously without staying provision of the speech output due to the received audio data.

18. The non-transitory computer readable medium of claim 13 , further including instructions for causing the processor to, upon determining that the device is no longer receiving speech input from the user, provide the speech output to the user.

19. The non-transitory computer readable medium of claim 13 , wherein determining if the device is currently receiving speech input from the user includes determining if a last speech input was received within a predetermined period of time, wherein the predetermined period of time is a function of a measure of an urgency of the output.

20. The non-transitory computer readable medium of claim 13 , further comprising:
upon determining that provision of the speech output is urgent, provide the speech output to the user without providing a displayed output corresponding to the speech output.

21. A system, comprising:
one or more processors;
a display, and
memory having instructions stored thereon, the instructions, when executed by the one or more processors, cause the processors to:
receive a speech output to be provided to a user;
determine if speech input is currently being received from the user,
upon determining that the user is not currently providing speech input, cause the speech output to be provided to the user;
upon determining that the user is currently providing speech input:
determine if the speech output is urgent;
upon determining that the speech output is urgent, cause the speech output to be provided to the user; and
upon determining that provision of the speech output is not urgent, stay providing the speech output to the user, and provide a displayed output corresponding to the speech output.

22. The system of claim 21 , further comprising instructions for causing the one or more processors to, prior to receiving the speech output:
receive a request from the user to perform a digital assistant task.

23. The system of claim 21 , wherein upon determining that provision of the speech output is urgent, provide the speech output to the user without delay.

24. The system of claim 21 , wherein determining if the user is currently providing speech input comprises determining if the user is participating in a telephone conversation.

25. The system of claim 21 , further including instructions for causing the processor to

Assignees

• Apple Inc

Inventors

• Larson Anthony L
• Dave Swapnil R
• Varoglu Devrim

Classifications

• G10L25/78

  Detection of presence or absence of voice signals (switching of direction of transmission by voice frequency in two-way loud-speaking telephone systems H04M9/10) · CPC title

• H04M2250/74

  with voice recognition means · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/165 Primary

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title