User activity shortcut suggestions

Patent metadata

Field	Value
Publication number	US-11360739-B2
Application number	US-201916592906-A
Country	US
Kind code	B2
Filing date	Oct 4, 2019
Priority date	May 31, 2019
Publication date	Jun 14, 2022
Grant date	Jun 14, 2022

Abstract

Systems and processes for accelerating task performance are provided. An example method includes, at an electronic device with a display, displaying a candidate shortcut affordance associated with a user activity, detecting a first set of inputs corresponding to a selection of the candidate shortcut affordance, in response to detecting the first set of inputs, displaying a first set of candidate task affordances, detecting a second set of inputs corresponding to a selection of a candidate task affordance associated with a first task, displaying a second set of candidate task affordances, detecting a third set of inputs corresponding to a selection of a candidate task affordance associated with a second task, and in response to detecting the second set of inputs and the third set of inputs, associating the first task and the second task with a task sequence for a voice shortcut corresponding to the user activity.

First claim

What is claimed is:

1. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device, cause the first electronic device to:
present a plurality of candidate user activities for a voice shortcut corresponding to a user activity, wherein the plurality of candidate user activities includes a first user activity previously performed by a user of the first electronic device;
receive a first user input selecting the first user activity from the plurality of candidate user activities;
determine, based on at least one previous performance of the first user activity by the user of the first electronic device, contextual data present when the user previously performed the first user activity;
in response to receiving the first user input selecting the first user activity, generate, based on the first user activity and the contextual data, a first plurality of candidate tasks of a first type and a second plurality of candidate tasks of a second task type different than the first task type, wherein at least one task of the first plurality of candidate tasks was previously performed in a context that matches the contextual data;
provide an output indicating the first plurality of candidate tasks and the second plurality of candidate tasks;
receive a set of user inputs identifying a first candidate task of the first plurality of candidate tasks and a second candidate task of the second plurality of candidate tasks; and
group the first candidate task and the second candidate task into a task sequence for a voice shortcut corresponding to the first user activity.

2. The non-transitory computer-readable storage medium of claim 1 , wherein determining the contextual data present when the user previously performed the first user activity includes:
receiving a second user input identifying the contextual data present when the user previously performed the first user activity.

3. The non-transitory computer-readable storage medium of claim 1 wherein generating, based on the first user activity and the contextual data, the first plurality of candidate tasks and the second plurality of candidate tasks includes:
determining one or more tasks performed in a context that matches the contextual data present when the user previously performed the first user activity; and
providing the first plurality of candidate tasks including the one or more tasks previously performed in a context that matches the contextual data present when the user previously performed the first user activity.

4. The non-transitory computer-readable storage medium of claim 1 , wherein generating, based on the first user activity and the contextual data, the first plurality of candidate tasks and the second plurality of candidate tasks includes:
determining one or more tasks based on a received indication of tasks that are most commonly requested by a plurality of users while engaged in the first user activity; and
providing the first plurality of candidate tasks including the one or more tasks determined based on the indication of tasks that are most commonly requested by a plurality of users while engaged in the first user activity.

5. The non-transitory computer-readable storage medium of claim 1 , wherein one or more tasks of the first plurality of candidate tasks are system-level tasks.

6. The non-transitory computer-readable storage medium of claim 1 , wherein one or more tasks of the first plurality of candidate tasks are application-level tasks.

7. The non-transitory computer-readable storage medium of claim 1 , wherein the first candidate task of the first plurality of candidate tasks is associated with a first task and a first parameter for the first task.

8. The non-transitory computer-readable storage medium of claim 7 , wherein a third candidate task of the first plurality of candidate tasks is associated with the first task and a second parameter for the first task.

9. The non-transitory computer-readable storage medium of claim 1 , wherein grouping the first candidate task and the second candidate task into the task sequence for the voice shortcut corresponding to the first user activity further comprises automatically grouping a third task into the task sequence.

10. The non-transitory computer-readable storage medium of claim 1 , wherein grouping the first candidate task and the second candidate task into the task sequence for the voice shortcut corresponding to the first user activity further comprises associating context criteria corresponding to the first user activity with the task sequence.

11. The non-transitory computer-readable storage medium of claim 10 , wherein the context criteria corresponding to the first user activity is determined based on the contextual data present when the user previously performed the first user activity.

12. The non-transitory computer-readable storage medium of claim 10 , wherein the context criteria corresponding to the first user activity is determined based on a user input identifying the contextual data present when the user previously performed the first user activity.

13. The non-transitory computer-readable storage medium of claim 10 , wherein grouping the first candidate task and the second candidate task into the task sequence for the voice shortcut corresponding to the first user activity further comprises determining if a suggestion notification mode is enabled.

14. The non-transitory computer-readable storage medium of claim 10 , wherein the one or more programs further comprise instructions, which when executed by one or more processors of the first electronic device, cause the first electronic device to:
receive contextual data associated with the electronic device;
determine, based on the received contextual data, whether the context criteria is satisfied; and
in accordance with a determination that the context criteria is satisfied, provide a suggestion notification corresponding to the task sequence, which when selected causes the electronic device to perform the task sequence including the first candidate task and the second candidate task.

15. The non-transitory computer-readable storage medium of claim 1 , wherein the one or more programs further comprise instructions, which when executed by one or more processors of the first electronic device, cause the first electronic device to:
provide a confirmation that the first candidate task and the second candidate task are associated with the task sequence.

16. The non-transitory computer-readable storage medium of claim 1 , wherein the one or more programs further comprise instructions, which when executed by one or more processors of the first electronic device, cause the first electronic device to:
receive a natural-language speech input;
determine whether the natural-language speech input satisfies voice shortcut criteria; and
in accordance with a determination that the natural-language speech input satisfies the voice shortcut criteria, cause the electronic device to perform the task sequence including first candidate task and the second candidate task.

17. An electronic device, comprising:
one or more processors;
a memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
present a plurality of candidate user activities for a voice shortcut corresponding to a user activity, wherein the plurality of c

Assignees

• Apple Inc

Inventors

• Blatz John L
• Malta Andrew William
• Moon Jay
• Ramaswamy Pallavika
• Weinstein Ari

Classifications

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/048

  Interaction techniques based on graphical user interfaces [GUI] · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F16/24575

  using context · CPC title

• G06F9/451

  Execution arrangements for user interfaces · CPC title