Devices, methods, and graphical user interfaces for a unified annotation layer for annotating content displayed on a device

Patent metadata

Field	Value
Publication number	US-10852936-B2
Application number	US-201715691715-A
Country	US
Kind code	B2
Filing date	Aug 30, 2017
Priority date	Sep 23, 2016
Publication date	Dec 1, 2020
Grant date	Dec 1, 2020

Abstract

An electronic device displays a first user interface of a first application. The first application is a respective application of a plurality of applications, and the first user interface including first application content. While displaying the first user interface, and in response to detecting a first input, the device continues to display the first application content and displays an annotation layer over at least a first portion of the first user interface. The annotation layer is associated with a user application distinct from the plurality of applications. While displaying the annotation layer over at least the first portion, and in response to detecting a second input, the device adds a representation of at least a second portion of the first user interface to the annotation layer. While displaying the representation, the device detects a set of one or more additional inputs and, in response, adds annotations to the annotation layer.

First claim

What is claimed is:

1. A method, comprising:
at an electronic device with a touch-sensitive display and one or more sensors to detect a stylus associated with the electronic device:
displaying a first user interface of a first application, wherein the first application is a respective application of a plurality of applications, and wherein the first user interface includes first application content;
while displaying the first user interface of the first application, detecting a first input on the touch-sensitive display;
in response to detecting the first input:
conditionally displaying an annotation user interface or a notification user interface based on whether the first input is performed using the stylus or a finger, including:
in accordance with a determination that the first input, that was detected while displaying the first user interface of the first application, is an edge gesture that begins at or near an edge of the touch-sensitive display and is performed using the stylus:
 displaying the annotation user interface while continuing to display the first application content and without displaying the notification user interface;
 while displaying the annotation user interface concurrently with the first application content, detecting a set of one or more additional inputs; and
 in response to detecting the set of one or more additional inputs, adding annotations to the annotation user interface; and
in accordance with a determination that the first input, that was detected while displaying the first user interface of the first application, is an edge gesture that begins at or near the edge of the touch-sensitive display and is performed using the finger, forgoing displaying the annotation user interface, and displaying the notification user interface, wherein the notification user interface includes notifications of communications received by the electronic device.

2. The method of claim 1 , including, in response to detecting a second input, creating a representation of at least a portion of the first user interface, and adding the representation of at least the portion of the first user interface to the annotation user interface.

3. The method of claim 2 , wherein the representation is added to the annotation user interface under control of a user application distinct from the plurality of applications, and wherein the annotations are added to the annotation user interface under control of the user application distinct from the plurality of applications.

4. The method of claim 2 , wherein the second input is a gesture having a path, and wherein a boundary of the portion of the first user interface to be represented in the annotation user interface is determined based on the path of the second input gesture.

5. The method of claim 2 , wherein the representation is a first representation, the set of one or more additional inputs is a first set of one or more additional inputs, the annotations are a first set of annotations, and the method includes, after adding the first set of annotations to the annotation user interface:
displaying a second user interface of a second application of the plurality of applications, wherein the second user interface includes second application content;
while displaying the second user interface of the second application, detecting a third input;
in response to detecting the third input, continuing to display the second application content and, in addition, displaying the annotation user interface while continuing to display the second application content;
while displaying the annotation user interface concurrently with the second application content, detecting a fourth input;
in response to detecting the fourth input, adding a second representation of at least a portion of the second user interface to the annotation user interface;
while displaying the second representation in the annotation user interface, detecting a second set of one or more additional inputs; and
in response to detecting the second set of one or more additional inputs, adding a second set of annotations to the annotation user interface.

6. The method of claim 2 , wherein the annotation user interface is a first annotation user interface, the representation is a first representation, the set of one or more additional inputs is a first set of one or more additional inputs, the annotations are a first set of annotations, and the method includes, after adding the first set of annotations to the annotation user interface:
displaying a second user interface of a second application of the plurality of applications, wherein the second user interface includes second application content;
while displaying the second user interface of the second application, detecting a third input;
in response to detecting the third input, continuing to display the second application content and, in addition, displaying a second annotation user interface distinct from the first annotation user interface while continuing to display the second application content;
while displaying the second annotation user interface concurrently with the second application content, detecting a fourth input;
in response to detecting the fourth input, adding a second representation of at least a portion of the second user interface to the second annotation user interface;
while displaying the second representation in the second annotation user interface, detecting a second set of one or more additional inputs; and
in response to detecting the second set of one or more additional inputs, adding a second set of annotations to the annotation user interface.

7. The method of claim 1 , including:
storing an object that includes at least the annotation user interface;
after storing the object that includes at least the annotation user interface, detecting a subsequent input; and
in response to detecting the subsequent input, displaying at least the annotation user interface.

8. The method of claim 7 , wherein:
the object that includes at least the annotation user interface further includes a sequence of annotations made to produce the annotation user interface; and
displaying at least the annotation user interface in response to detecting the subsequent input includes:
playing back the sequence of annotations made to produce the annotation user interface; and
after playing back the sequence of annotations, displaying the annotation user interface.

9. The method of claim 1 , wherein:
the set of one or more additional inputs includes a first additional input; and
the first additional input is input to the electronic device using the stylus.

10. The method of claim 1 , wherein the set of one or more additional inputs includes a third additional input, and the method includes, in accordance with a determination that the third additional input is provided using a finger, displaying a set of annotation controls for the annotation user interface.

11. The method of claim 1 , wherein the first input is detected independently of the plurality of applications.

12. The method of claim 1 , wherein the plurality of applications includes at least two applications selected from the set consisting of: a browser application, a photo application, a communications application, and a content editing application.

13. The method of claim 1 , wherein the annotation user interface has an adjustable opacity, and the method includes, while displaying the annotation user interface, changing the opacity of the annotation user interface in response to a fifth input, wherein increasing the opacity of the annotation user interface decreases visibility of application content that is di

Assignees

• Apple Inc

Inventors

• Graham David C
• Kocienda Kenneth L
• Stack Caelan G
• Foss Christopher P
• Anzures Freddy A

Classifications

• G06F2203/04804

  Transparency, e.g. transparent or translucent windows · CPC title

• G06F40/169

  Annotation, e.g. comment data or footnotes · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F3/03545

  Pens or stylus · CPC title