Devices, methods, and graphical user interfaces for a unified annotation layer for annotating content displayed on a device

Patent metadata

Field	Value
Publication number	US-12118201-B2
Application number	US-202017107819-A
Country	US
Kind code	B2
Filing date	Nov 30, 2020
Priority date	Sep 23, 2016
Publication date	Oct 15, 2024
Grant date	Oct 15, 2024

Abstract

An electronic device with a display device displays a user interface that includes content. The electronic device, while displaying the user interface that includes content, detects a first input. The electronic device, in response to detecting the first input, displays an annotation layer over the displayed content. At least a portion of the content is visible through the annotation layer. The electronic device, while displaying the annotation layer, displays a set of markup tools, including a plurality of tools for adding marks to the annotation layer. The electronic device detects a second input selecting a first markup tool of the set of markup tools. The electronic device adds one or more marks on the annotation layer in accordance with one or more additional inputs using the selected first markup tool.

First claim

What is claimed is:

1. A method, comprising:
at an electronic device in communication with a display device:
displaying, via the display device, a user interface that includes application content generated by the electronic device;
while displaying the user interface that includes the application content generated by the electronic device, detecting a first input that moves over a portion of the application content;
in response to detecting the first input, displaying an annotation user interface concurrently with a representation of the application content over which the first input moved; and
while displaying the annotation user interface:
displaying a set of markup tools, including a plurality of tools for adding marks to the application content over which the first input moved, wherein the set of markup tools is displayed concurrently with the representation of the application content over which the first input moved;
detecting a second input selecting a first markup tool of the set of markup tools;
while the first markup tool is selected, adding one or more marks on an annotation layer overlaying the application content over which the first input moved, wherein the one or more marks are generated by the electronic device in accordance with one or more additional inputs using the selected first markup tool; and
changing opacity of the annotation layer, wherein increasing opacity of the annotation layer decreases visibility of application content over which the first input moved relative to the one or more marks on the annotation layer.

2. The method of claim 1 , wherein the annotation layer includes an adjustable texture and the method includes, while displaying the annotation layer, changing the texture of the annotation layer in accordance with selection of a respective tool in the set of markup tools.

3. The method of claim 1 , further comprising:
while displaying the annotation layer, detecting a sixth input selecting a portion of the application content; and
in response to detecting the sixth input, adding a representation of the selected portion of the application content to the annotation layer.

4. The method of claim 1 , further comprising:
displaying, in the user interface, a first affordance for capturing a snapshot of the at least a portion of the application content that is visible through the annotation layer;
detecting a fourth input selecting the first affordance; and
in response to detecting the fourth input selecting the first affordance, capturing a snapshot of the at least a portion of the application content that is visible through the annotation layer.

5. The method of claim 1 , further comprising, saving the annotation layer, including the one or more marks, and metadata for the at least a portion of the application content that is visible through the annotation layer.

6. The method of claim 1 , further comprising:
displaying, in the user interface, a second affordance for sharing a view of the annotation layer and a portion of the application content that is visible through the annotation layer;
detecting a fifth input selecting the second affordance; and
in response to detecting the fifth input, sharing a view of the annotation layer and the portion of the application content that is visible through the annotation layer.

7. The method of claim 1 , further comprising:
detecting the one or more additional inputs, the one or more additional inputs comprising one or more gestures, and
in response to detecting the one or more additional inputs, adding the one or more marks on the annotation layer based at least in part on metadata of the at least a portion of the application content that is visible through the annotation layer and in accordance with the one or more gestures.

8. The method of claim 1 , further comprising, based on a structure of the at least a portion of the application content that is visible through the annotation layer:
determining a boundary of a content region in the application content; and
selecting the content region, wherein the selected content region is added to the annotation layer in accordance with the one or more additional inputs.

9. The method of claim 1 , wherein:
the at least a portion of the application content includes one or more objects within the application content; and
the method further includes:
detecting the one or more additional inputs; and
in response to detecting the one or more additional inputs, adding a line to the annotation layer, wherein the line added to the annotation layer is snapped to an object of the one or more objects within the application content.

10. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display device, cause the electronic device to:
display, via the display device, a user interface that includes application content generated by the electronic device;
while displaying the user interface that includes the application content generated by the electronic device, detect a first input that moves over a portion of the application content; and
in response to detecting the first input, display an annotation user interface concurrently with a representation of the application content over which the first input moved;
while displaying the annotation user interface:
displaying a set of markup tools, including a plurality of tools for adding marks to the application content over which the first input moved, wherein the set of markup tools is displayed concurrently with the representation of the application content over which the first input moved;
detecting a second input selecting a first markup tool of the set of markup tools;
while the first markup tool is selected, adding one or more marks on an annotation layer overlaying the application content over which the first input moved, wherein the one or more marks are generated by the electronic device in accordance with one or more additional inputs using the selected first markup tool; and
changing opacity of the annotation layer, wherein increasing opacity of the annotation layer decreases visibility of application content over which the first input moved relative to the one or more marks on the annotation layer.

11. An electronic device, comprising:
a display device;
one or more processors;
memory; and
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for:
displaying, via the display device, a user interface that includes application content generated by the electronic device;
while displaying the user interface that includes the application content generated by the electronic device, detecting a first input that moves over a portion of the application content;
in response to detecting the first input, displaying an annotation user interface concurrently with a representation of the application content over which the first input moved; and
while displaying the annotation user interface:
displaying a set of markup tools, including a plurality of tools for adding marks to the application content over which the first input moved, wherein the set of markup tools is displayed concurrently with the representation of the application content over which the first input moved;
detecting a second input selecting a first markup tool of the set of markup tools;
while the first markup tool is selected, adding one or more marks on an annotation layer overlaying the application content over which the first input moved, wherein the one or more

Assignees

• Apple Inc

Inventors

• Graham David C
• Kocienda Kenneth L
• Stack Caelan G
• Foss Christopher P
• Anzures Freddy A

Classifications

• G06F3/03545

  Pens or stylus · CPC title

• G06F40/169

  Annotation, e.g. comment data or footnotes · CPC title

• G06F3/0488 Primary

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06F2203/04804

  Transparency, e.g. transparent or translucent windows · CPC title

• G06F3/04883 Primary

  for inputting data by handwriting, e.g. gesture or text · CPC title