Context aware annotations for collaborative applications

Patent metadata

Field	Value
Publication number	US-12067223-B2
Application number	US-202117173310-A
Country	US
Kind code	B2
Filing date	Feb 11, 2021
Priority date	Feb 11, 2021
Publication date	Aug 20, 2024
Grant date	Aug 20, 2024

Abstract

Annotations can be correlated to components of a document image so that the annotations track movements of the document image. A transparent overlay is generated to include the annotations and is linked to various components of the document image. Movement of the underlying document image is tracked and then adjustments in components positions are applied to associated annotations to maintain a contextual relationship between the annotations and the components of the document image.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving an annotation input overlaying a region of a document, the annotation input corresponding to a non-textual modification to a presented object in the document controlled by a host user, the non-textual modification covering at least a portion of the presented object;
determining, based at least in part on information about the presented object associated with the annotation input, an annotation location correlating to one or more edges of the presented object;
associating the annotation input with a transparent overlay, the associating including associating the transparent overlay with the annotation input at the annotation location;
determining a first coordinate system for a first user providing the annotation input;
determining a second coordinate system for the host user;
determining an offset between the first coordinate system and the second coordinate system, the offset based at least in part on an attribute corresponding to respective screen resolutions for the first user and the host user;
adjusting the annotation location, based at least in part on the offset, for the annotation input in the second coordinate system; and
responsive to movement of the presented object, adjusting a presentation of the transparent overlay to maintain a position of the annotation location relative to the presented object to present the annotation input at the annotation location in the second coordinate system.

2. The computer-implemented method of claim 1 , further comprising:
receiving an object hierarchy for the presented object;
determining a feature of the object hierarchy; and
correlating the annotation location to the feature of the object hierarchy.

3. The computer-implemented method of claim 1 , further comprising:
determining a geometry of the presented object; and
determining a distance between a marker associated with the presented object and the annotation input.

4. The computer-implemented method of claim 1 ,
receiving a movement input to change an appearance of the presented object;
determining at least a portion of the annotation input, after the movement input, is outside of a viewable area;
clipping the annotation input; and
presenting at least a second portion of the annotation input within the viewable area after the movement input.

5. The computer-implemented method of claim 1 , wherein a plurality of annotation inputs from a plurality of users correspond to respective transparent overlays for each individual user.

6. The computer-implemented method of claim 1 , further comprising:
determining an active window, responsive to the annotation input, based at least in part on an alpha value.

7. The computer-implemented method of claim 6 , further comprising:
linking the transparent overlay to the active window.

8. A system, comprising:
at least one processor; and
memory storing instructions that, when executed, cause the system to:
generate a transparent overlay including an annotation input of a non-textual annotation to modify an underlying object in a region of a document controlled by a host user, the non-textual annotation being visible over the underlying object and representative of a change to be made to the underlying object;
determine, based at least in part on information from the underlying object, a relative location of the annotation input correlating to one or more edges of the underlying object;
determine a first coordinate system for a first user providing the annotation input;
determine a second coordinate system for the host user;
determine an offset between the first coordinate system and the second coordinate system, the offset based at least in part on an attribute corresponding to respective screen resolutions for the first user and the host user;
adjusting the relative location of the annotation input, based at least in part on the offset, for the annotation input in the second coordinate system; and
responsive to changes in a component position, adjust a presentation location of the annotation input to present the annotation at the presentation location in the second coordinate system.

9. The system of claim 8 , wherein the instructions when executed further cause the system to:
receive, from an application program interface (API), information corresponding to the component position, the component position being determined by at least one of a window geometry, a hierarchical structure, or a feature detection system.

10. The system of claim 8 , wherein the instructions when executed further cause the system to:
determine a window associated with the annotation input;
compute an alpha value for the window; and
determine the window is an active window.

11. The system of claim 8 , wherein the transparent overlay corresponds to a unique user.

12. The system of claim 8 , wherein the instructions when executed further cause the system to:
save the transparent overlay corresponding to annotations for the first user;
provide the transparent overlay to a second user; and
present the transparent overlay as a layered structure relative to the underlying object, the layered structure enabling activation and deactivation of the transparent overlay.

13. A system, comprising:
at least one processor; and
memory storing instructions that, when executed, cause the system to:
receive an annotation corresponding to non-textual content positioned to overlay at least a portion of presented content at a first position in a document controlled by a host user, the annotation being visible over the underlying object and representative of a change to be made to the underlying object;
determine, based at least in part on an annotation location, a first annotation presentation location correlating to one or more edges of the presented content at the first position;
determine a first coordinate system for a first user providing the annotation;
determine a second coordinate system for the host user;
determine an offset between the first coordinate system and the second coordinate system, the offset based at least in part on an attribute corresponding to respective screen resolutions for the first user and the host user;
adjust the presented content to a second position in the first coordinate system;
determine, based at least in part on an amount of adjustment between the first position and the second position, a second annotation presentation location in the first coordinate system;
determine, based at least in part on the amount of adjustment between the first position and the second position and the offset, the second annotation presentation location in the second coordinate system;
present the annotation at the second annotation presentation location in the first coordinate system, the second annotation presentation location corresponding to the presented content at the second position and the annotation overlaying at least a portion of the presented content at the second position; and
present the annotation at the second annotation presentation location in the second coordinate system.

14. The system of claim 13 , wherein the instructions when executed further cause the system to:
determine at least a portion of the presented content is outside of a viewable area at the second position; and
clip at least a portion of the annotation, the portion of the annotation corresponding to the presented content outside of the viewable area.

15. The system of claim 13 , wherein the instructions when executed further cause the system to:
determine an image size of the pres

Assignees

• Nvidia Corp

Inventors

• Woodard Andrew James
• Rose Amy
• Waine Benjemin Thomas
• Zimmerman Johannes

Classifications

• G06F2203/04804

  Transparency, e.g. transparent or translucent windows · CPC title

• G06V30/414

  Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text · CPC title

• G06V30/412

  Layout analysis of documents structured with printed lines or input boxes, e.g. business forms or tables · CPC title

• G06F3/04845 Primary

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06Q10/103 Primary

  Workflow collaboration or project management · CPC title