Progress tracking with automatic symbol detection

Patent metadata

Field	Value
Publication number	US-12462092-B2
Application number	US-202117461541-A
Country	US
Kind code	B2
Filing date	Aug 30, 2021
Priority date	Nov 17, 2020
Publication date	Nov 4, 2025
Grant date	Nov 4, 2025

Abstract

A method and system provide the ability to track object progress in a drawing sheet. An object type is created and activity types are assigned to the object type. The activity types represent a progression of an object of the object type. A portable document format (PDF) drawing sheet that has multiple symbol instances is obtained. A graphic region containing a symbol instance is selected in the drawing sheet. A markup is created on the drawing sheet based on the selected graphic region. Multiple symbol instances are autonomously detected based on the selected graphic region. Progress tracking markup instances of the markup are autonomously created for the detected symbol instances and are linked to the object type. The progress of the object instances is visually tracked using graphical user interface (GUI) visualizations that provide a visual representation of the progression via the markups.

First claim

What is claimed is:

1 . A computer-implemented method for tracking object progress in a current drawing sheet, comprising:
(a) creating, in a computer application, an object type; (b) assigning, in the computer application, two or more activity types to the object type, wherein the two or more activity types represent a progression of an object of the object type; (c) obtaining, in the computer application, the current drawing sheet, wherein:
(i) the current drawing sheet comprises a portable document format (PDF) document without computer aided design (CAD) or building information model (BIM) context;
(ii) the current drawing sheet comprises multiple symbol instances of a symbol, wherein the multiple symbol instances comprise graphic symbols on the current drawing sheet;
(iii) the multiple symbol instances each represent an object instance of the object;
(d) selecting a graphic region in the current drawing sheet, wherein the graphic region contains one of the multiple symbol instances; (e) creating a markup on the current drawing sheet based on the selected graphic region; (f) autonomously detecting the multiple symbol instances based on the selected graphic region; (g) autonomously creating progress tracking markup instances of the markup for the multiple symbol instances detected, wherein each progress tracking markup instance is linked to the object type; and (h) visually tracking the progress of the object instances using graphical user interface (GUI) visualizations, wherein the GUI visualizations provide a visual representation of the progression via the progress tracking markup instances.

2 . The computer-implemented method of claim 1 , wherein the selecting the graphic region comprises drawing a bounding box around the symbol.

3 . The computer-implemented method of claim 1 , wherein the creating the markup comprises specifying a shape and size for the markup.

4 . The computer-implemented method of claim 1 , further comprising:
accepting user input correcting the progress tracking markup instances.

5 . The computer-implemented method of claim 4 , wherein the autonomously detecting comprises:
maintaining a machine learning (ML) model, wherein:
the ML model models symbols previously detected on other drawing sheets; and
the ML model is updated based on the user input correcting the progress tracking markup instances; and
applying the ML model based on the selected graphic region to detect the multiple symbol instances in the current drawing sheet.

6 . The computer-implemented method of claim 4 , wherein the correcting removes one or more of the progress tracking markup instances.

7 . The computer-implemented method of claim 1 , wherein the GUI visualizations graphically differentiate the progress tracking markup instances based on a current activity type associated with each progress tracking markup instance.

8 . The computer-implemented method of claim 1 , wherein the GUI visualizations comprises a dashboard visualizing the progression over time.

9 . The computer-implemented method of claim 1 , wherein the GUI visualizations comprises a dashboard visualizing a total sum of the activity types that have been completed for each object type.

10 . The computer-implemented method of claim 1 , wherein the GUI visualizations provide a unique color for each activity type.

11 . A computer-implemented system for tracking object progress in a current drawing sheet, comprising:
(a) a computer having a memory; (b) a processor executing on the computer; (c) the memory storing a set of instructions, wherein the set of instructions, when executed by the processor cause the processor to perform operations comprising:
(i) creating, in a computer application, an object type;
(ii) assigning, in the computer application, two or more activity types to the object type, wherein the two or more activity types represent a progression of the object of the object type;
(iii) obtaining, in the computer application, the current drawing sheet, wherein:
(1) the current drawing sheet comprises a portable document format (PDF) document without computer aided design (CAD) or building information model (BIM) context;
(2) the current drawing sheet comprises multiple symbol instances of a symbol, wherein the multiple symbol instances comprise graphic symbols on the current drawing sheet;
(3) the multiple symbol instances each represent an object instance of the object;

(iv) selecting a graphic region in the current drawing sheet, wherein the graphic region contains one of the multiple symbol instances;
(v) creating a markup on the current drawing sheet based on the selected graphic region;
(vi) autonomously detecting the multiple symbol instances based on the selected graphic region;
(vii) autonomously creating progress tracking markup instances of the markup for the multiple symbol instances detected, wherein each progress tracking markup instance is linked to the object type; and
(viii) visually tracking the progress of the object instances using graphical user interface (GUI) visualizations, wherein the GUI visualizations provide a visual representation of the progression via the progress tracking markup instances.

12 . The computer-implemented system of claim 11 , wherein the selecting the graphic region comprises drawing a bounding box around the symbol.

13 . The computer-implemented system of claim 11 , wherein the creating the markup comprises specifying a shape and size for the markup.

14 . The computer-implemented system of claim 11 , further comprising:
accepting user input correcting the progress tracking markup instances.

15 . The computer-implemented system of claim 14 , wherein the autonomously detecting comprises:
maintaining a machine learning (ML) model, wherein:
the ML model models symbols previously detected on other drawing sheets; and
the ML model is updated based on the user input correcting the progress tracking markup instances; and
applying the ML model based on the selected graphic region to detect the multiple symbol instances in the current drawing sheet.

16 . The computer-implemented system of claim 14 , wherein the correcting removes one or more of the progress tracking markup instances.

17 . The computer-implemented system of claim 11 , wherein the GUI visualizations graphically differentiate the progress tracking markup instances based on a current activity type associated with each progress tracking markup instance.

18 . The computer-implemented system of claim 11 , wherein the GUI visualizations comprises a dashboard visualizing the progression over time.

19 . The computer-implemented system of claim 11 , wherein the GUI visualizations comprises a dashboard visualizing a total sum of the activity types that have been completed for each object type.

20 . The computer-implemented system of claim 11 , wherein the GUI visualizations provide a unique color for each activity type.

Assignees

• Autodesk Inc

Inventors

• Xu Xin
• Garland Graham
• Wang James
• Wolnewitz Cory
• Laffitte Christine
• Huang Alexander
• Shalimov Nikita
• Moores Nicholas
• Soe Brian Suwan
• Rajagopal Anand
• Nayini Arjun
• Raju Sanjay Penumetsa
• Lin Jeffrey
• Bryan Joseph Michael
• Arantes Paulo Rodrigues Espeschite

Classifications

• G06T11/26

  Drawing of charts or graphs · CPC title

• G06F30/27

  using machine learning, e.g. artificial intelligence, neural networks, support vector machines [SVM] or training a model · CPC title

• G06F2111/12

  Symbolic schematics · CPC title

• G06F30/12

  characterised by design entry means specially adapted for CAD, e.g. graphical user interfaces [GUI] specially adapted for CAD · CPC title

• G06Q50/08

  Construction · CPC title