Systems and methods for generating dynamic pipeline visualizations

Patent metadata

Field	Value
Publication number	US-11257263-B1
Application number	US-201916598804-A
Country	US
Kind code	B1
Filing date	Oct 10, 2019
Priority date	Oct 23, 2018
Publication date	Feb 22, 2022
Grant date	Feb 22, 2022

Abstract

In some embodiments, a method comprises obtaining a pipeline of operations, the pipeline of operations including a plurality of functions providing any of one or more modification operations or visualization operations for a plurality of datasets. A first dynamic visualization of the pipeline of operations at a first level of granularity is generated. A second dynamic visualization of the pipeline of operations at a second level of granularity is generated in response to user input.

First claim

The invention claimed is:

1. A system comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the system to perform:
obtaining a pipeline of operations associated with datasets, the pipeline of operations comprising nodes connected by edges, each of the nodes including one or more modification operations to be performed on the datasets and the edges indicating spatial distances between the nodes, the spatial distances indicating processing times of the one or more modification operations;
obtaining pipeline schedules, each of the pipeline schedules indicating a time or frequency a respective pipeline associated with the pipeline schedules is to be executed;
generating a first dynamic visualization of the pipeline of operations; and
overlaying visual indicators for three pipeline portions associated with the pipeline schedules on the first dynamic visualization, the visual indicators comprising:
a first visual indicator highlighting a first pipeline portion using a first line having a first line-weight; and
a second visual indicator highlighting a second pipeline portion using a second line having a second line-weight; and
a third visual indicator highlighting a potential pipeline on the first dynamic visualization using a third line having a different characteristic compared to the first line and the second line.

2. The system of claim 1 , wherein the first dynamic visualization of the pipeline of operations comprises a default visualization of the pipeline of operations.

3. The system of claim 1 , wherein the instructions, when executed, further cause the system to perform:
generating, in response to a user input, a second dynamic visualization of the pipeline of operations at a second level of granularity, wherein the second dynamic visualization of the pipeline of operations comprises a zoomed-in view of a portion of the pipeline of operations relative to the first dynamic visualization of the pipeline of operations.

4. The system of claim 3 , wherein the second dynamic visualization of the pipeline includes a representation of at least one dataset not represented in the first dynamic visualization of the pipeline of operations.

5. The system of claim 1 , wherein the instructions, when executed, further cause the system to perform:
generating a third dynamic visualization of the pipeline of operations at a third level of granularity.

6. The system of claim 5 , wherein the third dynamic visualization of the pipeline of operations comprises a zoomed-out view of a portion of the pipeline of operations relative to the second dynamic visualization of the pipeline of operations, and comprises a zoomed-in view of the portion of the pipeline of operations relative to the first dynamic visualization of the pipeline of operations.

7. The system of claim 5 , wherein the third dynamic visualization of the pipeline of operations includes a representation of at least one data set not represented in the first dynamic visualization of the pipeline of operations, and does not include at least one data set represented in the second dynamic visualization of the pipeline of operations.

8. The system of claim 3 , wherein spatial relationships of the spatial distances are maintained between the first and second dynamic visualizations of the pipeline of the operations.

9. The system of claim 1 , wherein the spatial distances between the nodes represent relative processing times of the one or more modification operations.

10. The system of claim 1 , wherein the first dynamic visualization includes:
a third visual indicator highlighting a potential pipeline using a dashed line.

11. The system of claim 1 , wherein the instructions further cause the system to perform:
receiving an indication that an access privilege of an entity associated with the pipeline has changed; and
in response to receiving the indication, modifying the pipeline by changing the spatial distances between the nodes or adjusting the connections between the nodes based on the change in the access privilege.

12. A method being implemented by a computing system including one or more physical processors and a storage media storing machine-readable instructions, the method comprising:
obtaining a pipeline of operations associated with datasets, the pipeline of operations comprising nodes connected by edges, each of the nodes including one or more modification operations to be performed on the datasets and the edges indicating spatial distances between the nodes, the spatial distances indicating processing times of the one or more modification operations;
obtaining pipeline schedules, each of the pipeline schedules indicating a time or frequency a respective pipeline associated with the pipeline schedules is to be executed;
generating a first dynamic visualization of the pipeline of operations; and
overlaying visual indicators for three pipeline portions associated with the pipeline schedules on the first dynamic visualization, the visual indicators comprising:
a first visual indicator highlighting a first pipeline portion using a first line having a first line-weight; and
a second visual indicator highlighting a second pipeline portion using a second line having a second line-weight; and
a third visual indicator highlighting a potential pipeline on the first dynamic visualization using a third line having a different characteristic compared to the first line and the second line.

13. The method of claim 12 , wherein the first dynamic visualization of the pipeline of operations comprises a default visualization of the pipeline of operations.

14. The method of claim 12 , further comprising:
generating, in response to a user input, a second dynamic visualization of the pipeline of operations at a second level of granularity, wherein the second dynamic visualization of the pipeline of operations comprises a zoomed-in view of a portion of the pipeline of operations relative to the first dynamic visualization of the pipeline of operations.

15. The method of claim 14 , wherein the second dynamic visualization of the pipeline includes a representation of at least one dataset not represented in the first dynamic visualization of the pipeline of operations.

16. The method of claim 15 , further comprising generating a third dynamic visualization of the pipeline of operations, the third dynamic visualization comprising a zoomed-out view of a portion of the pipeline of operations relative to the second dynamic visualization of the pipeline of operations, and comprises a zoomed-in view of the portion of the pipeline of operations relative to the first dynamic visualization of the pipeline of operations.

17. The method of claim 16 , wherein the third dynamic visualization of the pipeline of operations includes a representation of at least one data set not represented in the first dynamic visualization of the pipeline of operations, and does not include at least one data set represented in the second dynamic visualization of the pipeline of operations.

18. The method of claim 14 , wherein spatial relationships of the spatial distances are maintained between the first and second dynamic visualizations of the pipeline of the operations.

19. The method of claim 12 , wherein the spatial distances between operations nodes represent relative processing times of the one or more modification operations.

20. A non-transitory memory storing machine-readable instructions that, when executed by one or more p

Assignees

• Palantir Technologies Inc

Inventors

• Al Khafaji Salar
• Thompson James
• Hashim Joseph
• Rafidi Joseph
• Menon Parvathy
• Szmucer Patrick
• Kruszewski Robert
• Mucha Slawomir
• Uhlenkamp Tyler
• Ioo Vilmos

Classifications

• G06T11/26 Primary

  Drawing of charts or graphs · CPC title

• G06T3/40

  Scaling of whole images or parts thereof, e.g. expanding or contracting · CPC title

• G06T11/206 Primary

  Physics · mapped topic