Visualizing relationships between data elements

Patent metadata

Field	Value
Publication number	US-10860635-B2
Application number	US-201715694192-A
Country	US
Kind code	B2
Filing date	Sep 1, 2017
Priority date	Dec 2, 2008
Publication date	Dec 8, 2020
Grant date	Dec 8, 2020

Abstract

In general, a specification of multiple contexts that are related according to a hierarchy is received. Relationships are determined among three or more metadata objects, and at least some of the metadata objects are grouped into one or more respective groups. Each of at least some of the groups is based on a selected one of the contexts and is represented by a node in a diagram. Relationships among the nodes are determined based on the relationships among the metadata objects in the groups represented by the nodes, and a visual representation is generated of the diagram including the nodes and the relationships among the nodes.

First claim

What is claimed is:

1. A method including:
receiving, by a data processing system, a specification of multiple contexts that are related according to a hierarchy, the multiple contexts including a first context and a second context;
determining, by the data processing system, relationships among three or more metadata objects, in which at least some of the three or more metadata objects represent data elements and at least some of the three or more metadata objects represent transformations of data provided by the data elements,
wherein, for a given metadata object of the three or more metadata objects, the determined relationships among the three or more metadata objects include one or more of:
relationships between the given metadata object and one or more of the three or more metadata objects on which the given metadata object depends, and
relationships between the given metadata object and one or more of the three or more metadata objects that depend on the given metadata object;

grouping, by the data processing system, at least some of the three or more metadata objects into multiple groups, at least two groups being associated with different contexts among the multiple contexts;
presenting, via a graphical user interface (GUI) generated by the data processing system, the at least some of the three or more metadata objects grouped into the multiple groups by a diagram having nodes, each node representing a respective metadata object in the three or more metadata objects or a group of metadata objects from among the three or more metadata objects;
determining, by the data processing system, relationships among the nodes based on the relationships among the three or more metadata objects or the groups of metadata objects;
determining, by the data processing system, groupings of the nodes based on the groupings of the three or more metadata objects;
receiving, via the graphical user interface, a first user input indicating a user-selected node for which to determine data lineage;
receiving a second user input indicating a user-selected context from among the multiple contexts;
in response to the first and second user inputs, generating, by the data processing system, a visual representation of the diagram including the nodes and the relationships among the nodes, the visual representation of the diagram including:
a first group of one or more nodes representing one or more data elements, the first group including the user-selected node being associated with the first context in the received specification,
a second group of one or more nodes representing one or more transformations of data, the second group being associated with the second context in the received specification,
a first GUI container element surrounding the first group of one or more nodes, and
a second GUI container element surrounding the second group of one or more nodes,

wherein the user-selected node is shown at a level of resolution associated with the first context; and
wherein at least some of the nodes in the visual representation are shown at a level of resolution associated with the user-selected context, the user-selected context being different from the first context; and
presenting the generated visual representation of the diagram via the graphical user interface.

2. The method of claim 1 , further comprising:
receiving, via the graphical user interface, a third user input indicating that a node in the lineage diagram is to be expanded or collapsed.

3. The method of claim 1 , further comprising:
receiving a third user input selecting a custom expansion, and
modifying the visual representation of the data lineage diagram to show at least some of the nodes not containing the user-selected node at one or more levels of resolution in accordance with the custom expansion.

4. The method of claim 3 in which the custom expansion specifies that a node that represents an ultimate source of data without upstream systems is expanded.

5. The method of claim 3 in which the modifying is based on specific flags that are set on data elements.

6. The method of claim 1 wherein the data elements are grouped in contexts including data sets, applications, or systems.

7. The method of claim 1 wherein the transformations of data are grouped in contexts including executables, applications, or systems.

8. The method of claim 1 wherein nodes meeting a preselected condition are filtered out of the visual representation.

9. A system, comprising:
at least one computer;
at least one computer readable storage medium storing one or more computer programs that, when executed by the at least one computer, cause the at least one computer to perform:
receiving a specification of multiple contexts that are related according to a hierarchy, the multiple contexts including a first context and a second context;
determining relationships among three or more metadata objects, in which at least some of the three or more metadata objects represent data elements and at least some of the three or more metadata objects represent transformations of data provided by the data elements, wherein, for a given metadata object of the three or more metadata objects, the determined relationships among the three or more metadata objects include one or more of:
relationships between the given metadata object and one or more of the three or more metadata objects on which the given metadata object depends, and
relationships between the given metadata object and one or more of the three or more metadata objects that depend on the given metadata object;

grouping at least some of the three or more metadata objects into multiple groups, at least two groups being associated with different contexts among the multiple contexts;
presenting, via a graphical user interface, the at least some of the three or more metadata objects grouped into the multiple groups by a diagram having nodes, each node representing a respective metadata object in the three or more metadata objects or a group of metadata objects from among the three or more metadata objects;
determining relationships among the nodes based on the relationships among the three or more metadata objects or the groups of metadata objects;
determining groupings of the nodes based on the groupings of the three or more metadata objects;
receiving, via the graphical user interface, a first user input indicating a user-selected node for which to determine data lineage;
receiving a second user input indicating a user-selected context from among the multiple contexts;
in response to the first and second user inputs, generating a visual representation of the diagram including the nodes and the relationships among the nodes, the visual representation of the diagram including:
a first group of one or more nodes representing one or more data elements, the first group including the user-selected node being associated with the first context in the received specification, and
a second group of one or more nodes representing one or more transformations of data, the second group being associated with the second context in the received specification,
a first GUI container element surrounding the first group of one or more nodes, and
a second GUI container element surrounding the second group of one or more nodes,

wherein the user-selected node is shown at a level of resolution associated with the first context; and
wherein at least some of the nodes in the visual representation are shown at a level of resolution associated with the user-selected context, the user-selected context being different from the first context; and
presenting the generated visual representation of the diagram via the graphical user interface.

Assignees

• Ab Initio Technology Llc

Inventors

• Bator Erik
• Gould Joel
• Radivojevic Dusan
• Wakeling Tim

Classifications

• G06F16/40 Primary

  of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) · CPC title

• G06F16/907 Primary

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F16/26 Primary

  Visual data mining; Browsing structured data · CPC title