Visualizing relationships between data elements and graphical representations of data element attributes

Patent metadata

Field	Value
Publication number	US-10191904-B2
Application number	US-201815874800-A
Country	US
Kind code	B2
Filing date	Jan 18, 2018
Priority date	Dec 2, 2008
Publication date	Jan 29, 2019
Grant date	Jan 29, 2019

Abstract

In general, metadata is stored in a data storage system. Summary data identifying one or more characteristics of each of multiple metadata objects stored in the data storage system is computed, and the summary data characterizing a given metadata object in association with the given metadata object is stored. A visual representation is generated of a diagram including nodes representing respective metadata objects and relationships among the nodes. Generating the visual representation includes superimposing a representation of a characteristic identified by the summary data characterizing a given metadata object in proximity to the node representing the given metadata object.

First claim

What is claimed is:

1. A method including:
storing, in a data storage system, a transformation object representing transformation of data and at least two dataset objects representing stored data in datasets;
storing, in a data storage system, data lineage information linking the at least two dataset objects to the transformation object representing transformation of data;
computing summary data for the transformation object, including computing an indication of how recently the transformation object has been updated or modified;
generating a data lineage diagram that includes a visual representation of the data lineage information, in which the data lineage diagram includes at least two data element nodes that represent the at least two dataset objects, a transformation node that represents the transformation object, and directed links between each of the at least two data element nodes that represent a dataset object and the transformation node that represents the transformation object, wherein the directed links represent flows of data between the dataset objects and the transformation object; and
including in the data lineage diagram, a representation of the summary data in proximity to the transformation node that represents the transformation object, in which the transformation node is connected to directed links representing flows of data between the dataset objects and the transformation object, wherein the representation of the summary data includes a representation of the indication of how recently the transformation object has been updated or modified.

2. The method of claim 1 in which the representation of the summary data is associated with a legend that classifies the representation of the summary data.

3. The method of claim 1 in which hovering a cursor over the visual representation generates a window containing information related to the representation of the summary data.

4. The method of claim 1 in which the representation of the summary data represents a characteristic that is selectable by a user.

5. A system including:
means for storing, in a data storage system, a transformation object representing transformation of data and at least two dataset objects representing stored data in datasets;
means for storing, in a data storage system, data lineage information linking the at least two dataset objects to the transformation object representing transformation of data;
means for computing summary data for the transformation object, including computing an indication of how recently the transformation object has been updated or modified;
means for generating a data lineage diagram that includes a visual representation of the data lineage information, in which the data lineage diagram includes at least two data element nodes that represent the at least two dataset objects, a transformation node that represents the transformation object, and directed links between each of the at least two data element nodes that represent a dataset object and the transformation node that represents the transformation object, wherein the directed links represent flows of data between the dataset objects and the transformation object; and
means for including in the data lineage diagram, a representation of the summary data in proximity to the transformation node that represents the transformation object, in which the transformation node is connected to directed links representing flows of data between the dataset objects and the transformation object, wherein the representation of the summary data includes a representation of the indication of how recently the transformation object has been updated or modified.

6. A system for processing data, the system including a computer having one or more processors and at least one data storage system storing instructions that when executed by the computer causes the computer to perform:
storing, in a data storage system, a transformation object representing transformation of data and at least two dataset objects representing stored data in datasets;
storing, in a data storage system, data lineage information linking the at least two dataset objects to the transformation object representing transformation of data;
computing summary data for the transformation object, including computing an indication of how recently the transformation object has been updated or modified;
generating a data lineage diagram that includes a visual representation of the data lineage information, in which the data lineage diagram includes at least two data element nodes that represent the at least two dataset objects, a transformation node that represents the transformation object, and directed links between each of the at least two data element nodes that represent a dataset object and the transformation node that represents the transformation object, wherein the directed links represent flows of data between the dataset objects and the transformation object; and
including in the data lineage diagram, a representation of the summary data in proximity to the transformation node that represents the transformation object, in which the transformation node is connected to directed links representing flows of data between the dataset objects and the transformation object, wherein the representation of the summary data includes a representation of the indication of how recently the transformation object has been updated or modified.

7. The system of claim 6 in which the representation of the summary data is associated with a legend that classifies the representation of the summary data.

8. The system of claim 6 in which hovering a cursor over the visual representation generates a window containing information related to the representation of the summary data.

9. The system of claim 6 in which the representation of the summary data represents a characteristic that is selectable by a user.

10. A computer-readable device storing a computer program, the computer program including executable instructions for causing a computer to:
store, in a data storage system, a transformation object representing transformation of data and at least two dataset objects representing stored data in datasets;
store, in a data storage system, data lineage information linking the at least two dataset objects to the transformation object representing transformation of data;
compute summary data for the transformation object, including computing an indication of how recently the transformation object has been updated or modified;
generate a data lineage diagram that includes a visual representation of the data lineage information, in which the data lineage diagram includes at least two data element nodes that represent the at least two dataset objects, a transformation node that represents the transformation object, and directed links between each of the at least two data element nodes that represent a dataset object and the transformation node that represents the transformation object, wherein the directed links represent flows of data between the dataset objects and the transformation object; and
supplement the data lineage diagram with a representation of the summary data in proximity to the transformation node that represents the transformation object, in which the transformation node is connected to directed links representing flows of data between the dataset objects and the transformation object, wherein the representation of the summary data includes a representation of the indication of how recently the transformation object has been updated or modified.

11. The computer-readable device of claim 10 , wherein the representation of the summary data is associated with a legend that classifies the

Assignees

• Ab Initio Technology Llc

Inventors

• Bator Erik
• Gould Joel
• Radivojevic Dusan

Classifications

• G06F16/40 Primary

  of multimedia data, e.g. slideshows comprising image and additional audio data (retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70) · CPC title

• G06F16/26 Primary

  Visual data mining; Browsing structured data · CPC title

• G06F16/907 Primary

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F17/30017 Primary

  Physics · mapped topic

• G06F17/30572

  Physics · mapped topic