Data dictionary metadata for marketplace listings

Patent metadata

Field	Value
Publication number	US-2024256501-A1
Application number	US-202418635637-A
Country	US
Kind code	A1
Filing date	Apr 15, 2024
Priority date	Sep 30, 2022
Publication date	Aug 1, 2024
Grant date	—

Abstract

A data dictionary generation system automatically populates and updates a data dictionary for listings offering shared data. A data dictionary includes metadata describing the shared data, including the individual objects, such as the individual tables, schemas, views, and functions. The shared data and each individual data object may be described in the data dictionary by a set of data fields that corresponds to the shared dataset or the object type of the individual object. The data dictionary can be presented to data consumers along with the description of the listing to provide data consumers with a comprehensive description of the shared data provided by a listing, including a high-level summary of the shared data and description of each individual object included in the shared data. The data dictionary allows data consumers to understand the contents of the shared data and how to use the shared data.

First claim

What is claimed is:

1 . A method comprising:
storing, by one or more processors, permissions that grant access to a first data object; periodically scanning a listing offering to detect a change to the permissions associated with the first data object, the listing being visible across a plurality of regions associated with a plurality of data exchanges; and changing, at a particular time, visibility of the listing for an individual region of the plurality of regions, a first consumer of the listing being a member of an individual data exchange of the plurality of data exchanges associated with the individual region at the particular time, and a second consumer of the listing being a new member of the individual data exchange after the particular time, the first consumer being able to resolve the listing in response to changing the visibility while the second consumer is unable to resolve the listing.

2 . The method of claim 1 , further comprising:
accessing a listing offering shared data through a data marketplace, the shared data including the first data object; presenting a user interface comprising a plurality of user interface elements for configuring generation of a data dictionary, the plurality of user interface elements comprising one or more custom data fields; and receiving input that selects a set of data fields of the first data object to include in the listing based on the plurality of user interface elements of the user interface.

3 . The method of claim 2 , further comprising:
detecting a modification to the shared data offered by the listing; generating an updated data dictionary for the listing; and in response to receiving a subsequent request to view the listing, causing presentation of an updated description of the listing based on the updated data dictionary.

4 . The method of claim 3 , wherein generating the updated data dictionary for the listing comprises:
generating metadata describing a new data object added to the shared data provided by the listing, wherein the updated description of the listing includes the metadata describing the new data object.

5 . The method of claim 1 , further comprising:
generating metadata describing a set of data objects included in shared data offered by a listing, the metadata describing the set of data objects includes a set of values indicating a number of data objects in the set of data objects that are in each of a set of distinct data object types.

6 . The method of claim 5 , wherein the set of distinct data object types includes at least one of a data table, a data schema, a data view, a function, and a stored procedure.

7 . The method of claim 1 , wherein the first data object is a data table and metadata describing the first data object includes at least one of a table name assigned to the data table, a description of the data table, a size of the data table, a number of rows included in the data table, and a number of columns included in the data table.

8 . The method of claim 7 , wherein the metadata describing the first data object further includes metadata describing each column in the data table, the metadata describing each column in the data table including at least one of a name assigned to the column, a description of the column, a data type of values stored in the column, an example value stored in the column, a range of the values stored in the column, and a frequency of the values stored in the column.

9 . The method of claim 1 , wherein the first data object is a function or a stored procedure and metadata describing the first data object includes at least one of a name assigned to the function or stored procedure, a description of the function or stored procedure, parameter names included in the function or stored procedure, and parameter types used by the function or stored procedure.

10 . The method of claim 1 , further comprising:
prioritizing presentation of metadata describing a set of featured data selected by a data provider associated with a listing for the first data object.

11 . A system comprising:
one or more computer processors; and one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the system to perform operations comprising: storing permissions that grant access to a first data object; periodically scanning a listing offering to detect a change to the permissions associated with the first data object, the listing being visible across a plurality of regions associated with a plurality of data exchanges; and changing, at a particular time, visibility of the listing for an individual region of the plurality of regions, a first consumer of the listing being a member of an individual data exchange of the plurality of data exchanges associated with the individual region at the particular time, and a second consumer of the listing being a new member of the individual data exchange after the particular time, the first consumer being able to resolve the listing in response to changing the visibility while the second consumer is unable to resolve the listing.

12 . The system of claim 11 , the operations further comprising:
detecting a modification to a shared data offered by a listing for the first data object; generating an updated data dictionary for the listing; and in response to receiving a subsequent request to view the listing, causing presentation of an updated description of the listing based on the updated data dictionary.

13 . The system of claim 12 , wherein the listing describes what the first data object is about and includes usage of the first data object.

14 . The system of claim 11 , the operations comprising:
generating metadata describing a set of data objects included in a shared data offered by a listing for the first data object, the metadata describing the set of data objects includes a set of values indicating a number of data objects in the set of data objects that are in each of a set of distinct data object types, wherein a description of the listing also includes the metadata describing the set of data objects.

15 . The system of claim 11 , wherein a data dictionary comprises a set of fields describing the listing including a quantity of schemas of the first data object and stored procedures included in the first data object.

16 . The system of claim 11 , wherein a data dictionary comprises one or more fields specifying a quantity of rows and quantity of columns of the first data object, wherein the operations further comprise counting a number of columns in the first data object to store the quantity of columns in the one or more fields of the data dictionary.

17 . The system of claim 11 , wherein metadata describing the first data object includes metadata describing each column in a data table, the metadata describing each column in the data table including at least one of a name assigned to the column, a description of the column, a data type of values stored in the column, an example value stored in the column, a range of the values stored in the column, and a frequency of the values stored in the column.

18 . The system of claim 11 , wherein the first data object is a function or a stored procedure and metadata describing the first data object includes at least one of a name assigned to the function or stored procedure, a description of the function or stored procedure, parameter names included in the function or stored procedure, and parameter types used by the function or stored procedure.

Assignees

• Snowflake Inc

Inventors

• Arikatla Durga Mahesh
• Chao Robert K
• He Li
• Lam Joyce
• Liu Xinyue
• Muralidhar Subramanian
• Paladugu Vishnu Dutt
• Pulatova Shakhina
• Stillman Stephanie
• Wen Xin
• Wu Di
• Xu Ziqi

Classifications

• G06F16/213 Primary

  with details for schema evolution support · CPC title