Techniques for generating customer profiles in a data warehouse

Patent metadata

Field	Value
Publication number	US-12287803-B2
Application number	US-202217971329-A
Country	US
Kind code	B2
Filing date	Oct 21, 2022
Priority date	Oct 21, 2022
Publication date	Apr 29, 2025
Grant date	Apr 29, 2025

Abstract

A data warehouse connector service is described. The data warehouse connector service integrates with an identity resolution system of a customer data platform to systematically communicate identity-resolved customer profile data from the customer data platform to a cloud-based data warehouse. Operation of the data warehouse connector is managed through various configuration settings accessible to an end-user of the customer data platform via a user interface.

First claim

We claim:

1. A system comprising:
one or more computer processors for executing instructions;
one or more memory storage devices, storing instructions thereon, which, when executed by the one or more computer processors, cause the system to perform operations comprising:
processing received data to generate identity-resolved customer profile data, wherein the received data comprises event data and customer identifier data, and the identity-resolved customer profile data comprises i) event data and identifier data to which a system-generated identifier has been assigned, each system-generated identifier representing a customer, and ii) a directed graph indicating when two or more system-generated identifiers represent the same customer; and
processing the identity-resolved customer profile data by:
analyzing the event data to determine a schema for at least one instance of the event data by extracting key attributes from the event data, determining data types for each attribute, and identifying relationships among the attributes based on predefined rules;
storing the determined schema and per-warehouse schema settings in a schema database:
adding a table in a data warehouse to reflect the schema for the at least one instance of the event data by configuring the table with columns corresponding to the key attributes, setting data type constraints based on the determined data types, and establishing relational links among the columns based on the identified relationships; and
writing the identity-resolved customer profile data, including the at least one instance of the event data, to tables of the data warehouse based on the schema stored in the schema database;
wherein the identity-resolved customer profile data is written to and stored at a cloud-based staging bucket, prior to the customer profile data being written to the data warehouse during a scheduled data warehouse synchronization operation.

2. The system of claim 1 , wherein writing the identity-resolved customer profile data to tables of the data warehouse comprises:
writing identity-resolved event data to one of a plurality of event tables, where each event table is for events of a specific event type; and writing identity-resolved identifier data to an identity table.

3. The system of claim 1 , wherein writing the identity-resolved customer profile data to tables of the data warehouse comprises:
writing data to a profile graph table of the data warehouse to reflect that two or more system-generated identifiers represent the same customer.

4. The system of claim 1 , wherein the received data is received via messages communicated over a network to the system via one or more data sources that an end-user of the system has configured via a user interface of the system.

5. The system of claim 1 , wherein writing the identity-resolved customer profile data to tables of the data warehouse further comprises:
writing the identity-resolved customer profile data to one of a plurality of cloud-based data warehouses for which a data warehouse connection service has been configured via a user interface of the system.

6. The system of claim 5 , wherein the data warehouse connection is configurable to write the identity-resolved customer profile data to tables of the data warehouse on one of a plurality of synchronization schedules.

7. The system of claim 1 , further comprising:
receiving status information relating to an operation to write the identity-resolved customer profile data to tables of the data warehouse, the status information including any one or more of:
information indicating state of the operation;
information indicating a number of rows of identity-resolved customer profile data written to a table of the data warehouse; or, information indicating a duration of time that has lapsed in executing the operation.

8. A computer-implemented method comprising: processing received data to generate identity-resolved customer profile data, wherein the received data comprises event data and customer identifier data, and the identity-resolved customer profile data comprises i) event data and identifier data to which a system-generated identifier has been assigned, each system-generated identifier representing a customer, and ii) a directed graph indicating when two or more system-generated identifiers represent the same customer; and
processing the identity-resolved customer profile data by:
analyzing the event data to determine a schema for at least one instance of the event data by extracting key attributes from the event data, determining data types for each attribute, and identifying relationships among the attributes based on predefined rules;
storing the determined schema and per-warehouse schema settings in a schema database;
adding a table in a data warehouse to reflect the schema for the at least one instance of the event data by configuring the table with columns corresponding to the key attributes, setting data type constraints based on the determined data types, and establishing relational links among the columns based on the identified relationships; and
writing the identity-resolved customer profile data, including the at least one instance of the event data, to tables of the data warehouse based on the schema stored in the schema database; wherein the identity-resolved customer profile data is written to and stored at a cloud-based staging bucket, prior to the customer profile data being written to the data warehouse during a scheduled data warehouse synchronization operation.

9. The computer-implemented method of claim 8 , wherein writing the identity-resolved customer profile data to tables of the data warehouse comprises: writing identity-resolved event data to one of a plurality of event tables, where each event table is for events of a specific event type; and writing identity-resolved identifier data to an identity table.

10. The computer-implemented method of claim 8 , wherein writing the identity-resolved customer profile data to tables of the data warehouse comprises: writing data to a profile graph table of the data warehouse to reflect that two or more system-generated identifiers represent the same customer.

11. The computer-implemented method of claim 8 , wherein the received data is received via messages communicated over a network to a system via one or more data sources that an end-user of the system has configured via a user interface of the system.

12. The computer-implemented method of claim 11 , wherein writing the identity-resolved customer profile data to tables of the data warehouse further comprises: writing the identity-resolved customer profile data to one of a plurality of cloud-based data warehouses for which a data warehouse connection service has been configured via a user interface of the system.

13. The computer-implemented method of claim 12 , wherein the data warehouse connection is configurable to write the identity-resolved customer profile data to tables of the data warehouse on one of a plurality of synchronization schedules.

14. The computer-implemented method of claim 8 , further comprising:
receiving status information relating to an operation to write the identity-resolved customer profile data to tables of the data warehouse, the status information including any one or more of:
information indicating state of the operation;
information indicating a number of rows of identity-resolved customer profile data written to a table of the data warehouse; or,
information indicating a duration of time that has lapsed in executing the operation.

15. A system comprising:
means for processing received

Assignees

• Twilio Inc

Inventors

• Mehta Udit
• Pelletier Thomas
• Luster Max
• Taylor Brooks
• Wang Hanhan
• Govindan Ranjith
• Nair Rakesh

Classifications

• G06F16/2282

  Tablespace storage structures; Management thereof · CPC title

• G06F16/9535

  Search customisation based on user profiles and personalisation · CPC title

• G06F16/9035

  Filtering based on additional data, e.g. user or group profiles · CPC title

• G06F16/337

  Profile generation, learning or modification · CPC title

• G06F16/2365

  Ensuring data consistency and integrity · CPC title