Template based data reduction for commercial data mining

Patent metadata

Field	Value
Publication number	US-11030157-B2
Application number	US-201815979514-A
Country	US
Kind code	B2
Filing date	May 15, 2018
Priority date	May 18, 2017
Publication date	Jun 8, 2021
Grant date	Jun 8, 2021

Abstract

Systems and methods for mining and compressing commercial data including a network of point of sale devices to log commercial activity data including independent commercial events and corresponding dependent features. A middleware system is in communication with the network of point of sale devices to continuously collect and compress a stream of the commercial activity data and concurrently store the compressed commercial activity data. Compressing the stream includes a file access table corresponding to the commercial activity data, producing compressible file access templates (CFATs) according to frequent patterns of commercial activity data using the file access table, and replacing dependent feature sequences with a matching compressible file access template. A database is in communication with the middleware system to store the compressed commercial data. A commercial pattern analysis system is in communication with the database to determine patterns in commercial activities across the network of point of sale devices.

First claim

What is claimed is:

1. A method for mining commercial data, including:
mining commercial activity data from a network of point of sale devices, the commercial activity data including at least one type of independent commercial event and corresponding dependent features;
continuously collecting and compressing a stream of the commercial activity data from the network of point of sale devices with a middleware system;
concurrently storing in a database compressed commercial activity data corresponding to the commercial activity data of the stream, wherein compressing the stream includes producing compressible file access templates (CFATs) according to frequent patterns of commercial activity data and replacing dependent feature sequences with a matching compressible file access template; and
determining patterns in commercial activities across the network of point of sale devices using a commercial pattern analysis system.

2. The method of claim 1 , wherein compressing the commercial activity data further includes building a frequent pattern tree (FP-Tree) including nodes corresponding to the dependent features according to a frequency of occurrence of the dependent features relative to the independent commercial events.

3. The method of claim 1 , wherein compressing the commercial activity data further includes merging single paths of a FP-Tree corresponding to the event stream into a special not corresponding to dependent features of the commercial activity data.

4. The method of claim 1 , wherein compressing the commercial activity data further includes:
identifying all path combinations in a reduced FP-Tree formed by merging single paths of an FP-Tree corresponding to the commercial activity data into special nodes;
generating the compressible file access template (CFAT) corresponding to each of the path combinations.

5. The method of claim 1 , wherein the independent commercial event includes a consumer identifier corresponding to a consumer purchase.

6. The method of claim 1 , wherein the network of point of sale devices include a plurality of physical point of sale devices located at stores and configured to upload commercial activities to the middleware system.

7. The method of claim 1 , wherein the network of point of sale devices includes ecommerce webpages.

8. The method of claim 1 , wherein the dependent features include items purchased.

Assignees

• Nec Lab America Inc
• Nec Corp

Inventors

• Li Ding
• Jee Kangkook
• Li Zhichun
• Zhang Mu
• Wu Zhenyu

Classifications

• G06F21/6218 Primary

  to a system of files or objects, e.g. local or distributed file system or database · CPC title

• G06F16/1744 Primary

  using compression, e.g. sparse files · CPC title

• G06F18/231

  Hierarchical techniques, i.e. dividing or merging pattern sets so as to obtain a dendrogram · CPC title

• G06F2221/2143

  Clearing memory, e.g. to prevent the data from being stolen · CPC title

• G06F3/0643

  Management of files · CPC title