Bulk data processing system

Patent metadata

Field	Value
Publication number	US-12193113-B2
Application number	US-202217952842-A
Country	US
Kind code	B2
Filing date	Sep 26, 2022
Priority date	Feb 26, 2019
Publication date	Jan 7, 2025
Grant date	Jan 7, 2025

Abstract

The system allows real time collection and processing of massive data from many network elements. It has an elastic architecture that scales horizontally to support different network sizes. The system in a uniform data format for downstream consumption. It employs a pub/sub data distribution mechanism that supports multiple concurrent downstream subscribers efficiently in real-time.

First claim

The invention claimed is:

1. A method comprising:
partitioning, by a processing system including a processor, data into chunks, wherein the chunks are based on a cell identifier, the partitioning resulting in partitioned data;
publishing, by the processing system, the partitioned data in a standardized format in a first topic;
responsive to publishing the partitioned data in the standardized format in the first topic, obtaining, by the processing system, the partitioned data in the standardized format in a second topic; and
publishing, by the processing system, the partitioned data in the standardized format to a subscriber of the second topic.

2. The method of claim 1 , further comprising:
transforming, by the processing system, the data into the standardized format based on a type of the data, wherein the publishing of the partitioned data in the standardized format in the first topic is based on the transforming.

3. The method of claim 2 , further comprising:
determining, by the processing system, the type of the data from a network device.

4. The method of claim 1 , further comprising:
obtaining, by the processing system, the data from a network device.

5. The method of claim 4 , wherein the network device is a Mobility Management Entity.

6. The method of claim 4 , wherein the network device is a base station.

7. The method of claim 4 , wherein the network device is a mobile device.

8. The method of claim 4 , wherein the data is streamed from the network device.

9. The method of claim 1 , further comprising:
obtaining, by the processing system, the data using a collection layer that comprises a plurality of collector devices that decodes the data into the standardized format from a vendor format.

10. The method of claim 1 , further comprising:
obtaining, by the processing system, the data using a messaging layer, wherein the messaging layer partitions the data in the standardized format into the first topic, and wherein the first topic is based on an International Mobile Subscriber Identity.

11. The method of claim 1 , further comprising:
publishing, by the processing system, the partitioned data in the standardized format to a subscriber of the first topic.

12. A system comprising:
one or more processors; and
memory coupled with the one or more processors, the memory storing executable instructions that when executed by the one or more processors cause the one or more processors to effectuate operations, the operations comprising:
transforming data obtained from a wireless network into a standardized format;
partitioning the data into chunks, wherein the chunks are based on a cell identifier, the partitioning resulting in partitioned data;
publishing the partitioned data in the standardized format in a first topic;
responsive to publishing the partitioned data in the standardized format in the first topic, obtaining the partitioned data in the standardized format in a second topic; and
publishing the partitioned data in the standardized format to a subscriber of the second topic.

13. The system of claim 12 , wherein the operations further comprise:
obtaining the data from a network device coupled to the wireless network.

14. The system of claim 13 , wherein the network device is a Mobility Management Entity.

15. The system of claim 13 , wherein the network device is a base station.

16. The system of claim 13 , wherein the network device is a mobile device.

17. The system of claim 12 , wherein the data is streamed.

18. The system of claim 12 , wherein the transforming comprises using a collection layer that comprises a plurality of collector devices that decodes the data into the standardized format from a vendor format.

19. A tangible computer readable storage medium storing computer executable instructions that when executed by a processing system including a processor cause said processing system to effectuate operations, the operations comprising:
determining a type of obtained data;
based on the determining, transforming the obtained data into a standardized format;
partitioning the obtained data into chunks, resulting in partitioned data;
publishing the partitioned data in the standardized format in a first topic;
responsive to publishing the partitioned data in the standardized format in the first topic, obtaining the partitioned data in the standardized format in a second topic; and
publishing the partitioned data in the standardized format to a subscriber of the second topic.

20. The tangible computer readable storage medium of claim 19 , wherein the operations further comprise:
obtaining the obtained data from a network device that includes a base station.

Assignees

• At & T Ip I Lp

Inventors

• Chen Letian
• Jiang Baofeng
• Du Christopher
• Lim Yew-Aik

Classifications

• H04L2101/654

  International mobile subscriber identity [IMSI] numbers · CPC title

• H04L67/55

  Push-based network services · CPC title

• H04W8/186

  Processing of subscriber group data · CPC title

• H04W8/08

  Mobility data transfer · CPC title

• H04L67/565

  Conversion or adaptation of application format or content (adding application control or application functional data H04L67/561) · CPC title