Decentralized data platform

Patent metadata

Field	Value
Publication number	US-2024111580-A1
Application number	US-202318540394-A
Country	US
Kind code	A1
Filing date	Dec 14, 2023
Priority date	Jun 22, 2021
Publication date	Apr 4, 2024
Grant date	—

Abstract

Data from data sources may be processed at an edge device. The edge device may generate a local processing result, filter the data, and/or prioritize the data. Accordingly, data is transmitted from the edge device to the data platform, where it may be processed further. For example, a local processing result may be processed at the data platform, such that processing is performed without all of the data source data. In examples, at least a part of such data may remain at an edge device. The edge device may maintain a manifest of data stored by the edge device. The data platform may generate an aggregated manifest using manifests from associated edge devices, such that it may be determined where data is stored. As a result, the data platform may redirect requests to an associated edge device when it is determined that requested data is remote from the data platform.

First claim

1 - 20 . (canceled)

21 . A system comprising:
at least one processor; and memory storing instructions that, when executed by the at least one processor, causes the system to perform a set of operations, the set of operations comprising:
processing data from a data source to generate:
a first local processing result having a first priority; and
a second local processing result having a second priority, wherein the second priority is lower than the first priority;

generating a manifest indicating an association between the system and a part of the data that corresponds to the second local processing result;
providing, to a data platform, the first local processing result and the manifest; and
retaining the second processing result at the system as a result of the second priority being lower than the first priority.

22 . The system of claim 21 , wherein providing the first local processing result further comprises providing at least a part of the data that corresponds to the first local processing result.

23 . The system of claim 21 , wherein the set of operations further comprises:
identifying a change in computing resource availability; and in response to identifying the change, providing, to the data platform, the second local processing result and an updated manifest that omits the association between the system and the part of the data that corresponds to the second local processing result.

24 . The system of claim 23 , wherein providing the second local processing result further comprises providing at least a part of the data that corresponds to the second local processing result.

25 . The system of claim 21 , wherein the set of operations further comprises:
receiving, from a computing device, a request for data; identifying, using the manifest, response data associated with the request for data; and providing, in response to the request for data, the identified response data.

26 . The system of claim 21 , wherein the set of operations further comprises:
receiving, from the data platform, a platform processing result; and updating the manifest to indicate an association between the system and the platform processing result.

27 . The system of claim 26 , wherein the platform processing result is associated with one or more of a local processing result or data of another edge device.

28 . A method for processing data from a data source at an edge device, the method comprising:
obtaining data from a data source; identifying, within the data, a first group of data having a first priority and a second group of data having a second priority, wherein the second priority is lower than the first priority; providing, to a data platform, the first group of data and a manifest indicating an association between the edge device and the second group of data; and retaining the second group of data at the edge device as a result of identifying a first level of computing resource availability.

29 . The method of claim 28 , wherein providing the first group of data further comprises providing a local processing result corresponding to the first group of data.

30 . The method of claim 28 , further comprising:
identifying a second level of computing resource availability different than the first level of computing resource availability; and in response to identifying the second level of computing resource availability, providing, to the data platform, the second group of data and an updated manifest that omits the association between the edge device and the second group of data.

31 . The method of claim 30 , wherein providing the second group of data comprises providing a local processing result corresponding to the second group of data.

32 . The method of claim 28 , further comprising:
receiving, from a computing device, a request for data; identifying, using the manifest, response data associated with the request for data; and providing, in response to the request for data, the identified response data.

33 . The method of claim 28 , further comprising:
receiving, from the data platform, a platform processing result; and updating the manifest to indicate an association between the system and the platform processing result.

34 . A method for processing data from a data source at an edge device, the method comprising:
processing data from a data source to generate:
a first local processing result having a first priority; and
a second local processing result having a second priority, wherein the second priority is lower than the first priority;
generating a manifest indicating an association between the system and a part of the data that corresponds to the second local processing result; providing, to a data platform, the first local processing result and the manifest; and retaining the second processing result at the system as a result of the second priority being lower than the first priority.

35 . The method of claim 34 , wherein providing the first local processing result further comprises providing at least a part of the data that corresponds to the first local processing result.

36 . The method of claim 34 , further comprising:
identifying a change in computing resource availability; and in response to identifying the change, providing, to the data platform, the second local processing result and an updated manifest that omits the association between the system and the part of the data that corresponds to the second local processing result.

37 . The method of claim 36 , wherein providing the second local processing result further comprises providing at least a part of the data that corresponds to the second local processing result.

38 . The method of claim 34 , further comprising:
receiving, from a computing device, a request for data; identifying, using the manifest, response data associated with the request for data; and providing, in response to the request for data, the identified response data.

39 . The method of claim 34 , further comprising:
receiving, from the data platform, a platform processing result; and updating the manifest to indicate an association between the system and the platform processing result.

40 . The method of claim 39 , wherein the platform processing result is associated with one or more of a local processing result or data of another edge device.

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Umay Mehmet Kadri
• Badam Anirudh
• Witte Philipp Andre
• Siddique Imran

Classifications

• G06F9/4881 Primary

  Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues · CPC title

• G06F16/285

  Clustering or classification · CPC title

• G06F21/6218

  to a system of files or objects, e.g. local or distributed file system or database · CPC title

• G06F16/256 Primary

  in federated or virtual databases · CPC title