Data classification system for hybrid clouds

Patent metadata

Field	Value
Publication number	US-9953075-B1
Application number	US-201213728490-A
Country	US
Kind code	B1
Filing date	Dec 27, 2012
Priority date	Dec 27, 2012
Publication date	Apr 24, 2018
Grant date	Apr 24, 2018

Abstract

A data classification system is associated with a hybrid cloud comprising at least one private cloud and at least one public cloud. The data classification system comprises a data set classification model classifying data sets, a cloud classification model classifying the private and public clouds of the hybrid cloud, and mapping policies each specifying a particular mapping between one or more classes of the data set classification model and one or more classes of the cloud classification model. The data classification system classifies a received data set using the data set classification model, and determines for the received data set at least one cloud of the hybrid cloud to which the received data set should be directed for further processing based at least in part on a result of the classification of the received data set, the cloud classification model and a selected one of the mapping policies.

First claim

What is claimed is:

1. An apparatus comprising:
a data classification system associated with a hybrid cloud comprising at least one private cloud and at least one public cloud;
the data classification system comprising a data set classification model classifying data sets, a cloud classification model classifying the private and public clouds of the hybrid cloud into two or more different cloud classes, and a plurality of mapping policies each specifying a particular mapping between one or more classes of the data set classification model and one or more classes of the cloud classification model;
wherein the data classification system is configured to classify a received data set using the data set classification model;
wherein the data classification system further comprises a reasoner configured to determine a selected one of the mapping policies for the received data set, the reasoner comprising:
a semantic ontology application programming interface;
a model parser;
a model updater; and
a semantic learner;
wherein the semantic ontology application programming interface provides programming access for adjusting one or more semantic ontologies utilized by the semantic learner;
wherein the model parser extracts information from at least one of the data set classification model and the cloud classification model so as to make said information available to the semantic learner for use in performing one or more reasoning operations;
wherein the model updater adjusts one or more characteristics of at least one of the data set classification model, the cloud classification model and one or more of the mapping policies responsive to feedback from the semantic learner; and
wherein the semantic learner is configured to identify one or more additional relationship types that are not already captured in a current version of at least one of the data set classification model and the cloud classification model and to provide those relationship types to the model updater as part of said feedback;

wherein the data classification system is further configured to determine for the received data set at least one cloud of the hybrid cloud to which the received data set should be directed for further processing based at least in part on a result of the classification of the received data set, the cloud classification model and the selected mapping policy;
wherein the reasoner is further configured to migrate a given data set from a first cloud associated with a first one of the cloud classes to a second cloud associated with a second one of the cloud classes responsive to a change in at least one of the data set classification model, the cloud classification model and one or more of the mapping policies; and
wherein the data classification system is implemented using at least one processing device comprising a processor coupled to a memory.

2. The apparatus of claim 1 wherein the data classification system comprises:
a classifier configured to classify the received data set in accordance with the data set classification model; and
a mapper configured to apply the selected mapping policy for the received data set to determine said at least one cloud to which that received data set should be directed for further processing.

3. The apparatus of claim 1 wherein the data classification system is adapted for coupling between at least one enterprise storage system and the hybrid cloud.

4. The apparatus of claim 3 wherein the data classification system is configured to receive the data set and associated metadata from at least one cloud agent associated with the enterprise storage system.

5. The apparatus of claim 4 wherein the data classification system is further configured to select for the received data set a particular one of the private and public clouds in which the received data set will be stored and to inform the cloud agent regarding its selection for the received data set.

6. The apparatus of claim 2 wherein the classifier in classifying the received data set utilizes metadata associated with the received data set.

7. The apparatus of claim 6 wherein the metadata characterizes at least one of properties of the received data set and relationships between the received data set and one or more other data sets.

8. The apparatus of claim 6 wherein the metadata characterizes the received data set in accordance with at least one specified semantic ontology.

9. The apparatus of claim 1 wherein at least one of the data set classification model, the cloud classification model and the mapping policies are represented at least in part in an RDF format.

10. The apparatus of claim 1 wherein the reasoner is configured to traverse at least one of the data set classification model, the cloud classification model and the mapping policies using one or more SPARQL queries.

11. The apparatus of claim 1 wherein the cloud classification model is based at least in part on designated parameters of the private and public clouds including one or more of auditability, availability, capacity, colocation, cost, performance and security.

12. The apparatus of claim 1 wherein the data set classification model and the cloud classification model are each arranged in the form of a class hierarchy.

13. The apparatus of claim 1 wherein said at least one processing device comprises an element of a processing platform of an information processing system that implements the data classification system and the hybrid cloud.

14. The apparatus of claim 1 wherein the data classification system automatically maps the received data set to an appropriate cloud of the hybrid cloud using the results of the classification of the received data set, the cloud classification model and the selected one of the mapping policies.

15. The apparatus of claim 2 wherein the mapper combines multiple mapping policies to determine said at least one cloud to which the received data set should be directed for further processing.

16. The apparatus of claim 12 wherein the hierarchy for the cloud classification model classifies the hybrid cloud into classes that comprise a private cloud class and a public cloud class.

17. The apparatus of claim 1 wherein:
the data set classification model is configured to classify the received data set based at least in part on relationships between the received data set and one or more other data sets; and
the selected mapping policy for the received data set comprises at least one mapping policy relating to colocation of the received data set with the one or more other data sets based on the relationships between the received data set and the one or more other data sets.

18. The apparatus of claim 1 wherein:
the data set classification model is configured to classify the received data set based at least in part on properties of the received data set; and
the reasoner is configured to modify a data set class of the received data set based on relationships between the received data set and one or more other data sets.

19. A method comprising the steps of:
obtaining a data set classification model classifying data sets and a cloud classification model classifying private and public clouds of a hybrid cloud into two or more different cloud classes;
instantiating a plurality of mapping policies each specifying a particular mapping between one or more classes of the data set classification model and one or more classes of the cloud classification model;
receiving a data set;
classifying the received data set using the data set classification model;
p

Assignees

• Emc Corp
• Emc Ip Holding Co Llc

Inventors

• Reiner David Stephen
• Wan Lintao
• Chen Qiyan
• Wang Tianqing
• Guo Feng Golfen
• Xiang Dong

Classifications

• G06N99/005

  Physics · mapped topic

• G06F17/30598 Primary

  Physics · mapped topic

• G06N5/022

  Knowledge engineering; Knowledge acquisition · CPC title

• G06N20/00

  Machine learning · CPC title

• G06F16/285 Primary

  Clustering or classification · CPC title