Configurable metadata-based automation and content classification architecture for cloud-based collaboration platforms

Patent metadata

Field	Value
Publication number	US-11146600-B2
Application number	US-202016883645-A
Country	US
Kind code	B2
Filing date	May 26, 2020
Priority date	Aug 29, 2014
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

Scalable architectures, systems, and services are provided herein for generating jobs by applying user-specified metadata rules to metadata events. More specifically, the scalable architecture described herein uses metadata to drive automations and/or polices in a cloud-based environment. In one embodiment, the architecture integrates a metadata service with an event-based automation engine to automatically trigger polices and/or automations based on metadata and/or changes in metadata changes. The metadata service can include customizable and/or pre-build metadata templates which can be used to automatically apply a metadata framework (e.g., particular fields) to files based on, for example, the upload or placement of a particular file in a particular folder. The architecture also provides for advanced metadata searching and data classification.

First claim

What is claimed is:

1. A method for processing a metadata event in a collaborative cloud-based environment, the method comprising:
monitoring, by a server of the collaborative cloud-based environment, metadata associated with each of a plurality of work items in a work space of the collaborative cloud-based environment;
detecting, by the server of the collaborative cloud-based environment, a change in the metadata associated with a particular work item in the collaborative cloud-based environment based on the monitoring of metadata associated with each of the plurality of work items, the change in the metadata resulting from an action performed on the particular work item by a collaborator of the collaborative cloud-based environment;
generating, by the server of the collaborative cloud-based environment, a workflow comprising a plurality of jobs and including a set of parameters describing work to be executed in the collaborative cloud-based environment by each job with respect to the particular work item based on the detected change in the metadata associated with the particular work item; and
distributing, by the server of the collaborative cloud-based environment, each job of the generated workflow into a particular job queue to be processed by one or more worker machines in a distributed computing cluster associated with the collaborative cloud-based environment, the particular job queue comprising one of a plurality of job queues.

2. The method of claim 1 , further comprising selecting, by the server of the collaborative cloud-based environment, the particular job queue based on a type of each job of the plurality of jobs in the generated workflow, wherein the jobs of the generated workflow comprise a plurality of different types of jobs.

3. The method of claim 2 , wherein the particular job queue is designated for jobs of a particular job type, and wherein the particular job queue is serviced by one or more worker machines configured to process the particular job type.

4. The method of claim 1 , wherein each job is performed by the one or more worker machines processing the job.

5. The method of claim 1 , further comprising injecting, by the server of the collaborative cloud-based environment, callback information into one or more jobs of the generated workflow prior to distributing the job into the particular job queue, the callback information configured to cause a worker machine to transmit notifications to the job manager system while processing the job.

6. The method of claim 1 , further comprising injecting, by the server of the collaborative cloud-based environment, a token into one or more jobs of the workflow before distributing the jobs to the particular job queue, wherein the token is used by the one or more worker machines when processing the job and follows any additional job requests initiated by the one or more worker machines, and wherein additional job requests received by the job manager system are not generated into jobs or distributed to job queues if the token has been received by the job manager more than a threshold number of times.

7. A system comprising:
a processor; and
a memory coupled with and readable by the processor and storing therein a set of instructions which, when executed by the processor, causes the processor to process a metadata event in a collaborative cloud-based environment by:
monitoring metadata associated with each of a plurality of work items in a work space of the collaborative cloud-based environment;
detecting a change in the metadata associated with a particular work item in the collaborative cloud-based environment based on the monitoring of metadata associated with each of the plurality of work items, the change in the metadata resulting from an action performed on the particular work item by a collaborator of the collaborative cloud-based environment;
generating a workflow comprising a plurality of jobs and including a set of parameters describing work to be executed in the collaborative cloud-based environment by each job with respect to the particular work item based on the detected change in the metadata associated with the particular work item; and
distributing each job of the generated workflow into a particular job queue to be processed by one or more worker machines in a distributed computing cluster associated with the collaborative cloud-based environment, the particular job queue comprising one of a plurality of job queues.

8. The system of claim 7 , wherein the instructions further cause the processor to select the particular job queue based on a type of each job of the plurality of jobs in the generated workflow, wherein the jobs of the generated workflow comprise a plurality of different types of jobs.

9. The system of claim 8 , wherein the particular job queue is designated for jobs of a particular job type, and wherein the particular job queue is serviced by one or more worker machines configured to process the particular job type.

10. The system of claim 7 , wherein the one or more worker machines perform processing of each job.

11. The system of claim 7 , the instructions further cause the processor to inject callback information into one or more jobs of the generated workflow prior to distributing the job into the particular job queue, the callback information configured to cause a worker machine to transmit notifications to the job manager system while processing the job.

12. The system of claim 7 , the instructions further cause the processor to inject a token into one or more jobs of the workflow before distributing the jobs to the particular job queue, wherein the token is used by the one or more worker machines when processing the job and follows any additional job requests initiated by the one or more worker machines, and wherein additional job requests received by the job manager system are not generated into jobs or distributed to job queues if the token has been received by the job manager more than a threshold number of times.

13. A non-transitory, computer-readable medium comprising a set of instructions stored therein which, when executed by a processor, causes the processor to process a metadata event in a collaborative cloud-based environment by:
monitoring metadata associated with each of a plurality of work items in a work space of the collaborative cloud-based environment;
detecting a change in the metadata associated with a particular work item in the collaborative cloud-based environment based on the monitoring of metadata associated with each of the plurality of work items, the change in the metadata resulting from an action performed on the particular work item by a collaborator of the collaborative cloud-based environment;
generating a workflow comprising a plurality of jobs and including a set of parameters describing work to be executed in the collaborative cloud-based environment by each job with respect to the particular work item based on the detected change in the metadata associated with the particular work item; and
distributing each job of the generated workflow into a particular job queue to be processed by one or more worker machines in a distributed computing cluster associated with the collaborative cloud-based environment, the particular job queue comprising one of a plurality of job queues.

14. The non-transitory, computer-readable medium of claim 13 , wherein the instructions further cause the processor to select the particular job queue based on a type of each job of the plurality of jobs in the generated workflow, wherein the jobs of the generated workflow comprise a plurality of different types of jobs.

Assignees

• Box Inc

Inventors

• Pearl Annie
• Huamonte James
• Tran Brian
• Low Tiffany
• Masse Pierre-Alexandre
• Blosser Ted

Classifications

• G06F16/11

  File system administration, e.g. details of archiving or snapshots (error detection or correction of the data by redundancy in operations G06F11/14) · CPC title

• G06F16/14

  Details of searching files based on file metadata · CPC title

• H04L65/403 Primary

  Arrangements for multi-party communication, e.g. for conferences (data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15) · CPC title

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• H04W4/02

  Services making use of location information · CPC title