Dynamic partitioning techniques for data streams
US-2015134796-A1 · May 14, 2015 · US
US11271995B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-11271995-B2 |
| Application number | US-201916450920-A |
| Country | US |
| Kind code | B2 |
| Filing date | Jun 24, 2019 |
| Priority date | Aug 18, 2015 |
| Publication date | Mar 8, 2022 |
| Grant date | Mar 8, 2022 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
Techniques for partition balancing. Organization identifiers (orgIDs) are acquired for one or more organizations within a multi-organization on-demand services environment having multiple nodes, each of which have one or more partitions. A mapping of the orgIDs to the partitions within the multi-organization on-demand services environment is determined. Resource consumption for the organizations is determined. Resource consumption for the partitions based on the resource consumption of the organization and the mapping of the organization to the partitions is determined. A score for the partitions based on the resource consumption is generated. The partitions are redistributed among the nodes based on the partition scores.
Opening claim text (preview).
What is claimed is: 1. A method comprising: acquiring organization identifiers (orgIDs) for one or more organizations within a multi-organization on-demand services environment having multiple nodes, each of the one or more organizations having at least one partition and being capable of having a plurality of partitions, wherein each organization within the multi-organization on-demand services environment is uniquely identified by a single orgID, and wherein each partition is configured to be associated with multiple organizations of the plurality of organizations; determining a mapping of the orgIDs to the partitions, wherein the mapping is static and is set in association with creation of the orgID; determining organization-level resource consumption for the organizations using log information for the organizations based on the orgIDs corresponding to the organizations; determining partition-level resource consumption for the partitions based on the organization-level resource consumption of the organizations and the mapping of the orgIDs corresponding to the organizations to the partitions; generating a resource consumption score for the partitions based on the determined partition-level resource consumption of the partitions from the log information and non-log information queried from a database; redistributing the partitions among the nodes based on the partition scores. 2. The method of claim 1 wherein the on-demand services environment comprises at least databases organized as nodes that allow multiple computing devices to run database management software simultaneously while accessing a single database instance. 3. The method of claim 1 wherein determining resource consumption for the organizations comprises: loading log record types that have database statistics; and extracting relevant statistical information. 4. The method of claim 3 wherein the statistical information comprises one or more of: processor consumption, bandwidth utilization, memory utilization, physical reads, physical writes, or buffergets. 5. The method of claim 4 wherein a weighting value is applied to at least some of the statistical information. 6. The method of claim 1 wherein determining resource consumption for the partitions based on the resource consumption of the organization and the mapping of the organization to the partitions comprises joining the statistical information with the orgID to partition mapping. 7. A non-transitory computer readable medium having stored thereon instruction that, when executed by one or more processors, cause the one or more processors to: acquire organization identifiers (orgIDs) for one or more organizations within a multi-organization on-demand services environment having multiple nodes, each of the one or more organizations having at least one partition and being capable of having a plurality of partitions, wherein each organization within the multi-organization on-demand services environment is uniquely identified by a single orgID, and wherein each partition is configured to be associated with multiple organizations of the plurality of organizations; determine a mapping of the orgIDs to the partitions, wherein the mapping is static and is set in association with creation of the orgID; determine organization-level resource consumption for the organizations using log information for the organizations based on the orgIDs corresponding to the organizations; determine partition-level resource consumption for the partitions based on the organization-level resource consumption of the organizations and the mapping of the orgIDs corresponding to the organizations to the partitions; generate a resource consumption score for the partitions based on the determined partition-level resource consumption of the partitions from the log information and non-log information queried from a database; redistribute the partitions among the nodes based on the partition scores. 8. The non-transitory computer readable medium of claim 7 wherein the on-demand services environment comprises at least databases organized as nodes that allow multiple computing devices to run database management software simultaneously while accessing a single database instance. 9. The non-transitory computer readable medium of claim 7 wherein determining resource consumption for the organizations comprises: loading log record types that have database statistics; and extracting relevant statistical information. 10. The non-transitory computer readable medium of claim 9 wherein the statistical information comprises one or more of: processor consumption, bandwidth utilization, memory utilization, physical reads, physical writes, or buffergets. 11. The non-transitory computer readable medium of claim 10 wherein a weighting value is applied to at least some of the statistical information. 12. The non-transitory computer readable medium of claim 7 wherein determining resource consumption for the partitions based on the resource consumption of the organization and the mapping of the organization to the partitions comprises joining the statistical information with the orgID to partition mapping. 13. A system comprising: at least one storage device; one or more hardware processors coupled with the at least one storage device, the one or more hardware processors configured to acquire organization identifiers (orgIDs) for one or more organizations within a multi-organization on-demand services environment having multiple nodes, each of the one or more organizations having at least one partition and being capable of having a plurality of partitions, wherein each organization within the multi-organization on-demand services environment is uniquely identified by a single orgID, and wherein each partition is configured to be associated with multiple organizations of the plurality of organizations, to determine a mapping of the orgIDs to the partitions, wherein the mapping is static and is set in association with creation of the orgID, to determine organization-level resource consumption for the organizations using log information for the organizations based on the orgIDs corresponding to the organizations, to determine partition-level resource consumption for the partitions based on the organization-level resource consumption of the organizations and the mapping of the orgIDs corresponding to the organizations to the partitions, to generate a resource consumption score for the partitions based on the determined partition-level resource consumption of the partitions from the log information and non-log information queried from a database, and to redistribute the partitions among the nodes based on the partition scores. 14. The system of claim 13 wherein the on-demand services environment comprises at least databases organized as nodes that allow multiple computing devices to run database management software simultaneously while accessing a single database instance. 15. The system of claim 13 wherein determining resource consumption for the organizations comprises loading log record types that have database statistics, and extracting relevant statistical information. 16. The system of claim 15 wherein the statistical information comprises one or more of: processor consumption, bandwidth utilization, memory utilization, physical reads, physical writes, or buffergets. 17. The system of claim 16 wherein a weighting value is applied to at least some of the statistical information. 18. The system of claim 13 wherein acquiring organization identifiers (orgIDs) for one or more or
Processing captured monitoring data, e.g. for logfile generation · CPC title
characterised by the time relationship between creation and deployment of a service · CPC title
Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities (flow or congestion control using dynamic resource allocation, e.g. in-call renegotiation, H04L47/76) · CPC title
based on parameters of servers, e.g. available memory or workload (monitoring of computer activity G06F11/30) · CPC title
by checking functioning · CPC title
Related publications grouped by family.
Answers are generated from the same data shown on this page.