Platform and software framework for data intensive applications in the cloud

Patent metadata

Field	Value
Publication number	US-9513934-B2
Application number	US-201414266764-A
Country	US
Kind code	B2
Filing date	Apr 30, 2014
Priority date	May 1, 2013
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

A system deploys visualization tools, business analytics software, and big data software in a multi-instance mode on a large, coherent shared memory many-core computing system. The single machine solution provides or high performance and scalability and may be implemented remotely as a large capacity server (i.e., in the cloud) or locally to a user. Most big data software running in a single instance mode has limitations in scalability when running on a many-core and large coherent shared memory system. A configuration and deployment technique using a multi-instance approach, which also includes visualization tools and business analytics software, maximizes system performance and resource utilization, reduces latency and provides scalability as needed, for end-user applications in the cloud.

First claim

What is claimed is:

1. A method for visualizing data, the method comprising:
receiving a query to execute an application program from a user;
identifying that the application program corresponds to program code previously executed for identifying a preferred core-memory ratio for executing the program code on a single multi-core machine after receiving the query to execute the application, wherein:
the core-memory ratio corresponds to a quantity of memory and a number of processor cores,
the previously executed program code corresponds to the application program, and
the program code was executed according to one or more testing protocols for identifying the preferred core-memory ratio;

allocating an amount of memory according to the core-memory ratio, wherein the allocated amount of memory corresponds to the quantity of memory;
allocating one or more processor cores at the single multi-core machine according to the core-memory ratio, wherein the allocated one or more processor cores corresponds to the number of processor cores;
instantiating a plurality of instances of the application program on the single multi-core machine, wherein the instances are executed by a multi-threaded program to ensure that the plurality of instances are started or terminated at least partially simultaneously;
receiving, at the single multi-core machine, data from a database;
performing analytics, via the plurality of application instances, on the received data from the database, wherein the analytics are performed on the single multi-core machine; and
generating instructions for visualization of the received data from the database based on the performed analytics, wherein the generated visualization instructions include generating a graphical interface for the received data to be displayed via a visualization tool, and the received data from the database is displayed for the user to view using the generated visualization instructions.

2. The method of claim 1 , wherein the application instances, the database, and a visualization application are implemented on the single multi-core machine that provides visualization data to a client device over a network.

3. The method of claim 2 , wherein the client device is a smart phone, and the visualization data is displayed through an application residing on the smart phone.

4. The method of claim 1 , wherein the data received from the database occurs only on the single multi-core machine and a transfer of analytic results by the application program to a visualization application occurs only on the single multi-core machine.

5. The method of claim 1 , the method further comprising:
identifying the preferred core-memory ratio for a single instance execution of the application program, wherein the preferred core-memory ratio corresponds to an optimal core-memory ratio;
identifying a number of instances of the application program to deploy in a multi-instance database; and
applying the optimal core-memory ratio to each instance of the identified number of instances.

6. The method of claim 5 , wherein the preferred core-memory ratio is identified based at least in part on CPU usage.

7. The method of claim 1 , further comprising loading data corresponding to each of the plurality of instances of the application program in parallel.

8. The method of claim 1 , wherein the database on the single multi-core machine is a graph database, and the method further comprises:
retrieving a data stream from the graph database; and
populating a template with data from the received data stream.

9. The method of claim 1 , further comprising:
retrieving data from the database in a first format;
adapting the retrieved data to a second format compatible with a visualization interface; and
providing a visualization based on the retrieved data having the second format.

10. A non-transitory computer readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for visualizing data, the method comprising:
receiving a query to execute an application program from a user;
identifying that the application program corresponds to program code previously executed for identifying a preferred core-memory ratio for executing the program code on a single multi-core machine after receiving the query to execute the application, wherein the core-memory ratio corresponds to a quantity of memory and a number of processor cores, the previously executed program code corresponds to the application program, and the program code was executed according to one or more testing protocols for identifying the preferred core-memory ratio;
allocating an amount of memory according to the core-memory ratio, wherein the allocated amount of memory corresponds to the quantity of memory;
allocating one or more processor cores at the single multi-core machine according to the core-memory ratio, wherein the allocated one or more processor cores corresponds to the number of processor cores;
instantiating a plurality of instances of the application program on the single multi-core machine, wherein the instances are executed by a multi-threaded program to ensure that the plurality of instances are started or terminated at least partially simultaneously;
receiving, at the single multi-core machine, data from a database;
performing analytics, via the plurality of application instances, on the received data from the database, wherein the analytics are performed on the single multi-core machine; and
generating instructions for visualization of the received data from the database based on the performed analytics, wherein the generated visualization instructions include generating a graphical interface for the received data to be displayed via a visualization tool, and the received data from the database is displayed for the user to view using the generated visualization instructions.

11. The non-transitory computer readable storage medium of claim 10 , wherein the application instances, the database, and a visualization application are implemented on the single multi-core machine that provides visualization data to a client device over a network.

12. The non-transitory computer readable storage medium of claim 11 , wherein the client device is a smart phone, and the visualization data is displayed through an application residing on the smart phone.

13. The non-transitory computer readable storage medium of claim 10 , wherein the data received from the database occurs only on the single multi-core machine and a transfer of analytic results by the application program to a visualization application occurs only on the single multi-core machine.

14. The non-transitory computer readable storage medium of claim 10 , the program being further executable to perform a method to:
identify the preferred core-memory ratio for a single instance execution of the application program, wherein the preferred core-memory ratio corresponds to an optimal core-memory ratio;
identify a number of instances of the application program to deploy in a multi-instance database; and
apply the optimal core-memory ratio to each instance of the identified number of instances.

15. The non-transitory computer readable storage medium of claim 14 , wherein the preferred core-memory ratio is identified based at least in part on CPU usage.

16. The non-transitory computer readable storage medium of claim 10 , the program being further executable to perform a method to load data corresponding to each of the plurality of instances of the application program in parallel.

17. T

Assignees

• Silicon Graphics Int Corp

Inventors

• Sarkar Sanhita

Classifications

• G06F16/258

  Data format conversion from or to a database · CPC title

• H04L43/50

  Testing arrangements · CPC title

• G06F9/445 Primary

  Program loading or initiating (bootstrapping G06F9/4401; security arrangements for program loading or initiating G06F21/57) · CPC title

• H04L43/045

  for graphical visualisation of monitoring data · CPC title

• G06F16/248 Primary

  Presentation of query results · CPC title