Data assignment and data scheduling for physical machines in a virtual machine environment

Patent metadata

Field	Value
Publication number	US-9348632-B2
Application number	US-201414491072-A
Country	US
Kind code	B2
Filing date	Sep 19, 2014
Priority date	Sep 29, 2013
Publication date	May 24, 2016
Grant date	May 24, 2016

Abstract

A data assignment method for a physical machine having multiple virtual machines (VMs) running thereon includes receiving data to be processed from a scheduler for assigning job data; storing the received data to be processed into a single queue; and in response to an idle VM being among the multiple VMs, assigning data in the queue to the idle VM to be processed by the idle VM.

First claim

What is claimed is:

1. A data assignment method for a physical machine, the physical machine having multiple virtual machines running thereon, the method comprising:
receiving, by a processor executing on a computing device, data to be processed from a scheduler configured to assign job data;
storing, by the processor, the received data to be processed into a single queue,
wherein the single queue is shared by the multiple virtual machines running on the physical machine; and
in response to an idle virtual machine being among the multiple virtual machines, assigning, by the processor,
data in the queue to the idle virtual machine to be processed by the idle virtual machine;
wherein storing the received data to be processed into a single queue comprises:
parsing the received data to be processed; and s
storing data to be processed, which is determined as specific to a predetermined application after the parsing, into the single queue.

2. The method according to claim 1 , further comprising:
in response to the processing of the data to be processed being completed, according to the data size processed by the multiple virtual machines and their processing times, reporting information indicating the physical machine's data throughput to the scheduler, to enable the scheduler to assign data at to be processed at a next time with a size based on that information to the physical machine.

3. The method according to claim 2 , wherein the size of data to be assigned to the physical machine at the next time corresponds to a percentage of job data to be assigned by the scheduler at the next time, the percentage being equal to a ratio of the data throughput of the physical machine to the sum of data throughputs of all physical machines used to process the job.

4. The method according to claim 2 , wherein in the case of receiving data to be processed from the scheduler for a first time, the size of the received data to be processed is determined based on the number of physical machines used to process the job, the data amount of the job, and a predetermined ratio by the scheduler.

5. The method according to claim 1 , wherein storing the received data to be processed into a single queue comprises:
storing the received data to be processed into the single queue in the unit of a predetermined reference storage page; and
assigning data in the queue to the idle virtual machine comprises assigning an integral number of reference storage pages in the queue to the idle virtual machine.

6. The method according to claim 5 , wherein the size of data to be processed that is received from the scheduler is an integral multiple of the reference storage page.

7. The method according to claim 1 , wherein the predetermined application is a MapReduce based application.

8. An apparatus comprising: a processor in communication with one or more types of memory, the processor configured to initiate a receiving component, a storage component, and an assignment component;
the receiving component, configured to receive data to be processed from a scheduler for assigning job data;
the storage component configured to store the received data to be processed into a single queue,
wherein the single queue is shared by the multiple virtual machines running on the physical machine; and
the assignment component configured to assign, in response to an idle virtual machine being among the multiple virtual machines, data in the queue to the idle virtual machine to be processed by the idle virtual machine;
wherein the storage component comprises:
a parsing subcomponent, configured to parse the received data to be processed; and
a storage subcomponent, configured to store data to be processed, which is determined as specific to a predetermined application after the parsing, into the single queue.

9. The apparatus according to claim 8 , further comprising:
a report component, configured to report, in response to the processing of the data to be processed is completed, according to the data size processed by the multiple virtual machines and their processing times, information indicating the physical machine's data throughput to the scheduler, to enable the scheduler to assign data to be processed with a size based on that information to the physical machine next time.

10. The apparatus according to claim 9 , wherein the size of data to be assigned to the physical machine next time corresponds to a percentage of job data to be assigned by the scheduler next time, the percentage being equal to a ratio of the data throughput of the physical machine to the sum of data throughputs of all physical machines used to process the job.

11. The apparatus according to claim 9 , wherein in the case of receiving data to be processed from the scheduler for the first time, the size of the received data to be processed is determined based on the number of physical machines used to process the job, the data amount of the job, and a predetermined ratio by the scheduler.

12. The apparatus according to claim 8 , wherein,
the storage component is configured to store the received data to be processed into the single queue in the unit of a predetermined reference storage page;
the assignment component is configured to assign an integral number of reference storage pages in the queue to the idle virtual machine.

13. The apparatus according to claim 12 , wherein the size of data to be processed that is received from the scheduler is an integral multiple of the reference storage page.

14. The apparatus according to claim 8 , wherein the predetermined application is a MapReduce based application.

Assignees

• IBM

Inventors

• Ge Yi
• Li Li
• Liu Liang
• Shi Ju Wei

Classifications

• G06F9/505

  considering the load · CPC title

• G06F2009/45575

  Starting, stopping, suspending or resuming virtual machine instances · CPC title

• G06F9/45558 Primary

  Hypervisor-specific management and integration aspects · CPC title

• G06F9/5077

  Logical partitioning of resources; Management or configuration of virtualized resources (specific details on emulation or internal functioning of virtual machines G06F9/455) · CPC title

• G06F9/45533 Primary

  Hypervisors; Virtual machine monitors · CPC title