CN102404385A - Virtual cluster deployment system and deployment method for high performance computing - Google Patents
Virtual cluster deployment system and deployment method for high performance computing Download PDFInfo
- Publication number
- CN102404385A CN102404385A CN2011103262159A CN201110326215A CN102404385A CN 102404385 A CN102404385 A CN 102404385A CN 2011103262159 A CN2011103262159 A CN 2011103262159A CN 201110326215 A CN201110326215 A CN 201110326215A CN 102404385 A CN102404385 A CN 102404385A
- Authority
- CN
- China
- Prior art keywords
- virtual
- virtual cluster
- submodule
- module
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Stored Programmes (AREA)
Abstract
The invention discloses a virtual cluster deployment system for high-performance computing, which comprises a task management module, a virtual cluster deployment module and a virtual machine management module, wherein the task management module is used for responding a virtual cluster establishment request of a user, sending the virtual cluster establishment request to the virtual cluster deployment module and sending an internet protocol (IP) address and a root account password of a management node of an established virtual cluster to the user; the virtual cluster deployment module is used for receiving the virtual cluster establishment request from the task management module and sending the virtual cluster establishment request to the virtual machine management module; and the virtual machine management module is used for receiving the virtual cluster establishment request from the virtual cluster deployment module, determining that on which physical nodes virtual machines are to be established according to resources required by all virtual machines and resources of the physical nodes, and sending the IP addresses and the root account passwords of the established virtual machines to the virtual cluster deployment module. With the adoption of the virtual cluster deployment system, the efficiency and the flexibility of virtual cluster deployment are improved.
Description
Technical field
The invention belongs to high-performance calculation and computing system technical field of virtualization, be specifically related to a kind of virtual cluster deployment system and dispositions method towards high-performance calculation.
Background technology
In recent years, the computing system Intel Virtualization Technology is constantly ripe, and increasing application program operates among the virtual machine.Virtual computing system can the multiple computational resource of dynamic organization, isolates concrete hardware architecture and the tight dependence between the software systems; Intel Virtualization Technology separates the bottom physical equipment with upper strata operating system, software a kind of uncoupling technology, it can realize the high efficient and flexible use of computational resource.
Existing virtual machine manager; Like Xen, VMWare etc.; All include only the deployment of basic operating system and the distribution of bottom hardware resource at applied environment aspect providing; The virtual machine that takies certain resource promptly is provided, but not basic contact between the virtual machine, and promptly these virtual machines are the virtual machines that isolate.And at high-performance computing sector, most of high-performance calculation application programs are concurrent applications, this type application requirement parallel computation environment, and isolated virtual machine can not satisfy the demands.
Summary of the invention
The object of the present invention is to provide a kind of virtual cluster deployment system towards high-performance calculation, it makes that a plurality of virtual machines are configured as the Virtual Cluster that satisfies high-performance calculation becomes very simple.
The present invention realizes through following scheme:
A kind of virtual cluster deployment system towards high-performance calculation; Comprise task management module, virtual cluster deployment module and Virtual Machine Manager module; The task management module is used to respond user's Virtual Cluster establishment request; Virtual Cluster is created request send to the virtual cluster deployment module; And IP address and the root account password that will create the management node of the Virtual Cluster of accomplishing send to the user; The virtual cluster deployment module is used for receiving Virtual Cluster from the task management module and creates request, and Virtual Cluster is created the quantity that comprises whole virtual machines that Virtual Cluster is required in the request, Virtual Cluster is created request send to the Virtual Machine Manager module; Receive IP address and the root account password of creating whole virtual machines of accomplishing from the Virtual Machine Manager module; Whole virtual machines are configured to Virtual Cluster, and the IP address and the root account password of the management node of Virtual Cluster sent to the task management module, the Virtual Machine Manager module is used for receiving Virtual Cluster from the virtual cluster deployment module and creates request; Resource decision according to required resource of whole virtual machines and physical node is created virtual machine on which physical node, and IP address and the root account password that will create the virtual machine of completion send to the virtual cluster deployment module.
The task management module comprises mutual submodule, task queue submodule and task scheduling submodule; Mutual submodule is used for receiving Virtual Cluster from the user and creates request; Virtual Cluster is created request carry out format conversion, it is joined in the task queue submodule, receive the IP address and the root account password of the management node of creating the Virtual Cluster of accomplishing from the task scheduling submodule; And send it to the user; The task queue submodule receives Virtual Cluster establishment request from mutual submodule, and the task scheduling submodule is used for selecting Virtual Cluster to create request from the task queue submodule, and Virtual Cluster establishment request is sent to the virtual cluster deployment resume module; Receive the IP address and the root account password of the management node of creating the Virtual Cluster of accomplishing from the virtual cluster deployment module, and send it to mutual submodule.
The virtual cluster deployment module comprises virtual cluster deployment scheduling sublayer module, shared stored configuration submodule, parallel computation communication pool configuration submodule, batch processing scheduler configuration submodule, intercommunication configuration submodule and cluster access control submodule; Virtual cluster deployment scheduling sublayer module is used for receiving Virtual Cluster from the task management module and creates request; Virtual Cluster is created request send to the Virtual Machine Manager module; Receive IP address and the root account password of creating whole virtual machines of accomplishing from the Virtual Machine Manager module, call and share stored configuration submodule, parallel computation communication pool configuration submodule, batch processing scheduler configuration submodule, intercommunication configuration submodule, cluster access control submodule, respectively whole virtual machines are configured; And after configuration is accomplished; The IP address and the root account password of the management node of Virtual Cluster are sent to the task management module, share the stored configuration submodule and receive IP address and the root account password of whole virtual machines from virtual cluster deployment scheduling sublayer module, selection wherein virtual machine as the management node of Virtual Cluster; With the root account catalogue of management node shared storage directory as Virtual Cluster; The shared system of all virtual machines of configuration residue, so that the share directory of its Sharing Management node, and after configuration is accomplished; Configuration result is sent to virtual cluster deployment scheduling sublayer module; Parallel computation communication pool configuration submodule is used for receiving from virtual cluster deployment scheduling sublayer module the IP address and the root account password of whole virtual machines, activates the parallel computation communication pool in whole virtual machines, and after configuration is accomplished; Configuration result is sent to virtual cluster deployment scheduling sublayer module; Batch processing scheduler configuration submodule is used for receiving from virtual cluster deployment scheduling sublayer module the IP address and the root account password of whole virtual machines, and CPU, memory information with whole virtual machines in the management node of Virtual Cluster write in the configuration file of batch processing scheduler, the batch processing scheduler center monitor on the management node of startup Virtual Cluster; On other nodes of Virtual Cluster, start batch processing scheduler client simultaneously; And after configuration is accomplished, configuration result being sent to virtual cluster deployment scheduling sublayer module, intercommunication configuration submodule is used for receiving from virtual cluster deployment scheduling sublayer module the IP address and the root account password of whole virtual machines; Dispose the safety shell protocol access key of the root account of whole virtual machines; So that can not have the password mutual communication and access between the virtual machine in the Virtual Cluster, and after configuration is accomplished, configuration result is sent to virtual cluster deployment scheduling sublayer module; Cluster access control submodule is used for receiving from virtual cluster deployment scheduling sublayer module the IP address and the root account password of whole virtual machines; The root account safety shell protocol access key of the management node of configuration virtual cluster, and after configuration is accomplished sends to virtual cluster deployment scheduling sublayer module with the IP address and the root account password of the management node of Virtual Cluster.
The Virtual Machine Manager module comprises scheduling virtual machine submodule, virtual machine creating submodule, virtual machine template storehouse; The scheduling virtual machine submodule is used for receiving Virtual Cluster from the virtual cluster deployment module and creates request; Resource situation decision according to required resource of whole virtual machines and physical node is created virtual machine on which physical node; Virtual Cluster is created request send to the virtual machine creating submodule on the corresponding physical node; Receive the IP address and the root account password of whole virtual machines from the virtual machine creating submodule; And the IP address and the root password account of whole virtual machines sent to the virtual cluster deployment module, the virtual machine creating submodule is used for receiving Virtual Cluster from the scheduling virtual machine submodule and creates request, creates request according to Virtual Cluster and from the virtual machine template storehouse, copies virtual machine image; Call the interface of virtual machine manager based on virtual machine image; Creating virtual machine, and the IP address and the root account password of whole virtual machines sent to the scheduling virtual machine submodule, the virtual machine template storehouse is used for the storage virtual machine mirror image.
A kind of dispositions method of the Virtual Cluster towards high-performance calculation; May further comprise the steps: Virtual Cluster is created module and is obtained the Virtual Cluster establishment request that the user submits to; The Virtual Machine Manager module receives Virtual Cluster from the virtual cluster deployment module and creates request; Virtual Cluster is created module and is created request configuration virtual cluster according to Virtual Cluster; The task management module receives the IP address and the root account password of the management node of Virtual Cluster from the virtual cluster deployment module, and sends it to the task management module, and the task management module sends to the user with the IP address and the root account password of the management node of its Virtual Cluster.
The virtual cluster deployment module comprises shares stored configuration submodule, parallel computation communication pool configuration submodule, batch processing scheduler configuration submodule, intercommunication configuration submodule and cluster access control submodule.
The step that Virtual Cluster establishment module is created request configuration virtual cluster according to Virtual Cluster comprises: virtual cluster deployment scheduling sublayer module receives the IP address and the root account password of whole virtual machines of creating completion from the Virtual Machine Manager module; Share the stored configuration submodule according to the IP address of whole virtual machines and the NFS assembly of root account password configuration Virtual Cluster; Parallel computation communication pool configuration submodule is according to the IP address and the root account password configuration parallel computation communication pool assembly of whole virtual machines; Batch processing scheduler configuration submodule is according to all the IP address and the root account password configuration of virtual machine are used for the batch processing scheduler component that Virtual Cluster is managed; Intercommunication is disposed submodule according to all IP address of virtual machines and no cryptographic acess intercommunications between inner each virtual machine of root account password configuration Virtual Cluster, and cluster access control submodule is according to the IP address of whole virtual machines and the root account password of root account password configuration Virtual Cluster management node.
The present invention has the following advantages:
Assembly prepackage pattern: the present invention combines the demand of high-performance calculation and the characteristics of Virtual Cluster; High-performance calculation basic softwares such as parallel computation communication pool, batch processing job scheduler are loaded in the virtual machine image template in advance, and are saved in the virtual machine template storehouse of system.In the virtual cluster deployment process, create virtual machine in batches based on the virtual machine image template, virtual machine is configured gets final product dynamically, utilize Virtual Cluster to improve efficient and the flexibility of disposing high-performance computing environment.
The application program seamless migration: the present invention is according to the characteristics of high-performance calculation; In Virtual Cluster, dispose and activated the parallel computation communication pool; Support the seamless migration of concurrent application, improved the availability and the maintainability of system from the conventional physical cluster to Virtual Cluster.
Deployment is transparent: the selection scheduling of the virtual machine that relates to towards the virtual cluster deployment process of high-performance calculation, the communication of each intermodule, the distribution of hardware resource, establishment of Virtual Cluster or the like; The present invention shields these complicated deployment to the user; The user only need propose the virtual cluster deployment requirement, need not to be concerned about concrete deployment specifics, and whole deployment is transparent fully concerning the user; Reduce the technical threshold of user's using system, improved the ease for use of system.
In addition, Virtual Cluster has following advantage: (1) in view of the migration and the snapshot characteristic of virtual machine, and it is very little that Virtual Cluster carries out fault-tolerant expense; (2) parallel computation application program operates in the virtual machine, can the better protection physical hardware; (3) Virtual Cluster can be supported some legacy softwares, and these legacy softwares can not continue because of the upgrading of original physical hardware system to use.
Description of drawings
Fig. 1 is the structural representation of the present invention towards the virtual cluster deployment system of high-performance calculation.
Fig. 2 is the dispositions method sketch map of the present invention towards the Virtual Cluster of high-performance calculation.
Embodiment
Below in conjunction with accompanying drawing the present invention is done further detailed explanation.
As shown in Figure 1, the present invention comprises task management module 1, virtual cluster deployment module 2 and Virtual Machine Manager module 3 towards the virtual cluster deployment system of high-performance calculation.
Task management module 1 is used to receive the Virtual Cluster establishment request that the user submits to, and Virtual Cluster establishment request is sent to virtual cluster deployment module 2, comprises the quantity of whole virtual machines that Virtual Cluster is required during Virtual Cluster is created and asked.
Virtual cluster deployment module 2 is used for that Virtual Cluster is created request and issues Virtual Machine Manager module 3.
Virtual Machine Manager module 3 is used to create whole virtual machines, and IP address and the root account password that will create whole virtual machines of accomplishing send to virtual cluster deployment module 2.
Virtual cluster deployment module 2 also is used for whole virtual machines are configured as the Virtual Cluster towards high-performance calculation; IP address and root account password with the management node of Virtual Cluster after configuration is accomplished send to task management module 1, and the IP address and the root account password of the management node of Virtual Cluster sent to the user.
Task management module 1 comprises mutual submodule 11, task queue submodule 12, task scheduling submodule 13.These three modules can be decomposed as required, and are deployed on one or more server.
Mutual submodule 11 is used for receiving Virtual Cluster from the user and creates request; Virtual Cluster is created request carry out format conversion; It is joined in the task queue submodule 12; Receive the IP address and the root account password of the management node of creating the Virtual Cluster of accomplishing from task scheduling submodule 13, and send it to the user.
Task queue submodule 12 receives Virtual Cluster from mutual submodule 11 and creates request.
Task scheduling submodule 13 is used for selecting Virtual Cluster to create request from task queue submodule 12; And the Virtual Cluster establishment is asked to send to virtual cluster deployment module 2 handle; Receive the IP address and the root account password of the management node of creating the Virtual Cluster of accomplishing from virtual cluster deployment module 2, and send it to mutual submodule 11.
The information flow direction of task management module 1 is: the user submits to Virtual Cluster to create request to mutual submodule 11, and 11 pairs of Virtual Clusters of mutual submodule are created request and carried out format conversion, and it is joined in the task queue submodule 12.Task scheduling submodule 13 selects Virtual Cluster to create request from task queue submodule 12, and sends it to virtual cluster deployment module 2.Task scheduling submodule 13 is accepted the IP address and the root account password of the management node of Virtual Cluster from virtual cluster deployment module 2, and sends it to mutual submodule 11.Mutual submodule 11 returns to the user with the IP address and the root account key of Virtual Cluster management node.
Virtual cluster deployment module 2 comprises virtual cluster deployment scheduling sublayer module 21, shared stored configuration submodule 22, parallel computation communication pool configuration submodule 23, batch processing scheduler configuration submodule 24, intercommunication configuration submodule 25, cluster access control submodule 26.These modules can be decomposed as required, are deployed on one or more server.
Virtual cluster deployment scheduling sublayer module 21 is used for receiving Virtual Cluster from task management module 1 and creates request; Virtual Cluster is created request send to Virtual Machine Manager module 3; Receive IP address and the root account password of creating whole virtual machines of accomplishing from Virtual Machine Manager module 3; Call and share stored configuration submodule 22, parallel computation communication pool configuration submodule 23, batch processing scheduler configuration submodule 24, intercommunication configuration submodule 25, cluster access control submodule 26; Respectively whole virtual machines being configured, and after configuration is accomplished, the IP address and the root account password of the management node of Virtual Cluster sent to task management module 1.
Share IP address and root account password that stored configuration submodule 22 is used for receiving from virtual cluster deployment scheduling sublayer module 21 whole virtual machines; Select wherein the management node of a virtual machine as Virtual Cluster; With the root account catalogue of the management node shared storage directory as Virtual Cluster, the shared system of all virtual machines of configuration residue is so that the shared storage directory of its Sharing Management node; And after configuration is accomplished, configuration result is sent to virtual cluster deployment scheduling sublayer module 21.
Parallel computation communication pool configuration submodule 23 is used for receiving from virtual cluster deployment scheduling sublayer module 21 the IP address and the root account password of whole virtual machines; Activate the parallel computation communication pool in whole virtual machines; And after configuration is accomplished, configuration result is sent to virtual cluster deployment scheduling sublayer module 21.
Batch processing scheduler configuration submodule 24 is used for receiving from virtual cluster deployment scheduling sublayer module 21 the IP address and the root account password of whole virtual machines; CPU, memory information with whole virtual machines in the management node of Virtual Cluster write in the configuration file of batch processing scheduler, the batch processing scheduler center monitor on the management node of startup Virtual Cluster; On other nodes of Virtual Cluster, start batch processing scheduler client simultaneously, and after configuration is accomplished, configuration result is sent to virtual cluster deployment scheduling sublayer module 21.
Intercommunication configuration submodule 25 is used for receiving from virtual cluster deployment scheduling sublayer module 21 the IP address and the root account password of whole virtual machines; Dispose the safety shell protocol access key of the root account of whole virtual machines; So that can not have the password mutual communication and access between the virtual machine in the Virtual Cluster; And after configuration is accomplished, configuration result is sent to virtual cluster deployment scheduling sublayer module 21.
Cluster access control submodule 26 is used for receiving from virtual cluster deployment scheduling sublayer module 21 the IP address and the root account password of whole virtual machines; The root account safety shell protocol access key of the management node of configuration virtual cluster; And after configuration is accomplished, the IP address and the root account password of the management node of Virtual Cluster sent to virtual cluster deployment scheduling sublayer module 21.
Virtual Machine Manager module 3 comprises scheduling virtual machine submodule 31, virtual machine creating submodule 32, virtual machine template storehouse 33.
Scheduling virtual machine submodule 31 is used for receiving Virtual Cluster from virtual cluster deployment module 2 and creates request; Resource situation decision according to required resource of whole virtual machines and physical node is created virtual machine on which physical node; Virtual Cluster is created request send to the virtual machine creating submodule 32 on the corresponding physical node; Receive the IP address and the root account password of whole virtual machines from virtual machine creating submodule 32, and the IP address and the root password account of whole virtual machines sent to virtual cluster deployment module 2.
Virtual machine creating submodule 32 is used for receiving Virtual Cluster from scheduling virtual machine submodule 31 and creates request; Create request according to Virtual Cluster and from virtual machine template storehouse 33, copy virtual machine image; Call the interface of virtual machine manager based on virtual machine image; Creating virtual machine, and the IP address and the root account password of whole virtual machines sent to scheduling virtual machine submodule 31.
Virtual machine template storehouse 33 is used for the storage virtual machine mirror image.
As shown in Figure 2, the present invention may further comprise the steps towards the dispositions method of the Virtual Cluster of high-performance calculation:
(1) virtual cluster deployment scheduling sublayer module 21 is obtained the Virtual Cluster establishment request that the user submits to.
The virtual cluster deployment scheduling sublayer module 21 of Virtual Cluster establishment module 2 is obtained Virtual Cluster establishment request from the task scheduling submodule 13 of task management module 1; The Virtual Cluster of analysis request need be created how many platform virtual machines (being assumed to be the N platform), and the establishment request of this N platform virtual machine is sent to the scheduling virtual machine submodule 31 in the Virtual Machine Manager module 3.
(2) Virtual Machine Manager module 3 is accepted Virtual Cluster from virtual cluster deployment module 2 and is created request.
Scheduling virtual machine submodule 31 is accepted Virtual Cluster from virtual cluster deployment scheduling sublayer module 21 and is created request; Scheduling virtual machine submodule 31 is according to the resource situation of virtual machine request and physical node; Decision is created virtual machine on which physical node, and Virtual Cluster establishment request is sent to the virtual machine creating submodule 32 on the respective physical node.After virtual machine creating submodule 32 is accomplished and is created virtual machine; The IP address and the root account password of virtual machine are sent to scheduling virtual machine submodule 31, and scheduling virtual machine submodule 31 sends to virtual cluster deployment scheduling sublayer module 21 with whole virtual machine IP addresses and root account password.
(3) Virtual Cluster is created module 2 and is created request configuration virtual cluster according to Virtual Cluster
Virtual cluster deployment scheduling sublayer module 21 receives the IP address and the root account password of whole virtual machines from scheduling virtual machine submodule 31; And carrying out a series of configuration 3.1,3.2,3.3,3.4,3.5, IP address and root account password with the Virtual Cluster management node after the completion send to task scheduling submodule 13.
Particularly, step (3) comprises following substep:
(3.1) virtual cluster deployment scheduling sublayer module (21) receives IP address and the root account password of creating whole virtual machines of accomplishing from Virtual Machine Manager module (3);
(3.2) share stored configuration submodule 22 according to the IP address of whole virtual machines and the NFS assembly of root account password configuration Virtual Cluster;
(3.3) parallel computation communication pool configuration submodule 23 IP address and root account password configuration parallel computation communication pool assemblies according to whole virtual machines;
(3.4) batch processing scheduler configuration submodule 24 is according to all the IP address and the root account password configuration of virtual machine are used for the batch processing scheduler component that Virtual Cluster is managed;
(3.5) intercommunication configuration submodule 25 is according to all IP address of virtual machine and no cryptographic acess intercommunications between inner each virtual machine of root account password configuration Virtual Cluster;
(3.6) cluster access control submodule 26 is according to the IP address of whole virtual machines and the root account password of root account password configuration Virtual Cluster management node.
(4) task scheduling submodule 13 is accepted the IP address and the root account password of Virtual Cluster management node from virtual cluster deployment scheduling sublayer module 21, and sends it to mutual submodule 11;
(5) task management module 1 sends to the user with the IP address and the root account password of the management node of Virtual Cluster.
Instance:
For feasibility and the validity of verifying system of the present invention, under true environment the configuration system of the present invention, and with Xen 4.0 as the Virtual Machine Manager applicator platform.Experimental situation is the NF5120 of a Langchao Yingxin server, and internal network comprises 1 management node for adopting the 1Gbit/s Ethernet, 10 computing nodes, and the detailed configuration of management node and computing node is seen shown in the table 1.
Management node; Adopt CentOS 5.4 as operating system platform; The module of disposing above that has mutual submodule 11, task queue submodule 12, task scheduling submodule 13 in the task management module 1; Virtual cluster deployment scheduling sublayer module 21 in the virtual cluster deployment module 2, shared stored configuration submodule 22, parallel computation communication pool configuration submodule 23, batch processing scheduler configuration submodule 24, intercommunication configuration submodule 25, cluster access control submodule 26, and the scheduling virtual machine submodule 31 in the Virtual Machine Manager module 3.
Whole 10 computing nodes adopt CentOS 5.4 as operating system platform, and Xen 4.0 is as virtual machine manager, and the module of disposing above that has virtual machine creating submodule 32, virtual machine template storehouse 33 in the Virtual Machine Manager module 3.
Virtual machine image, disposing operating system is CentOS 5.4, high-performance calculation communication pool OpenMPI 1.4.3, batch processing scheduler, network shared files system server and the client of Linux 2.6.18 kernel.
Table 1: experimental configuration environment
Claims (7)
1. the virtual cluster deployment system towards high-performance calculation comprises task management module (1), virtual cluster deployment module (2) and Virtual Machine Manager module (3),
Said task management module (1) is used to respond user's Virtual Cluster establishment request; Said Virtual Cluster is created request send to said virtual cluster deployment module (2), and the IP address and the root account password of management node that will create the Virtual Cluster of completion sends to said user;
Said virtual cluster deployment module (2) is used for receiving said Virtual Cluster from said task management module (1) and creates request; Said Virtual Cluster is created the quantity that comprises whole virtual machines that said Virtual Cluster is required in the request; Virtual Cluster is created request send to said Virtual Machine Manager module (3); Receive IP address and the root account password of creating said whole virtual machines of accomplishing from said Virtual Machine Manager module (3); Said whole virtual machines are configured to said Virtual Cluster, and the IP address and the root account password of the management node of said Virtual Cluster sent to said task management module (1);
Said Virtual Machine Manager module (3) is used for receiving said Virtual Cluster from said virtual cluster deployment module (2) and creates request; Resource decision according to required resource of said whole virtual machines and physical node is created virtual machine on which physical node, and the IP address and the root account password of the virtual machine that said establishment is accomplished send to said virtual cluster deployment module (2).
2. virtual cluster deployment according to claim 1 system is characterized in that:
Said task management module (1) comprises mutual submodule (11), task queue submodule (12) and task scheduling submodule (13);
Said mutual submodule (11) is used for receiving said Virtual Cluster from said user and creates request; Said Virtual Cluster is created request carry out format conversion; It is joined in the said task queue submodule (12); Receive the IP address and the root account password of the management node of creating the Virtual Cluster of accomplishing from said task scheduling submodule (13), and send it to said user;
Said task queue submodule (12) receives said Virtual Cluster from said mutual submodule (11) and creates request;
Said task scheduling submodule (13) is used for selecting said Virtual Cluster to create request from said task queue submodule (12); And said Virtual Cluster establishment is asked to send to said virtual cluster deployment module (2) handle; Receive the IP address and the root account password of the management node of creating the Virtual Cluster of accomplishing from said virtual cluster deployment module (2), and send it to said mutual submodule (11).
3. virtual cluster deployment according to claim 1 system is characterized in that:
Said virtual cluster deployment module (2) comprises virtual cluster deployment scheduling sublayer module (21), shared stored configuration submodule (22), parallel computation communication pool configuration submodule (23), batch processing scheduler configuration submodule (24), intercommunication configuration submodule (25) and cluster access control submodule (26);
Said virtual cluster deployment scheduling sublayer module (21) is used for receiving said Virtual Cluster from said task management module (1) and creates request; Said Virtual Cluster is created request send to said Virtual Machine Manager module (3); Receive IP address and the root account password of creating said whole virtual machines of accomplishing from said Virtual Machine Manager module (3); Call said shared stored configuration submodule (22), said parallel computation communication pool configuration submodule (23), said batch processing scheduler configuration submodule (24), said intercommunication configuration submodule (25), said cluster access control submodule (26); Respectively said whole virtual machines are configured; And after configuration is accomplished, configuration result is sent to said task management module (1);
Said shared stored configuration submodule (22) receives the IP address and the root account password of said whole virtual machines from said virtual cluster deployment scheduling sublayer module (21); Select wherein the management node of a virtual machine as said Virtual Cluster; With the root account catalogue of said management node shared storage directory as said Virtual Cluster; The shared system of all virtual machines of configuration residue; So that it shares the share directory of said management node, and after configuration is accomplished, configuration result is sent to said virtual cluster deployment scheduling sublayer module (21);
Said parallel computation communication pool configuration submodule (23) is used for receiving from said virtual cluster deployment scheduling sublayer module (21) the IP address and the root account password of said whole virtual machines; Activate the parallel computation communication pool in said whole virtual machine; And after configuration is accomplished, configuration result is sent to said virtual cluster deployment scheduling sublayer module (21);
Said batch processing scheduler configuration submodule (24) is used for receiving from said virtual cluster deployment scheduling sublayer module (21) the IP address and the root account password of said whole virtual machines; CPU, memory information with said whole virtual machines in the management node of said Virtual Cluster write in the configuration file of batch processing scheduler, start the batch processing scheduler center monitor on the management node of said Virtual Cluster; On other nodes of Virtual Cluster, start batch processing scheduler client simultaneously, and after configuration is accomplished, configuration result is sent to said virtual cluster deployment scheduling sublayer module (21);
Said intercommunication configuration submodule (25) is used for receiving from said virtual cluster deployment scheduling sublayer module (21) the IP address and the root account password of said whole virtual machines; Dispose the safety shell protocol access key of the root account of said whole virtual machines; So that can not have the password mutual communication and access between the virtual machine in the said Virtual Cluster; And after configuration is accomplished, configuration result is sent to said virtual cluster deployment scheduling sublayer module (21);
Cluster access control submodule (26) is used for receiving from said virtual cluster deployment scheduling sublayer module (21) the IP address and the root account password of said whole virtual machines; Dispose the root account safety shell protocol access key of the management node of said Virtual Cluster; And after configuration is accomplished, the IP address and the root account password of the management node of said Virtual Cluster sent to said virtual cluster deployment scheduling sublayer module (21).
4. virtual cluster deployment according to claim 1 system is characterized in that:
Said Virtual Machine Manager module (3) comprises scheduling virtual machine submodule (31), virtual machine creating submodule (32), virtual machine template storehouse (33);
Said scheduling virtual machine submodule (31) is used for receiving said Virtual Cluster from said virtual cluster deployment module (2) and creates request; Resource situation decision according to required resource of said whole virtual machines and physical node is created virtual machine on which physical node; Said Virtual Cluster is created request send to the virtual machine creating submodule (32) on the corresponding physical node; Receive the IP address and the root account password of said whole virtual machines from said virtual machine creating submodule (32), and the IP address and the root password account of said whole virtual machines sent to said virtual cluster deployment module (2);
Said virtual machine creating submodule (32) is used for receiving said Virtual Cluster from said scheduling virtual machine submodule (31) and creates request; Create request copy virtual machine image from said virtual machine template storehouse (33) according to said Virtual Cluster; Call the interface of virtual machine manager based on said virtual machine image; Creating virtual machine, and the IP address and the root account password of said whole virtual machines sent to said scheduling virtual machine submodule (31);
Said virtual machine template storehouse (33) is used to store said virtual machine image.
5. dispositions method towards the Virtual Cluster of high-performance calculation may further comprise the steps:
Virtual Cluster is created module (2) and is obtained the Virtual Cluster establishment request that the user submits to;
Virtual Machine Manager module (3) receives said Virtual Cluster from said virtual cluster deployment module (2) and creates request;
Said Virtual Cluster is created module (2) and is created request configuration virtual cluster according to said Virtual Cluster;
Task management module (1) receives the IP address and the root account password of the management node of said Virtual Cluster from said virtual cluster deployment module (2), and sends it to said task management module (1);
Said task management module (1) sends to the user with the IP address and the root account password of the management node of said Virtual Cluster.
6. dispositions method according to claim 5; It is characterized in that said virtual cluster deployment module (2) comprises shares stored configuration submodule (22), parallel computation communication pool configuration submodule (23), batch processing scheduler configuration submodule (24), intercommunication configuration submodule (25) and cluster access control submodule (26).
7. dispositions method according to claim 6 is characterized in that, said Virtual Cluster is created module (2) asks the step of configuration virtual cluster to comprise according to said Virtual Cluster establishment:
Said virtual cluster deployment scheduling sublayer module (21) receives IP address and the root account password of creating said whole virtual machines of accomplishing from said Virtual Machine Manager module (3);
Said shared stored configuration submodule (22) is according to the IP address of said whole virtual machines and the NFS assembly of root account password configuration Virtual Cluster;
Said parallel computation communication pool configuration submodule (23) is according to the IP address and the root account password configuration parallel computation communication pool assembly of said whole virtual machines;
Said batch processing scheduler configuration submodule (24) is used for the batch processing scheduler component that Virtual Cluster is managed according to the IP address and the root account password configuration of said whole virtual machines;
Said intercommunication configuration submodule (25) is according to the IP address of said whole virtual machines and the no cryptographic acess intercommunication between inner each virtual machine of root account password configuration Virtual Cluster;
Said cluster access control submodule (26) is according to the IP address of said whole virtual machines and the root account password of root account password configuration Virtual Cluster management node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103262159A CN102404385A (en) | 2011-10-25 | 2011-10-25 | Virtual cluster deployment system and deployment method for high performance computing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011103262159A CN102404385A (en) | 2011-10-25 | 2011-10-25 | Virtual cluster deployment system and deployment method for high performance computing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102404385A true CN102404385A (en) | 2012-04-04 |
Family
ID=45886165
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103262159A Pending CN102404385A (en) | 2011-10-25 | 2011-10-25 | Virtual cluster deployment system and deployment method for high performance computing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102404385A (en) |
Cited By (34)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693297A (en) * | 2012-05-16 | 2012-09-26 | 华为技术有限公司 | Data processing method, node and ETL (extract transform and load) system |
| CN102799519A (en) * | 2012-06-07 | 2012-11-28 | 浪潮电子信息产业股份有限公司 | Automatic test method for cluster file system |
| CN102833310A (en) * | 2012-07-03 | 2012-12-19 | 中山大学 | Workflow engine trunking system based on virtualization technology |
| CN102932408A (en) * | 2012-09-21 | 2013-02-13 | 中国电信股份有限公司云计算分公司 | Management method and platform of server cluster |
| CN103067501A (en) * | 2012-12-28 | 2013-04-24 | 广州杰赛科技股份有限公司 | Large data processing method of PaaS platform |
| CN103118141A (en) * | 2013-03-11 | 2013-05-22 | 黄惠芬 | Multi-node-oriented cloud deployment method |
| CN103279330A (en) * | 2013-05-14 | 2013-09-04 | 江苏名通信息科技有限公司 | MapReduce multiple programming model based on virtual machine GPU computation |
| CN103701890A (en) * | 2013-12-20 | 2014-04-02 | 浪潮(北京)电子信息产业有限公司 | Virtual cluster processing method and system based on cloud computing |
| CN104021037A (en) * | 2013-03-01 | 2014-09-03 | 英飞凌科技股份有限公司 | Dynamic resource sharing |
| CN104239159A (en) * | 2013-06-11 | 2014-12-24 | 鸿富锦精密工业（深圳）有限公司 | Virtual machine maintenance system and method |
| WO2015021629A1 (en) * | 2013-08-15 | 2015-02-19 | 华为技术有限公司 | Resource allocation method |
| CN104487944A (en) * | 2012-06-26 | 2015-04-01 | 日本电气株式会社 | System construction device and system construction method |
| CN104615487A (en) * | 2015-01-12 | 2015-05-13 | 中国科学院计算机网络信息中心 | System and method for optimizing parallel tasks |
| CN104767778A (en) * | 2014-01-07 | 2015-07-08 | 中兴通讯股份有限公司 | Task processing method and device |
| CN105242872A (en) * | 2014-06-18 | 2016-01-13 | 华中科技大学 | Virtual cluster-oriented shared memory system |
| CN105404542A (en) * | 2015-08-14 | 2016-03-16 | 国家超级计算深圳中心(深圳云计算中心) | Cloud computing system and method for running high-performance computation in same |
| CN103747059B (en) * | 2013-12-26 | 2016-10-05 | 华中科技大学 | A kind of cloud computing server cluster network support method towards many tenants and system |
| CN106127391A (en) * | 2016-06-25 | 2016-11-16 | 浙江中烟工业有限责任公司 | A kind of virtualization terminal user management system based on IC-card is united |
| CN106371889A (en) * | 2016-08-22 | 2017-02-01 | 浪潮(北京)电子信息产业有限公司 | Method and device for realizing high-performance cluster system for scheduling mirror images |
| CN106713052A (en) * | 2017-02-16 | 2017-05-24 | 郑州云海信息技术有限公司 | Operation and maintenance management method and device of server |
| CN106998329A (en) * | 2017-03-31 | 2017-08-01 | 腾讯科技（深圳）有限公司 | File sharing method and device |
| CN107329802A (en) * | 2017-06-30 | 2017-11-07 | 联想(北京)有限公司 | A kind of virtual machine creation method and electronic equipment |
| CN107741873A (en) * | 2016-12-14 | 2018-02-27 | 腾讯科技（深圳）有限公司 | Method for processing business and device |
| CN107908512A (en) * | 2017-11-14 | 2018-04-13 | 郑州云海信息技术有限公司 | The test method and test device of a kind of disk performance |
| CN108037977A (en) * | 2017-12-08 | 2018-05-15 | 上海市信息网络有限公司 | Management method, equipment, computer media and the system of virtual machine resource |
| CN109274654A (en) * | 2018-08-31 | 2019-01-25 | 郑州云海信息技术有限公司 | A kind of method for building up, device and the storage medium of memory device set group |
| CN109947557A (en) * | 2017-12-20 | 2019-06-28 | 慧与发展有限责任合伙企业 | Distributed life cycle management for cloud platform |
| WO2019158969A1 (en) * | 2018-02-14 | 2019-08-22 | Pratik Sharma | Centralized message queueing service |
| CN110874256A (en) * | 2018-08-31 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Computing cluster updating system, method and device |
| CN111221541A (en) * | 2019-12-26 | 2020-06-02 | 曙光信息产业(北京)有限公司 | Cluster parallel program deployment method and device |
| CN111309447A (en) * | 2020-03-16 | 2020-06-19 | 优刻得科技股份有限公司 | Container scheduling method and device |
| CN113900775A (en) * | 2021-12-08 | 2022-01-07 | 北京交研智慧科技有限公司 | Method and device for processing edge-side cloud computing cross-node virtual machine |
| CN114675965A (en) * | 2022-03-10 | 2022-06-28 | 北京百度网讯科技有限公司 | Federal learning method, apparatus, device and medium |
| WO2022134918A1 (en) * | 2020-12-24 | 2022-06-30 | 中兴通讯股份有限公司 | Virtual machine attribute changing method and apparatus, storage medium, and electronic device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101594387A (en) * | 2009-06-29 | 2009-12-02 | 北京航空航天大学 | The virtual cluster deployment method and system |
| CN102014159A (en) * | 2010-11-29 | 2011-04-13 | 华中科技大学 | Layered resource reservation system under cloud computing environment |
| CN102096596A (en) * | 2010-11-29 | 2011-06-15 | 华中科技大学 | Cloud computing service Cache system based on internal memory template of virtual machine |
| CN102110071A (en) * | 2011-03-04 | 2011-06-29 | 浪潮(北京)电子信息产业有限公司 | Virtual machine cluster system and implementation method thereof |
-
2011
- 2011-10-25 CN CN2011103262159A patent/CN102404385A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101594387A (en) * | 2009-06-29 | 2009-12-02 | 北京航空航天大学 | The virtual cluster deployment method and system |
| CN102014159A (en) * | 2010-11-29 | 2011-04-13 | 华中科技大学 | Layered resource reservation system under cloud computing environment |
| CN102096596A (en) * | 2010-11-29 | 2011-06-15 | 华中科技大学 | Cloud computing service Cache system based on internal memory template of virtual machine |
| CN102110071A (en) * | 2011-03-04 | 2011-06-29 | 浪潮(北京)电子信息产业有限公司 | Virtual machine cluster system and implementation method thereof |
Cited By (50)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693297A (en) * | 2012-05-16 | 2012-09-26 | 华为技术有限公司 | Data processing method, node and ETL (extract transform and load) system |
| CN102693297B (en) * | 2012-05-16 | 2015-03-11 | 华为技术有限公司 | Data processing method, node and ETL (extract transform and load) system |
| CN102799519A (en) * | 2012-06-07 | 2012-11-28 | 浪潮电子信息产业股份有限公司 | Automatic test method for cluster file system |
| CN104487944B (en) * | 2012-06-26 | 2017-07-14 | 日本电气株式会社 | System constructs equipment and system building approach |
| CN104487944A (en) * | 2012-06-26 | 2015-04-01 | 日本电气株式会社 | System construction device and system construction method |
| CN102833310B (en) * | 2012-07-03 | 2015-02-25 | 中山大学 | Workflow engine trunking system based on virtualization technology |
| CN102833310A (en) * | 2012-07-03 | 2012-12-19 | 中山大学 | Workflow engine trunking system based on virtualization technology |
| CN102932408A (en) * | 2012-09-21 | 2013-02-13 | 中国电信股份有限公司云计算分公司 | Management method and platform of server cluster |
| CN102932408B (en) * | 2012-09-21 | 2016-02-03 | 中国电信股份有限公司 | A kind of management method of server cluster and platform |
| CN103067501A (en) * | 2012-12-28 | 2013-04-24 | 广州杰赛科技股份有限公司 | Large data processing method of PaaS platform |
| CN103067501B (en) * | 2012-12-28 | 2015-12-09 | 广州杰赛科技股份有限公司 | The large data processing method of PaaS platform |
| US9536075B2 (en) | 2013-03-01 | 2017-01-03 | Infineon Technologies Ag | Dynamic resource sharing |
| CN104021037A (en) * | 2013-03-01 | 2014-09-03 | 英飞凌科技股份有限公司 | Dynamic resource sharing |
| CN104021037B (en) * | 2013-03-01 | 2018-11-06 | 英飞凌科技股份有限公司 | Dynamic resource is shared |
| CN103118141A (en) * | 2013-03-11 | 2013-05-22 | 黄惠芬 | Multi-node-oriented cloud deployment method |
| CN103118141B (en) * | 2013-03-11 | 2015-11-18 | 山东英才学院 | A kind of cloud dispositions method towards multinode |
| CN103279330A (en) * | 2013-05-14 | 2013-09-04 | 江苏名通信息科技有限公司 | MapReduce multiple programming model based on virtual machine GPU computation |
| CN104239159A (en) * | 2013-06-11 | 2014-12-24 | 鸿富锦精密工业（深圳）有限公司 | Virtual machine maintenance system and method |
| US9999030B2 (en) | 2013-08-15 | 2018-06-12 | Huawei Technologies Co., Ltd. | Resource provisioning method |
| WO2015021629A1 (en) * | 2013-08-15 | 2015-02-19 | 华为技术有限公司 | Resource allocation method |
| CN103701890A (en) * | 2013-12-20 | 2014-04-02 | 浪潮(北京)电子信息产业有限公司 | Virtual cluster processing method and system based on cloud computing |
| CN103747059B (en) * | 2013-12-26 | 2016-10-05 | 华中科技大学 | A kind of cloud computing server cluster network support method towards many tenants and system |
| CN104767778A (en) * | 2014-01-07 | 2015-07-08 | 中兴通讯股份有限公司 | Task processing method and device |
| CN105242872B (en) * | 2014-06-18 | 2018-06-12 | 华中科技大学 | A kind of shared memory systems of Virtual cluster |
| CN105242872A (en) * | 2014-06-18 | 2016-01-13 | 华中科技大学 | Virtual cluster-oriented shared memory system |
| CN104615487B (en) * | 2015-01-12 | 2019-03-08 | 中国科学院计算机网络信息中心 | Parallel task optimization system and method |
| CN104615487A (en) * | 2015-01-12 | 2015-05-13 | 中国科学院计算机网络信息中心 | System and method for optimizing parallel tasks |
| CN105404542A (en) * | 2015-08-14 | 2016-03-16 | 国家超级计算深圳中心(深圳云计算中心) | Cloud computing system and method for running high-performance computation in same |
| CN106127391A (en) * | 2016-06-25 | 2016-11-16 | 浙江中烟工业有限责任公司 | A kind of virtualization terminal user management system based on IC-card is united |
| CN106371889A (en) * | 2016-08-22 | 2017-02-01 | 浪潮(北京)电子信息产业有限公司 | Method and device for realizing high-performance cluster system for scheduling mirror images |
| CN107741873A (en) * | 2016-12-14 | 2018-02-27 | 腾讯科技（深圳）有限公司 | Method for processing business and device |
| CN106713052A (en) * | 2017-02-16 | 2017-05-24 | 郑州云海信息技术有限公司 | Operation and maintenance management method and device of server |
| CN106998329A (en) * | 2017-03-31 | 2017-08-01 | 腾讯科技（深圳）有限公司 | File sharing method and device |
| CN107329802A (en) * | 2017-06-30 | 2017-11-07 | 联想(北京)有限公司 | A kind of virtual machine creation method and electronic equipment |
| CN107329802B (en) * | 2017-06-30 | 2020-08-25 | 联想(北京)有限公司 | Virtual machine creating method and electronic equipment |
| CN107908512A (en) * | 2017-11-14 | 2018-04-13 | 郑州云海信息技术有限公司 | The test method and test device of a kind of disk performance |
| CN108037977A (en) * | 2017-12-08 | 2018-05-15 | 上海市信息网络有限公司 | Management method, equipment, computer media and the system of virtual machine resource |
| CN108037977B (en) * | 2017-12-08 | 2021-10-29 | 上海市信息网络有限公司 | Virtual computer resource management method, device, computer medium, and system |
| CN109947557A (en) * | 2017-12-20 | 2019-06-28 | 慧与发展有限责任合伙企业 | Distributed life cycle management for cloud platform |
| CN109947557B (en) * | 2017-12-20 | 2023-09-29 | 慧与发展有限责任合伙企业 | Distributed lifecycle management for cloud platforms |
| WO2019158969A1 (en) * | 2018-02-14 | 2019-08-22 | Pratik Sharma | Centralized message queueing service |
| CN110874256B (en) * | 2018-08-31 | 2023-04-07 | 阿里巴巴集团控股有限公司 | Computing cluster updating system, method and device |
| CN109274654A (en) * | 2018-08-31 | 2019-01-25 | 郑州云海信息技术有限公司 | A kind of method for building up, device and the storage medium of memory device set group |
| CN110874256A (en) * | 2018-08-31 | 2020-03-10 | 阿里巴巴集团控股有限公司 | Computing cluster updating system, method and device |
| CN111221541A (en) * | 2019-12-26 | 2020-06-02 | 曙光信息产业(北京)有限公司 | Cluster parallel program deployment method and device |
| CN111309447B (en) * | 2020-03-16 | 2023-08-25 | 优刻得科技股份有限公司 | Container dispatching method and device |
| CN111309447A (en) * | 2020-03-16 | 2020-06-19 | 优刻得科技股份有限公司 | Container scheduling method and device |
| WO2022134918A1 (en) * | 2020-12-24 | 2022-06-30 | 中兴通讯股份有限公司 | Virtual machine attribute changing method and apparatus, storage medium, and electronic device |
| CN113900775A (en) * | 2021-12-08 | 2022-01-07 | 北京交研智慧科技有限公司 | Method and device for processing edge-side cloud computing cross-node virtual machine |
| CN114675965A (en) * | 2022-03-10 | 2022-06-28 | 北京百度网讯科技有限公司 | Federal learning method, apparatus, device and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102404385A (en) | Virtual cluster deployment system and deployment method for high performance computing | |
| US10467725B2 (en) | Managing access to a resource pool of graphics processing units under fine grain control | |
| US10275851B1 (en) | Checkpointing for GPU-as-a-service in cloud computing environment | |
| US11275622B2 (en) | Utilizing accelerators to accelerate data analytic workloads in disaggregated systems | |
| Luckow et al. | Saga bigjob: An extensible and interoperable pilot-job abstraction for distributed applications and systems | |
| US8892945B2 (en) | Efficient application management in a cloud with failures | |
| Moreno-Vozmediano et al. | Elastic management of cluster-based services in the cloud | |
| Zhang et al. | Cloud computing: state-of-the-art and research challenges | |
| EP2875439B1 (en) | Migrating applications between networks | |
| US10148736B1 (en) | Executing parallel jobs with message passing on compute clusters | |
| CN107707622B (en) | Method and device for accessing desktop cloud virtual machine and desktop cloud controller | |
| US10572421B2 (en) | Topology-aware parallel reduction in an accelerator | |
| Hwang et al. | Resource allocation policies for loosely coupled applications in heterogeneous computing systems | |
| CN105100180A (en) | Cluster node dynamic loading method, device and system | |
| Ghosh et al. | Jupiter: a networked computing architecture | |
| Wang et al. | The cumulus project: Build a scientific cloud for a data center | |
| Kijsipongse et al. | Autonomic resource provisioning in rocks clusters using eucalyptus cloud computing | |
| Merzky et al. | Application level interoperability between clouds and grids | |
| EP2923320A1 (en) | Transparently routing job submissions between disparate environments | |
| John et al. | Making cloud easy: design considerations and first components of a distributed operating system for cloud | |
| CN114745377B (en) | Edge cloud cluster service system and implementation method | |
| CN110300192B (en) | Method for updating distributed training task connection parameters according to IP distribution table | |
| Timm et al. | Grids, virtualization, and clouds at Fermilab | |
| Zhang et al. | Dynamic load-balanced multicast based on the Eucalyptus open-source cloud-computing system | |
| Song et al. | Research on Cross-Cluster Migration Technologies |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120404 |