CN106227397A - Computing cluster job management system based on application virtualization technology and method - Google Patents
Computing cluster job management system based on application virtualization technology and method Download PDFInfo
- Publication number
- CN106227397A CN106227397A CN201610639416.7A CN201610639416A CN106227397A CN 106227397 A CN106227397 A CN 106227397A CN 201610639416 A CN201610639416 A CN 201610639416A CN 106227397 A CN106227397 A CN 106227397A
- Authority
- CN
- China
- Prior art keywords
- module
- engineering calculation
- parameter information
- user interface
- graphic user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/3006—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system is distributed, e.g. networked systems, clusters, multiprocessor systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F15/00—Digital computers in general; Data processing equipment in general
- G06F15/16—Combinations of two or more digital computers each having at least an arithmetic unit, a program unit and a register, e.g. for a simultaneous processing of several programs
- G06F15/161—Computing infrastructure, e.g. computer clusters, blade chassis or hardware partitioning
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Human Computer Interaction (AREA)
- Stored Programmes (AREA)
Abstract
The present invention discloses a kind of computing cluster job management system based on application virtualization technology and method, it is possible to high-efficiency management engineering calculation operation, reduces the complexity of HPCC O&M.Described system includes: WEB graphic user interface module and engineering calculation module；Wherein, described WEB graphic user interface module, for obtaining engineering calculation operation and the parameter information of user's input, and described engineering calculation operation and parameter information are sent to described engineering calculation module；Described engineering calculation module is deployed on HPCC, for resolving described parameter information, performs described engineering calculation operation according to the parameter information after resolving；Described WEB graphic user interface module, is additionally operable to be monitored the running status of described cluster.
Description
Technical field
The invention belongs to engineering calculation resource management field, especially relate to a kind of calculating based on application virtualization technology
Cluster-Based Job Management System and method.
Background technology
Along with improving constantly of computing power and engineering calculation software parallelization degree, engineering calculation is in product design
Utilization in R&D process is increasingly extensive and deep so that engineering calculation operation increasing number, the complexity of cluster O&M increase
Add.And prior art is when carrying out engineer operation and calculating, cluster typically uses (SuSE) Linux OS, needs engineer to use life
Operation is submitted in cluster by the mode of order row operation one by one, and command line mode is for a lot of engineers, is footpath between fields
Life and not good friend's.Additionally, engineer needs to write corresponding order, and cluster is carried out O&M so that engineer needs to expend relatively
Many energy is safeguarded at task management and cluster, thus reduces research and development of products efficiency to a certain extent.
Summary of the invention
For the defect of prior art, the present invention provides a kind of computing cluster task management based on application virtualization technology
System and method.
On the one hand, the embodiment of the present invention proposes a kind of computing cluster job management system based on application virtualization technology,
Including:
WEB graphic user interface module and engineering calculation module；Wherein,
Described WEB graphic user interface module, uses HTML5 technology, makees for obtaining the engineering calculation of user's input
Industry and parameter information, and described engineering calculation operation and parameter information are sent to described engineering calculation module, and for right
The running status of described cluster is monitored；
Described engineering calculation module is deployed on HPCC, for described parameter information is resolved, and root
Described engineering calculation operation is performed according to the parameter information after resolving；
Described WEB graphic user interface module, use application virtualization technology, be also used for family remote activation institute
State engineering calculation module graphic interface, so that described engineering calculation operation front and back to be processed.
Alternatively, described system also includes:
WEB service module and RPC module；Wherein,
Described WEB service module and RPC module are disposed on the server,
Described WEB graphic user interface module, specifically for engineering calculation operation user inputted and parameter information
It is sent to described WEB service module；
Described WEB service module, for resolving described engineering calculation operation and parameter information, and after resolving
Engineering calculation operation and parameter information are sent to described RPC module；
Described RPC module, for changing the engineering calculation operation received and parameter information, and by after conversion
Data are sent to described engineering calculation module.
Alternatively, described engineering calculation module, especially by calling default support class libraries, described parameter information is carried out
Resolve.
Alternatively, described engineering calculation module, it is additionally operable to result data produced by described for execution engineering calculation operation
It is stored in default data base；Wherein,
Described WEB graphic user interface module, is additionally operable to according to user command, checks and/or download described data base
The result data of middle storage.
Alternatively, described WEB graphic user interface module, it is additionally operable to described HPCC is carried out user's pipe
Reason, including creating and deleting user and imparting and amendment user right.
Alternatively, described WEB graphic user interface module, it is additionally operable to according to user command, dynamically increases or reduce
The execution number of nodes of described engineering calculation operation.
On the other hand, the embodiment of the present invention proposes a kind of computing cluster task management side based on application virtualization technology
Method, including:
Described WEB graphic user interface module obtains engineering calculation operation and the parameter information of user's input, and by institute
State engineering calculation operation and parameter information is sent to described engineering calculation module；
Described parameter information is resolved by described engineering calculation module, performs described work according to the parameter information after resolving
Journey calculates operation, and wherein, described engineering calculation module is deployed on HPCC.
Alternatively, described method also includes:
User is by engineering described in the described WEB graphic user interface module remote activation of employing application virtualization technology
Computing module graphic interface, front and back to process described engineering calculation operation.
Alternatively, described method also includes:
The running status of described cluster is monitored by described WEB graphic user interface module, and to described high property
User's management can be carried out by computing cluster, including creating and deleting user and imparting and amendment user right.
The embodiment of the present invention has the advantages that
By unified to engineering calculation operation submission and control function to computing cluster working pipe based on application virtualization technology
In reason system, user interface breaks away from command mode dry as dust, and the WEB being encapsulated into interactivity more friendly is graphical
In interface, user has only to click on mouse, and a key is submitted to, can be realized the process to engineering calculation operation, it is possible to increase engineering
Calculate the efficiency of management of operation.It addition, make cluster operation maintenance personnel can know the fortune of PC cluster node by control function
Row state, reduces the complexity of cluster O&M, allows an engineer to enough be absorbed in product design itself, additionally it is possible at task management
System is directly viewable result of calculation, improves research and development of products efficiency.
Accompanying drawing explanation
Fig. 1 is the structural representation of present invention computing cluster based on application virtualization technology job management system one embodiment
Figure；
Fig. 2 is the flow process signal of present invention computing cluster based on application virtualization technology job management method one embodiment
Figure.
Detailed description of the invention
For making the purpose of the embodiment of the present invention, technical scheme and advantage clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is explicitly described, it is clear that described embodiment is the present invention
A part of embodiment rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not having
Make the every other embodiment obtained under creative work premise, broadly fall into the scope of protection of the invention.
Referring to Fig. 1, the present embodiment discloses a kind of computing cluster job management system based on application virtualization technology, bag
Include:
WEB graphic user interface module 1 and engineering calculation module 2；Wherein,
Described WEB graphic user interface module 1, uses HTML5 technology, makees for obtaining the engineering calculation of user's input
Industry and parameter information, and described engineering calculation operation and parameter information are sent to described engineering calculation module 2, and for right
The running status of described cluster is monitored；
In actual applications, the parameter needed for described parameter information refers to the model calculating of engineering calculation operation.Different
Computation model needed for parameter be different, multiple engineering calculation module can be set as required.
Described engineering calculation module 2 is deployed on HPCC, for described parameter information is resolved, and root
Described engineering calculation operation is performed according to the parameter information after resolving；
Described WEB graphic user interface module 1, uses application virtualization technology, is also used for family remote activation institute
State engineering calculation module graphic interface, so that described engineering calculation operation front and back to be processed.
Flow process involved by whole computing cluster job management system based on application virtualization technology can be:
Described WEB graphic user interface module 1 obtains engineering calculation operation and the parameter information of user's input, and by institute
State engineering calculation operation and parameter information is sent to WEB service module 3；
Described engineering calculation operation and parameter information are resolved by described WEB service module 3, and will resolve after engineering
Calculate operation and parameter information is sent to remote procedure call (Remote Procedure Call, RPC) module 4；
The engineering calculation operation to receiving of the described RPC module 4 and parameter information are changed and (are included that form and agreement turn
Change), and the data after conversion are sent to described engineering calculation module 2；
The parameter information received is resolved by described engineering calculation module 2, performs according to the parameter information after resolving
The engineering calculation operation received.
Specifically, described parameter information can be carried out by described engineering calculation module 2 by calling default support class libraries
Resolve.Wherein, in described support class libraries, storage has the class for Parameter analysis of electrochemical.
It should be noted that described WEB service module 3 and RPC module 4 is disposed on the server.Described engineering calculation mould
Described parameter information, when receiving described engineering calculation operation and parameter information, can be saved in default data base by block 2,
And the journal file produced during engineering calculation Job execution and the execution result that produces after being finished also can be protected
Deposit in the database, in order to user is checked by WEB graphic user interface module 1 and/or downloaded.Corresponding
Ground, described WEB graphic user interface module 1 can be based on model-view-controller (model-view-
Controller, MVC) Frame Design, the form of expression is traditional Web page mode, submits to and prison according to the order of user
Control operation (described submission and monitoring operation include submitting operation to, check and/or download calculating journal file and/or destination file)
And/or (described management cluster includes adding or deleting engineering calculation module, and monitoring PC cluster node runs shape to manage cluster
State, adds or deletes PC cluster node, creates and delete user and imparting and amendment user right).Wherein, node is calculated
It is made up of the calculating resource in job management system, including the operating system disposed on physical server and portion in an operating system
The engineering calculation module software of administration.
It should be noted that described Web service module 3 supports that multi-point login, different users have different authorities, user
Application and the management function of to one's name authority can only be used.When user right needs to adjust, user can be ordered by user
Order is applied for revising existing authority to manager.
It addition, described WEB graphic user interface module 1 can also be according to user command, by using application virtualization
Engineering calculation module graphic interface described in technology remote activation, front and back to process described engineering calculation operation.
The computing cluster job management system based on application virtualization technology that the embodiment of the present invention provides, user can be led to
Cross WEB graphic user interface module and carry out task delivery, it is simple to the user without informatics, computer language deposit knowledge is straight
See operation, after task is delivered, prepare delivery module by described task and task is delivered in the task run cluster preset
Run, by the running status of described task scan monitoring module monitor task, and will by described task propelling movement feedback module
The operation result of the task that successful operation is complete is pushed to described WEB graphic user interface module and presents, it is possible to realize
One key of task is delivered, fully automatic operation, and described task prepares delivery module, task scan monitoring module and task and pushes
The operation relevant information real time propelling movement of task to described WEB graphic user interface module can be presented, just by feedback module
Operation relevant information is checked, it is achieved the complete monitoring of task in user.
Referring to Fig. 2, the present embodiment discloses a kind of computing cluster job management method based on application virtualization technology, bag
Include:
S1, described WEB graphic user interface module obtain engineering calculation operation and the parameter information of user's input, and will
Described engineering calculation operation and parameter information are sent to described engineering calculation module；
Described parameter information is resolved by S2, described engineering calculation module, performs institute according to the parameter information after resolving
Stating engineering calculation operation, wherein, described engineering calculation module is deployed on HPCC.
It should be noted that described WEB graphic user interface module is in addition to carrying out engineering calculation operation submission, also can
The running status of described cluster is monitored.In the present embodiment, it is performed entirely automatically raising engineering by engineering calculation operation
Calculate the efficiency of management of operation, reduced the complexity of cluster O&M by the monitoring of cluster running status.
On the basis of preceding method embodiment, described method can also include:
User is by engineering described in the described WEB graphic user interface module remote activation of employing application virtualization technology
Computing module graphic interface, front and back to process described engineering calculation operation.
On the basis of preceding method embodiment, described method can also include:
The running status of described cluster is monitored by described WEB graphic user interface module, and to described high property
User's management can be carried out by computing cluster, including creating and deleting user and imparting and amendment user right.
Although being described in conjunction with the accompanying embodiments of the present invention, but those skilled in the art can be without departing from this
Making various modifications and variations in the case of bright spirit and scope, such amendment and modification each fall within by claims
Within limited range.
Claims (9)
1. a computing cluster job management system based on application virtualization technology, it is characterised in that including:
WEB graphic user interface module and engineering calculation module；Wherein,
Described WEB graphic user interface module, use HTML5 technology, for obtain user input engineering calculation operation and
Parameter information, and described engineering calculation operation and parameter information are sent to described engineering calculation module, and for described
The running status of cluster is monitored；
Described engineering calculation module is deployed on HPCC, for resolving described parameter information, according to solution
Parameter information after analysis performs described engineering calculation operation；
Described WEB graphic user interface module, uses application virtualization technology, is also used for engineering described in the remote activation of family
Computing module graphic interface, front and back to process described engineering calculation operation.
System the most according to claim 1, it is characterised in that also include:
WEB service module and RPC module；Wherein,
Described WEB service module and RPC module are disposed on the server,
Described WEB graphic user interface module, sends specifically for engineering calculation operation user inputted and parameter information
To described WEB service module；
Described WEB service module, for described engineering calculation operation and parameter information are resolved, and the engineering after resolving
Calculate operation and parameter information is sent to described RPC module；
Described RPC module, for changing the engineering calculation operation received and parameter information, and by the data after conversion
It is sent to described engineering calculation module.
System the most according to claim 2, it is characterised in that described engineering calculation module, default especially by calling
Support class libraries described parameter information is resolved.
System the most according to claim 3, it is characterised in that described engineering calculation module, is additionally operable to described for execution work
Journey calculates result data produced by operation and is stored in default data base；Wherein,
Described WEB graphic user interface module, is additionally operable to according to user command, checks and/or download in described data base and deposit
The result data of storage.
System the most according to claim 3, it is characterised in that described WEB graphic user interface module, is additionally operable to institute
State HPCC and carry out user's management, including creating and deleting user and imparting and amendment user right.
System the most according to claim 3, it is characterised in that described WEB graphic user interface module, is additionally operable to basis
User command, dynamically increases or reduces the execution number of nodes of described engineering calculation operation.
7. a job management method based on the system described in aforementioned any one of claim 1 to 6, it is characterised in that including:
Described WEB graphic user interface module obtains engineering calculation operation and the parameter information of user's input, and by described work
Journey calculates operation and parameter information is sent to described engineering calculation module；
Described parameter information is resolved by described engineering calculation module, performs described engineering meter according to the parameter information after resolving
Can be regarded as industry, wherein, described engineering calculation module is deployed on HPCC.
Method the most according to claim 7, it is characterised in that also include:
User is by engineering calculation described in the described WEB graphic user interface module remote activation of employing application virtualization technology
Module graphic interface, front and back to process described engineering calculation operation.
Method the most according to claim 8, it is characterised in that also include:
The running status of described cluster is monitored by described WEB graphic user interface module, and to described high-performance meter
Calculate cluster and carry out user's management, including creating and deleting user and imparting and amendment user right.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610639416.7A CN106227397A (en) | 2016-08-05 | 2016-08-05 | Computing cluster job management system based on application virtualization technology and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610639416.7A CN106227397A (en) | 2016-08-05 | 2016-08-05 | Computing cluster job management system based on application virtualization technology and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106227397A true CN106227397A (en) | 2016-12-14 |
Family
ID=57547736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610639416.7A Pending CN106227397A (en) | 2016-08-05 | 2016-08-05 | Computing cluster job management system based on application virtualization technology and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106227397A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106844056A (en) * | 2017-01-25 | 2017-06-13 | 北京百分点信息科技有限公司 | Hadoop big datas platform multi-tenant job management method and its system |
| CN106897186A (en) * | 2017-01-13 | 2017-06-27 | 江苏信息职业技术学院 | Cluster real-time monitoring system and monitoring method based on MES |
| CN107317713A (en) * | 2017-06-29 | 2017-11-03 | 郑州云海信息技术有限公司 | A kind of method and system of cluster user management |
| CN107944564A (en) * | 2017-10-13 | 2018-04-20 | 北京百度网讯科技有限公司 | Deep learning job processing method, device, equipment and storage medium |
| CN109117224A (en) * | 2018-07-26 | 2019-01-01 | 深信服科技股份有限公司 | A kind of method and default Virtual terminal for graphically changing configuration in console |
| CN109697118A (en) * | 2017-10-20 | 2019-04-30 | 北京京东尚科信息技术有限公司 | Streaming computing task management method, device, electronic equipment and storage medium |
| CN109815016A (en) * | 2019-01-25 | 2019-05-28 | 北京仿真中心 | A kind of High-Performance Computing Cluster method of servicing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289572A (en) * | 2011-07-26 | 2011-12-21 | 北京市计算中心 | Method for reducing computing cost in engineering computing process |
| CN102779041A (en) * | 2012-06-20 | 2012-11-14 | 北京市计算中心 | Engineering calculation system and method |
| CN102799764A (en) * | 2012-06-20 | 2012-11-28 | 北京市计算中心 | Web-based engineering calculation system and method |
| CN103198097A (en) * | 2013-03-11 | 2013-07-10 | 中国科学院计算机网络信息中心 | Massive geoscientific data parallel processing method based on distributed file system |
-
2016
- 2016-08-05 CN CN201610639416.7A patent/CN106227397A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102289572A (en) * | 2011-07-26 | 2011-12-21 | 北京市计算中心 | Method for reducing computing cost in engineering computing process |
| CN102779041A (en) * | 2012-06-20 | 2012-11-14 | 北京市计算中心 | Engineering calculation system and method |
| CN102799764A (en) * | 2012-06-20 | 2012-11-28 | 北京市计算中心 | Web-based engineering calculation system and method |
| CN103198097A (en) * | 2013-03-11 | 2013-07-10 | 中国科学院计算机网络信息中心 | Massive geoscientific data parallel processing method based on distributed file system |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106897186A (en) * | 2017-01-13 | 2017-06-27 | 江苏信息职业技术学院 | Cluster real-time monitoring system and monitoring method based on MES |
| CN106844056A (en) * | 2017-01-25 | 2017-06-13 | 北京百分点信息科技有限公司 | Hadoop big datas platform multi-tenant job management method and its system |
| CN106844056B (en) * | 2017-01-25 | 2020-01-10 | 北京百分点信息科技有限公司 | Hadoop big data platform multi-tenant job management method and system |
| CN107317713A (en) * | 2017-06-29 | 2017-11-03 | 郑州云海信息技术有限公司 | A kind of method and system of cluster user management |
| CN107944564A (en) * | 2017-10-13 | 2018-04-20 | 北京百度网讯科技有限公司 | Deep learning job processing method, device, equipment and storage medium |
| US11055602B2 (en) | 2017-10-13 | 2021-07-06 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Deep learning assignment processing method and apparatus, device and storage medium |
| CN109697118A (en) * | 2017-10-20 | 2019-04-30 | 北京京东尚科信息技术有限公司 | Streaming computing task management method, device, electronic equipment and storage medium |
| CN109117224A (en) * | 2018-07-26 | 2019-01-01 | 深信服科技股份有限公司 | A kind of method and default Virtual terminal for graphically changing configuration in console |
| CN109815016A (en) * | 2019-01-25 | 2019-05-28 | 北京仿真中心 | A kind of High-Performance Computing Cluster method of servicing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106227397A (en) | Computing cluster job management system based on application virtualization technology and method | |
| CN102375731B (en) | Coding-free integrated application platform system | |
| CN112668386A (en) | Long running workflows for document processing using robotic process automation | |
| US11110601B2 (en) | Scheduling robots for robotic process automation | |
| CN104506620A (en) | Extensible automatic computing service platform and construction method for same | |
| CN108985937A (en) | A kind of computing resource sharing method and block catenary system based on block chain technology | |
| CN105338045A (en) | Cloud computing resource processing device, method and cloud computing system | |
| CN103338135A (en) | Real-time monitoring method of cluster storage capacity | |
| CN104102949A (en) | Distributed workflow device and method for processing workflow by distributed workflow device | |
| CN105786611A (en) | Method and device for task scheduling of distributed cluster | |
| CN106293847B (en) | A kind of method of virtual platform supporting | |
| CN111327692A (en) | Model training method and device and cluster system | |
| CN103345386A (en) | Software production method, device and operation system | |
| CN105718601A (en) | Dynamic business integrating model and application method thereof | |
| CN107807854A (en) | The method and rendering task processing method of a kind of Automatic dispatching Node station | |
| CN112527474A (en) | Task processing method and device, equipment, readable medium and computer program product | |
| CN105549964A (en) | Page display method and system | |
| CN113177088B (en) | Multi-scale simulation big data management system for material irradiation damage | |
| CN102541811B (en) | On-demand computing-based data analysis device and method for analysis factors | |
| CN104598250B (en) | A kind of system management architecture and its method for realizing management | |
| CN103258014A (en) | Method for working out production plan through network diagram | |
| CN112948353A (en) | Data analysis method, system and storage medium applied to DAstudio | |
| CN103793281A (en) | Load balancing method of compute-intensive simulation task | |
| Huang et al. | A survey of cloud workflow | |
| CN107819598A (en) | A kind of method and device for managing network function node |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161214 |
|
| RJ01 | Rejection of invention patent application after publication |