CN102929695B - A kind of batch jobs dispatching method based on reservation - Google Patents
A kind of batch jobs dispatching method based on reservation Download PDFInfo
- Publication number
- CN102929695B CN102929695B CN201210348300.XA CN201210348300A CN102929695B CN 102929695 B CN102929695 B CN 102929695B CN 201210348300 A CN201210348300 A CN 201210348300A CN 102929695 B CN102929695 B CN 102929695B
- Authority
- CN
- China
- Prior art keywords
- task
- coupling
- reservation
- job
- interim reservation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention provides a kind of batch jobs dispatching method based on reservation, comprises the following steps: submits operation to and specifies coupling attribute for operation；Operation is scheduling by job scheduling system, if finding, certain task is coupling task, and the most automatically using this generic task as one group, the priority of unified task is the task that this coupling task medium priority is the highest；If all coupling task successfully create interim reservation, then start job initiation process；Otherwise, the interim reservation created before deletion, then proceed to process next operation；If all corresponding interim reservation of all coupling task, then batch starts all coupling task.The problem that the present invention solves coupling job patch scheduling, it is ensured that the normally calculating of coupling task, can also avoid indivedual coupling task to start but the overall problem that can not calculate of coupling operation simultaneously, improve the overall utilization rate of cluster.
Description
Technical field
The invention belongs to field of computer technology, be specifically related to a kind of batch jobs dispatching method based on reservation.
Background technology
High-Performance Computing Cluster is the general name of the software and hardware system for carrying out high-performance calculation.Generally taken by high-performance on hardware
The part compositions such as business device, high speed storing, express network, machine room infrastructure (such as power supply, refrigeration)；Software aspects, generally includes
The part composition such as job scheduling software, monitor and management of cluster software, parallel memorizing software.
Job scheduling system has been responsible for the software system of application job scheduling.Functionally, generally by resource pipe
The part compositions such as reason device, job scheduler, task performer；Dispatching patcher is similar to an operating system, typically can provide ratio
The more perfect interface being managed for the internal object such as operation, resource, including command line interface, api interface.Relatively common
Dispatching patcher include that LSF, SGE, PBS(Torque are branches of pbs).
It is when the more popular Simulation Application field of former that coupling Simulation calculates.Lead at bullet train, aircraft, automobile etc.
Territory has important application.At present, coupling Simulation application is generally all the software system proprietary as, runs on similar
Under the environment such as work station, seldom consider the use under cluster environment.
From the point of view of development trend, it is inevitable for running under cluster after this kind of application.Problem is that dispatching patcher is such as
What supports that the type calculates.It is exactly that each coupling module must be dispatched successfully simultaneously that coupling task calculating has a marked feature,
Coupling task could start to calculate.This is different from traditional job scheduling.
Dispatching patcher in current main flow is all to provide various dispatching algorithm for single operation, and job stream function is the most only
It is only to define the sequential relationship such as stream compression, job run between operation, does not the most support the lot size scheduling for operation.
Summary of the invention
In order to overcome above-mentioned the deficiencies in the prior art, the present invention provides a kind of batch jobs dispatching method based on reservation,
The problem solving coupling job patch scheduling, it is ensured that the normal calculating of coupling task, can also avoid indivedual coupling simultaneously
Close task start but the overall problem that can not calculate of coupling operation, improve the overall utilization rate of cluster.
In order to realize foregoing invention purpose, the present invention adopts the following technical scheme that:
A kind of batch jobs dispatching method based on reservation, said method comprising the steps of:
Step 1: submit operation to and specify coupling attribute for operation；
Step 2: operation is scheduling by job scheduling system, if finding, certain task is coupling task, the most automatically by this
Generic task is as one group, and the priority of unified task is the task that this coupling task medium priority is the highest；
Step 3: if all coupling task successfully create interim reservation, then start job initiation process；Otherwise, before deletion
The interim reservation created, then proceedes to process next operation；
Step 4: if all corresponding interim reservation of all coupling task, then batch starts all coupling task.
In described step 1, when submitting first coupling task to, described job scheduling system auto-returned coupling numbering.Carry
When handing over follow-up work, it is intended that use described coupling numbering.
In described step 2, when job scheduling system is according to priority scheduling task, if finding this coupling task, then
When joining resource success, create interim reservation, then proceed to check other task of same coupling operation.
In described step 4, if there being the failure of arbitrary task start, then deleted having been started up of task by rollback, and delete
Interim reservation, continues with next operation.
Compared with prior art, the beneficial effects of the present invention is: the present invention provides a kind of batch jobs based on reservation
Dispatching method, the problem solving coupling job patch scheduling, it is ensured that the normal calculating of coupling task, can also keep away simultaneously
Exempt from indivedual coupling task to start but the overall problem that can not calculate of coupling operation, improve the overall utilization rate of cluster；The method letter
Single reliable, easily perform.
Accompanying drawing explanation
Fig. 1 is coupling task scheduling flow figure.
Detailed description of the invention
Below in conjunction with the accompanying drawings the present invention is described in further detail.
The present invention provides a kind of batch jobs dispatching method based on reservation, said method comprising the steps of:
Step 1: submit operation to and specify coupling attribute for operation；When submitting first coupling task to, described job scheduling
System auto-returned coupling numbering.When submitting follow-up work to, it is intended that use described coupling numbering.Coupling task can after having submitted to
Can be dispatched by order notice this group coupling task of dispatching patcher.
Step 2: operation is scheduling by job scheduling system, if finding, certain task is coupling task, the most automatically by this
Generic task is as one group, and the priority of unified task is the task that this coupling task medium priority is the highest；Job scheduling system root
During according to priority scheduling task, if finding this coupling task, then when mating resource success, creating interim reservation, then proceeding to
Check other task of same coupling operation.
Step 3: if all coupling task successfully create interim reservation, then start job initiation process；Otherwise, before deletion
The interim reservation created, then proceedes to process next operation；
Step 4: if all corresponding interim reservation of all coupling task, then batch starts all coupling task.If there being arbitrary
Business starts unsuccessfully, then deleted having been started up of task by rollback, and delete interim reservation, continue with next operation.
Finally should be noted that: above example is only in order to illustrate that technical scheme is not intended to limit, to the greatest extent
The present invention has been described in detail by pipe with reference to above-described embodiment, and those of ordinary skill in the field are it is understood that still
The detailed description of the invention of the present invention can be modified or equivalent, and any without departing from spirit and scope of the invention
Amendment or equivalent, it all should be contained in the middle of scope of the presently claimed invention.
Claims (1)
1. a batch jobs dispatching method based on reservation, it is characterised in that: said method comprising the steps of:
Step 1: submit operation to and specify coupling attribute for operation；
Step 2: operation is scheduling by job scheduling system, if finding, certain task is coupling task, then automatically by this kind of
Business is as one group, and the priority of unified task is the task that this coupling task medium priority is the highest；
Step 3: if all coupling task successfully create interim reservation, then start job initiation process；Otherwise, create before deletion
Interim reservation, then proceed to process next operation；
Step 4: if all corresponding interim reservation of all coupling task, then batch starts all coupling task；
In described step 1, when submitting first coupling task to, described job scheduling system auto-returned coupling numbering；
When submitting follow-up work to, it is intended that use described coupling numbering；
In described step 2, when job scheduling system is according to priority scheduling task, if finding this coupling task, then in coupling money
During the success of source, create interim reservation, then proceed to check other task of same coupling operation；
In described step 4, if there being the failure of arbitrary task start, then deleted having been started up of task by rollback, and delete interim
Reservation, continues with next operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210348300.XA CN102929695B (en) | 2012-09-18 | 2012-09-18 | A kind of batch jobs dispatching method based on reservation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210348300.XA CN102929695B (en) | 2012-09-18 | 2012-09-18 | A kind of batch jobs dispatching method based on reservation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102929695A CN102929695A (en) | 2013-02-13 |
| CN102929695B true CN102929695B (en) | 2016-12-21 |
Family
ID=47644504
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210348300.XA Active CN102929695B (en) | 2012-09-18 | 2012-09-18 | A kind of batch jobs dispatching method based on reservation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102929695B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112506634B (en) * | 2020-12-08 | 2022-07-12 | 天津津航计算技术研究所 | Fairness operation scheduling method based on reservation mechanism |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101038559A (en) * | 2006-09-11 | 2007-09-19 | 中国工商银行股份有限公司 | Batch task scheduling engine and dispatching method |
| CN101561768A (en) * | 2008-04-18 | 2009-10-21 | 北京闻言科技有限公司 | Universal multitask scheduling method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8584122B2 (en) * | 2006-03-31 | 2013-11-12 | Ebay Inc. | Batch scheduling |
-
2012
- 2012-09-18 CN CN201210348300.XA patent/CN102929695B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101038559A (en) * | 2006-09-11 | 2007-09-19 | 中国工商银行股份有限公司 | Batch task scheduling engine and dispatching method |
| CN101561768A (en) * | 2008-04-18 | 2009-10-21 | 北京闻言科技有限公司 | Universal multitask scheduling method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102929695A (en) | 2013-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20140358315A1 (en) | Intelligent power utilization system and method for parks | |
| US20120284730A1 (en) | System to provide computing services | |
| CN102843418A (en) | Resource dispatching system | |
| WO2021155667A1 (en) | Model training method and apparatus, and clustering system | |
| CN106055388A (en) | Cloud platform application automatic deployment framework | |
| CN103793278A (en) | Automatic resource adjusting method on basis of operation and maintenance rules of virtual device | |
| CN104731657A (en) | Resource scheduling method and system | |
| CN106227397A (en) | Computing cluster job management system based on application virtualization technology and method | |
| WO2012100545A1 (en) | Method, system and device for service scheduling | |
| CN102929695B (en) | A kind of batch jobs dispatching method based on reservation | |
| CN105049267A (en) | Hybrid cloud management method of sea of cloud OS and CloudStack | |
| CN109388812A (en) | A kind of modularization automatic map delivery method and system based on cloud computing | |
| CN106022648A (en) | Electric power scheduling report form coordination and generation method | |
| CN104992271A (en) | Different-process-instance coordinated operation system and different-process-instance coordinated operation implementation method | |
| CN203225789U (en) | virtual desktop terminal system | |
| CN106406978A (en) | Automatic making device and method for private cloud virtual machine template | |
| CN202167019U (en) | Device for construction simulation through Building Information Modeling | |
| US9239720B2 (en) | Device and method for generating application model based on layered structure | |
| CN106599116B (en) | Cloud platform data integration management system and method | |
| CN110868330A (en) | Evaluation method, device and evaluation system for CPU resources which can be divided by cloud platform | |
| CN106155804A (en) | Method and system to the unified management service of GPU cloud computing resources | |
| CN101751260A (en) | Business object persistence processing method based on dynamic labels | |
| CN106779936A (en) | Firm Order system and Firm Order method | |
| CN102819619A (en) | Device for simulating streams of people through BIM (building information modeling) | |
| CN102915252B (en) | PBS (public broadcast service)-based power use packaging method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20211022 Address after: 100089 zone A-1, floor 2, building 36, yard 8, Dongbeiwang West Road, Haidian District, Beijing Patentee after: Shuguang zhisuan Information Technology Co.,Ltd. Address before: 100193 No.36 Zhongguancun Software Park, No.8 Dongbeiwang West Road, Haidian District, Beijing Patentee before: Dawning Information Industry (Beijing) Co.,Ltd. |
|
| TR01 | Transfer of patent right |