CN107908459B - Cloud computing scheduling system - Google Patents

Cloud computing scheduling system Download PDF

Info

Publication number
CN107908459B
CN107908459B CN201711155677.2A CN201711155677A CN107908459B CN 107908459 B CN107908459 B CN 107908459B CN 201711155677 A CN201711155677 A CN 201711155677A CN 107908459 B CN107908459 B CN 107908459B
Authority
CN
China
Prior art keywords
module
cloud computing
scheduling
data
electronic equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201711155677.2A
Other languages
Chinese (zh)
Other versions
CN107908459A (en
Inventor
甘博
金山
邢海燕
陈静
王芬
冯冲
赵烽
任洪亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong Labor Vocational and Technical College
Original Assignee
Shandong Labor Vocational and Technical College
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Labor Vocational and Technical College filed Critical Shandong Labor Vocational and Technical College
Priority to CN201711155677.2A priority Critical patent/CN107908459B/en
Publication of CN107908459A publication Critical patent/CN107908459A/en
Application granted granted Critical
Publication of CN107908459B publication Critical patent/CN107908459B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/4557Distribution of virtual machine instances; Migration and load balancing

Abstract

The invention discloses a cloud computing scheduling system which comprises an information acquisition module, a task receiving module, an electronic equipment working condition access module, a data preprocessing module, a cloud computing forecasting sub-module, a cloud computing joint scheduling analysis module, an expert decision analysis module and a man-machine interaction module. The invention adopts a centralized task scheduling method, when a user task arrives, the user task is temporarily stored in a user task set, the optimized output of a task allocation scheme is carried out in a combined group scheduling mode, simultaneously, the monitoring of the working load condition of each virtual machine is realized in the whole calculation process, and the dynamic real-time updating of scheduling decision is realized, thereby effectively improving the bearing capacity of the server, balancing the link load, increasing the network throughput and improving the flexibility.

Description

Cloud computing scheduling system
Technical Field
The invention belongs to the technical field of cloud computing, and particularly relates to a cloud computing scheduling system.
Background
Cloud computing is the integration and development of parallel computing, distributed computing and grid computing, and is a revolution integrating software technology, hardware technology, virtual technology and network technology. The cloud computing needs to realize that resources on the internet are distributed on the network as required like water and electricity, and can be dynamically adjusted reasonably according to the complexity of a request task and the size of a data set, so that the horizontal expansion capability of a system can be improved, and the cost of software and hardware resources is greatly reduced.
The simple explanation of a server cluster is that a plurality of servers are centralized to provide services to the outside, the cluster is hidden from clients, and the clients feel like one server provides services to the cluster. The cluster obtains high-speed computing performance and mass data storage space through a parallel computing technology. It is a necessary trend that server clusters are replacing single servers as load bearing units of application services.
How to reasonably distribute task requests of users on a server cluster and a virtual machine to enable all servers to achieve a relative load balancing state, and meanwhile, the problem that serious waste of resources and energy is caused by starting too many servers with low utilization rate is avoided as much as possible is a difficult problem to be paid attention to.
Disclosure of Invention
The technical problem to be solved by the invention is to provide a cloud computing scheduling system, which can effectively improve the bearing capacity of a server, balance link load, increase network throughput, improve flexibility and provide a process of scheduling the cloud computing system which is optimized as much as possible.
To solve the above technical problem, an embodiment of the present invention provides a cloud computing scheduling system, including
The information acquisition module consists of all function detection modules and is used for detecting the workload parameters of all the virtual machines in a fixed time and quantitative mode;
the task receiving module is used for receiving task demand data of a user and sending the received demand data to the scheduling decision module;
the electronic equipment working condition access module is used for accessing real-time operation working condition information of each electronic equipment;
the data preprocessing module is used for receiving and standardizing the acquired workload parameter data and the electronic equipment operation condition data;
the cloud computing forecasting submodule is used for establishing a short-term forecasting unit by adopting a statistical regression and data driving method, and generating short-term cloud computing system condition forecasting information by utilizing the acquired workload parameters and the electronic equipment operation condition data for the cloud computing joint scheduling analysis module to use;
the cloud computing joint scheduling analysis module is used for optimizing and calculating by adopting a multi-group differential evolution algorithm according to the received task demand data and the load working condition information of the virtual machine which completes the standardized processing to obtain a cloud computing group joint scheduling scheme which is beneficial to improving the efficient operation of the cloud computing system;
the expert decision analysis module is used for receiving the cloud computing group joint scheduling alternative schemes obtained by the cloud computing group joint scheduling analysis module, comparing the change trends of the operation working conditions of the electronic equipment caused by the different cloud computing group joint scheduling alternative schemes, and providing a final scheduling decision scheme;
and the human-computer interaction module consists of a high-performance server and a display terminal thereof.
Preferably, the cloud computing group joint scheduling scheme at least includes performing reasonable allocation and migration of existing virtual machines, and performing establishment of a new virtual machine as needed.
Preferably, the expert decision analysis module comprises
The physical model building module is used for building a physical model of the electric power equipment according to the received working conditions of the electronic equipment and corresponding basic parameter data of the electronic equipment through Flac 3D;
the virtual parameter actuation module is used for changing parameters within a specified range after establishing a relationship with each element in the physical model construction module, so that various simulation analysis methods are driven to calculate and solve different parameters;
the virtual parameter module is used for inserting a logic unit which can directly obtain a corresponding result or information target into the established mathematical model;
the simulation analysis module is used for inputting parameters and algorithms which can be decomposed into design variables, design targets and design constraints, dividing the input parameters and algorithms into units, characteristics and loads, and respectively applying the units, the characteristics and the loads to the specified modules;
the virtual parameter actuation module feeds back results to the simulation analysis module through the circulation execution simulation analysis module, the simulation analysis module extracts the results and sends the results to the virtual parameter module, and the virtual parameter module receives the results and automatically displays result data.
Preferably, the cloud computing forecast submodule comprises
The graph drawing module is used for drawing various curve graphs according to the monitoring data;
the comparison analysis module is used for performing comparison analysis and prediction on the drawn curve and the original actual measurement curve and outputting an analysis prediction result;
and the regression calculation module is used for carrying out regression calculation on the drawn curve through different functions.
The graph drawing module generates a temporal curve and a spatial effect curve which change along with time and space according to the input monitoring data; the temporal curve shows the change condition of the original data of each monitoring point along with time, and the spatial effect curve highlights the change rule of the monitoring results of different measuring points along with the position of the information acquisition module at the same time.
The invention has the following beneficial effects:
by adopting a centralized task scheduling method, when a user task arrives, the user task is temporarily stored in a user task set, the optimized output of a task allocation scheme is carried out in a combined group scheduling mode, meanwhile, in the whole calculation process, the monitoring of the working load condition of each virtual machine is realized, and the dynamic real-time updating of scheduling decisions is realized, so that the bearing capacity of a server can be effectively improved, the link load is balanced, the network throughput is increased, and the flexibility is improved.
Drawings
Fig. 1 is a schematic block diagram of a cloud computing scheduling system according to an embodiment of the present invention.
Detailed Description
In order to make the technical problems, technical solutions and advantages of the present invention more apparent, the following detailed description is given with reference to the accompanying drawings and specific embodiments.
As shown in fig. 1, an embodiment of the present invention provides a cloud computing scheduling system, which includes
The information acquisition module consists of all function detection modules and is used for detecting the workload parameters of all the virtual machines in a fixed time and quantitative mode;
the task receiving module is used for receiving task demand data of a user, collecting the received demand data to a certain number and then sending the data to the scheduling decision module, wherein the number is not less than 2 but not more than 10;
the electronic equipment working condition access module is used for accessing real-time operation working condition information of each electronic equipment;
the data preprocessing module is used for receiving and standardizing the acquired workload parameter data and the electronic equipment operation condition data;
the cloud computing forecasting submodule is used for establishing a short-term forecasting unit by adopting a statistical regression and data driving method, and generating short-term cloud computing system condition forecasting information by utilizing the acquired workload parameters and the electronic equipment operation condition data for the cloud computing joint scheduling analysis module to use;
the cloud computing joint scheduling analysis module is used for optimizing and calculating by adopting a multi-group differential evolution algorithm according to the received task demand data and the load working condition information of the virtual machine which completes the standardized processing to obtain a cloud computing group joint scheduling scheme which is beneficial to improving the efficient operation of the cloud computing system;
the expert decision analysis module is used for receiving the cloud computing group joint scheduling alternative schemes obtained by the cloud computing group joint scheduling analysis module, comparing the change trends of the operation working conditions of the electronic equipment caused by the different cloud computing group joint scheduling alternative schemes, and providing a final scheduling decision scheme;
and the human-computer interaction module consists of a high-performance server and a display terminal thereof.
The cloud computing group joint scheduling scheme at least comprises the steps of reasonably distributing and migrating the existing virtual machines and establishing new virtual machines according to needs.
The expert decision analysis module comprises
The physical model building module is used for building a physical model of the electric power equipment according to the received working conditions of the electronic equipment and corresponding basic parameter data of the electronic equipment through Flac 3D;
the virtual parameter actuation module is used for changing parameters within a specified range after establishing a relationship with each element in the physical model construction module, so that various simulation analysis methods are driven to calculate and solve different parameters;
the virtual parameter module is used for inserting a logic unit which can directly obtain a corresponding result or information target into the established mathematical model;
the simulation analysis module is used for inputting parameters and algorithms which can be decomposed into design variables, design targets and design constraints, dividing the input parameters and algorithms into units, characteristics and loads, and respectively applying the units, the characteristics and the loads to the specified modules;
the virtual parameter actuation module feeds back results to the simulation analysis module through the circulation execution simulation analysis module, the simulation analysis module extracts the results and sends the results to the virtual parameter module, and the virtual parameter module receives the results and automatically displays result data.
The cloud computing forecast submodule comprises
The graph drawing module is used for drawing various curve graphs according to the monitoring data;
the comparison analysis module is used for performing comparison analysis and prediction on the drawn curve and the original actual measurement curve and outputting an analysis prediction result;
and the regression calculation module is used for carrying out regression calculation on the drawn curve through different functions.
The graph drawing module generates a temporal curve and a spatial effect curve which change along with time and space according to the input monitoring data; the temporal curve shows the change condition of the original data of each monitoring point along with time, and the spatial effect curve highlights the change rule of the monitoring results of different measuring points along with the position of the information acquisition module at the same time.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (6)

1. A cloud computing scheduling system is characterized by comprising
The information acquisition module consists of all function detection modules and is used for detecting the workload parameters of all the virtual machines in a fixed time and quantitative mode;
the task receiving module is used for receiving task demand data of a user, collecting the received demand data to a certain number and then sending the data to the scheduling decision module, wherein the number is not less than 2 but not more than 10;
the electronic equipment working condition access module is used for accessing real-time operation working condition information of each electronic equipment;
the data preprocessing module is used for receiving and standardizing the acquired workload parameter data and the electronic equipment operation condition data;
the cloud computing forecasting submodule is used for establishing a short-term forecasting unit by adopting a statistical regression and data driving method, and generating short-term cloud computing system condition forecasting information by utilizing the acquired workload parameters and the electronic equipment operation condition data for the cloud computing joint scheduling analysis module to use;
the cloud computing joint scheduling analysis module is used for collecting a certain amount of demand data and the virtual machine load working condition information which is subjected to standardized processing in the scheduling decision module, and optimizing and calculating by adopting a multi-group differential evolution algorithm to obtain a cloud computing group joint scheduling scheme which is beneficial to improving the efficient operation of a cloud computing system;
the expert decision analysis module is used for receiving the cloud computing group joint scheduling alternative schemes obtained by the cloud computing group joint scheduling analysis module, comparing the change trends of the operation working conditions of the electronic equipment caused by the different cloud computing group joint scheduling alternative schemes, and providing a final scheduling decision scheme;
and the human-computer interaction module consists of a high-performance server and a display terminal thereof.
2. The cloud computing scheduling system of claim 1, wherein the cloud computing group joint scheduling scheme at least includes performing rational allocation and migration of existing virtual machines, and performing establishment of new virtual machines as needed.
3. The cloud computing scheduling system of claim 1 wherein said expert decision analysis module comprises
The physical model building module is used for building a physical model of the electronic equipment according to the received working conditions of the electronic equipment and corresponding basic parameter data of the electronic equipment through Flac 3D;
the virtual parameter actuation module is used for changing the parameters within a specified range after establishing a relationship with the elements in the physical model construction module, so as to drive various simulation analysis methods to calculate and solve the parameters;
the virtual parameter module is used for inserting a logic unit which can directly obtain a corresponding result or information target into the established physical model;
the simulation analysis module is used for inputting parameters and algorithms which can be decomposed into design variables, design targets and design constraints, dividing the input parameters and algorithms into units, characteristics and loads, and respectively applying the units, the characteristics and the loads to the specified modules;
the virtual parameter actuation module feeds back results to the simulation analysis module through the circulation execution simulation analysis module, the simulation analysis module extracts the results and sends the results to the virtual parameter module, and the virtual parameter module receives the results and automatically displays result data.
4. The cloud computing scheduling system of claim 1 wherein the cloud computing forecast submodule comprises
The graph drawing module is used for drawing various curve graphs according to the monitoring data;
the comparison analysis module is used for performing comparison analysis and prediction on the drawn curve and the original actual measurement curve and outputting an analysis prediction result;
and the regression calculation module is used for carrying out regression calculation on the drawn curve through different functions.
5. The cloud computing scheduling system of claim 4 wherein the graph plotting module generates temporal curves and spatial effect curves that vary over time and space based on the input monitoring data.
6. The cloud computing scheduling system of claim 5 wherein the temporal curve shows the change of the raw data of each monitoring point with time, and the spatial effect curve highlights the change rule of the monitoring results of different measuring points with the position of the information acquisition module at the same time.
CN201711155677.2A 2017-11-10 2017-11-10 Cloud computing scheduling system Expired - Fee Related CN107908459B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711155677.2A CN107908459B (en) 2017-11-10 2017-11-10 Cloud computing scheduling system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711155677.2A CN107908459B (en) 2017-11-10 2017-11-10 Cloud computing scheduling system

Publications (2)

Publication Number Publication Date
CN107908459A CN107908459A (en) 2018-04-13
CN107908459B true CN107908459B (en) 2020-06-09

Family

ID=61846294

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711155677.2A Expired - Fee Related CN107908459B (en) 2017-11-10 2017-11-10 Cloud computing scheduling system

Country Status (1)

Country Link
CN (1) CN107908459B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108764580A (en) * 2018-05-28 2018-11-06 延安大学 A kind of assembly shop scheduling system
CN111258767B (en) * 2020-01-22 2023-01-03 中国人民解放军国防科技大学 Cloud computing resource intelligent distribution method and device for complex system simulation application
CN111639395B (en) * 2020-05-26 2023-07-04 成都运达科技股份有限公司 Device and method for acquiring vibration information of vehicle under transverse track expansion

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102004671A (en) * 2010-11-15 2011-04-06 北京航空航天大学 Resource management method of data center based on statistic model in cloud computing environment
CN102546379A (en) * 2010-12-27 2012-07-04 ***通信集团公司 Virtualized resource scheduling method and system
CN103679285A (en) * 2013-11-29 2014-03-26 河海大学 Reservoir group combined operation scheduling system and method for improving river and lake relationship
CN106950902A (en) * 2017-04-26 2017-07-14 衢州职业技术学院 A kind of electric integrated automatic monitoring system
CN107273185A (en) * 2017-06-19 2017-10-20 成都鼎智汇科技有限公司 A kind of control method for equalizing load based on virtual machine

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9753760B2 (en) * 2015-12-17 2017-09-05 International Business Machines Corporation Prioritization of low active thread count virtual machines in virtualized computing environment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102004671A (en) * 2010-11-15 2011-04-06 北京航空航天大学 Resource management method of data center based on statistic model in cloud computing environment
CN102546379A (en) * 2010-12-27 2012-07-04 ***通信集团公司 Virtualized resource scheduling method and system
CN103679285A (en) * 2013-11-29 2014-03-26 河海大学 Reservoir group combined operation scheduling system and method for improving river and lake relationship
CN106950902A (en) * 2017-04-26 2017-07-14 衢州职业技术学院 A kind of electric integrated automatic monitoring system
CN107273185A (en) * 2017-06-19 2017-10-20 成都鼎智汇科技有限公司 A kind of control method for equalizing load based on virtual machine

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
云计算环境下虚拟机资源均衡调度方法研究;李济汉 等;《电信科学》;20130805;第29卷(第4期);第78-82页 *

Also Published As

Publication number Publication date
CN107908459A (en) 2018-04-13

Similar Documents

Publication Publication Date Title
Abd Elaziz et al. Advanced optimization technique for scheduling IoT tasks in cloud-fog computing environments
Lu et al. An effective task scheduling algorithm based on dynamic energy management and efficient resource utilization in green cloud computing environment
CN102611622B (en) Dispatching method for working load of elastic cloud computing platform
Toosi et al. A fuzzy logic-based controller for cost and energy efficient load balancing in geo-distributed data centers
CN102929718B (en) Distributed GPU (graphics processing unit) computer system based on task scheduling
CN107908459B (en) Cloud computing scheduling system
Peng et al. Energy and QoS aware resource allocation for heterogeneous sustainable cloud datacenters
CN108322548A (en) A kind of industrial process data analyzing platform based on cloud computing
CN104239144A (en) Multilevel distributed task processing system
Li et al. Adaptive resource allocation based on the billing granularity in edge-cloud architecture
Cheng et al. Heterogeneity aware workload management in distributed sustainable datacenters
CN107450855A (en) A kind of model for distributed storage variable data distribution method and system
Zhou et al. Strategy optimization of resource scheduling based on cluster rendering
He et al. Energy-efficient framework for virtual machine consolidation in cloud data centers
CN106027318A (en) Cloud computing-based two-level optimal scheduling management platform for virtual machine
CN108132840A (en) Resource regulating method and device in a kind of distributed system
CN111625583A (en) Service data processing method and device, computer equipment and storage medium
CN105116987B (en) The multiple power source and performance management system of a kind of cloud computing center
Peng et al. Energy-efficient management of data centers using a renewable-aware scheduler
CN103425523A (en) Parallel computing system and method of PMU (Phasor Measurement Unit) online application system
Lee et al. Refining micro services placement over multiple kubernetes-orchestrated clusters employing resource monitoring
CN115526737A (en) Power grid energy management method and system based on digital twinning and terminal equipment
Ashraf et al. Logarithmic utilities for aggregator based demand response
CN113806606A (en) Three-dimensional scene-based electric power big data rapid visual analysis method and system
Patel et al. Efficient resource allocation strategy to improve energy consumption in cloud data centers

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200609

Termination date: 20211110

CF01 Termination of patent right due to non-payment of annual fee