WO2021179522A1 - Computing resource allocation system, method, and apparatus, and computer device - Google Patents

Computing resource allocation system, method, and apparatus, and computer device Download PDF

Info

Publication number
WO2021179522A1
WO2021179522A1 PCT/CN2020/106078 CN2020106078W WO2021179522A1 WO 2021179522 A1 WO2021179522 A1 WO 2021179522A1 CN 2020106078 W CN2020106078 W CN 2020106078W WO 2021179522 A1 WO2021179522 A1 WO 2021179522A1
Authority
WO
WIPO (PCT)
Prior art keywords
distribution
node
result
task
allocation
Prior art date
Application number
PCT/CN2020/106078
Other languages
French (fr)
Chinese (zh)
Inventor
周俊
Original Assignee
平安国际智慧城市科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安国际智慧城市科技股份有限公司 filed Critical 平安国际智慧城市科技股份有限公司
Publication of WO2021179522A1 publication Critical patent/WO2021179522A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5017Task decomposition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/5018Thread allocation

Definitions

  • This application relates to the field of artificial intelligence, in particular to a computing resource allocation system, method, device, computer equipment, and storage medium.
  • Computer resource allocation is an important content in the computer field.
  • the traditional computer resource allocation method is to obtain the computer task submitted by the user (for example, a main program) at a master node.
  • the master node divides the computer task into multiple subtasks (subthreads) and assigns them to other nodes to perform the tasks separately. Execute to achieve distributed thread division.
  • the inventor found that the traditional computer resource allocation method is based on the main node to complete the task division, so when the main node is too stressed, for example, when multiple users submit multiple computer tasks at the same time, the main node will not be able to smoothly Completing the task division, resulting in delays and other abnormal conditions, resulting in poor operation of the entire computer system.
  • the main purpose of this application is to provide a computing resource allocation system, method, device, computer equipment, and storage medium to ensure the smoothness of the overall system operation.
  • this application proposes a computing resource allocation system, including multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node and a second allocation node.
  • the multiple resource allocation nodes include a first allocation node and a second allocation node.
  • the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is greater than 1 and less than An integer equal to n;
  • the first distribution node is configured to, when the first distribution node is in a normal state, the first distribution node is in a signal connection with the task acquisition node through a preset first channel;
  • the second distribution node is configured to, when the first distribution node is not in a normal state, the second distribution node is in signal connection with the task acquisition node through a preset second channel, wherein the second distribution node is The channel includes the first channel;
  • the i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i-th channel includes the first channel, the second channel, ..., the i-1th channel;
  • the nth distribution node is configured to, when the n-1th distribution node is not in a normal state, the nth distribution node is in signal connection with the task acquisition node through a preset nth channel, wherein the The nth channel includes the first channel, the second channel, ..., the n-1th channel;
  • the task acquisition node is configured to acquire a computer task input by a user, send the computer task to the multiple resource allocation nodes, receive the allocation result of the computer task by the multiple resource allocation nodes, and according to all The allocation result allocates the computer task to the multiple task execution nodes.
  • the present application provides a computing resource allocation method, which is applied to any one of the task acquisition nodes described above, and includes:
  • the multiple subtasks are sent to the multiple task execution nodes respectively.
  • the present application provides a computing resource allocation device, which is applied to the task acquisition node as described in any one of the above, and includes:
  • the computer task acquisition unit is used to acquire the computer task input by the user
  • a computer task sending unit configured to send the computer task to the first distribution node through the first channel
  • the receiving judgment unit is configured to judge whether the first distribution result sent by the first distribution node is received within a first preset time, wherein the first distribution result is that the first distribution node performs the computer task The result of the allocation;
  • the first allocation result judgment unit is configured to, if the first allocation result sent by the first allocation node is received within the first preset time, determine whether the first allocation result is based on a preset allocation result judgment method normal;
  • a split processing unit configured to perform split processing on the computer task according to the first assignment result if the first assignment result is normal, so as to obtain multiple subtasks
  • the subtask sending unit is configured to send the multiple subtasks to the multiple task execution nodes respectively.
  • the present application provides a computer device, including a memory and a processor, the memory stores a computer program, and the processor implements a computing resource allocation method when the computer program is executed, and the computing resource allocation method is applied to claim 1 or 2.
  • the task acquisition node includes: acquiring a computer task input by a user; sending the computer task to the first distribution node through the first channel; The first distribution result sent by the first distribution node, where the first distribution result is the result of the first distribution node distributing the computer task; if the first distribution result is received within the first preset time The first distribution result sent by the distribution node is determined according to the preset distribution result judgment method to determine whether the first distribution result is normal; if the first distribution result is normal, the computer will be processed according to the first distribution result.
  • the task is split and processed to obtain multiple subtasks; the multiple subtasks are respectively sent to the multiple task execution nodes.
  • the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a method for allocating computing resources is implemented, and the method for allocating computing resources is applied to the task according to claim 1 or 2.
  • Obtaining a node includes: obtaining a computer task input by a user; sending the computer task to the first distribution node through the first channel; determining whether the first distribution node is received within a first preset time The first distribution result sent, where the first distribution result is the result of the first distribution node distributing the computer task; if the first distribution node receives the first distribution result within the first preset time For an allocation result, judge whether the first allocation result is normal according to the preset allocation result judgment method; if the first allocation result is normal, then split the computer task according to the first allocation result , Thereby obtaining multiple subtasks; sending the multiple subtasks to the multiple task execution nodes respectively.
  • the computing resource allocation system, method, device, computer equipment, and storage medium of the present application wherein the system includes multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node , The second distribution node,..., the i-th distribution node,..., the n-th distribution node; the plurality of task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is An integer greater than 1 and less than or equal to n; the i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node communicates with the i-th channel through a preset A task acquisition node signal connection, wherein the i-th channel includes the first channel, the second channel, ..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, and The computer task is sent to the multiple resource allocation nodes, the
  • Figure 1 is a schematic block diagram of the structure of a computing resource allocation system according to an embodiment of this application;
  • FIG. 2 is a schematic flowchart of a computing resource allocation method according to an embodiment of this application.
  • FIG. 3 is a schematic block diagram of the structure of a computing resource allocation device according to an embodiment of the application.
  • FIG. 4 is a schematic block diagram of the structure of a computer device according to an embodiment of the application.
  • an embodiment of the present application provides a computing resource allocation system, including multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node and a second allocation node.
  • the multiple resource allocation nodes include a first allocation node and a second allocation node.
  • the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is greater than 1 and less than An integer equal to n;
  • the first distribution node is configured to, when the first distribution node is in a normal state, the first distribution node is in a signal connection with the task acquisition node through a preset first channel;
  • the second distribution node is configured to, when the first distribution node is not in a normal state, the second distribution node is in signal connection with the task acquisition node through a preset second channel, wherein the second distribution node is The channel includes the first channel;
  • the i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i-th channel includes the first channel, the second channel, ..., the i-1th channel;
  • the nth distribution node is configured to, when the n-1th distribution node is not in a normal state, the nth distribution node is in signal connection with the task acquisition node through a preset nth channel, wherein the The nth channel includes the first channel, the second channel, ..., the n-1th channel;
  • the task acquisition node is configured to acquire a computer task input by a user, send the computer task to the multiple resource allocation nodes, receive the allocation result of the computer task by the multiple resource allocation nodes, and according to all The allocation result allocates the computer task to the multiple task execution nodes.
  • the computer resource allocation system of the present application adopts a special setting (see Figure 1), that is, the resource allocation nodes are arranged in a stepwise and hierarchical manner.
  • the lower-level allocation nodes are not in a normal state.
  • the resource allocation work is transferred to the high-level allocation node in time to ensure the normal operation of the system.
  • the adopted signal channel still includes the original signal channel, which saves the time of resetting.
  • the signal channel may be a physical signal channel (for example, a physical signal line, etc.), or a signal channel that does not have a physical signal (for example, a wireless signal channel).
  • the mutual inclusion relationship between the first channel, the second channel and the nth channel can be set by means of a signal switch, for example, the first channel and the second channel are divided by A signal switch is set at the intersection of a part of the channel, and the signal switch can control the direction of the signal (that is, when the first distribution node is in a normal state, the first distribution node is connected to the task acquisition node; when the first distribution node is not In the normal state, connect the non-first distribution node such as the second distribution node to the task acquisition node).
  • the second channel includes the first channel is understood to mean that the second channel includes all of the first channel, or the second channel includes at least a part of the first channel.
  • the first channel is, for example, a first routing structure (path) between a task acquisition node and the first distribution node, and the first routing structure may be a dynamic routing It can also be a static route.
  • a second routing structure is constructed on the basis of the first routing structure, so that the task acquisition node is signally connected to the second distribution node.
  • the second channel includes the first channel is understood to mean that the second channel includes all of the first channel, or the second channel includes at least a part of the first channel.
  • the node in this application can be any feasible node, such as an independent computer terminal.
  • the execution subject in this application is the task acquisition node, and the task acquisition node serves as the hub of the entire system. It is signal-connected to multiple task execution nodes, is signal-connected to multiple resource allocation nodes, and is also used to obtain computer tasks input by users. .
  • the task acquisition node divides the work that needs to be assigned to computer tasks, and multiple resource allocation nodes, so the actual load of the task acquisition node is not large, compared to the traditional solution where all the work is concentrated on one node Completed, the computing resource allocation system of this application is more stable.
  • the multiple task execution nodes in the present application receive the assigned subtasks, they can also perform data coordination among the multiple task execution nodes.
  • the implementation of the data coordination is, for example, monitoring the available memory data of the task execution node, and when the available memory data is less than a predetermined value, sending at least part of the received subtasks to other task execution nodes.
  • the memory of the first allocation node, the second allocation node,..., the i-th allocation node,..., the n-th allocation node in the computing resource allocation system of the present application increases sequentially.
  • special resource allocation nodes are arranged in a stepwise manner among each other, that is, to reduce the impact on the entire system when the allocation nodes are in an abnormal state.
  • the memory of multiple distribution nodes is increased sequentially, so that the computing power of multiple distribution nodes is sequentially increased. In this way, when the distribution node of the previous level is abnormal, the distribution node of the latter level is more likely to bear Assignment tasks that cannot be completed by the assignment node at the previous level.
  • the CPU frequencies corresponding to the first distribution node, the second distribution node, ..., the i-th distribution node, ..., and the n-th distribution node respectively increase in order.
  • the computing resource allocation system of the present application includes multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node, a second allocation node,..., The i-th distribution node,..., the n-th distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n;
  • the i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i channel includes the first channel, the second channel, ..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, and send the computer task to the plurality of
  • the resource allocation node receives the allocation result of the computer task by the multiple resource allocation no
  • an embodiment of the present application provides a computing resource allocation method, which is applied to the task acquisition node described in any one of the foregoing (that is, any one of the foregoing embodiments), including:
  • This application can use any feasible method to obtain the computer task input by the user, for example, input through a preset input device, for example, using a physical interface such as a U disk interface for input, or input computer tasks through remote signal transmission.
  • the computer task is, for example, a complete program.
  • the first channel may be a signal channel with entities or a signal channel without entities.
  • the computer task is first sent to the first allocation node through the first channel.
  • the first distribution node will complete the distribution of the computer task within the first preset time and send it to the task acquisition node.
  • the first distribution node Under abnormal circumstances, for example, the first distribution node crashes due to overload, then the first distribution node cannot complete the distribution and sending of computer tasks within the first preset time. From this, it is possible to determine for the first time whether the first distribution node is normal.
  • the present application further performs a second judgment on the first allocation result sent by the first allocation node to determine whether the first allocation result is normal.
  • the judgment method may be any feasible method, such as judging whether the first distribution result conforms to a normal distribution, and if the first distribution result conforms to a normal distribution, it is determined that the first distribution result is normal.
  • the computer task is split and processed according to the first allocation result to obtain multiple subtasks, and the multiple subtasks are respectively sent to the multiple task execution nodes to complete the allocation of computing resources .
  • This application can be applied to any feasible scenario, for example: a user submits an application or task to the computing resource allocation system of this application, a task acquisition node in the computing resource allocation system receives the application or task, and the task acquisition node applies the application Or the task is sent to the first distribution node through the first channel; the first distribution node uses a preset task divider to divide, and then sends the result of the division to the task acquisition node; the task acquisition node according to the result of the division, the application or The task is specifically divided to obtain multiple subtasks; the task acquisition node sends the task acquisition node to multiple task execution nodes; the task execution node constructs threads corresponding to the subtasks and executes them in the thread pool.
  • Serialization is the process of converting data into a form that can be stored or transmitted. During serialization, data is written to temporary or persistent storage. Later, you can recreate the data by deserializing it from the storage area.
  • the task execution node can obtain specific subtasks through deserialization.
  • the status and progress of the execution of the subtask are also sent to the task acquisition node, so that the task acquisition node can grasp the running status of the task execution node in time.
  • the instructions for logging off and closing the computer task can be generated by the task execution node or the task acquisition node, thereby completing the distribution and final execution of the entire computer task.
  • step S2 of sending the computer task to the first distribution node through the first channel includes:
  • S201 Send an available memory acquisition request to the multiple task execution nodes respectively;
  • S203 Determine whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data
  • the computer task is sent to the first distribution node through the first channel.
  • This application further uses abnormal memory data and abnormal task execution node elimination, and uses available memory data as a basis for computing resource allocation to improve the accuracy of allocation. Since this application uses available memory data, it can realize dynamic computing resource allocation, which is more flexible and more efficient than traditional static computing resource allocation. Among them, because the task execution node is also running at full capacity, the available memory is extremely small at this time, that is, abnormal memory data less than the preset memory threshold, so it should not be listed as the actual task execution node, so it should be excluded . Then, through the first channel, the computer task and the multiple normally available memory data are sent to the first allocation node, so that the first allocation node has an accurate basis for computing resource allocation.
  • the resource allocation nodes are arranged in a stepwise and hierarchical manner.
  • the first channel is modified to the second channel and passes through the second channel.
  • Channel sending the computer task to the second allocation node, so that the computer resource allocation can continue to be executed.
  • the second distribution result is completed in the second distribution node, but the splitting of computer tasks is completed in the task acquisition node, thereby avoiding the waste of additional signal transmission and further improving the overall Calculate the efficiency of resource allocation and execution.
  • the first allocation result includes the data allocation amount corresponding to the multiple task execution nodes, and the step S4 of judging whether the first allocation result is normal according to a preset allocation result judgment method ,include:
  • S402 Send an available memory acquisition request to the multiple task execution nodes respectively, and acquire multiple available memory data returned by the multiple task execution nodes respectively;
  • S403 Arrange the multiple task execution nodes in descending order according to the size of the multiple available memory data, so as to obtain a second sequence
  • S404 Calculate the Levinstein distance between the first sequence and the second sequence, and determine whether the Levinstein distance is greater than a preset distance threshold;
  • the first distribution result is the analysis result of how the first distribution node should distribute the computer tasks.
  • This application judges whether it is normal or not, so as to improve the overall fluency.
  • this application adopts descending order of multiple task execution nodes in the first allocation result according to the size of the data allocation amount Arrange to obtain the first sequence; according to the size of the multiple available memory data, arrange the multiple task execution nodes in descending order to obtain the second sequence; then calculate the first sequence and the second sequence Levinstein distance, and use Levinstein distance as the basis for judging whether it is normal.
  • the Levinstein distance is a distance that measures the degree of difference between two sequences, and refers to the minimum number of editing operations required to transform one sequence into another sequence.
  • the editing operations include replacing, inserting, and deleting.
  • the minimum value of the Levinstein distance is 0.
  • the Levinstein distance is 0, it indicates that the two sequences are exactly the same, that is, the division of multiple task execution nodes in the first allocation result and the available memory of multiple task execution nodes The data is completely corresponding, so it is judged that the first allocation result is normal; when the Levinstein distance is too large (that is, the Levinstein distance is greater than the preset distance threshold), it indicates that the two sequences are not the same, so the first allocation is judged
  • the result is not normal.
  • the preset distance threshold is, for example, 2-10, preferably 3-5.
  • the computing resource allocation method of the present application is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass the special setting in the computing resource allocation system, that is, the system includes multiple resource allocation nodes, A task acquisition node and a plurality of task execution nodes, wherein the plurality of resource allocation nodes include a first allocation node, a second allocation node, ..., the i-th allocation node, ..., the n-th allocation node;
  • Each task execution node is signally connected to the task acquisition node, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n;
  • the i-th distribution node is configured to: When the node is not in a normal state, the i-th distribution node is signally connected to the task acquisition node through a preset i-th channel, where the i-th channel includes the first channel, the second channel, ..., Channel i-1; the task acquisition node is configured
  • an embodiment of the present application provides a computing resource allocation device, which is applied to the task acquisition node according to any one of the above, and includes:
  • the computer task obtaining unit 10 is used to obtain the computer task input by the user;
  • the computer task sending unit 20 is configured to send the computer task to the first distribution node through the first channel;
  • the receiving judging unit 30 is configured to judge whether a first distribution result sent by the first distribution node is received within a first preset time, wherein the first distribution result is the task of the first distribution node to the computer The result of the allocation;
  • the first allocation result judgment unit 40 is configured to, if the first allocation result sent by the first allocation node is received within the first preset time, judge the first allocation result according to a preset allocation result judgment method Is it normal
  • the split processing unit 50 is configured to, if the first distribution result is normal, perform split processing on the computer task according to the first distribution result, so as to obtain multiple subtasks;
  • the subtask sending unit 60 is configured to send the multiple subtasks to the multiple task execution nodes respectively.
  • the computer task sending unit 20 includes:
  • a memory acquisition request sending subunit configured to send available memory acquisition requests to the multiple task execution nodes respectively;
  • a memory data acquisition subunit for acquiring multiple available memory data returned by the multiple task execution nodes respectively;
  • An abnormal memory data judging subunit used for judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data
  • the normal available memory data acquisition subunit is configured to remove the abnormal memory data to obtain a plurality of normal available memory data if there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, and The task execution node corresponding to the abnormal memory data is excluded from the multiple task execution nodes;
  • the computer task sending subunit is configured to send the computer task and the multiple normally available memory data to the first distribution node through the first channel.
  • the device includes:
  • the computer task resending unit is configured to send the computer task to the second channel through the second channel if the first distribution result sent by the first distribution node is not received within the first preset time Two distribution nodes;
  • the second allocation result receiving and judging unit is configured to judge whether a second allocation result sent by the second allocation node is received within a second preset time, wherein the second allocation result is that the second allocation node has The result of the assignment of the computer tasks;
  • a second allocation result judging unit configured to judge whether the second allocation result is normal if the second allocation result sent by the second allocation node is received within the second preset time
  • a plurality of subtask acquiring units are configured to, if the second distribution result is normal, split the computer task according to the second distribution result, thereby obtaining a plurality of subtasks, and send the plurality of subtasks to multiple subtasks respectively.
  • a task execution node configured to, if the second distribution result is normal, split the computer task according to the second distribution result, thereby obtaining a plurality of subtasks, and send the plurality of subtasks to multiple subtasks respectively.
  • the first allocation result includes data allocation amounts corresponding to the multiple task execution nodes, respectively, and the first allocation result judgment unit 40 includes:
  • the first sequence obtaining subunit is configured to sort the multiple task execution nodes in the first distribution result in descending order according to the size of the data distribution amount, so as to obtain the first sequence;
  • the available memory data obtaining subunit is configured to send available memory obtaining requests to the multiple task execution nodes, and obtain multiple available memory data returned by the multiple task execution nodes respectively;
  • the second sequence obtaining subunit is configured to arrange the plurality of task execution nodes in descending order according to the size of the plurality of available memory data, so as to obtain the second sequence;
  • a Levinstein distance calculation subunit configured to calculate the Levinstein distance between the first sequence and the second sequence, and determine whether the Levinstein distance is greater than a preset distance threshold
  • the first distribution result normal determination subunit is configured to determine that the first distribution result is normal if the Levinstein distance is not greater than a preset distance threshold.
  • the computing resource allocation device of the present application is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass the special setting in the computing resource allocation system, that is, the system includes multiple resource allocation nodes, A task acquisition node and a plurality of task execution nodes, wherein the plurality of resource allocation nodes include a first allocation node, a second allocation node, ..., the i-th allocation node, ..., the n-th allocation node;
  • Each task execution node is signally connected to the task acquisition node, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n;
  • the i-th distribution node is configured to: When the node is not in a normal state, the i-th distribution node is signally connected to the task acquisition node through a preset i-th channel, where the i-th channel includes the first channel, the second channel, ..., Channel i-1; the task acquisition node is configured
  • an embodiment of the present application also provides a computer device.
  • the computer device may be a server, and its internal structure may be as shown in the figure.
  • the computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor designed by the computer is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, a computer program, and a database.
  • the memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium.
  • the database of the computer equipment is used to store the data used in the computing resource allocation method.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer program is executed by the processor to realize a computing resource allocation method.
  • the foregoing processor executes the foregoing computing resource allocation method, wherein the steps included in the method respectively correspond to the steps of executing the computing resource allocation method of the foregoing embodiment, and will not be repeated here.
  • the computer device of the present application implements a computing resource allocation method, and the method is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass a special setting in the computing resource allocation system, that is, where
  • the system includes multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, where the multiple resource allocation nodes include a first allocation node, a second allocation node,..., an i-th allocation node,..., The nth distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal connection, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n; the i-th distribution node is configured to, When the i-1th distribution node is not in a normal state, the i-th distribution node is signally connected to the task acquisition node through a preset i-th channel, wherein the i-th channel includes the first channel, The second channel,..., the i-1
  • An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a method for allocating computing resources is implemented, wherein the steps included in the method are respectively the same as those in performing the calculation in the foregoing embodiment.
  • the steps of the resource allocation method correspond to each other, so I won't repeat them here.
  • the computer-readable storage medium may be non-volatile or volatile.
  • the computer-readable storage medium of the present application implements a computing resource allocation method, and the method is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass special settings in the computing resource allocation system , That is, the system includes multiple resource allocation nodes, task acquisition nodes and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node, a second allocation node,..., the i-th allocation node,.
  • the nth distribution node the plurality of task execution nodes are respectively connected to the task acquisition node signal, n is an integer greater than 1, i is an integer greater than 1 and less than or equal to n; the i-th distribution node is It is configured that, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the i-th channel includes the A channel, a second channel, ..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, send the computer task to the plurality of resource allocation nodes, and receive According to the allocation result of the multiple resource allocation nodes to the computer task, the computer task is allocated to the multiple task execution nodes according to the allocation result. So as to ensure the smoothness of the overall system operation.
  • Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual-rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

Abstract

The present application relates to the field of artificial intelligence, and provides a computing resource allocation system, method, and apparatus, a computer device, and a storage medium. The system comprises a plurality of resource allocation nodes, a task obtaining node, and a plurality of task execution nodes; the plurality of resource allocation nodes comprise a first allocation node, ..., and an n-th allocation node; the plurality of task execution nodes are separately signaled to the task obtaining node; the i-th allocation node is configured to be signaled to the task obtaining node by means of a preset i-th channel when the (i-1)-th allocation node is not in a normal state, and the i-th channel comprises a first channel, ..., and an (i-1)-th channel; the task obtaining node is configured to obtain a computer task input by a user, send the computer task to the plurality of resource allocation nodes, receive an allocation result, and allocate the computer task to the plurality of task execution nodes. Therefore, the operation smoothness of the whole system is ensured.

Description

计算资源分配***、方法、装置和计算机设备Computing resource allocation system, method, device and computer equipment
本申请要求于2020年3月13日提交中国专利局、申请号为202010177684.8,发明名称为“计算资源分配***、方法、装置和计算机设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on March 13, 2020 with the application number 202010177684.8 and the invention title "Computer Resource Allocation System, Method, Device and Computer Equipment", the entire content of which is incorporated by reference In this application.
技术领域Technical field
本申请涉及到人工智能领域,特别是涉及到一种计算资源分配***、方法、装置、计算机设备和存储介质。This application relates to the field of artificial intelligence, in particular to a computing resource allocation system, method, device, computer equipment, and storage medium.
背景技术Background technique
计算机资源分配是计算机领域中的重要内容。传统的计算机资源分配方法,是在一个主节点获取用户提交的计算机任务(例如一个主程序),该主节点将该计算机任务划分为多个子任务(子线程),并交给具有其他节点分别进行执行,从而实现分布式的线程划分。但是发明人发现传统的计算机资源分配方法,由于其进行任务划分是基于主节点来完成的,那么当主节点压力过大时,例如当多个用户同时提交多个计算机任务时,主节点将无法顺畅完成任务划分,从而造成延迟等异常状况的出现,造成整个计算机***的运转不畅。Computer resource allocation is an important content in the computer field. The traditional computer resource allocation method is to obtain the computer task submitted by the user (for example, a main program) at a master node. The master node divides the computer task into multiple subtasks (subthreads) and assigns them to other nodes to perform the tasks separately. Execute to achieve distributed thread division. However, the inventor found that the traditional computer resource allocation method is based on the main node to complete the task division, so when the main node is too stressed, for example, when multiple users submit multiple computer tasks at the same time, the main node will not be able to smoothly Completing the task division, resulting in delays and other abnormal conditions, resulting in poor operation of the entire computer system.
技术问题technical problem
保证整体***运转的流畅性。Ensure the smoothness of the overall system operation.
技术解决方案Technical solutions
本申请的主要目的为提供一种计算资源分配***、方法、装置、计算机设备和存储介质,旨在保证整体***运转的流畅性。The main purpose of this application is to provide a computing resource allocation system, method, device, computer equipment, and storage medium to ensure the smoothness of the overall system operation.
为了实现上述发明目的,本申请提出一种计算资源分配***,包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;In order to achieve the above-mentioned object of the invention, this application proposes a computing resource allocation system, including multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node and a second allocation node. Node,..., the i-th distribution node,..., the n-th distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is greater than 1 and less than An integer equal to n;
所述第一分配节点被配置为,当所述第一分配节点处于正常状态时,所述第一分配节点通过预设的第一通道与所述任务获取节点信号连接;The first distribution node is configured to, when the first distribution node is in a normal state, the first distribution node is in a signal connection with the task acquisition node through a preset first channel;
所述第二分配节点被配置为,当所述第一分配节点不处于正常状态时,所述第二分配节点通过预设的第二通道与所述任务获取节点信号连接,其中所述第二通道包括所述第一通道;The second distribution node is configured to, when the first distribution node is not in a normal state, the second distribution node is in signal connection with the task acquisition node through a preset second channel, wherein the second distribution node is The channel includes the first channel;
所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;The i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i-th channel includes the first channel, the second channel, ..., the i-1th channel;
所述第n分配节点被配置为,当所述第n-1分配节点不处于正常状态时,所述第n分配节点通过预设的第n通道与所述任务获取节点信号连接,其中所述第n通道包括所述第一通道、第二通道、...、第n-1通道;The nth distribution node is configured to, when the n-1th distribution node is not in a normal state, the nth distribution node is in signal connection with the task acquisition node through a preset nth channel, wherein the The nth channel includes the first channel, the second channel, ..., the n-1th channel;
所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。The task acquisition node is configured to acquire a computer task input by a user, send the computer task to the multiple resource allocation nodes, receive the allocation result of the computer task by the multiple resource allocation nodes, and according to all The allocation result allocates the computer task to the multiple task execution nodes.
本申请提供一种计算资源分配方法,应用于如上所述任一项的任务获取节点,包括:The present application provides a computing resource allocation method, which is applied to any one of the task acquisition nodes described above, and includes:
获取用户输入的计算机任务;Obtain the computer task entered by the user;
通过所述第一通道,将所述计算机任务发送给所述第一分配节点;Sending the computer task to the first distribution node through the first channel;
判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;Judging whether a first distribution result sent by the first distribution node is received within a first preset time, where the first distribution result is a result of the first distribution node distributing the computer task;
若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;If the first distribution result sent by the first distribution node is received within the first preset time, determine whether the first distribution result is normal according to a preset distribution result judgment method;
若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;If the first allocation result is normal, split the computer task according to the first allocation result to obtain multiple subtasks;
将所述多个子任务分别发送给所述多个任务执行节点。The multiple subtasks are sent to the multiple task execution nodes respectively.
本申请提供一种计算资源分配装置,其中,应用于如上述任一项所述的任务获取节点,包括:The present application provides a computing resource allocation device, which is applied to the task acquisition node as described in any one of the above, and includes:
计算机任务获取单元,用于获取用户输入的计算机任务;The computer task acquisition unit is used to acquire the computer task input by the user;
计算机任务发送单元,用于通过所述第一通道,将所述计算机任务发送给所述第一分配节点;A computer task sending unit, configured to send the computer task to the first distribution node through the first channel;
接收判断单元,用于判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;The receiving judgment unit is configured to judge whether the first distribution result sent by the first distribution node is received within a first preset time, wherein the first distribution result is that the first distribution node performs the computer task The result of the allocation;
第一分配结果判断单元,用于若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;The first allocation result judgment unit is configured to, if the first allocation result sent by the first allocation node is received within the first preset time, determine whether the first allocation result is based on a preset allocation result judgment method normal;
拆分处理单元,用于若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;A split processing unit, configured to perform split processing on the computer task according to the first assignment result if the first assignment result is normal, so as to obtain multiple subtasks;
子任务发送单元,用于将所述多个子任务分别发送给所述多个任务执行节点。The subtask sending unit is configured to send the multiple subtasks to the multiple task execution nodes respectively.
本申请提供一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,所述处理器执行所述计算机程序时实现计算资源分配方法,该计算资源分配方法应用于如权利要求1或2所述的任务获取节点,包括:获取用户输入的计算机任务;通过所述第一通道,将所述计算机任务发送给所述第一分配节点;判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;将所述多个子任务分别发送给所述多个任务执行节点。The present application provides a computer device, including a memory and a processor, the memory stores a computer program, and the processor implements a computing resource allocation method when the computer program is executed, and the computing resource allocation method is applied to claim 1 or 2. The task acquisition node includes: acquiring a computer task input by a user; sending the computer task to the first distribution node through the first channel; The first distribution result sent by the first distribution node, where the first distribution result is the result of the first distribution node distributing the computer task; if the first distribution result is received within the first preset time The first distribution result sent by the distribution node is determined according to the preset distribution result judgment method to determine whether the first distribution result is normal; if the first distribution result is normal, the computer will be processed according to the first distribution result. The task is split and processed to obtain multiple subtasks; the multiple subtasks are respectively sent to the multiple task execution nodes.
本申请提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现计算资源分配方法,该计算资源分配方法应用于如权利要求1或2所述的任务获取节点,包括:获取用户输入的计算机任务;通过所述第一通道,将所述计算机任务发送给所述第一分配节点;判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;将所述多个子任务分别发送给所述多个任务执行节点。The present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a method for allocating computing resources is implemented, and the method for allocating computing resources is applied to the task according to claim 1 or 2. Obtaining a node includes: obtaining a computer task input by a user; sending the computer task to the first distribution node through the first channel; determining whether the first distribution node is received within a first preset time The first distribution result sent, where the first distribution result is the result of the first distribution node distributing the computer task; if the first distribution node receives the first distribution result within the first preset time For an allocation result, judge whether the first allocation result is normal according to the preset allocation result judgment method; if the first allocation result is normal, then split the computer task according to the first allocation result , Thereby obtaining multiple subtasks; sending the multiple subtasks to the multiple task execution nodes respectively.
有益效果Beneficial effect
本申请的计算资源分配***、方法、装置、计算机设备和存储介质,其中***包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。从而保证整体***运转的流畅性。The computing resource allocation system, method, device, computer equipment, and storage medium of the present application, wherein the system includes multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node , The second distribution node,..., the i-th distribution node,..., the n-th distribution node; the plurality of task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is An integer greater than 1 and less than or equal to n; the i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node communicates with the i-th channel through a preset A task acquisition node signal connection, wherein the i-th channel includes the first channel, the second channel, ..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, and The computer task is sent to the multiple resource allocation nodes, the allocation result of the computer task by the multiple resource allocation nodes is received, and the computer task is allocated to the multiple task execution nodes according to the allocation result . So as to ensure the smoothness of the overall system operation.
附图说明Description of the drawings
图1 为本申请一实施例的计算资源分配***的结构示意框图;Figure 1 is a schematic block diagram of the structure of a computing resource allocation system according to an embodiment of this application;
图2 为本申请一实施例的计算资源分配方法的流程示意图;FIG. 2 is a schematic flowchart of a computing resource allocation method according to an embodiment of this application;
图3 为本申请一实施例的计算资源分配装置的结构示意框图;3 is a schematic block diagram of the structure of a computing resource allocation device according to an embodiment of the application;
图4 为本申请一实施例的计算机设备的结构示意框图。FIG. 4 is a schematic block diagram of the structure of a computer device according to an embodiment of the application.
本发明的最佳实施方式The best mode of the present invention
参照图1,本申请实施例提供一种计算资源分配***,包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;1, an embodiment of the present application provides a computing resource allocation system, including multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node and a second allocation node. Node,..., the i-th distribution node,..., the n-th distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is greater than 1 and less than An integer equal to n;
所述第一分配节点被配置为,当所述第一分配节点处于正常状态时,所述第一分配节点通过预设的第一通道与所述任务获取节点信号连接;The first distribution node is configured to, when the first distribution node is in a normal state, the first distribution node is in a signal connection with the task acquisition node through a preset first channel;
所述第二分配节点被配置为,当所述第一分配节点不处于正常状态时,所述第二分配节点通过预设的第二通道与所述任务获取节点信号连接,其中所述第二通道包括所述第一通道;The second distribution node is configured to, when the first distribution node is not in a normal state, the second distribution node is in signal connection with the task acquisition node through a preset second channel, wherein the second distribution node is The channel includes the first channel;
所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;The i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i-th channel includes the first channel, the second channel, ..., the i-1th channel;
所述第n分配节点被配置为,当所述第n-1分配节点不处于正常状态时,所述第n分配节点通过预设的第n通道与所述任务获取节点信号连接,其中所述第n通道包括所述第一通道、第二通道、...、第n-1通道;The nth distribution node is configured to, when the n-1th distribution node is not in a normal state, the nth distribution node is in signal connection with the task acquisition node through a preset nth channel, wherein the The nth channel includes the first channel, the second channel, ..., the n-1th channel;
所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。The task acquisition node is configured to acquire a computer task input by a user, send the computer task to the multiple resource allocation nodes, receive the allocation result of the computer task by the multiple resource allocation nodes, and according to all The allocation result allocates the computer task to the multiple task execution nodes.
本申请的计算机资源分配***采用特殊的设置(参见附图1),即资源分配节点彼此间采用阶梯式分级别设置,当需要分配的计算机任务过重而导致底层级的分配节点不处于正常状态时,及时将资源分配的工作转换至高层级的分配节点,以保证***的正常运转。并且采用的信号通道仍包括原有的信号通道,节省了重设置的时间。其中所述信号通道可为具有实体的信号通道(例如实体的信号线等),也可为不具有实体的信号通道(例如无线信号通道)。The computer resource allocation system of the present application adopts a special setting (see Figure 1), that is, the resource allocation nodes are arranged in a stepwise and hierarchical manner. When the computer tasks that need to be allocated are too heavy, the lower-level allocation nodes are not in a normal state. When the time, the resource allocation work is transferred to the high-level allocation node in time to ensure the normal operation of the system. And the adopted signal channel still includes the original signal channel, which saves the time of resetting. The signal channel may be a physical signal channel (for example, a physical signal line, etc.), or a signal channel that does not have a physical signal (for example, a wireless signal channel).
当信号通道为具有实体的信号通道时,第一通道、第二通道直到第n通道之间的互相包括关系,可通过信号开关的方式进行设置,例如在第一通道与第二通道中除第一通道的部分的交叉处设置信号开关,该信号开关能够控制信号的走向(即当第一分配节点处于正常状态下时,使第一分配节点与任务获取节点连接;当第一分配节点处于不正常状态下时,使例如第二分配节点的非第一分配节点与任务获取节点连接)。其中,所述第二通道包括所述第一通道的理解为,所述第二通道包括所述第一通道的全部,或者,所述第二通道包括所述第一通道的至少部分通道。When the signal channel is a physical signal channel, the mutual inclusion relationship between the first channel, the second channel and the nth channel can be set by means of a signal switch, for example, the first channel and the second channel are divided by A signal switch is set at the intersection of a part of the channel, and the signal switch can control the direction of the signal (that is, when the first distribution node is in a normal state, the first distribution node is connected to the task acquisition node; when the first distribution node is not In the normal state, connect the non-first distribution node such as the second distribution node to the task acquisition node). Where the second channel includes the first channel is understood to mean that the second channel includes all of the first channel, or the second channel includes at least a part of the first channel.
当信号通道为不具有实体的信号通道时,所述第一通道例如为任务获取节点与所述第一分配节点之间的第一路由结构(路径),所述第一路由结构可以为动态路由也可为静态路由。当需要修改为第二通道时,在第一路由结构的基础上,构建第二路由结构,以使任务获取节点与所述第二分配节点信号连接。其中,所述第二通道包括所述第一通道的理解为,所述第二通道包括所述第一通道的全部,或者,所述第二通道包括所述第一通道的至少部分通道。When the signal channel is a signal channel with no entity, the first channel is, for example, a first routing structure (path) between a task acquisition node and the first distribution node, and the first routing structure may be a dynamic routing It can also be a static route. When the second channel needs to be modified, a second routing structure is constructed on the basis of the first routing structure, so that the task acquisition node is signally connected to the second distribution node. Where the second channel includes the first channel is understood to mean that the second channel includes all of the first channel, or the second channel includes at least a part of the first channel.
本申请中的节点可为任意可行节点,例如为独立的计算机终端等。本申请中执行主体为任务获取节点,而该任务获取节点是作为整个***的中枢,与多个任务执行节点信号连接,与多个资源分配节点信号连接,并且还用于获取用户输入的计算机任务。但是,该任务获取节点将需要对计算机任务进行分配的工作划分了出去,由多个资源分配节点,因此任务获取节点的实际负荷并不大,相对于传统方案中将所有工作都集中在一个节点中完成,本申请的计算资源分配***更为稳定。进一步地,本申请中的多个任务执行节点在接收到被分配的子任务后,还能够进行多个任务执行节点之间的数据协调。其中所述数据协调的实现方式例如为:监控任务执行节点的可用内存数据,当可用内存数据小于预定数值时,将接收到的至少部分子任务发送给其他任务执行节点。The node in this application can be any feasible node, such as an independent computer terminal. The execution subject in this application is the task acquisition node, and the task acquisition node serves as the hub of the entire system. It is signal-connected to multiple task execution nodes, is signal-connected to multiple resource allocation nodes, and is also used to obtain computer tasks input by users. . However, the task acquisition node divides the work that needs to be assigned to computer tasks, and multiple resource allocation nodes, so the actual load of the task acquisition node is not large, compared to the traditional solution where all the work is concentrated on one node Completed, the computing resource allocation system of this application is more stable. Further, after the multiple task execution nodes in the present application receive the assigned subtasks, they can also perform data coordination among the multiple task execution nodes. The implementation of the data coordination is, for example, monitoring the available memory data of the task execution node, and when the available memory data is less than a predetermined value, sending at least part of the received subtasks to other task execution nodes.
进一步地,本申请的计算资源分配***中的所述第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点的内存依次增大。本申请采用特殊的资源分配节点彼此间采用阶梯式分级别设置,即是为了减轻分配节点处于异常状态时对整个***的影响。更进一步地,采用了多个分配节点的内存依次增大,从而使多个分配节点的算力依次提高,这样,在前一级别的分配节点异常时,后一级别的分配节点更有可能承受前一级别的分配节点无法完成的分配任务。更进一步地,所述第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点分别对应的CPU主频依次增大。Further, the memory of the first allocation node, the second allocation node,..., the i-th allocation node,..., the n-th allocation node in the computing resource allocation system of the present application increases sequentially. In this application, special resource allocation nodes are arranged in a stepwise manner among each other, that is, to reduce the impact on the entire system when the allocation nodes are in an abnormal state. Furthermore, the memory of multiple distribution nodes is increased sequentially, so that the computing power of multiple distribution nodes is sequentially increased. In this way, when the distribution node of the previous level is abnormal, the distribution node of the latter level is more likely to bear Assignment tasks that cannot be completed by the assignment node at the previous level. Furthermore, the CPU frequencies corresponding to the first distribution node, the second distribution node, ..., the i-th distribution node, ..., and the n-th distribution node respectively increase in order.
本申请的计算资源分配***,该***包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。从而保证整体***运转的流畅性。The computing resource allocation system of the present application includes multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node, a second allocation node,..., The i-th distribution node,..., the n-th distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n; The i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i channel includes the first channel, the second channel, ..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, and send the computer task to the plurality of The resource allocation node receives the allocation result of the computer task by the multiple resource allocation nodes, and allocates the computer task to the multiple task execution nodes according to the allocation result. So as to ensure the smoothness of the overall system operation.
参照图2,本申请实施例提供一种计算资源分配方法,应用于如上述任一项(即前述实施例中任一项)所述的任务获取节点,包括:2, an embodiment of the present application provides a computing resource allocation method, which is applied to the task acquisition node described in any one of the foregoing (that is, any one of the foregoing embodiments), including:
S1、获取用户输入的计算机任务;S1. The computer task of obtaining user input;
S2、通过所述第一通道,将所述计算机任务发送给所述第一分配节点;S2. Send the computer task to the first distribution node through the first channel;
S3、判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;S3. Determine whether a first distribution result sent by the first distribution node is received within a first preset time, where the first distribution result is a result of the first distribution node assigning the computer task;
S4、若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;S4. If the first distribution result sent by the first distribution node is received within the first preset time, determine whether the first distribution result is normal according to a preset distribution result judgment method;
S5、若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;S5. If the first allocation result is normal, split the computer task according to the first allocation result to obtain multiple subtasks;
S6、将所述多个子任务分别发送给所述多个任务执行节点。S6. Send the multiple subtasks to the multiple task execution nodes respectively.
本申请可采用任意可行方式获取用户输入的计算机任务,例如为通过预设的输入设备进行输入,例如利用U盘接口等物理接口等方式进行输入,也可以通过远程信号传输的方式输入计算机任务。其中所述计算机任务例如为一个完整的程序。所述第一通道可为具有实体的信号通道,也可能为不具有实体的信号通道。在初始阶段,即未确认所有分配节点的状态的阶段,先通过所述第一通道,将所述计算机任务发送给所述第一分配节点。在正常情况下,第一分配节点将在第一预设时间内完成对计算机任务的分配,并发送给任务获取节点。在不正常情况下,例如第一分配节点由于负荷过重导致死机,那么第一分配节点在第一预设时间内无法完成计算机任务的分配与发送。由此可进行初次判断第一分配节点是否正常。This application can use any feasible method to obtain the computer task input by the user, for example, input through a preset input device, for example, using a physical interface such as a U disk interface for input, or input computer tasks through remote signal transmission. The computer task is, for example, a complete program. The first channel may be a signal channel with entities or a signal channel without entities. In the initial stage, that is, the stage in which the states of all allocation nodes are not confirmed, the computer task is first sent to the first allocation node through the first channel. Under normal circumstances, the first distribution node will complete the distribution of the computer task within the first preset time and send it to the task acquisition node. Under abnormal circumstances, for example, the first distribution node crashes due to overload, then the first distribution node cannot complete the distribution and sending of computer tasks within the first preset time. From this, it is possible to determine for the first time whether the first distribution node is normal.
若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,表明初步判定第一分配节点正常。本申请更进一步地,对所述第一分配节点发送的第一分配结果进行二次判断,以判断所述第一分配结果是否正常。其中判断的方式可为任意可行方式,例如判断所述第一分配结果是否符合正态分布,若所述第一分配结果符合正态分布,则判定第一分配结果正常。If the first distribution result sent by the first distribution node is received within the first preset time, it indicates that the first distribution node is preliminarily determined to be normal. The present application further performs a second judgment on the first allocation result sent by the first allocation node to determine whether the first allocation result is normal. The judgment method may be any feasible method, such as judging whether the first distribution result conforms to a normal distribution, and if the first distribution result conforms to a normal distribution, it is determined that the first distribution result is normal.
由于第一分配节点正常,因此其生成的第一分配结果可用,并且第一通道无需进行修改。据此,根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,将所述多个子任务分别发送给所述多个任务执行节点,即可完成计算资源的分配。Since the first distribution node is normal, the first distribution result generated by it is available, and the first channel does not need to be modified. Accordingly, the computer task is split and processed according to the first allocation result to obtain multiple subtasks, and the multiple subtasks are respectively sent to the multiple task execution nodes to complete the allocation of computing resources .
本申请可应用于任意可行场景,例如为:用户向本申请的计算资源分配***提交应用程序或任务,计算资源分配***中的任务获取节点接收该应用程序或任务,任务获取节点将该应用程序或任务通过第一通道发送给第一分配节点;第一分配节点利用预设的任务划分器进行划分,再将划分的结果发给任务获取节点;任务获取节点根据划分的结果对该应用程序或任务进行具体划分,以得到多个子任务;任务获取节点将任务获取节点发给多个任务执行节点;任务执行节点构建与子任务对应的线程,并在线程池中执行。其中,子任务的发送可通过序列化的方式进行。序列化是将数据转换为可以存储或传输的形式的过程。在序列化期间,数据写入到临时或持久性存储区。以后,可以通过从存储区中进行反序列化,重新创建该数据。对应地,任务执行节点可通过反序列化获取具体的子任务。进一步地,在任务执行节点执行子任务的过程中,还将执行子任务的状态和进度发送给所述任务获取节点,以使任务获取节点能够及时掌握任务执行节点的运行状态。进一步地,当计算机任务执行完成后,该计算机任务的注销与关闭的指令,能够由所述任务执行节点生成,或者由所述任务获取节点生成,从而完成整个计算机任务的分配与最终的执行。This application can be applied to any feasible scenario, for example: a user submits an application or task to the computing resource allocation system of this application, a task acquisition node in the computing resource allocation system receives the application or task, and the task acquisition node applies the application Or the task is sent to the first distribution node through the first channel; the first distribution node uses a preset task divider to divide, and then sends the result of the division to the task acquisition node; the task acquisition node according to the result of the division, the application or The task is specifically divided to obtain multiple subtasks; the task acquisition node sends the task acquisition node to multiple task execution nodes; the task execution node constructs threads corresponding to the subtasks and executes them in the thread pool. Among them, the sending of subtasks can be carried out in a serialized manner. Serialization is the process of converting data into a form that can be stored or transmitted. During serialization, data is written to temporary or persistent storage. Later, you can recreate the data by deserializing it from the storage area. Correspondingly, the task execution node can obtain specific subtasks through deserialization. Further, in the process of executing the subtask by the task execution node, the status and progress of the execution of the subtask are also sent to the task acquisition node, so that the task acquisition node can grasp the running status of the task execution node in time. Further, after the execution of the computer task is completed, the instructions for logging off and closing the computer task can be generated by the task execution node or the task acquisition node, thereby completing the distribution and final execution of the entire computer task.
在一个实施方式中,所述通过所述第一通道,将所述计算机任务发送给所述第一分配节点的步骤S2,包括:In one embodiment, the step S2 of sending the computer task to the first distribution node through the first channel includes:
S201、向所述多个任务执行节点分别发送可用内存获取请求;S201: Send an available memory acquisition request to the multiple task execution nodes respectively;
S202、获取所述多个任务执行节点分别返回的多个可用内存数据;S202: Obtain multiple available memory data returned by the multiple task execution nodes respectively;
S203、判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;S203: Determine whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
S204、若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;S204. If there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, remove the abnormal memory data to obtain a plurality of normally available memory data, and assign a task corresponding to the abnormal memory data The execution node is excluded from the multiple task execution nodes;
S205、通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。S205. Send the computer task and the multiple normally available memory data to the first distribution node through the first channel.
如上所述,实现了通过所述第一通道,将所述计算机任务发送给所述第一分配节点。本申请进一步地采用异常内存数据和异常任务执行节点排除,并依据可用内存数据作为计算资源分配的依据,以提高分配的准确性。由于本申请使用的是可用内存数据,因此能够实现动态的计算资源分配,相比于传统的静态计算资源分配,更灵活且效率更高。其中,由于任务执行节点也存在满负荷运行的状态,此时可用内存极小,即小于预设的内存阈值的异常内存数据,因此不应将其列为实际的任务执行节点,故将其排除。再通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点,以使第一分配节点具有计算资源分配的准确依据。As described above, it is realized that the computer task is sent to the first distribution node through the first channel. This application further uses abnormal memory data and abnormal task execution node elimination, and uses available memory data as a basis for computing resource allocation to improve the accuracy of allocation. Since this application uses available memory data, it can realize dynamic computing resource allocation, which is more flexible and more efficient than traditional static computing resource allocation. Among them, because the task execution node is also running at full capacity, the available memory is extremely small at this time, that is, abnormal memory data less than the preset memory threshold, so it should not be listed as the actual task execution node, so it should be excluded . Then, through the first channel, the computer task and the multiple normally available memory data are sent to the first allocation node, so that the first allocation node has an accurate basis for computing resource allocation.
在一个实施方式中,所述判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果的步骤S3之后,包括:In an embodiment, the determining whether a first distribution result sent by the first distribution node is received within a first preset time, wherein the first distribution result is that the first distribution node performs the assignment to the computer After step S3 of the result of task assignment, it includes:
S31、若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,则通过所述第二通道,将所述计算机任务发送给所述第二分配节点;S31. If the first distribution result sent by the first distribution node is not received within the first preset time, send the computer task to the second distribution node through the second channel;
S32、判断在第二预设时间内是否接收有所述第二分配节点发送的第二分配结果,其中所述第二分配结果是所述第二分配节点对所述计算机任务进行分配的结果;S32. Determine whether a second distribution result sent by the second distribution node is received within a second preset time, where the second distribution result is a result of the second distribution node assigning the computer task;
S33、若在第二预设时间内接收有所述第二分配节点发送的第二分配结果,则判断所述第二分配结果是否正常;S33: If the second distribution result sent by the second distribution node is received within the second preset time, determine whether the second distribution result is normal;
S34、若所述第二分配结果正常,则根据所述第二分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,并将多个子任务分别发送给多个任务执行节点。S34. If the second allocation result is normal, split the computer task according to the second allocation result to obtain multiple subtasks, and send the multiple subtasks to multiple task execution nodes respectively.
如上所述,实现了将多个子任务分别发送给多个任务执行节点。若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,表明第一分配节点异常,无法胜任计算资源分配的工作。据此,利用本申请的特殊的设置,即资源分配节点彼此间采用阶梯式分级别设置,在第一分配节点异常的情况下,将第一通道修改为第二通道,并通过所述第二通道,将所述计算机任务发送给所述第二分配节点,以使计算机资源分配能够继续执行。其中,所述第二分配结果是在第二分配节点中完成的,但是对于计算机任务的拆分,是在任务获取节点中完成了,从而避免了额外的信号传输的浪费,进一步提高了整体的计算资源分配与执行的效率。As mentioned above, multiple subtasks are sent to multiple task execution nodes respectively. If the first allocation result sent by the first allocation node is not received within the first preset time, it indicates that the first allocation node is abnormal and cannot perform the task of computing resource allocation. Accordingly, using the special setting of the present application, that is, the resource allocation nodes are arranged in a stepwise and hierarchical manner. When the first allocation node is abnormal, the first channel is modified to the second channel and passes through the second channel. Channel, sending the computer task to the second allocation node, so that the computer resource allocation can continue to be executed. Wherein, the second distribution result is completed in the second distribution node, but the splitting of computer tasks is completed in the task acquisition node, thereby avoiding the waste of additional signal transmission and further improving the overall Calculate the efficiency of resource allocation and execution.
在一个实施方式中,所述第一分配结果包括所述多个任务执行节点分别对应的数据分配量,所述根据预设的分配结果判断方法,判断所述第一分配结果是否正常的步骤S4,包括:In one embodiment, the first allocation result includes the data allocation amount corresponding to the multiple task execution nodes, and the step S4 of judging whether the first allocation result is normal according to a preset allocation result judgment method ,include:
S401、根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;S401. According to the size of the data distribution amount, arrange the multiple task execution nodes in the first distribution result in descending order, so as to obtain a first sequence;
S402、向所述多个任务执行节点分别发送可用内存获取请求,并获取所述多个任务执行节点分别返回的多个可用内存数据;S402: Send an available memory acquisition request to the multiple task execution nodes respectively, and acquire multiple available memory data returned by the multiple task execution nodes respectively;
S403、根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;S403: Arrange the multiple task execution nodes in descending order according to the size of the multiple available memory data, so as to obtain a second sequence;
S404、计算所述第一序列与所述第二序列的莱文斯坦距离,并判断所述莱文斯坦距离是否大于预设的距离阈值;S404: Calculate the Levinstein distance between the first sequence and the second sequence, and determine whether the Levinstein distance is greater than a preset distance threshold;
S405、若所述莱文斯坦距离不大于预设的距离阈值,则判定所述第一分配结果正常。S405. If the Levinstein distance is not greater than a preset distance threshold, determine that the first allocation result is normal.
如上所述,实现了根据预设的分配结果判断方法,判断所述第一分配结果是否正常。第一分配结果是第一分配节点对计算机任务的应如何分配的分析结果,本申请对其进行是否正常进行判断,以提高整体的流畅性。其中,为了避免在判断所述第一分配结果是否正常的过程中耗费过多的算力,本申请采用根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;再计算所述第一序列与所述第二序列的莱文斯坦距离,并以莱文斯坦距离作为是否正常的判断依据。其中,莱文斯坦距离是一种衡量两个序列之间差异度的一种距离,是指由一个序列转成另一个序列所需的最少编辑操作次数。所述编辑操作包括将替换、***和删除。莱文斯坦距离的最小值为0,当莱文斯坦距离为0时,表明两个序列完全相同,也即第一分配结果中的多个任务执行节点的划分与多个任务执行节点的可用内存数据是完全对应的,从而判断第一分配结果正常;当莱文斯坦距离过大时(即所述莱文斯坦距离大于预设的距离阈值),表明两个序列不相同,从而判断第一分配结果不正常。其中所述预设的距离阈值例如为2-10,优选为3-5。As described above, it is realized whether the first distribution result is normal according to the preset distribution result judgment method. The first distribution result is the analysis result of how the first distribution node should distribute the computer tasks. This application judges whether it is normal or not, so as to improve the overall fluency. Wherein, in order to avoid consuming too much computing power in the process of judging whether the first allocation result is normal, this application adopts descending order of multiple task execution nodes in the first allocation result according to the size of the data allocation amount Arrange to obtain the first sequence; according to the size of the multiple available memory data, arrange the multiple task execution nodes in descending order to obtain the second sequence; then calculate the first sequence and the second sequence Levinstein distance, and use Levinstein distance as the basis for judging whether it is normal. Among them, the Levinstein distance is a distance that measures the degree of difference between two sequences, and refers to the minimum number of editing operations required to transform one sequence into another sequence. The editing operations include replacing, inserting, and deleting. The minimum value of the Levinstein distance is 0. When the Levinstein distance is 0, it indicates that the two sequences are exactly the same, that is, the division of multiple task execution nodes in the first allocation result and the available memory of multiple task execution nodes The data is completely corresponding, so it is judged that the first allocation result is normal; when the Levinstein distance is too large (that is, the Levinstein distance is greater than the preset distance threshold), it indicates that the two sequences are not the same, so the first allocation is judged The result is not normal. The preset distance threshold is, for example, 2-10, preferably 3-5.
本申请的计算资源分配方法,应用于前述任一项所述的计算资源分配***中的任务获取节点,从而通过所述计算资源分配***中的特别设置,即其中***包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。从而保证整体***运转的流畅性。The computing resource allocation method of the present application is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass the special setting in the computing resource allocation system, that is, the system includes multiple resource allocation nodes, A task acquisition node and a plurality of task execution nodes, wherein the plurality of resource allocation nodes include a first allocation node, a second allocation node, ..., the i-th allocation node, ..., the n-th allocation node; Each task execution node is signally connected to the task acquisition node, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n; the i-th distribution node is configured to: When the node is not in a normal state, the i-th distribution node is signally connected to the task acquisition node through a preset i-th channel, where the i-th channel includes the first channel, the second channel, ..., Channel i-1; the task acquisition node is configured to acquire the computer task input by the user, send the computer task to the multiple resource allocation nodes, and receive the computer task from the multiple resource allocation nodes According to the distribution result of, the computer task is distributed to the multiple task execution nodes according to the distribution result. So as to ensure the smoothness of the overall system operation.
参照图3,本申请实施例提供一种计算资源分配装置,应用于如上述任一项所述的任务获取节点,包括:Referring to FIG. 3, an embodiment of the present application provides a computing resource allocation device, which is applied to the task acquisition node according to any one of the above, and includes:
计算机任务获取单元10,用于获取用户输入的计算机任务;The computer task obtaining unit 10 is used to obtain the computer task input by the user;
计算机任务发送单元20,用于通过所述第一通道,将所述计算机任务发送给所述第一分配节点;The computer task sending unit 20 is configured to send the computer task to the first distribution node through the first channel;
接收判断单元30,用于判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;The receiving judging unit 30 is configured to judge whether a first distribution result sent by the first distribution node is received within a first preset time, wherein the first distribution result is the task of the first distribution node to the computer The result of the allocation;
第一分配结果判断单元40,用于若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;The first allocation result judgment unit 40 is configured to, if the first allocation result sent by the first allocation node is received within the first preset time, judge the first allocation result according to a preset allocation result judgment method Is it normal
拆分处理单元50,用于若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;The split processing unit 50 is configured to, if the first distribution result is normal, perform split processing on the computer task according to the first distribution result, so as to obtain multiple subtasks;
子任务发送单元60,用于将所述多个子任务分别发送给所述多个任务执行节点。The subtask sending unit 60 is configured to send the multiple subtasks to the multiple task execution nodes respectively.
其中上述单元分别用于执行的操作与前述实施方式的计算资源分配方法的步骤一一对应,在此不再赘述。The operations performed by the above-mentioned units respectively correspond to the steps of the computing resource allocation method of the foregoing embodiment, and will not be repeated here.
在一个实施方式中,所述计算机任务发送单元20,包括:In one embodiment, the computer task sending unit 20 includes:
内存获取请求发送子单元,用于向所述多个任务执行节点分别发送可用内存获取请求;A memory acquisition request sending subunit, configured to send available memory acquisition requests to the multiple task execution nodes respectively;
内存数据获取子单元,用于获取所述多个任务执行节点分别返回的多个可用内存数据;A memory data acquisition subunit for acquiring multiple available memory data returned by the multiple task execution nodes respectively;
异常内存数据判断子单元,用于判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;An abnormal memory data judging subunit, used for judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
正常可用内存数据获取子单元,用于若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;The normal available memory data acquisition subunit is configured to remove the abnormal memory data to obtain a plurality of normal available memory data if there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, and The task execution node corresponding to the abnormal memory data is excluded from the multiple task execution nodes;
计算机任务发送子单元,用于通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。The computer task sending subunit is configured to send the computer task and the multiple normally available memory data to the first distribution node through the first channel.
其中上述子单元分别用于执行的操作与前述实施方式的计算资源分配方法的步骤一一对应,在此不再赘述。The operations performed by the aforementioned sub-units respectively correspond to the steps of the computing resource allocation method of the foregoing embodiment, and will not be repeated here.
在一个实施方式中,所述装置,包括:In one embodiment, the device includes:
计算机任务再次发送单元,用于若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,则通过所述第二通道,将所述计算机任务发送给所述第二分配节点;The computer task resending unit is configured to send the computer task to the second channel through the second channel if the first distribution result sent by the first distribution node is not received within the first preset time Two distribution nodes;
第二分配结果接收判断单元,用于判断在第二预设时间内是否接收有所述第二分配节点发送的第二分配结果,其中所述第二分配结果是所述第二分配节点对所述计算机任务进行分配的结果;The second allocation result receiving and judging unit is configured to judge whether a second allocation result sent by the second allocation node is received within a second preset time, wherein the second allocation result is that the second allocation node has The result of the assignment of the computer tasks;
第二分配结果判断单元,用于若在第二预设时间内接收有所述第二分配节点发送的第二分配结果,则判断所述第二分配结果是否正常;A second allocation result judging unit, configured to judge whether the second allocation result is normal if the second allocation result sent by the second allocation node is received within the second preset time;
多个子任务获取单元,用于若所述第二分配结果正常,则根据所述第二分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,并将多个子任务分别发送给多个任务执行节点。A plurality of subtask acquiring units are configured to, if the second distribution result is normal, split the computer task according to the second distribution result, thereby obtaining a plurality of subtasks, and send the plurality of subtasks to multiple subtasks respectively. A task execution node.
其中上述单元分别用于执行的操作与前述实施方式的计算资源分配方法的步骤一一对应,在此不再赘述。The operations performed by the above-mentioned units respectively correspond to the steps of the computing resource allocation method of the foregoing embodiment, and will not be repeated here.
在一个实施方式中,所述第一分配结果包括所述多个任务执行节点分别对应的数据分配量,所述第一分配结果判断单元40,包括:In one embodiment, the first allocation result includes data allocation amounts corresponding to the multiple task execution nodes, respectively, and the first allocation result judgment unit 40 includes:
第一序列获取子单元,用于根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;The first sequence obtaining subunit is configured to sort the multiple task execution nodes in the first distribution result in descending order according to the size of the data distribution amount, so as to obtain the first sequence;
可用内存数据获取子单元,用于向所述多个任务执行节点分别发送可用内存获取请求,并获取所述多个任务执行节点分别返回的多个可用内存数据;The available memory data obtaining subunit is configured to send available memory obtaining requests to the multiple task execution nodes, and obtain multiple available memory data returned by the multiple task execution nodes respectively;
第二序列获取子单元,用于根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;The second sequence obtaining subunit is configured to arrange the plurality of task execution nodes in descending order according to the size of the plurality of available memory data, so as to obtain the second sequence;
莱文斯坦距离计算子单元,用于计算所述第一序列与所述第二序列的莱文斯坦距离,并判断所述莱文斯坦距离是否大于预设的距离阈值;A Levinstein distance calculation subunit, configured to calculate the Levinstein distance between the first sequence and the second sequence, and determine whether the Levinstein distance is greater than a preset distance threshold;
第一分配结果正常判定子单元,用于若所述莱文斯坦距离不大于预设的距离阈值,则判定所述第一分配结果正常。The first distribution result normal determination subunit is configured to determine that the first distribution result is normal if the Levinstein distance is not greater than a preset distance threshold.
其中上述子单元分别用于执行的操作与前述实施方式的计算资源分配方法的步骤一一对应,在此不再赘述。The operations performed by the aforementioned sub-units respectively correspond to the steps of the computing resource allocation method of the foregoing embodiment, and will not be repeated here.
本申请的计算资源分配装置,应用于前述任一项所述的计算资源分配***中的任务获取节点,从而通过所述计算资源分配***中的特别设置,即其中***包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。从而保证整体***运转的流畅性。The computing resource allocation device of the present application is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass the special setting in the computing resource allocation system, that is, the system includes multiple resource allocation nodes, A task acquisition node and a plurality of task execution nodes, wherein the plurality of resource allocation nodes include a first allocation node, a second allocation node, ..., the i-th allocation node, ..., the n-th allocation node; Each task execution node is signally connected to the task acquisition node, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n; the i-th distribution node is configured to: When the node is not in a normal state, the i-th distribution node is signally connected to the task acquisition node through a preset i-th channel, where the i-th channel includes the first channel, the second channel, ..., Channel i-1; the task acquisition node is configured to acquire the computer task input by the user, send the computer task to the multiple resource allocation nodes, and receive the computer task from the multiple resource allocation nodes According to the distribution result of, the computer task is distributed to the multiple task execution nodes according to the distribution result. So as to ensure the smoothness of the overall system operation.
参照图4,本申请实施例中还提供一种计算机设备,该计算机设备可以是服务器,其内部结构可以如图所示。该计算机设备包括通过***总线连接的处理器、存储器、网络接口和数据库。其中,该计算机设计的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作***、计算机程序和数据库。该内存器为非易失性存储介质中的操作***和计算机程序的运行提供环境。该计算机设备的数据库用于存储计算资源分配方法所用数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时以实现一种计算资源分配方法。Referring to FIG. 4, an embodiment of the present application also provides a computer device. The computer device may be a server, and its internal structure may be as shown in the figure. The computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor designed by the computer is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer equipment is used to store the data used in the computing resource allocation method. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer program is executed by the processor to realize a computing resource allocation method.
上述处理器执行上述计算资源分配方法,其中所述方法包括的步骤分别与执行前述实施方式的计算资源分配方法的步骤一一对应,在此不再赘述。The foregoing processor executes the foregoing computing resource allocation method, wherein the steps included in the method respectively correspond to the steps of executing the computing resource allocation method of the foregoing embodiment, and will not be repeated here.
本申请的计算机设备实现一种计算资源分配方法,并且该方法应用于前述任一项所述的计算资源分配***中的任务获取节点,从而通过所述计算资源分配***中的特别设置,即其中***包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。从而保证整体***运转的流畅性。The computer device of the present application implements a computing resource allocation method, and the method is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass a special setting in the computing resource allocation system, that is, where The system includes multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, where the multiple resource allocation nodes include a first allocation node, a second allocation node,..., an i-th allocation node,..., The nth distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal connection, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n; the i-th distribution node is configured to, When the i-1th distribution node is not in a normal state, the i-th distribution node is signally connected to the task acquisition node through a preset i-th channel, wherein the i-th channel includes the first channel, The second channel,..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, send the computer task to the plurality of resource allocation nodes, and receive the plurality of According to the allocation result of the resource allocation node to the computer task, the computer task is allocated to the multiple task execution nodes according to the allocation result. So as to ensure the smoothness of the overall system operation.
本领域技术人员可以理解,图中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备的限定。Those skilled in the art can understand that the structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
本申请一实施例还提供一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现计算资源分配方法,其中所述方法包括的步骤分别与执行前述实施方式的计算资源分配方法的步骤一一对应,在此不再赘述。An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a method for allocating computing resources is implemented, wherein the steps included in the method are respectively the same as those in performing the calculation in the foregoing embodiment. The steps of the resource allocation method correspond to each other, so I won't repeat them here.
所述计算机可读存储介质可以是非易失性,也可以是易失性。The computer-readable storage medium may be non-volatile or volatile.
本申请的计算机可读存储介质实现一种计算资源分配方法,并且该方法应用于前述任一项所述的计算资源分配***中的任务获取节点,从而通过所述计算资源分配***中的特别设置,即其中***包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。从而保证整体***运转的流畅性。The computer-readable storage medium of the present application implements a computing resource allocation method, and the method is applied to the task acquisition node in the computing resource allocation system described in any one of the foregoing, so as to pass special settings in the computing resource allocation system , That is, the system includes multiple resource allocation nodes, task acquisition nodes and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node, a second allocation node,..., the i-th allocation node,. .., the nth distribution node; the plurality of task execution nodes are respectively connected to the task acquisition node signal, n is an integer greater than 1, i is an integer greater than 1 and less than or equal to n; the i-th distribution node is It is configured that, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the i-th channel includes the A channel, a second channel, ..., the i-1th channel; the task acquisition node is configured to acquire a computer task input by a user, send the computer task to the plurality of resource allocation nodes, and receive According to the allocation result of the multiple resource allocation nodes to the computer task, the computer task is allocated to the multiple task execution nodes according to the allocation result. So as to ensure the smoothness of the overall system operation.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一非易失性计算机可读取存储介质中,该计算机程序在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的和实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可以包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双速据率SDRAM(SSRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage. In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media provided in this application and used in the embodiments may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual-rate SDRAM (SSRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

Claims (20)

  1. 一种计算资源分配***,其中,包括多个资源分配节点、任务获取节点和多个任务执行节点,其中所述多个资源分配节点包括第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点;所述多个任务执行节点分别与所述任务获取节点信号连接,n为大于1的整数,i为大于1且小于等于n的整数;A computing resource allocation system, including multiple resource allocation nodes, task acquisition nodes, and multiple task execution nodes, wherein the multiple resource allocation nodes include a first allocation node, a second allocation node, ... i distribution node,..., nth distribution node; the multiple task execution nodes are respectively connected to the task acquisition node in signal, n is an integer greater than 1, and i is an integer greater than 1 and less than or equal to n;
    所述第一分配节点被配置为,当所述第一分配节点处于正常状态时,所述第一分配节点通过预设的第一通道与所述任务获取节点信号连接;The first distribution node is configured to, when the first distribution node is in a normal state, the first distribution node is in a signal connection with the task acquisition node through a preset first channel;
    所述第二分配节点被配置为,当所述第一分配节点不处于正常状态时,所述第二分配节点通过预设的第二通道与所述任务获取节点信号连接,其中所述第二通道包括所述第一通道;The second distribution node is configured to, when the first distribution node is not in a normal state, the second distribution node is in signal connection with the task acquisition node through a preset second channel, wherein the second distribution node is The channel includes the first channel;
    所述第i分配节点被配置为,当所述第i-1分配节点不处于正常状态时,所述第i分配节点通过预设的第i通道与所述任务获取节点信号连接,其中所述第i通道包括所述第一通道、第二通道、...、第i-1通道;The i-th distribution node is configured to, when the i-1th distribution node is not in a normal state, the i-th distribution node is in signal connection with the task acquisition node through a preset i-th channel, wherein the The i-th channel includes the first channel, the second channel, ..., the i-1th channel;
    所述第n分配节点被配置为,当所述第n-1分配节点不处于正常状态时,所述第n分配节点通过预设的第n通道与所述任务获取节点信号连接,其中所述第n通道包括所述第一通道、第二通道、...、第n-1通道;The nth distribution node is configured to, when the n-1th distribution node is not in a normal state, the nth distribution node is in signal connection with the task acquisition node through a preset nth channel, wherein the The nth channel includes the first channel, the second channel, ..., the n-1th channel;
    所述任务获取节点被配置为,获取用户输入的计算机任务,将所述计算机任务发送给所述多个资源分配节点,接收所述多个资源分配节点对所述计算机任务的分配结果,根据所述分配结果将所述计算机任务分配至所述多个任务执行节点。The task acquisition node is configured to acquire a computer task input by a user, send the computer task to the multiple resource allocation nodes, receive the allocation result of the computer task by the multiple resource allocation nodes, and according to all The allocation result allocates the computer task to the multiple task execution nodes.
  2. 根据权利要求1所述的计算资源分配***,其中,所述第一分配节点、第二分配节点、...、第i分配节点、...、第n分配节点的内存依次增大。The computing resource allocation system according to claim 1, wherein the memory of the first allocation node, the second allocation node,..., the i-th allocation node,..., and the n-th allocation node increase sequentially.
  3. 根据权利要求1或2所述的计算资源分配***,其中,所述***还包括:The computing resource allocation system according to claim 1 or 2, wherein the system further comprises:
    获取用户输入的计算机任务;Obtain the computer task entered by the user;
    通过所述第一通道,将所述计算机任务发送给所述第一分配节点;Sending the computer task to the first distribution node through the first channel;
    判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;Judging whether a first distribution result sent by the first distribution node is received within a first preset time, where the first distribution result is a result of the first distribution node distributing the computer task;
    若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;If the first distribution result sent by the first distribution node is received within the first preset time, determine whether the first distribution result is normal according to a preset distribution result judgment method;
    若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;If the first allocation result is normal, split the computer task according to the first allocation result to obtain multiple subtasks;
    将所述多个子任务分别发送给所述多个任务执行节点。The multiple subtasks are sent to the multiple task execution nodes respectively.
  4. 根据权利要求3所述的计算资源分配***,其中,所述通过所述第一通道,将所述计算机任务发送给所述第一分配节点的步骤,包括:The computing resource allocation system according to claim 3, wherein the step of sending the computer task to the first allocation node through the first channel comprises:
    向所述多个任务执行节点分别发送可用内存获取请求;Sending available memory acquisition requests to the multiple task execution nodes respectively;
    获取所述多个任务执行节点分别返回的多个可用内存数据;Acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;Judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
    若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;If there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, remove the abnormal memory data to obtain a plurality of normal available memory data, and assign the task execution node corresponding to the abnormal memory data Exclude from the multiple task execution nodes;
    通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。The computer task and the multiple normally available memory data are sent to the first distribution node through the first channel.
  5. 一种计算资源分配方法,其中,应用于如权利要求1或2所述的任务获取节点,包括:A method for allocating computing resources, which is applied to the task acquisition node according to claim 1 or 2, comprising:
    获取用户输入的计算机任务;Obtain the computer task entered by the user;
    通过所述第一通道,将所述计算机任务发送给所述第一分配节点;Sending the computer task to the first distribution node through the first channel;
    判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;Judging whether a first distribution result sent by the first distribution node is received within a first preset time, where the first distribution result is a result of the first distribution node distributing the computer task;
    若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;If the first distribution result sent by the first distribution node is received within the first preset time, determine whether the first distribution result is normal according to a preset distribution result judgment method;
    若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;If the first allocation result is normal, split the computer task according to the first allocation result to obtain multiple subtasks;
    将所述多个子任务分别发送给所述多个任务执行节点。The multiple subtasks are sent to the multiple task execution nodes respectively.
  6. 根据权利要求5所述的计算资源分配方法,其中,所述通过所述第一通道,将所述计算机任务发送给所述第一分配节点的步骤,包括:The computing resource allocation method according to claim 5, wherein the step of sending the computer task to the first allocation node through the first channel comprises:
    向所述多个任务执行节点分别发送可用内存获取请求;Sending available memory acquisition requests to the multiple task execution nodes respectively;
    获取所述多个任务执行节点分别返回的多个可用内存数据;Acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;Judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
    若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;If there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, remove the abnormal memory data to obtain a plurality of normal available memory data, and assign the task execution node corresponding to the abnormal memory data Exclude from the multiple task execution nodes;
    通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。The computer task and the multiple normally available memory data are sent to the first distribution node through the first channel.
  7. 根据权利要求5所述的计算资源分配方法,其中,所述判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果的步骤之后,包括:The method for allocating computing resources according to claim 5, wherein said determining whether a first allocation result sent by said first allocation node is received within a first preset time, wherein said first allocation result is said After the step of the first distributing node distributing the result of the computer task, it includes:
    若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,则通过所述第二通道,将所述计算机任务发送给所述第二分配节点;If the first distribution result sent by the first distribution node is not received within the first preset time, sending the computer task to the second distribution node through the second channel;
    判断在第二预设时间内是否接收有所述第二分配节点发送的第二分配结果,其中所述第二分配结果是所述第二分配节点对所述计算机任务进行分配的结果;Determining whether a second distribution result sent by the second distribution node is received within a second preset time, where the second distribution result is a result of the second distribution node's distribution of the computer task;
    若在第二预设时间内接收有所述第二分配节点发送的第二分配结果,则判断所述第二分配结果是否正常;If the second distribution result sent by the second distribution node is received within the second preset time, determining whether the second distribution result is normal;
    若所述第二分配结果正常,则根据所述第二分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,并将多个子任务分别发送给多个任务执行节点。If the second allocation result is normal, the computer task is split and processed according to the second allocation result to obtain multiple subtasks, and the multiple subtasks are respectively sent to multiple task execution nodes.
  8. 根据权利要求5所述的计算资源分配方法,其中,所述第一分配结果包括所述多个任务执行节点分别对应的数据分配量,所述根据预设的分配结果判断方法,判断所述第一分配结果是否正常的步骤,包括:The computing resource allocation method according to claim 5, wherein the first allocation result includes data allocation amounts corresponding to the plurality of task execution nodes respectively, and the first allocation result judgment method is used to judge the first allocation result. Steps for whether the distribution result is normal, including:
    根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;According to the size of the data distribution amount, arrange the multiple task execution nodes in the first distribution result in descending order, so as to obtain the first sequence;
    向所述多个任务执行节点分别发送可用内存获取请求,并获取所述多个任务执行节点分别返回的多个可用内存数据;Sending available memory acquisition requests to the multiple task execution nodes respectively, and acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;According to the size of the multiple available memory data, arrange the multiple task execution nodes in descending order to obtain a second sequence;
    计算所述第一序列与所述第二序列的莱文斯坦距离,并判断所述莱文斯坦距离是否大于预设的距离阈值;Calculating the Levinstein distance between the first sequence and the second sequence, and determining whether the Levinstein distance is greater than a preset distance threshold;
    若所述莱文斯坦距离不大于预设的距离阈值,则判定所述第一分配结果正常。If the Levinstein distance is not greater than a preset distance threshold, it is determined that the first allocation result is normal.
  9. 一种计算资源分配装置,其中,应用于如权利要求1或2所述的任务获取节点,包括:A computing resource allocation device, which is applied to the task acquisition node according to claim 1 or 2, comprising:
    计算机任务获取单元,用于获取用户输入的计算机任务;The computer task acquisition unit is used to acquire the computer task input by the user;
    计算机任务发送单元,用于通过所述第一通道,将所述计算机任务发送给所述第一分配节点;A computer task sending unit, configured to send the computer task to the first distribution node through the first channel;
    接收判断单元,用于判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;The receiving judgment unit is configured to judge whether the first distribution result sent by the first distribution node is received within a first preset time, wherein the first distribution result is that the first distribution node performs the computer task The result of the allocation;
    第一分配结果判断单元,用于若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;The first allocation result judgment unit is configured to, if the first allocation result sent by the first allocation node is received within the first preset time, determine whether the first allocation result is based on a preset allocation result judgment method normal;
    拆分处理单元,用于若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;A split processing unit, configured to perform split processing on the computer task according to the first assignment result if the first assignment result is normal, so as to obtain multiple subtasks;
    子任务发送单元,用于将所述多个子任务分别发送给所述多个任务执行节点。The subtask sending unit is configured to send the multiple subtasks to the multiple task execution nodes respectively.
  10. 根据权利要求9所述的计算资源分配装置,其中,所述计算机任务发送单元,包括:The computing resource allocation device according to claim 9, wherein the computer task sending unit comprises:
    内存获取请求发送子单元,用于向所述多个任务执行节点分别发送可用内存获取请求;A memory acquisition request sending subunit, configured to send available memory acquisition requests to the multiple task execution nodes respectively;
    内存数据获取子单元,用于获取所述多个任务执行节点分别返回的多个可用内存数据;A memory data acquisition subunit for acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    异常内存数据判断子单元,用于判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;An abnormal memory data judging subunit, used for judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
    正常可用内存数据获取子单元,用于若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;The normal available memory data acquisition subunit is configured to remove the abnormal memory data to obtain a plurality of normal available memory data if there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, and The task execution node corresponding to the abnormal memory data is excluded from the multiple task execution nodes;
    计算机任务发送子单元,用于通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。The computer task sending subunit is configured to send the computer task and the multiple normally available memory data to the first distribution node through the first channel.
  11. 根据权利要求9所述的计算资源分配装置,其中,所述装置,包括:The computing resource allocation device according to claim 9, wherein the device comprises:
    计算机任务再次发送单元,用于若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,则通过所述第二通道,将所述计算机任务发送给所述第二分配节点;The computer task resending unit is configured to send the computer task to the second channel through the second channel if the first distribution result sent by the first distribution node is not received within the first preset time Two distribution nodes;
    第二分配结果接收判断单元,用于判断在第二预设时间内是否接收有所述第二分配节点发送的第二分配结果,其中所述第二分配结果是所述第二分配节点对所述计算机任务进行分配的结果;The second allocation result receiving and judging unit is configured to judge whether a second allocation result sent by the second allocation node is received within a second preset time, wherein the second allocation result is that the second allocation node has The result of the assignment of the computer tasks;
    第二分配结果判断单元,用于若在第二预设时间内接收有所述第二分配节点发送的第二分配结果,则判断所述第二分配结果是否正常;A second allocation result judging unit, configured to judge whether the second allocation result is normal if the second allocation result sent by the second allocation node is received within the second preset time;
    多个子任务获取单元,用于若所述第二分配结果正常,则根据所述第二分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,并将多个子任务分别发送给多个任务执行节点。A plurality of subtask acquiring units are configured to, if the second distribution result is normal, split the computer task according to the second distribution result, thereby obtaining a plurality of subtasks, and send the plurality of subtasks to multiple subtasks respectively. A task execution node.
  12. 根据权利要求9所述的计算资源分配装置,其中,所述第一分配结果包括所述多个任务执行节点分别对应的数据分配量,所述第一分配结果判断单元40,包括:The computing resource allocation device according to claim 9, wherein the first allocation result includes data allocation amounts corresponding to the plurality of task execution nodes respectively, and the first allocation result judgment unit 40 includes:
    第一序列获取子单元,用于根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;The first sequence obtaining subunit is configured to sort the multiple task execution nodes in the first distribution result in descending order according to the size of the data distribution amount, so as to obtain the first sequence;
    可用内存数据获取子单元,用于向所述多个任务执行节点分别发送可用内存获取请求,并获取所述多个任务执行节点分别返回的多个可用内存数据;The available memory data obtaining subunit is configured to send available memory obtaining requests to the multiple task execution nodes, and obtain multiple available memory data returned by the multiple task execution nodes respectively;
    第二序列获取子单元,用于根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;The second sequence obtaining subunit is configured to arrange the plurality of task execution nodes in descending order according to the size of the plurality of available memory data, so as to obtain the second sequence;
    莱文斯坦距离计算子单元,用于计算所述第一序列与所述第二序列的莱文斯坦距离,并判断所述莱文斯坦距离是否大于预设的距离阈值;A Levinstein distance calculation subunit, configured to calculate the Levinstein distance between the first sequence and the second sequence, and determine whether the Levinstein distance is greater than a preset distance threshold;
    第一分配结果正常判定子单元,用于若所述莱文斯坦距离不大于预设的距离阈值,则判定所述第一分配结果正常。The first distribution result normal determination subunit is configured to determine that the first distribution result is normal if the Levinstein distance is not greater than a preset distance threshold.
  13. 一种计算机设备,包括存储器和处理器,所述存储器存储有计算机程序,其中,所述处理器执行所述计算机程序时实现计算资源分配方法,该计算资源分配方法应用于如权利要求1或2所述的任务获取节点,包括:A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements a computing resource allocation method when the computer program is executed, and the computing resource allocation method is applied to as claimed in claim 1 or 2. The task acquisition node includes:
    获取用户输入的计算机任务;Obtain the computer task entered by the user;
    通过所述第一通道,将所述计算机任务发送给所述第一分配节点;Sending the computer task to the first distribution node through the first channel;
    判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;Judging whether a first distribution result sent by the first distribution node is received within a first preset time, where the first distribution result is a result of the first distribution node distributing the computer task;
    若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;If the first distribution result sent by the first distribution node is received within the first preset time, determine whether the first distribution result is normal according to a preset distribution result judgment method;
    若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;If the first allocation result is normal, split the computer task according to the first allocation result to obtain multiple subtasks;
    将所述多个子任务分别发送给所述多个任务执行节点。The multiple subtasks are sent to the multiple task execution nodes respectively.
  14. 根据权利要求13所述的计算机设备,其中,所述通过所述第一通道,将所述计算机任务发送给所述第一分配节点的步骤,包括:The computer device according to claim 13, wherein the step of sending the computer task to the first distribution node through the first channel comprises:
    向所述多个任务执行节点分别发送可用内存获取请求;Sending available memory acquisition requests to the multiple task execution nodes respectively;
    获取所述多个任务执行节点分别返回的多个可用内存数据;Acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;Judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
    若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;If there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, remove the abnormal memory data to obtain a plurality of normal available memory data, and assign the task execution node corresponding to the abnormal memory data Exclude from the multiple task execution nodes;
    通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。The computer task and the multiple normally available memory data are sent to the first distribution node through the first channel.
  15. 根据权利要求13所述的计算机设备,其中,所述判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果的步骤之后,包括:The computer device according to claim 13, wherein said determining whether a first distribution result sent by said first distribution node is received within a first preset time, wherein said first distribution result is said first distribution result After the step of distributing the result of distributing the computer task by the node, it includes:
    若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,则通过所述第二通道,将所述计算机任务发送给所述第二分配节点;If the first distribution result sent by the first distribution node is not received within the first preset time, sending the computer task to the second distribution node through the second channel;
    判断在第二预设时间内是否接收有所述第二分配节点发送的第二分配结果,其中所述第二分配结果是所述第二分配节点对所述计算机任务进行分配的结果;Determining whether a second distribution result sent by the second distribution node is received within a second preset time, where the second distribution result is a result of the second distribution node's distribution of the computer task;
    若在第二预设时间内接收有所述第二分配节点发送的第二分配结果,则判断所述第二分配结果是否正常;If the second distribution result sent by the second distribution node is received within the second preset time, determining whether the second distribution result is normal;
    若所述第二分配结果正常,则根据所述第二分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,并将多个子任务分别发送给多个任务执行节点。If the second allocation result is normal, the computer task is split and processed according to the second allocation result to obtain multiple subtasks, and the multiple subtasks are respectively sent to multiple task execution nodes.
  16. 根据权利要求13所述的计算机设备,其中,所述第一分配结果包括所述多个任务执行节点分别对应的数据分配量,所述根据预设的分配结果判断方法,判断所述第一分配结果是否正常的步骤,包括:The computer device according to claim 13, wherein the first allocation result includes data allocation amounts corresponding to the plurality of task execution nodes, and the first allocation result is determined according to a preset allocation result judgment method. The steps for whether the result is normal, including:
    根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;According to the size of the data distribution amount, arrange the multiple task execution nodes in the first distribution result in descending order, so as to obtain the first sequence;
    向所述多个任务执行节点分别发送可用内存获取请求,并获取所述多个任务执行节点分别返回的多个可用内存数据;Sending available memory acquisition requests to the multiple task execution nodes respectively, and acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;According to the size of the multiple available memory data, arrange the multiple task execution nodes in descending order to obtain a second sequence;
    计算所述第一序列与所述第二序列的莱文斯坦距离,并判断所述莱文斯坦距离是否大于预设的距离阈值;Calculating the Levinstein distance between the first sequence and the second sequence, and determining whether the Levinstein distance is greater than a preset distance threshold;
    若所述莱文斯坦距离不大于预设的距离阈值,则判定所述第一分配结果正常。If the Levinstein distance is not greater than a preset distance threshold, it is determined that the first allocation result is normal.
  17. 一种计算机可读存储介质,其上存储有计算机程序,其中,所述计算机程序被处理器执行时实现计算资源分配方法,该计算资源分配方法应用于如权利要求1或2所述的任务获取节点,包括:A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, a computing resource allocation method is implemented, and the computing resource allocation method is applied to the task acquisition according to claim 1 or 2. Nodes, including:
    获取用户输入的计算机任务;Obtain the computer task entered by the user;
    通过所述第一通道,将所述计算机任务发送给所述第一分配节点;Sending the computer task to the first distribution node through the first channel;
    判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果;Judging whether a first distribution result sent by the first distribution node is received within a first preset time, where the first distribution result is a result of the first distribution node distributing the computer task;
    若在第一预设时间内接收有所述第一分配节点发送的第一分配结果,则根据预设的分配结果判断方法,判断所述第一分配结果是否正常;If the first distribution result sent by the first distribution node is received within the first preset time, determine whether the first distribution result is normal according to a preset distribution result judgment method;
    若所述第一分配结果正常,则根据所述第一分配结果对所述计算机任务进行拆分处理,从而得到多个子任务;If the first allocation result is normal, split the computer task according to the first allocation result to obtain multiple subtasks;
    将所述多个子任务分别发送给所述多个任务执行节点。The multiple subtasks are sent to the multiple task execution nodes respectively.
  18. 根据权利要求17所述的计算机可读存储介质,其中,所述通过所述第一通道,将所述计算机任务发送给所述第一分配节点的步骤,包括:The computer-readable storage medium according to claim 17, wherein the step of sending the computer task to the first distribution node through the first channel comprises:
    向所述多个任务执行节点分别发送可用内存获取请求;Sending available memory acquisition requests to the multiple task execution nodes respectively;
    获取所述多个任务执行节点分别返回的多个可用内存数据;Acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    判断所述多个可用内存数据中是否存在数值小于预设的内存阈值的异常内存数据;Judging whether there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data;
    若所述多个可用内存数据中存在数值小于预设的内存阈值的异常内存数据,则去除所述异常内存数据以得到多个正常可用内存数据,并将所述异常内存数据对应的任务执行节点从所述多个任务执行节点中排除;If there is abnormal memory data with a value less than a preset memory threshold in the plurality of available memory data, remove the abnormal memory data to obtain a plurality of normal available memory data, and assign the task execution node corresponding to the abnormal memory data Exclude from the multiple task execution nodes;
    通过所述第一通道,将所述计算机任务和所述多个正常可用内存数据发送给所述第一分配节点。The computer task and the multiple normally available memory data are sent to the first distribution node through the first channel.
  19. 根据权利要求17所述的计算机可读存储介质,其中,所述判断在第一预设时间内是否接收有所述第一分配节点发送的第一分配结果,其中所述第一分配结果是所述第一分配节点对所述计算机任务进行分配的结果的步骤之后,包括:The computer-readable storage medium according to claim 17, wherein said determining whether a first distribution result sent by said first distribution node is received within a first preset time, wherein said first distribution result is all After the step of distributing the result of the computer task by the first distributing node, the method includes:
    若在第一预设时间内未接收有所述第一分配节点发送的第一分配结果,则通过所述第二通道,将所述计算机任务发送给所述第二分配节点;If the first distribution result sent by the first distribution node is not received within the first preset time, sending the computer task to the second distribution node through the second channel;
    判断在第二预设时间内是否接收有所述第二分配节点发送的第二分配结果,其中所述第二分配结果是所述第二分配节点对所述计算机任务进行分配的结果;Judging whether a second distribution result sent by the second distribution node is received within a second preset time, where the second distribution result is a result of the second distribution node assigning the computer task;
    若在第二预设时间内接收有所述第二分配节点发送的第二分配结果,则判断所述第二分配结果是否正常;If the second distribution result sent by the second distribution node is received within the second preset time, determining whether the second distribution result is normal;
    若所述第二分配结果正常,则根据所述第二分配结果对所述计算机任务进行拆分处理,从而得到多个子任务,并将多个子任务分别发送给多个任务执行节点。If the second allocation result is normal, the computer task is split and processed according to the second allocation result to obtain multiple subtasks, and the multiple subtasks are respectively sent to multiple task execution nodes.
  20. 根据权利要求17所述的计算机可读存储介质,其中,所述第一分配结果包括所述多个任务执行节点分别对应的数据分配量,所述根据预设的分配结果判断方法,判断所述第一分配结果是否正常的步骤,包括:17. The computer-readable storage medium according to claim 17, wherein the first distribution result includes the data distribution amount corresponding to the plurality of task execution nodes, and the determination method is performed according to a preset distribution result judgment method. The steps for whether the first distribution result is normal include:
    根据数据分配量的大小,对所述第一分配结果中的多个任务执行节点进行降序排列,从而得到第一序列;According to the size of the data distribution amount, arrange the multiple task execution nodes in the first distribution result in descending order, so as to obtain the first sequence;
    向所述多个任务执行节点分别发送可用内存获取请求,并获取所述多个任务执行节点分别返回的多个可用内存数据;Sending available memory acquisition requests to the multiple task execution nodes respectively, and acquiring multiple available memory data returned by the multiple task execution nodes respectively;
    根据所述多个可用内存数据的大小,对所述多个任务执行节点进行降序排列,从而得到第二序列;According to the size of the multiple available memory data, arrange the multiple task execution nodes in descending order to obtain a second sequence;
    计算所述第一序列与所述第二序列的莱文斯坦距离,并判断所述莱文斯坦距离是否大于预设的距离阈值;Calculating the Levinstein distance between the first sequence and the second sequence, and determining whether the Levinstein distance is greater than a preset distance threshold;
    若所述莱文斯坦距离不大于预设的距离阈值,则判定所述第一分配结果正常。If the Levinstein distance is not greater than a preset distance threshold, it is determined that the first allocation result is normal.
PCT/CN2020/106078 2020-03-13 2020-07-31 Computing resource allocation system, method, and apparatus, and computer device WO2021179522A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010177684.8A CN111506400A (en) 2020-03-13 2020-03-13 Computing resource allocation system, method, device and computer equipment
CN202010177684.8 2020-03-13

Publications (1)

Publication Number Publication Date
WO2021179522A1 true WO2021179522A1 (en) 2021-09-16

Family

ID=71875763

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/106078 WO2021179522A1 (en) 2020-03-13 2020-07-31 Computing resource allocation system, method, and apparatus, and computer device

Country Status (2)

Country Link
CN (1) CN111506400A (en)
WO (1) WO2021179522A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115328663A (en) * 2022-10-10 2022-11-11 亚信科技(中国)有限公司 Method, device, equipment and storage medium for scheduling resources based on PaaS platform

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113254199A (en) * 2021-05-07 2021-08-13 埃森智能科技(深圳)有限公司 Method, system and equipment for simultaneously processing multiple tasks

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104731663A (en) * 2015-03-31 2015-06-24 北京奇艺世纪科技有限公司 Task processing method and system
US20160239341A1 (en) * 2015-02-12 2016-08-18 International Business Machines Corporation Dynamic correlated operation management for a distributed computing system
CN106909451A (en) * 2017-02-28 2017-06-30 郑州云海信息技术有限公司 A kind of distributed task dispatching system and method
CN107707592A (en) * 2017-01-24 2018-02-16 贵州白山云科技有限公司 Task processing method, node and content distributing network
CN108304255A (en) * 2017-12-29 2018-07-20 北京城市网邻信息技术有限公司 Distributed task dispatching method and device, electronic equipment and readable storage medium storing program for executing
CN110673938A (en) * 2019-09-23 2020-01-10 腾讯科技(深圳)有限公司 Task processing method, system, server and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160239341A1 (en) * 2015-02-12 2016-08-18 International Business Machines Corporation Dynamic correlated operation management for a distributed computing system
CN104731663A (en) * 2015-03-31 2015-06-24 北京奇艺世纪科技有限公司 Task processing method and system
CN107707592A (en) * 2017-01-24 2018-02-16 贵州白山云科技有限公司 Task processing method, node and content distributing network
CN106909451A (en) * 2017-02-28 2017-06-30 郑州云海信息技术有限公司 A kind of distributed task dispatching system and method
CN108304255A (en) * 2017-12-29 2018-07-20 北京城市网邻信息技术有限公司 Distributed task dispatching method and device, electronic equipment and readable storage medium storing program for executing
CN110673938A (en) * 2019-09-23 2020-01-10 腾讯科技(深圳)有限公司 Task processing method, system, server and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115328663A (en) * 2022-10-10 2022-11-11 亚信科技(中国)有限公司 Method, device, equipment and storage medium for scheduling resources based on PaaS platform
CN115328663B (en) * 2022-10-10 2023-01-03 亚信科技(中国)有限公司 Method, device, equipment and storage medium for scheduling resources based on PaaS platform

Also Published As

Publication number Publication date
CN111506400A (en) 2020-08-07

Similar Documents

Publication Publication Date Title
US11003507B2 (en) Mapreduce job resource sizing using assessment models
US8185908B2 (en) Dynamic scheduling in a distributed environment
CN105912399B (en) Task processing method, device and system
CN102835068B (en) Method and apparatus for managing reallocation of system resources
CN109408590B (en) Method, device and equipment for expanding distributed database and storage medium
WO2021179522A1 (en) Computing resource allocation system, method, and apparatus, and computer device
WO2021180092A1 (en) Task dispatching method and apparatus
WO2024021489A1 (en) Task scheduling method and apparatus, and kubernetes scheduler
CN112463390A (en) Distributed task scheduling method and device, terminal equipment and storage medium
TW201818244A (en) Method, apparatus and system for allocating resources of application clusters under cloud environment
US8316375B2 (en) Load-balancing of processes based on inertia
WO2023077750A1 (en) Method and apparatus for allocating neural network computing task among heterogeneous resources, and device
CN111163140A (en) Method, apparatus and computer readable storage medium for resource acquisition and allocation
WO2024022142A1 (en) Resource use method and apparatus
CN117234733A (en) Distributed system task allocation method, system, storage medium and equipment
CN110275777B (en) Resource scheduling system
CN107645421A (en) A kind of ISCSI protocol implementing methods of distributed storage
TW201627873A (en) Method and Apparatus of Processing Retransmission Request in Distributed Computing
CN113485828B (en) Distributed task scheduling system and method based on quatertz
KR100478346B1 (en) Load balancing method based on graph-partitioning for cluster sever and the system
KR102201651B1 (en) Probability-based data stream partitioning method considering task locality and downstream status
CN108809699B (en) Method for realizing large-scale virtual network node repeated mapping
KR100795593B1 (en) Grid computing system using dynamic grading and grouping, and data processing method thereof
CN113703930A (en) Task scheduling method, device and system and computer readable storage medium
KR20200094838A (en) Method and Device for Processing Big Data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20924308

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 16/01/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20924308

Country of ref document: EP

Kind code of ref document: A1