CN108259555B - The configuration method and device of parameter - Google Patents

The configuration method and device of parameter Download PDF

Info

Publication number
CN108259555B
CN108259555B CN201711239287.3A CN201711239287A CN108259555B CN 108259555 B CN108259555 B CN 108259555B CN 201711239287 A CN201711239287 A CN 201711239287A CN 108259555 B CN108259555 B CN 108259555B
Authority
CN
China
Prior art keywords
component
hardware
configuration
information
configuration strategy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711239287.3A
Other languages
Chinese (zh)
Other versions
CN108259555A (en
Inventor
黄雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
New H3C Big Data Technologies Co Ltd
Original Assignee
New H3C Big Data Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by New H3C Big Data Technologies Co Ltd filed Critical New H3C Big Data Technologies Co Ltd
Priority to CN201711239287.3A priority Critical patent/CN108259555B/en
Publication of CN108259555A publication Critical patent/CN108259555A/en
Application granted granted Critical
Publication of CN108259555B publication Critical patent/CN108259555B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/2866Architectures; Arrangements
    • H04L67/30Profiles
    • H04L67/303Terminal profiles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

This disclosure relates to the configuration method and device of a kind of parameter, the method is applied to server, the server and agent client, which are established, to be communicated to connect, on the host of the agent client deployment in the cluster, the described method includes: the environmental information that Receiving Agent client is sent, the hardware information of the host, and the running state information of each component of deployment on the host are carried in the environmental information;For each component, the recommended parameter value of the component is generated according to the running state information of the component and the hardware information;The recommended parameter value is sent to the agent client, in order to which the agent client is directed to each component, the component is configured using the recommended parameter value of the component.By the parameter according to the running environment recommended configuration component of component, automatic adaptation and the update of component parameter can be realized according to the configuration method of the parameter of the embodiment of the present disclosure and device.

Description

The configuration method and device of parameter
Technical field
This disclosure relates to the configuration method and device of big data technical field more particularly to a kind of parameter.
Background technique
Big data refers to that related data quantity is huge to that can not penetrate current main software tool, in the reasonable time Inside reach acquisition, management, processing and arranges the information for becoming help user.Big data big, data category with the data scale of construction Greatly, the feature that processing speed is fast, authenticity is high.
Big data processing relies on numerous services, such as HDFS (Hadoop Distributed File System, distributed text Part system), YARN (Yet Another Resource Negotiator, resource management system), Spark (distributed memory meter Calculate machine frame) etc..Because of reasons such as cluster environment difference is big, data format multiplicity processed, data scale of construction dynamic changes, lead to this The configuration of the parameter of a little serviced components is complex.
Summary of the invention
In view of this, can be realized the automatic of component parameter the present disclosure proposes a kind of configuration method of parameter and device Adaptation and update.
According to the one side of the disclosure, a kind of configuration method of parameter is provided, the method is applied to server, described Server and agent client, which are established, to be communicated to connect, on the host of the agent client deployment in the cluster, the method packet Include: the environmental information that Receiving Agent client is sent carries hardware information and the portion of the host in the environmental information The running state information of each component of administration on the host;For each component, according to the running state information of the component and The hardware information generates the recommended parameter value of the component;The recommended parameter value is sent to the agent client, so as to It is directed to each component in the agent client, the component is configured using the recommended parameter value of the component.
According to another aspect of the present disclosure, a kind of configuration device of parameter is provided, described device is applied to server, institute It states server and agent client is established and communicated to connect, on the host of the agent client deployment in the cluster, described device Include: the first receiving module, for the environmental information that Receiving Agent client is sent, carries the master in the environmental information The hardware information of machine, and the running state information of each component of deployment on the host;First generation module, for being directed to Each component generates the recommended parameter value of the component according to the running state information of the component and the hardware information;Send mould Block, in order to which the agent client is directed to each component, makes for the recommended parameter value to be sent to the agent client The component is configured with the recommended parameter value of the component.
The environmental information sent by Receiving Agent client, collects the hardware information of host, and is deployed in the master The running state information of each component on machine, according to the running state information and each component of hardware information generation with component Recommended parameter value, recommended parameter value is sent to agent client, in order to agent client using each component recommendation join Number respectively configures each component, according to the configuration method and device of the parameter of all aspects of this disclosure embodiment, Ke Yigen According to the parameter of the running environment recommended configuration component of component, automatic adaptation and the update of component parameter are realized.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, the other feature and aspect of the disclosure will become It is clear.
Detailed description of the invention
Comprising in the description and constituting the attached drawing of part of specification and specification together illustrates the disclosure Exemplary embodiment, feature and aspect, and for explaining the principles of this disclosure.
Fig. 1 shows the flow chart of the configuration method of the parameter according to one embodiment of the disclosure;
Fig. 2 shows the flow charts according to the configuration method of the parameter of one embodiment of the disclosure;
Fig. 3 shows the block diagram of the configuration device of the parameter according to one embodiment of the disclosure;
Fig. 4 shows the block diagram of the configuration device of the parameter according to one embodiment of the disclosure;
Fig. 5 shows the block diagram of the configuration device of the parameter according to one embodiment of the disclosure.
Specific embodiment
Various exemplary embodiments, feature and the aspect of the disclosure are described in detail below with reference to attached drawing.It is identical in attached drawing Appended drawing reference indicate element functionally identical or similar.Although the various aspects of embodiment are shown in the attached drawings, remove It non-specifically points out, it is not necessary to attached drawing drawn to scale.
Dedicated word " exemplary " means " being used as example, embodiment or illustrative " herein.Here as " exemplary " Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
In addition, giving numerous details in specific embodiment below to better illustrate the disclosure. It will be appreciated by those skilled in the art that without certain details, the disclosure equally be can be implemented.In some instances, for Method, means, element and circuit well known to those skilled in the art are not described in detail, in order to highlight the purport of the disclosure.
Fig. 1 shows the flow chart of the configuration method of the parameter according to one embodiment of the disclosure.As shown in Figure 1, this method can To be applied to server, the server and agent client, which are established, to be communicated to connect, and the agent client is disposed in the cluster On host, this method may include:
Step S11, the environmental information that Receiving Agent client is sent carry the hard of the host in the environmental information Part information, and the running state information of each component of deployment on the host.
Wherein, agent client can collect the parameter of current environmental information, each component of configuration, and carry out to component Operate (such as start stop operation) etc..
Environmental information may include the running state information of the hardware information of host and each component being deployed on host.Its In, the hardware information of host can be used to indicate that the information of the hardware resource of host.
The hardware resource of host includes CPU (Central Processing Unit, central processing unit), memory, magnetic Disk, network interface card etc..In one possible implementation, the hardware information of host may include hardware resource type and provide with hardware The corresponding amount of hardware resources of Source Type.The type of hardware resource can be used for identifying that hardware resource is CPU, memory, disk, net It is any in the hardware resources such as card.The type of hardware resource can be typonym, type number etc..The disclosure to how area Classifying type hardware resource type is with no restrictions.Amount of hardware resources corresponding with hardware resource type is for indicating the hardware resource class The specification of the hardware of type.It should be noted that the type of hardware resource is different, the unit of amount of hardware resources is different.
Component can be used to indicate that big data handles relied on service, such as HDFS, YARN, Spark etc..Component can be with It is identified according to component.Component mark can be component Name, component ID etc..How the disclosure is to distinguishing each component not It is limited.Running state information can be used to indicate that the operating status of component.The operating status of component includes running, hanging up, sleeping It sleeps, stop.
In one possible implementation, after server and agent client establish communication connection, agent client can The environmental information of collection is sent to server by heartbeat mechanism.Environment message can be since when agent client starts It sends, until agent client is closed, during which agent client can repeat to send environmental information.Agent client passes through heartbeat Mechanism is by hardware information, and the running state information of each component being deployed on this host is sent to server, can make to take The running environment of business device dynamic knowledge component.
Step S12 generates the component according to the running state information of the component and the hardware information for each component Recommended parameter value.
In one possible implementation, server can be by the running state information of the component and the hardware information It is matched with configuration strategy, the recommended parameter of the component is generated according to matching result.Fig. 2 shows according to one embodiment of the disclosure Parameter configuration method flow chart.As shown in Fig. 2, step S12 may be implemented are as follows:
Step S121 searches operating status and the matched configuration strategy of the hardware information with the component.
Wherein, configuration strategy can be used to indicate that the rule that parameter configuration is carried out to component.Configuration strategy may include group Part mark, running state information, hardware resource type, the maximum value of amount of hardware resources corresponding with hardware resource type, with it is hard The recommendation of the configuration parameter of the minimum value and component of the corresponding amount of hardware resources of part resource type.Wherein, recommendation can be with It is modified by WEB terminal, recommendation can be used for the configuration of optimization component.It should be noted that WEB terminal can be deployed in server On, it can also be deployed on the network equipment for the communication connection that other are established with server, the disclosure is without limitation.
Server can match the running state information of the component and hardware information with each single item of configuration strategy, When each single item all successful match, the operating status and the hardware information and the configuration strategy of the component can be determined With success.
In one possible implementation, step S121 may be implemented are as follows: obtain configuration strategy corresponding with the component. For each configuration strategy, whether the running state information for judging the component is consistent with the running state information of the configuration strategy, Whether the corresponding amount of hardware resources of each hardware resource type of hardware information, which is greater than or equal to the hardware in the configuration strategy, provides The minimum value of the corresponding amount of hardware resources of Source Type and to be less than or equal to the hardware resource type in the configuration strategy corresponding hard The maximum value of part stock number.For each configuration strategy, if the operation shape of the running state information of the component and the configuration strategy State information is consistent, and the corresponding amount of hardware resources of each hardware resource type of hardware information is greater than or equal in the configuration strategy should The minimum value of the corresponding amount of hardware resources of hardware resource type and be less than or equal to the configuration strategy in the hardware resource type pair The maximum value for the amount of hardware resources answered, it is determined that the operating status and the hardware information of the configuration strategy and the component Match.
Wherein, and the component of the corresponding configuration strategy of component mark is identical as the component mark of the component.The component can With corresponding one or more configuration strategies.
It should be noted that the component in configuration strategy identifies, operating status, hardware resource type, amount of hardware resources with Component mark, running state information, hardware resource type, amount of hardware resources meaning in environmental information is identical, no longer superfluous here It states.
In one example, the component of configuration strategy A is identified as first assembly, and running state information is operation, hardware money Source Type is CPU, and the maximum value of the amount of hardware resources of CPU is 5, minimum value 3;The component of configuration strategy B is identified as first Component, running state information are to hang up, and hardware resource type is CPU, and the maximum value of the amount of hardware resources of CPU is 5, minimum value It is 3.Server obtains the running state information of first assembly from environmental information as operation, and the hardware that hardware information is CPU provides Source amount is 4.Server can by the running state information of the first assembly in environmental information and hardware information respectively with configuration plan Slightly A and configuration strategy B is matched.For configuration strategy A, the running state information of configuration strategy A is operation and environmental information The running state information of middle first assembly is consistent, and the amount of hardware resources of the CPU of environmental information is 4, greater than the CPU of configuration strategy A Amount of hardware resources minimum value 3, the maximum value 5 of the amount of hardware resources less than the CPU of configuration strategy A, the operation of first assembly Status information and hardware information are all matched with each single item of configuration strategy A, the operating status of configuration strategy A and first assembly and The hardware information matching.For configuration strategy B, the running state information of configuration strategy B is to hang up and in environmental information first The running state information of component is inconsistent, therefore configuration strategy B cannot believe with the operating status of first assembly and the hardware Breath matching.
In one possible implementation, in configuration strategy can also include component configuration parameter default value, In, default value cannot be modified by WEB terminal, and default value can be used for component recovery to original state.
Step S122 then will if it exists with the operating status of the component and the matched configuration strategy of the hardware information Recommended parameter value of the recommendation as the component in the configuration strategy.
It in one possible implementation, further include the mark automatically updated in configuration strategy, the mark automatically updated Know recommended parameter value of the recommendation in the configuration strategy that can be used to determine whether to will match to automatically as the component.When true When automatically updating recommended parameter value surely, the recommendation in configuration strategy that server can directly will match to is as the component Recommended parameter value.When determine do not automatically update recommended parameter when, the recommendation for the configuration strategy that server can will match to and Default value is pushed to WEB terminal, by WEB terminal determine using in matching strategy recommendation or default value as the component recommendation join Numerical value.
Step S123, if it does not exist with the operating status of the component and the matched configuration strategy of the hardware information, then The recommended parameter value of the component is obtained from WEB terminal.
In one possible implementation, when there is no match with the operating status of the component and the hardware information Configuration strategy when, the operating status of the component and the hardware information can be pushed to WEB terminal by server, by WEB terminal Configuration recommendation parameter value, such as by user in WEB terminal configuration recommendation parameter value.
In one possible implementation, after the recommended parameter value for obtaining the component from WEB terminal, server may be used also It is corresponding to generate the component according to the operating status of the component, the hardware information and the recommended parameter value obtained from WEB terminal Configuration strategy.In this way, when being received again by the operating status of identical component with consistent hardware information, can directly be matched to pair The configuration strategy answered obtains the recommended parameter value of the component, without obtaining from WEB terminal, realizes the automatic suitable of component parameter Match and updates.
The recommended parameter value is sent to the agent client, in order to which the agent client is directed to by step S13 Each component configures the component using the recommended parameter value of the component.
In one possible implementation, recommended parameter can be sent to agent client by server, by agency visitor Family end configures each component according to the recommended parameter of each component.
In one possible implementation, for each component, when recommended parameter value and the component of the component are currently matched When the parameter difference set, the recommended parameter of the component is sent to agent client by server, in order to the agent client The component is configured using the recommended parameter value of the component.In this way, it is possible to reduce information content, and reduce to component parameter Refresh operation.
The environmental information sent by Receiving Agent client, collects the hardware information of host, and is deployed in the master The running state information of each component on machine, according to the running state information and each component of hardware information generation with component Recommended parameter value, recommended parameter value is sent to agent client, in order to agent client using each component recommendation join Number respectively configures each component, can be according to the operation ring of component according to the configuration method of the parameter of the embodiment of the present disclosure The parameter of border recommended configuration component realizes automatic adaptation and the update of component parameter.For the hardware change of host, such as host Memory increase etc., can be by hard after environment information acquisition hardware change according to the configuration method of the parameter of the embodiment of the present disclosure Part information realizes the automatic adaptation and more of component parameter according to the recommended parameter value of the hardware information formation component after the variation Newly.
In one possible implementation, server may also receive from the configuration strategy modification message of WEB terminal, and Modification configuration strategy corresponding with configuration strategy modification message.
In one example, the assembly operating state of configuration strategy, hardware resource type, corresponding with hardware resource type The maximum value and minimum value of hardware resource can be modified.The recommendation and default value of configuration strategy can be modified.Configuration The occurrence of strategy setting can be modified, such as increase occurrence, reduce occurrence etc..
Using example
The component of configuration strategy A is identified as first assembly, and running state information is operation, and hardware resource type is CPU, and The maximum value of the amount of hardware resources of CPU is 5, minimum value 3, and the maximum value of the amount of hardware resources of memory is 10, minimum value 1, Recommendation is the first recommendation;The component of configuration strategy B is identified as first assembly, and running state information is to hang up, hardware resource Type is CPU, and the maximum value of the amount of hardware resources of CPU is 5, minimum value 3, and the maximum value of the amount of hardware resources of memory is 10, minimum value 1, recommendation are the second recommendation.The component of configuration strategy C is identified as first assembly, and running state information is Operation, hardware resource type is CPU, and the maximum value of the amount of hardware resources of CPU is 3, minimum value 1, the hardware resource of memory The maximum value of amount is 10, minimum value 1, and recommendation is third recommendation.Application scenarios: server obtains from environmental information The running state information of one component is operation, and the amount of hardware resources that hardware information is CPU is 4, and the amount of hardware resources of memory is 6.
Under above-mentioned application scenarios, configuration strategy A is matched with the running state information of first assembly and the hardware information, Agent client configures first assembly using the first recommendation.
Example 1, on the basis of above-mentioned application scenarios, the operating status of CPU becomes hanging up from running.Server is from environment In information obtain first assembly running state information be hang up, the amount of hardware resources that hardware information is CPU is 4, memory it is hard Part stock number is 6.At this point, configuration strategy B is matched with the running state information of first assembly and the hardware information, proxy client End configures first assembly using the second recommendation.
Example 2, on the basis of above-mentioned application scenarios, the amount of hardware resources of CPU becomes 2.Server is from environmental information The running state information for obtaining first assembly is to hang up, and the amount of hardware resources that hardware information is CPU is 2, the hardware resource of memory Amount is 6.At this point, configuration strategy C is matched with the running state information of first assembly and the hardware information, agent client is used Third recommendation configures first assembly.
Example 3, on the basis of above-mentioned application scenarios, server receives the configuration strategy from WEB terminal and modifies message, will The maximum value of the memory source amount of configuration strategy A is revised as 3.Configuration strategy A becomes at this time: component is identified as first assembly, fortune Row status information is operation, and hardware resource type is CPU and memory, and the maximum value of the amount of hardware resources of CPU is 3, minimum value It is 1, the maximum value of the amount of hardware resources of memory is 3, minimum value 1, and recommendation is the first recommendation.In this way, configuration strategy A is not It is matched again with the running state information of first assembly and the hardware information.Other configurations strategy and first assembly if it does not exist Running state information and hardware information matching, server can obtain the recommended parameter value of first assembly from WEB terminal.
Example 4, on the basis of above-mentioned application scenarios, server receives the configuration strategy from WEB terminal and modifies message, will The recommendation of configuration strategy A is revised as the 4th recommendation.Configuration strategy A becomes at this time: component is identified as first assembly, runs shape State information is operation, and hardware resource type is CPU, and the maximum value of the amount of hardware resources of CPU is 5, minimum value 3, memory The maximum value of amount of hardware resources is 10, minimum value 1, and recommendation is the 4th recommendation.In this way, configuration strategy A and first assembly Running state information and hardware information matching, agent client first assembly is configured using the 4th recommendation
Fig. 3 shows the block diagram of the configuration device 30 of the parameter according to one embodiment of the disclosure.Described device 30 can be applied In server, the server and agent client are established and are communicated to connect, the host of the agent client deployment in the cluster On, as shown in figure 3, described device 30 may include:
First receiving module 31 carries in the environmental information for the environmental information that Receiving Agent client is sent The hardware information of the host, and the running state information of each component of deployment on the host;
First generation module 32 is believed for being directed to each component according to the running state information of the component and the hardware Breath generates the recommended parameter value of the component;
Sending module 33, for the recommended parameter value to be sent to the agent client, in order to the agency visitor Family end is directed to each component, is configured using the recommended parameter value of the component to the component.
Fig. 4 shows the block diagram of the configuration device 30 of the parameter according to one embodiment of the disclosure.As shown in figure 4, one kind can In the implementation of energy, the first generation module 32 is also used to: being searched and the operating status of the component and the hardware information The configuration strategy matched;It, then will be described if it exists with the operating status of the component and the matched configuration strategy of the hardware information Recommended parameter value of the recommendation as the component in configuration strategy;If it does not exist with the operating status of the component and described hard The configuration strategy of part information matches then obtains the recommended parameter value of the component from WEB terminal.
In one possible implementation, the first generation module 32 is also used to include: to obtain match corresponding with the component Set strategy;For each configuration strategy, if the running state information of the component is consistent with the running state information of the configuration strategy, The corresponding amount of hardware resources of each hardware resource type of hardware information is greater than or equal to the hardware resource class in the configuration strategy The minimum value of the corresponding amount of hardware resources of type and hardware corresponding less than or equal to the hardware resource type in configuration strategy money The maximum value of source amount, it is determined that the configuration strategy is matched with the operating status of the component and the hardware information.
In one possible implementation, described device 30 further include:
Second receiving module 34 is modified message for receiving the configuration strategy from WEB terminal, and is modified and the configuration plan The slightly corresponding configuration strategy of modification message.
In one possible implementation, described device 30 further include:
Second generation module 35, according to the operating status of the component, the hardware information and the recommendation obtained from WEB terminal Parameter value generates the corresponding configuration strategy of the component.
Fig. 5 is a kind of block diagram of configuration device 900 for parameter shown according to an exemplary embodiment.Reference Fig. 5, The device 900 may include processor 901, the machine readable storage medium 902 for being stored with machine-executable instruction.Processor 901 It can be communicated via system bus 903 with machine readable storage medium 902.Also, processor 901 passes through read machine readable storage Machine-executable instruction corresponding with the configuration logic of parameter is in medium 902 to execute the configuration method of parameters discussed above.
Machine readable storage medium 902 referred to herein can be any electronics, magnetism, optics or other physical stores Device may include or store information, such as executable instruction, data, etc..For example, machine readable storage medium may is that RAM (Radom Access Memory, random access memory), volatile memory, nonvolatile memory, flash memory, storage are driven Dynamic device (such as hard disk drive), solid state hard disk, any kind of storage dish (such as CD, dvd) or similar storage are situated between Matter or their combination.
The presently disclosed embodiments is described above, above description is exemplary, and non-exclusive, and It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill Many modifications and changes are obvious for the those of ordinary skill in art field.The selection of term used herein, purport In the principle, practical application or technological improvement to the technology in market for best explaining each embodiment, or lead this technology Other those of ordinary skill in domain can understand each embodiment disclosed herein.

Claims (10)

1. a kind of configuration method of parameter, which is characterized in that the method is applied to server, the server and proxy client Communication connection is established at end, and the agent client is disposed on host in the cluster, which comprises
The environmental information that Receiving Agent client is sent carries the hardware information of the host in the environmental information, and The running state information of each component of deployment on the host;Wherein, the service that the component is relied on by big data processing;
For each component, the configuration parameter of the component is generated according to the running state information of the component and the hardware information Recommended parameter value;Wherein, the recommended parameter value is obtained from configuration strategy;
The recommended parameter value is sent to the agent client, in order to which the agent client is directed to each component, is used The recommended parameter value of the component configures the component.
2. the method according to claim 1, wherein according to the running state information of the component and the hardware Information generates the recommended parameter value of the configuration parameter of the component, comprising:
Search the operating status and the matched configuration strategy of the hardware information with the component;
It, then will be in the configuration strategy if it exists with the operating status of the component and the matched configuration strategy of the hardware information Recommendation as the component configuration parameter recommended parameter value;
If it does not exist with the operating status of the component and the matched configuration strategy of the hardware information, then obtaining from WEB terminal should The recommended parameter value of the configuration parameter of component.
3. according to the method described in claim 2, it is characterized in that, the hardware information includes hardware resource type and and hardware The corresponding amount of hardware resources of resource type;Search the operating status and the matched configuration plan of the hardware information with the component Slightly, comprising:
Obtain configuration strategy corresponding with the component;
For each configuration strategy, if the running state information of the component is consistent with the running state information of the configuration strategy, firmly The corresponding amount of hardware resources of each hardware resource type of part information is greater than or equal to the hardware resource type in the configuration strategy The minimum value of corresponding amount of hardware resources and be less than or equal to the configuration strategy in the corresponding hardware resource of hardware resource type The maximum value of amount, it is determined that the configuration strategy is matched with the operating status of the component and the hardware information.
4. according to the method described in claim 2, it is characterized in that, the method also includes:
It receives the configuration strategy from WEB terminal and modifies message, and modify configuration plan corresponding with configuration strategy modification message Slightly.
5. according to the method described in claim 2, it is characterized in that, obtaining the recommendation ginseng of the configuration parameter of the component from WEB terminal After numerical value, the method also includes:
According to the operating status of the component, the hardware information and the recommended parameter value obtained from WEB terminal, the component pair is generated The configuration strategy answered.
6. a kind of configuration device of parameter, which is characterized in that described device is applied to server, the server and proxy client Communication connection is established at end, and the agent client is disposed on host in the cluster, and described device includes:
First receiving module carries the master in the environmental information for the environmental information that Receiving Agent client is sent The hardware information of machine, and the running state information of each component of deployment on the host;Wherein, the component is big data Handle relied on service;
First generation module is generated for being directed to each component according to the running state information of the component and the hardware information The recommended parameter value of the configuration parameter of the component;Wherein, the recommended parameter value is obtained from configuration strategy;
Sending module, for the recommended parameter value to be sent to the agent client, in order to the agent client needle To each component, the component is configured using the recommended parameter value of the component.
7. device according to claim 6, which is characterized in that the first generation module is also used to:
Search the operating status and the matched configuration strategy of the hardware information with the component;
It, then will be in the configuration strategy if it exists with the operating status of the component and the matched configuration strategy of the hardware information Recommendation as the component configuration parameter recommended parameter value;
If it does not exist with the operating status of the component and the matched configuration strategy of the hardware information, then obtaining from WEB terminal should The recommended parameter value of the configuration parameter of component.
8. device according to claim 7, which is characterized in that the hardware information includes hardware resource type and and hardware The corresponding amount of hardware resources of resource type;First generation module is also used to
Obtain configuration strategy corresponding with the component;
For each configuration strategy, if the running state information of the component is consistent with the running state information of the configuration strategy, firmly The corresponding amount of hardware resources of each hardware resource type of part information is greater than or equal to the hardware resource type in the configuration strategy The minimum value of corresponding amount of hardware resources and be less than or equal to the configuration strategy in the corresponding hardware resource of hardware resource type The maximum value of amount, it is determined that the configuration strategy is matched with the operating status of the component and the hardware information.
9. device according to claim 7, which is characterized in that described device further include:
Second receiving module modifies message for receiving the configuration strategy from WEB terminal, and modifies and modify with the configuration strategy The corresponding configuration strategy of message.
10. device according to claim 7, which is characterized in that described device further include:
Second generation module, after the recommended parameter value of the configuration parameter for obtaining the component from WEB terminal, according to the component Operating status, the hardware information and the recommended parameter value obtained from WEB terminal, generate the corresponding configuration strategy of the component.
CN201711239287.3A 2017-11-30 2017-11-30 The configuration method and device of parameter Active CN108259555B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711239287.3A CN108259555B (en) 2017-11-30 2017-11-30 The configuration method and device of parameter

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711239287.3A CN108259555B (en) 2017-11-30 2017-11-30 The configuration method and device of parameter

Publications (2)

Publication Number Publication Date
CN108259555A CN108259555A (en) 2018-07-06
CN108259555B true CN108259555B (en) 2019-11-12

Family

ID=62722095

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711239287.3A Active CN108259555B (en) 2017-11-30 2017-11-30 The configuration method and device of parameter

Country Status (1)

Country Link
CN (1) CN108259555B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110515670A (en) * 2019-09-03 2019-11-29 深圳市路畅科技股份有限公司 A kind of operation method of embedded device, system and a kind of host computer
CN110784546A (en) * 2019-10-31 2020-02-11 浙江大华技术股份有限公司 Distributed cluster deployment method, server and storage device
CN111310932A (en) * 2020-02-10 2020-06-19 深圳前海微众银行股份有限公司 Method, device and equipment for optimizing horizontal federated learning system and readable storage medium
CN111522669A (en) * 2020-04-29 2020-08-11 深圳前海微众银行股份有限公司 Method, device and equipment for optimizing horizontal federated learning system and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102255752A (en) * 2011-06-30 2011-11-23 北京新媒传信科技有限公司 Configuration management system and method of server cluster
CN105528230A (en) * 2015-12-23 2016-04-27 北京奇虎科技有限公司 Method and device for setting configuration parameters
CN107357555A (en) * 2016-05-09 2017-11-17 阿里巴巴集团控股有限公司 Configure method for pushing and device, system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2784673A1 (en) * 2013-03-28 2014-10-01 Alcatel Lucent Scheduling
JP2016042249A (en) * 2014-08-15 2016-03-31 富士通株式会社 Setting verification method, setting verification program, and setting verification device
CN104219329A (en) * 2014-09-28 2014-12-17 浪潮软件集团有限公司 Method for deploying service through content distribution in cluster server
CN106020930B (en) * 2016-05-13 2019-07-23 深圳市中润四方信息技术有限公司 A kind of application management method and system based on application container
CN106959892A (en) * 2017-03-30 2017-07-18 联想(北京)有限公司 Process handling method, device and electronic equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102255752A (en) * 2011-06-30 2011-11-23 北京新媒传信科技有限公司 Configuration management system and method of server cluster
CN105528230A (en) * 2015-12-23 2016-04-27 北京奇虎科技有限公司 Method and device for setting configuration parameters
CN107357555A (en) * 2016-05-09 2017-11-17 阿里巴巴集团控股有限公司 Configure method for pushing and device, system

Also Published As

Publication number Publication date
CN108259555A (en) 2018-07-06

Similar Documents

Publication Publication Date Title
CN108259555B (en) The configuration method and device of parameter
CN108282527B (en) Generate the distributed system and method for Service Instance
US10257142B2 (en) Message delivery in a message system
CN108289034B (en) A kind of fault discovery method and apparatus
CN107885539A (en) A kind of middleware management method and server
CN108881354A (en) A kind of pushed information storage method, device, server and computer storage medium
US8090873B1 (en) Methods and systems for high throughput information refinement
US20130227568A1 (en) Systems and methods involving virtual machine host isolation over a network
CN111262726A (en) Configuration information updating method and device and computer readable storage medium
CN107784068A (en) Acquisition methods, device, storage medium, processor and the service end of data variation
CN109104368B (en) Connection request method, device, server and computer readable storage medium
CN108769118B (en) Method and device for selecting master nodes in distributed system
CN108234607B (en) File distribution method and system based on micro-service architecture mode
CN111200523A (en) Middle station system configuration method, device, equipment and storage medium
US7949610B2 (en) Method and system for discovering dependencies in project plans of distributed system
CN111083204B (en) File transmission method, device and storage medium
CN114401319A (en) Request processing method, device, server and storage medium
CN106506641A (en) A kind of ident value extracting method of client device and device
CN113641742A (en) Data extraction method, device, equipment and storage medium
CN108768849A (en) Message processing method and device
CN110198227A (en) Processing method, device, storage medium and the electronic device of journal file
CN110417860A (en) File transfer management method, apparatus, equipment and storage medium
CN107968798A (en) A kind of network management resources label acquisition method, cache synchronization method, apparatus and system
CN103326892B (en) The operating method and device of web interface
US11714692B2 (en) Classical management of qubit requests

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant