CN107704362A - A kind of method and device based on Ambari monitoring big data components - Google Patents

A kind of method and device based on Ambari monitoring big data components Download PDF

Info

Publication number
CN107704362A
CN107704362A CN201710874410.2A CN201710874410A CN107704362A CN 107704362 A CN107704362 A CN 107704362A CN 201710874410 A CN201710874410 A CN 201710874410A CN 107704362 A CN107704362 A CN 107704362A
Authority
CN
China
Prior art keywords
monitored
ambari
monitoring
big data
monitored item
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710874410.2A
Other languages
Chinese (zh)
Inventor
崔俊珩
李国涛
张栋
石皓轩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inspur Software Co Ltd
Original Assignee
Inspur Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inspur Software Co Ltd filed Critical Inspur Software Co Ltd
Priority to CN201710874410.2A priority Critical patent/CN107704362A/en
Publication of CN107704362A publication Critical patent/CN107704362A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/30—Monitoring
    • G06F11/3089—Monitoring arrangements determined by the means or processing involved in sensing the monitored data, e.g. interfaces, connectors, sensors, probes, agents
    • G06F11/3093—Configuration details thereof, e.g. installation, enabling, spatial arrangement of the probes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention provides it is a kind of based on Ambari monitoring big data component method and device, this method, including：The monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface in advance；At least one monitored item of each big data component to be monitored is configured in Ambari in advance；For any big data component to be monitored, perform：Call the current monitor interface of current big data component to be monitored；The monitoring value of at least one monitored item of the current big data component to be monitored is obtained from the current monitor interface；The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that at least one monitored item of the user using the Ambari monitoring current big data component to be monitored.The present invention can more easily monitor big data component.

Description

A kind of method and device based on Ambari monitoring big data components
Technical field
The present invention relates to field of computer technology, it is more particularly to a kind of based on Ambari monitoring big data component method and Device.
Background technology
With the fast development of big data technology, monitoring to each big data component in big data system increasingly by To attention.
In the prior art, the monitoring for each big data component is mainly carried out by the daily record of big data component itself Monitoring.For example, when needing to monitor big data component A, first, user needs to obtain big data component A daily record, so Afterwards, user needs to search the monitoring value for each monitored item for needing to monitor from the daily record.
Visible by foregoing description, the project plan comparison for monitoring big data component in the prior art is cumbersome.
The content of the invention
, can be more square the embodiments of the invention provide a kind of method and device based on Ambari monitoring big data components Just big data component is monitored.
On the one hand, the embodiments of the invention provide a kind of method based on Ambari monitoring big data components, including：
The monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface in advance；
At least one monitored item of each big data component to be monitored is configured in Ambari in advance；
For any big data component to be monitored, perform：
Call the current monitor interface of current big data component to be monitored；
At least one monitored item of the current big data component to be monitored is obtained from the current monitor interface Monitoring value；
The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；
The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that described in user's utilization At least one monitored item of the Ambari monitoring current big data component to be monitored.
Further,
At least one monitored item for configuring each big data component to be monitored in Ambari in advance, including：
Each big data component to be monitored is added in the metrics.json files in the Ambari in advance The definition of at least one monitored item.
Further,
This method further comprises：
Each big data component to be monitored is added in the widget.json files in the Ambari in advance extremely The definition of at least one monitored item to be shown in a few monitored item, so that the Ambari is to described at least one to be shown Monitored item shown.
Further,
The monitoring value by least one monitored item is converted to the form that the Ambari can be identified, including：
For the monitoring value of each monitored item, the current monitor value of json string formats is resolved to java pairs As the java objects are converted into the form that the Ambari can identify.
Further,
After the monitoring value by least one monitored item is converted to the form that the Ambari can be identified, Before the monitoring value of at least one monitored item by after conversion is sent to the Ambari, further comprise：
For the monitoring value of each monitored item, the title of current monitor value is arranged to and the current monitor value pair Title of the monitored item answered in the Ambari is consistent.
Further,
The monitoring value of at least one monitored item by after conversion is sent to the Ambari, including：
The monitoring value of at least one monitored item after conversion is saved in caching；
The monitoring value of at least one monitored item after the conversion in the caching is periodically obtained, and is sent to institute State Ambari.
On the other hand, the embodiments of the invention provide a kind of device based on Ambari monitoring big data components, including：
Setting unit, for setting the monitoring interface to be not provided with monitoring the big data component to be monitored of interface；
Dispensing unit, for configuring at least one monitored item of each big data component to be monitored in Ambari；
Monitoring unit, for for any big data component to be monitored, performing：
Call the current monitor interface of current big data component to be monitored；
At least one monitored item of the current big data component to be monitored is obtained from the current monitor interface Monitoring value；
The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；
The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that described in user's utilization At least one monitored item of the Ambari monitoring current big data component to be monitored.
Further,
The dispensing unit, it is each described to be monitored for being added in the metrics.json files in the Ambari The definition of at least one monitored item of big data component.
Further,
The device further comprises：
Definition unit is shown, it is each described to be monitored for being added in the widget.json files in the Ambari The definition of at least one monitored item to be shown at least one monitored item of big data component, so that the Ambari is to described At least one monitored item to be shown is shown.
Further,
The monitoring unit, for the monitoring value for each monitored item, by the current prison of json string formats Control value resolves to java objects, and the java objects are converted into the form that the Ambari can identify.
Further,
The monitoring unit, it is further used for the monitoring value for each monitored item, by the title of current monitor value It is consistent to be arranged to title of the monitored item corresponding with the current monitor value in the Ambari.
Further,
The monitoring unit, for the monitoring value of at least one monitored item after conversion to be saved in caching, week The monitoring value of at least one monitored item after the conversion in the caching is obtained to phase property, and is sent to the Ambari.
In embodiments of the present invention, monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface, made Obtain each big data component to be monitored and be respectively provided with monitoring interface, the monitoring of each big data component to be monitored is configured in Ambari , in order to be monitored to these monitored item of configuration, call the monitoring interface of big data component to be monitored to obtain monitored item Monitoring value, each monitoring value is converted into form that Ambari can identify and is sent to Ambari, user can directly lead to The process such as monitored item, the acquisition process without participating in monitoring value that Ambari monitors each big data component to be monitored is crossed, can Directly to obtain the monitoring value needed, more easily monitoring big data component is realized.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are the present invention Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis These accompanying drawings obtain other accompanying drawings.
Fig. 1 is a kind of flow chart for method based on Ambari monitoring big data components that one embodiment of the invention provides；
Fig. 2 is the flow for another method based on Ambari monitoring big data components that one embodiment of the invention provides Figure；
Fig. 3 is a kind of schematic diagram for device based on Ambari monitoring big data components that one embodiment of the invention provides；
Fig. 4 is the signal for another device based on Ambari monitoring big data components that one embodiment of the invention provides Figure.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is Part of the embodiment of the present invention, rather than whole embodiments, based on the embodiment in the present invention, those of ordinary skill in the art The every other embodiment obtained on the premise of creative work is not made, belongs to the scope of protection of the invention.
As shown in figure 1, the embodiments of the invention provide a kind of method based on Ambari monitoring big data components, this method It may comprise steps of：
The monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface in advance；
At least one monitored item of each big data component to be monitored is configured in Ambari in advance；
For any big data component to be monitored, perform：
Step 101：Call the current monitor interface of current big data component to be monitored；
Step 102：Obtained from the current monitor interface at least one described in the current big data component to be monitored The monitoring value of individual monitored item；
Step 103：The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；
Step 104：The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that user Utilize at least one monitored item of the Ambari monitoring current big data component to be monitored.
In embodiments of the present invention, monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface, made Obtain each big data component to be monitored and be respectively provided with monitoring interface, the monitoring of each big data component to be monitored is configured in Ambari , in order to be monitored to these monitored item of configuration, call the monitoring interface of big data component to be monitored to obtain monitored item Monitoring value, each monitoring value is converted into form that Ambari can identify and is sent to Ambari, user can directly lead to The process such as monitored item, the acquisition process without participating in monitoring value that Ambari monitors each big data component to be monitored is crossed, can Directly to obtain the monitoring value needed, more easily monitoring big data component is realized.
In embodiments of the present invention, when monitoring is not provided with monitoring the big data component to be monitored of interface, call advance The monitoring interface of setting, when monitoring is provided with the big data component to be monitored of monitoring interface, call the monitoring interface carried.
In an embodiment of the present invention, it is described to configure each big data component to be monitored in Ambari in advance extremely A few monitored item, including：
Each big data component to be monitored is added in the metrics.json files in the Ambari in advance The definition of at least one monitored item.
In embodiments of the present invention, after the definition that monitored item is added by the metrics.json files in Ambari, Ambari can be monitored to these monitored item, and user can determine in the monitoring value of the monitored item in checking Ambari Corresponding definition., can be according to the prison in metrics.json files when Ambari receives the monitoring value of some monitored item The definition of item is controlled, determines monitored item corresponding to the monitoring value.For example, monitored item is CPU utilization rate, is received The monitoring value of CPU utilization rate is 80%, due to determining for the utilization rate for being already provided with CPU in metrics.json files Justice, when receiving the 80% monitoring value, can determine this is CPU utilization rate.
In embodiments of the present invention, the definition of monitored item can include the form of monitored item in metrics.json files Definition.Step 103, specifically include：For the monitoring value of each monitored item, the monitoring value of current monitor item is converted into current prison Control form of the item defined in metrics.json files.
In an embodiment of the present invention, this method further comprises：
Each big data component to be monitored is added in the widget.json files in the Ambari in advance extremely The definition of at least one monitored item to be shown in a few monitored item, so that the Ambari is to described at least one to be shown Monitored item shown.
In embodiments of the present invention, by adding the definition of monitored item in widget.json files, can cause Ambari is shown to the monitored item in widget.json files automatically.For example, monitored item is CPU utilization rate, is connect The monitoring value of the CPU received utilization rate is 80%, due to being already provided with CPU utilization rate in widget.json files Definition, Ambari receiving monitoring value as 80%, and the utilization rate that can show CPU is 80%, and user can pass through Ambari display interface views the information.
In embodiments of the present invention, the definition of monitored item can include the form of monitored item in widget.json files Definition.With form of the monitored item defined in metrics.json files in the form defined in widget.json files It can be consistent.
In an embodiment of the present invention, the monitoring value by least one monitored item is converted to the Ambari energy The form enough identified, including：
For the monitoring value of each monitored item, the current monitor value of json string formats is resolved to java pairs As the java objects are converted into the form that the Ambari can identify.
In embodiments of the present invention, the monitoring value obtained by monitoring interface is the data of json string formats, will The monitoring value of json string formats can more facilitate progress subsequent conversion after resolving to java objects.Ambari can be identified Form can be defined by metrics.json files and/or widget.json files, conversion when, can first root Determine that there is the Final Format to be converted into according to metrics.json files and/or widget.json files, then, will Java objects are converted to Final Format.
In an embodiment of the present invention, the Ambari is converted in the monitoring value by least one monitored item After the form that can be identified, the Ambari is sent in the monitoring value of at least one monitored item by after conversion Before, further comprise：
For the monitoring value of each monitored item, the title of current monitor value is arranged to and the current monitor value pair Title of the monitored item answered in the Ambari is consistent.
In embodiments of the present invention, the title of monitored item can be in metrics.json files and/or widget.json texts Part is defined., can be from metrics.json files and/or widget.json texts when setting the title of current monitor value The title of monitored item corresponding to current monitor value is determined in part, the title of current monitor value is arranged to and corresponding monitored item Title it is consistent.
In embodiments of the present invention, monitored item corresponding with the monitoring value is arranged to by the title for being worth monitoring to exist Title in Ambari is consistent, and Ambari can be enabled accurately to determine monitored item corresponding to the monitoring value, convenient follow-up Monitored item is monitored.For example, the monitored item of big data component A memory usage is configured with Ambari, It is entitled in Ambari：Big data component A memory usage, when getting internal memory in the monitoring interface from big data component A When the monitoring value of utilization rate is 45%, the title that the monitoring is worth is arranged to：Big data component A memory usage, so, when When Ambari receives the monitoring value, the memory usage that the monitoring value is big data component A can be accurately determined.If not yet Have and the title that the monitoring is worth be arranged to consistent with corresponding monitored item, then, the monitoring value is received in Ambari, can not be true Fixed 45% meaning represented, though it is determined that memory usage, may also can not it is determined which big data component it is interior Deposit utilization rate.
In an embodiment of the present invention, the monitoring value of at least one monitored item by after conversion is sent to described Ambari, including：
The monitoring value of at least one monitored item after conversion is saved in caching；
The monitoring value of at least one monitored item after the conversion in the caching is periodically obtained, and is sent to institute State Ambari.
In embodiments of the present invention, the monitoring value received is preserved by caching, then monitoring value is obtained simultaneously from caching Be sent to Ambari, in such manner, it is possible to prevent data it is excessive, obstruction, it is out of order the problems such as.
As shown in Fig. 2 the embodiments of the invention provide a kind of method based on Ambari monitoring big data components, this method It may comprise steps of：
Monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface in advance.
Specifically, in big data component, some big data components come with monitoring interface, and some big data components do not have Interface is monitored, in order to obtain the monitoring value of each monitored item, it is necessary to which the big data component for no monitoring interface sets monitoring to connect Mouthful.Wherein, it can be rest interfaces to monitor interface.Monitoring interface can be realized by get methods, can also pass through put methods Realize.The monitoring interface realized for get methods, can call monitoring interface, big data group to be monitored corresponding to active obtaining The monitoring value of the monitored item of part.The monitoring interface realized for put methods, interface can be monitored by calling, wait to be monitored connect The monitoring value of the monitored item of big data component to be monitored corresponding to mouth push.
For example, big data component A does not monitor interface, and this is, the monitored item that can be monitored as needed, and analysis is big Code inside data package A, determine to obtain the scheme of each monitored item, and then big data component A monitoring interface is set.
At least one of each big data component to be monitored is added in the metrics.json files in Ambari in advance The definition of monitored item.
Specifically, title, form of each monitored item etc. can be defined.
For any big data component to be monitored, perform：
Step 201：Call the current monitor interface of current big data component to be monitored.
Specifically, the big data component to be monitored of interface, the monitoring interface for calling it to carry, example are monitored for carrying Such as：The big data component such as HDFS, YARN.Big data component to be monitored for not carrying monitoring interface, is called as its is advance The monitoring interface of setting, such as：The big data component such as Hive, ElasticSearch, Spark.
Step 202：The prison of at least one monitored item of current big data component to be monitored is obtained from current monitor interface Control value.
For example, big data component A to be monitored at least one monitored item is：CPU utilization rate, the utilization rate of internal memory With the number of read-write.CPU utilization rate, the utilization rate of internal memory and the number of read-write are obtained from big data component A to be monitored Monitoring value.
Step 203：For the monitoring value of each monitored item, the current monitor value of json string formats is resolved into java Object, java objects are converted into the form that Ambari can identify.
For example, the prison of big data component A to be monitored CPU utilization rate, the utilization rate of internal memory and the number of read-write Control value is json string formats.These monitoring values are resolved into java objects, can specifically pass through json analytical tools Jackson is realized.
Step 204：For the monitoring value of each monitored item, the title of current monitor value is arranged to and current monitor value pair Title of the monitored item answered in Ambari is consistent.
By the step can Ambari can accurately determine monitored item corresponding to each monitoring value.
Step 205：The monitoring value of at least one monitored item after conversion is saved in caching.
Step 206：The monitoring value of at least one monitored item after the conversion in caching is periodically obtained, and is sent to Ambari, so that at least one monitored item of the user using the current big data component to be monitored of Ambari monitoring.
Specifically, Ambari can be monitored after the monitoring value of each monitored item is received to these monitoring values, The order that can be inputted according to user, provides the user corresponding monitoring service, such as：Monitoring value can be included on display circle On face.
In embodiments of the present invention, the monitoring value of at least one monitored item after conversion can be sent Ambari's Metrics collector modules, these monitoring values are received by metrics collector modules.
In embodiments of the present invention, the monitored item of big data component to be monitored can be the operation of big data component to be monitored Information.
In embodiments of the present invention, the monitoring of each big data component to be monitored can be uniformly shown using the Ambari page .
In embodiments of the present invention, each big data component to be monitored can be monitored, Ambari can be utilized to unite The running status of the one each big data component to be monitored of monitoring, enhances the maintainability of big data component, improves Ambari Scalability, centralized management makes user more convenient, and visual operate preferably is experienced to user, altitude module The code of change reduces the workload of developer.
As shown in Figure 3, Figure 4, the embodiments of the invention provide a kind of device based on Ambari monitoring big data components.Dress Putting embodiment can be realized by software, can also be realized by way of hardware or software and hardware combining.From hardware view Speech, as shown in figure 3, being a kind of device place equipment that big data component is monitored based on Ambari provided in an embodiment of the present invention A kind of hardware structure diagram, in addition to the processor shown in Fig. 3, internal memory, network interface and nonvolatile memory, implement Equipment in example where device can also generally include other hardware, such as be responsible for the forwarding chip of processing message.With software It is to be deposited by the CPU of equipment where it by non-volatile as shown in figure 4, as the device on a logical meaning exemplified by realization Corresponding computer program instructions read what operation in internal memory was formed in reservoir.One kind that the present embodiment provides is based on Ambari The device of big data component is monitored, including：
Setting unit 401, for setting the monitoring interface to be not provided with monitoring the big data component to be monitored of interface；
Dispensing unit 402, for configuring at least one monitoring of each big data component to be monitored in Ambari ；
Monitoring unit 403, for for any big data component to be monitored, performing：
Call the current monitor interface of current big data component to be monitored；
At least one monitored item of the current big data component to be monitored is obtained from the current monitor interface Monitoring value；
The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；
The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that described in user's utilization At least one monitored item of the Ambari monitoring current big data component to be monitored.
In an embodiment of the present invention, the dispensing unit, for the metrics.json files in the Ambari The definition of at least one monitored item of the middle each big data component to be monitored of addition.
In an embodiment of the present invention, the device further comprises：
Definition unit is shown, it is each described to be monitored for being added in the widget.json files in the Ambari The definition of at least one monitored item to be shown at least one monitored item of big data component, so that the Ambari is to described At least one monitored item to be shown is shown.
In an embodiment of the present invention, the monitoring unit, for the monitoring value for each monitored item, by json The current monitor value of string format resolves to java objects, and the java objects are converted into what the Ambari can be identified Form.
In an embodiment of the present invention, the monitoring unit, it is further used for the monitoring value for each monitored item, It is consistent that the title of current monitor value is arranged to title of the monitored item corresponding with the current monitor value in the Ambari.
In an embodiment of the present invention, the monitoring unit, for by the prison of at least one monitored item after conversion Control value is saved in caching, periodically obtains the monitoring value of at least one monitored item after the conversion in the caching, And it is sent to the Ambari.
The contents such as the information exchange between each unit, implementation procedure in said apparatus, due to implementing with the inventive method Example is based on same design, and particular content can be found in the narration in the inventive method embodiment, and here is omitted.
The embodiments of the invention provide a kind of computer-readable recording medium, including execute instruction, when the computing device of storage control During the execute instruction, the storage control perform it is provided in an embodiment of the present invention any one be based on the big number of Ambari monitoring According to the method for component.
The embodiments of the invention provide a kind of storage control, including：Processor, memory and bus；
The memory is used to store execute instruction, and the processor is connected with the memory by the bus, when During the storage control operation, the execute instruction of memory storage described in the computing device, so that the storage control Device performs any one method based on Ambari monitoring big data components provided in an embodiment of the present invention.
The each embodiment of the present invention at least has the advantages that：
1st, in embodiments of the present invention, monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface, So that each big data component to be monitored is respectively provided with monitoring interface, the prison of each big data component to be monitored is configured in Ambari Item is controlled, in order to be monitored to these monitored item of configuration, calls the monitoring interface of big data component to be monitored to obtain monitoring Monitoring value, each monitoring value is converted into form that Ambari can identify and is sent to Ambari, user directly can be with The process such as monitored item, the acquisition process without participating in monitoring value of each big data component to be monitored is monitored by Ambari, The monitoring value of needs can be directly obtained, realizes more easily monitoring big data component.
2nd, in embodiments of the present invention, the monitoring value received is preserved by caching, then monitoring value is obtained from caching And be sent to Ambari, in such manner, it is possible to prevent data it is excessive, obstruction, it is out of order the problems such as.
3rd, in embodiments of the present invention, each big data component to be monitored can be monitored, Ambari can be utilized The running status of each big data component to be monitored of unified monitoring, enhances the maintainability of big data component, improves Ambari scalability, centralized management make user more convenient, and visual operate preferably is experienced to user.
It should be noted that herein, such as first and second etc relational terms are used merely to an entity Or operation makes a distinction with another entity or operation, and not necessarily require or imply and exist between these entities or operation Any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant be intended to it is non- It is exclusive to include, so that process, method, article or equipment including a series of elements not only include those key elements, But also the other element including being not expressly set out, or also include solid by this process, method, article or equipment Some key elements.In the absence of more restrictions, by sentence " including the key element that a 〃 〃 " is limited, it is not excluded that Other identical factor in the process including the key element, method, article or equipment also be present.
One of ordinary skill in the art will appreciate that：Realizing all or part of step of above method embodiment can pass through Programmed instruction related hardware is completed, and foregoing program can be stored in computer-readable storage medium, the program Upon execution, the step of execution includes above method embodiment；And foregoing storage medium includes：ROM, RAM, magnetic disc or light Disk etc. is various can be with the medium of store program codes.
It is last it should be noted that：Presently preferred embodiments of the present invention is the foregoing is only, is merely to illustrate the skill of the present invention Art scheme, is not intended to limit the scope of the present invention.Any modification for being made within the spirit and principles of the invention, Equivalent substitution, improvement etc., are all contained in protection scope of the present invention.

Claims (10)

  1. A kind of 1. method based on Ambari monitoring big data components, it is characterised in that
    The monitoring interface is set to be not provided with monitoring the big data component to be monitored of interface in advance；
    At least one monitored item of each big data component to be monitored is configured in Ambari in advance；
    Including：
    For any big data component to be monitored, perform：
    Call the current monitor interface of current big data component to be monitored；
    The prison of at least one monitored item of the current big data component to be monitored is obtained from the current monitor interface Control value；
    The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；
    The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that described in user's utilization At least one monitored item of the Ambari monitoring current big data component to be monitored.
  2. 2. according to the method for claim 1, it is characterised in that
    At least one monitored item for configuring each big data component to be monitored in Ambari in advance, including：
    Added in advance in the metrics.json files in the Ambari described in each big data component to be monitored The definition of at least one monitored item.
  3. 3. according to the method for claim 1, it is characterised in that
    Further comprise：
    At least the one of each big data component to be monitored is added in the widget.json files in the Ambari in advance The definition of at least one monitored item to be shown in individual monitored item, so that the Ambari is at least one prison to be shown Control item is shown.
  4. 4. according to the method for claim 1, it is characterised in that
    The monitoring value by least one monitored item is converted to the form that the Ambari can be identified, including：
    For the monitoring value of each monitored item, the current monitor value of json string formats is resolved into java objects, will The java objects are converted to the form that the Ambari can be identified.
  5. 5. according to any described method in claim 1-4, it is characterised in that
    After the monitoring value by least one monitored item is converted to the form that the Ambari can be identified, in institute State before the monitoring value of at least one monitored item after conversion is sent into the Ambari, further comprise：
    For the monitoring value of each monitored item, the title of current monitor value is arranged to corresponding with the current monitor value Title of the monitored item in the Ambari is consistent；
    And/or
    The monitoring value of at least one monitored item by after conversion is sent to the Ambari, including：
    The monitoring value of at least one monitored item after conversion is saved in caching；
    The monitoring value of at least one monitored item after the conversion in the caching is periodically obtained, and is sent to described Ambari。
  6. A kind of 6. device based on Ambari monitoring big data components, it is characterised in that including：
    Setting unit, for setting the monitoring interface to be not provided with monitoring the big data component to be monitored of interface；
    Dispensing unit, for configuring at least one monitored item of each big data component to be monitored in Ambari；
    Monitoring unit, for for any big data component to be monitored, performing：
    Call the current monitor interface of current big data component to be monitored；
    The prison of at least one monitored item of the current big data component to be monitored is obtained from the current monitor interface Control value；
    The monitoring value of at least one monitored item is converted into the form that the Ambari can identify；
    The monitoring value of at least one monitored item after conversion is sent to the Ambari, so that described in user's utilization At least one monitored item of the Ambari monitoring current big data component to be monitored.
  7. 7. device according to claim 6, it is characterised in that
    The dispensing unit, for adding each big number to be monitored in the metrics.json files in the Ambari According to the definition of at least one monitored item of component.
  8. 8. device according to claim 6, it is characterised in that
    Further comprise：
    Definition unit is shown, for adding each big number to be monitored in the widget.json files in the Ambari According to the definition of at least one monitored item to be shown at least one monitored item of component so that the Ambari to it is described at least One monitored item to be shown is shown.
  9. 9. device according to claim 6, it is characterised in that
    The monitoring unit, for the monitoring value for each monitored item, by the current monitor value of json string formats Java objects are resolved to, the java objects are converted into the form that the Ambari can identify.
  10. 10. according to any described device in claim 6-9, it is characterised in that
    The monitoring unit, it is further used for the monitoring value for each monitored item, the title of current monitor value is set It is consistent for title of the monitored item corresponding with the current monitor value in the Ambari；
    And/or
    The monitoring unit, for the monitoring value of at least one monitored item after conversion to be saved in caching, periodically Ground obtains the monitoring value of at least one monitored item after the conversion in the caching, and is sent to the Ambari.
CN201710874410.2A 2017-09-25 2017-09-25 A kind of method and device based on Ambari monitoring big data components Pending CN107704362A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710874410.2A CN107704362A (en) 2017-09-25 2017-09-25 A kind of method and device based on Ambari monitoring big data components

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710874410.2A CN107704362A (en) 2017-09-25 2017-09-25 A kind of method and device based on Ambari monitoring big data components

Publications (1)

Publication Number Publication Date
CN107704362A true CN107704362A (en) 2018-02-16

Family

ID=61176057

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710874410.2A Pending CN107704362A (en) 2017-09-25 2017-09-25 A kind of method and device based on Ambari monitoring big data components

Country Status (1)

Country Link
CN (1) CN107704362A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110515795A (en) * 2019-07-29 2019-11-29 北京百分点信息科技有限公司 A kind of monitoring method of big data component, device, electronic equipment
CN110955579A (en) * 2019-11-29 2020-04-03 杭州安恒信息技术股份有限公司 Ambari-based large data platform monitoring method
CN114090387A (en) * 2021-11-24 2022-02-25 建信金融科技有限责任公司 Server monitoring method and device, server and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140025683A1 (en) * 2012-07-18 2014-01-23 Salesforce.Com, Inc. Methods and apparatus for managing community-updateable data
CN106648799A (en) * 2016-12-30 2017-05-10 广东浪潮大数据研究有限公司 Method for quickly adding widget to third-party component on the basis of Ambari
CN106648801A (en) * 2016-12-30 2017-05-10 广东浪潮大数据研究有限公司 Automatic node adding and deleting method for Hadoop cluster

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140025683A1 (en) * 2012-07-18 2014-01-23 Salesforce.Com, Inc. Methods and apparatus for managing community-updateable data
CN106648799A (en) * 2016-12-30 2017-05-10 广东浪潮大数据研究有限公司 Method for quickly adding widget to third-party component on the basis of Ambari
CN106648801A (en) * 2016-12-30 2017-05-10 广东浪潮大数据研究有限公司 Automatic node adding and deleting method for Hadoop cluster

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
IBM DEVELOPER: "Ambari Metrics 详解", 《HTTPS://WWW.IBM.COM/DEVELOPERWORKS/CN/OPENSOURCE/OS-CN-AMBARI-METRICS/》 *
LINUX公社: "Ambari Metrics 详解", 《HTTPS://WWW.LINUXIDC.COM/LINUX/2016-12/138147.HTM》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110515795A (en) * 2019-07-29 2019-11-29 北京百分点信息科技有限公司 A kind of monitoring method of big data component, device, electronic equipment
CN110955579A (en) * 2019-11-29 2020-04-03 杭州安恒信息技术股份有限公司 Ambari-based large data platform monitoring method
CN114090387A (en) * 2021-11-24 2022-02-25 建信金融科技有限责任公司 Server monitoring method and device, server and storage medium

Similar Documents

Publication Publication Date Title
CN108595157B (en) Block chain data processing method, device, equipment and storage medium
US10073683B2 (en) System and method for providing software build violation detection and self-healing
CN109032914A (en) Resource occupation data predication method, electronic equipment, storage medium
CN105049268A (en) Distributed computing resource allocation system and task processing method
CN102711139B (en) A kind of data flow statistic method and terminal
CN104778124A (en) Automatic testing method for software application
EP2763055B1 (en) A telecommunication method and mobile telecommunication device for providing data to a mobile application
EP4027240A1 (en) Cloud system resource set recommendation method and apparatus, and computing device cluster
CN104410671B (en) A kind of snapshot grasping means and data supervising device
CN103714004A (en) JVM online memory leak analysis method and system
CN110347407A (en) A kind of method, apparatus, computer equipment and medium obtaining EMS memory occupation amount
CN110245145A (en) Structure synchronization method and apparatus of the relevant database to Hadoop database
CN111177237B (en) Data processing system, method and device
CN107704362A (en) A kind of method and device based on Ambari monitoring big data components
CN103713935A (en) Method and device for managing Hadoop cluster resources in online manner
CN104331328A (en) Virtual resource scheduling method and virtual resource scheduling device
CN108427709B (en) Multi-source mass data processing system and method
CN110727664A (en) Method and device for executing target operation on public cloud data
CN105933154A (en) Management method of cloud calculation resources
US10951540B1 (en) Capture and execution of provider network tasks
CN110134646B (en) Knowledge platform service data storage and integration method and system
CN106886477B (en) Method and device for setting monitoring threshold in cloud system
CN109710474A (en) A kind of hard disk fault detection method, device, terminal and readable storage medium storing program for executing
CN102855297B (en) A kind of method of control data transmission and connector
US11416318B1 (en) Application programming interface for integration flow design

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180216

RJ01 Rejection of invention patent application after publication