CN107291868A - A kind of monitoring data processing unit and monitoring data processing method - Google Patents
A kind of monitoring data processing unit and monitoring data processing method Download PDFInfo
- Publication number
- CN107291868A CN107291868A CN201710448768.9A CN201710448768A CN107291868A CN 107291868 A CN107291868 A CN 107291868A CN 201710448768 A CN201710448768 A CN 201710448768A CN 107291868 A CN107291868 A CN 107291868A
- Authority
- CN
- China
- Prior art keywords
- monitoring data
- information
- node
- pending
- default queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses a kind of monitoring data processing unit and monitoring data processing method, set on each node, including for receiving the receiving module of the monitoring data of monitor in itself affiliated node；For by supervising data storage in the memory module of the default queue of itself affiliated node；For obtaining monitoring data from default queue, the acquisition module of pending monitoring data is used as；For the processing module handled pending monitoring data.The technical scheme provided from the present invention, because the device is set on each node, so that each node possesses the ability for obtaining monitoring data and then handling, eliminate Nagios distributed systems and synchronous and distributed node information the operation of main controlled node needs that monitoring data is brought is handled by main controlled node, reduce expense；Simultaneously as the device causes each node independently can handle monitoring data, disperse the processing pressure of monitoring data, improve the processing speed of monitoring data.
Description
Technical field
The present invention relates to monitoring of tools field, espespecially a kind of monitoring data processing unit and monitoring data processing method.
Background technology
With the arrival of big data and cloud computing era, treat monitoring device and be monitored so as to which the monitoring data obtained is normal
Often need to be gathered and then handled to play higher performance, dispersiveness and monitoring number yet with equipment to be supervised
According to complex, the processing of monitoring data often runs into huge challenge.
At present, the universal way that industry is used is by setting Nagios distributed monitoring system to complete monitoring data
Processing.Specifically, the system is divided into main controlled node and distributed node two parts, first, and each distributed node needs configuration
The affiliated group information of facility information, equipment, monitor information and associated person information etc., need to configure each distribution in main controlled node
The information that node is configured, each distributed node by nsca_client processes by monitoring data real-time report to main controlled node,
Main controlled node receives the monitoring data of each distributed node transmission by nsca processes and handles monitoring data.
But, this distributed monitoring system also has its not enough place, due to this system include distributed node and
Main controlled node two parts, the collection of monitoring data is undertaken by distributed node, and the processing of monitoring data is undertaken by main controlled node, and
The processing of monitoring data is needed premised on correct parse, therefore main controlled node needs setting for synchronous each distributed node configuration
Group information, monitor information and associated person information described in standby information, equipment are can parse the monitoring of distributed node acquisition
Data, but the simultaneously operating of main controlled node and distributed node needs to expend many resources in complicated network environment, because
This, can cause expense excessive；Simultaneously as main controlled node will handle the monitoring data that all distributed nodes are obtained, master control section
The processing pressure of point is excessive, and therefore, the processing procedure of monitoring data is very slow.
The content of the invention
In order to solve the above-mentioned technical problem, the invention provides a kind of monitoring data processing unit and monitoring data processing side
Method, can save main controlled node and distributed node carries out the operation of synchronizing information, so as to reduce expense, and can disperse
The processing pressure of monitoring data, so as to improve the processing speed of monitoring data.
In order to reach the object of the invention, the invention provides a kind of monitoring data processing unit, including：
Receiving module, the monitoring data for receiving monitor in itself affiliated node；
Memory module, for by the supervising data storage in the default queue of itself affiliated node；
Acquisition module, for obtaining monitoring data from the default queue, is used as pending monitoring data；
Processing module, for handling the pending monitoring data.
Also include：
Module is set up, for presetting queue using producer consumer Model Establishment in itself affiliated node；
The processing module, specifically for according to the monitored item threshold information pre-set in itself affiliated node,
Condition adjudgement standard information, alarm conditions information, notification condition information and associated person information to the pending data at
Reason.
The processing module, including：
First processing units, for using multithread mode, in each thread according to the monitored item threshold information, institute
The pending monitoring data in part for stating condition adjudgement standard information and current thread processing determines monitored item state, and by the prison
Control item state is stored in the shared presetting database of all nodes；
Second processing unit, for being judged whether to accuse according to the monitored item state and the alarm conditions information
It is alert；
3rd processing unit, if for being alerted, generation alarm record is added in the presetting database, and root
Judge whether to meet notification condition according to the notification condition information；
Notification unit, if for meeting the notification condition, notifying contact person to alert according to the associated person information.
Also include：
Setup module, for setting preset rules；Wherein, the preset rules are that the default queue abnormal conditions occurs
When how to handle the rules of the data that the default queue is stored；
The acquisition module, specifically for obtaining monitoring data from the default queue according to the preset rules, makees
For the pending monitoring data.
The preset rules include：
When the length M of the default queue is more than preset length N, the preceding S for being arranged in the default queue team head is abandoned
Individual monitoring data, wherein, S>M-N；
The acquisition module, specifically for according to the preset rules, when the length M of the default queue is more than default length
When spending N, the preceding S monitoring data for being arranged in the default queue team head, then the acquisition monitoring number from the default queue are abandoned
According to being used as the pending monitoring data.
Present invention also offers a kind of monitoring data processing method, including：
Receive the monitoring data of monitor in the affiliated node of target monitoring data processing equipment；Wherein, the target monitoring
Data processing equipment is to set any one in monitoring processing unit on each node；
By the supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment；
Monitoring data is obtained from the default queue, pending monitoring data is used as；
The pending monitoring data is handled.
Described to receive in the affiliated node of target monitoring data processing equipment before the monitoring data of monitor, methods described is also
Including：
Queue is preset using producer consumer Model Establishment in the affiliated node of target monitoring data processing equipment；
It is described that pending monitoring data is handled, including：
Monitored item threshold information, state according to being pre-set in the affiliated node of target monitoring data processing equipment are sentenced
Disconnected standard information, alarm conditions information, notification condition information and associated person information are handled the pending monitoring data.
The monitored item threshold information that is pre-set in the affiliated node according to target monitoring data processing equipment, state are sentenced
Disconnected standard information, alarm conditions information, notification condition information and associated person information are handled pending monitoring data, are wrapped
Include：
Using multithread mode, believed in each thread according to the monitored item threshold information, the condition adjudgement standard
The pending monitoring data in part that breath and current thread are handled determines monitored item state, and the monitored item state is stored in into institute
Have in the shared presetting database of node；
Alarm is judged whether to according to the monitored item state and the alarm conditions information；
If being alerted, generation alarm record is added in the presetting database, and is believed according to the notification condition
Breath judges whether to meet notification condition；
If meeting the notification condition, contact person is notified to alert according to the associated person information.
Described to obtain monitoring data from default queue, before pending monitoring data, methods described also includes：
Preset rules are set；Wherein, institute how is handled when the preset rules abnormal conditions occur for the default queue
State the rule of the data stored in default queue；
Accordingly, it is described to obtain monitoring data from default queue, as pending monitoring data, including：
Monitoring data is obtained from the default queue according to the preset rules, the pending monitoring data is used as.
The preset rules include：
When the length M of the default queue is more than preset length N, the preceding S for being arranged in the default queue team head is abandoned
Individual monitoring data, wherein, S>M-N；
Accordingly, it is described to obtain monitoring data from the default queue according to preset rules, it is used as pending monitoring number
According to, including：
According to the preset rules, when the length M of the default queue is more than preset length N, discarding is arranged in described
The preceding S monitoring data of default queue team head, then monitoring data is obtained from the default queue, it is used as the pending monitoring
Data.
Compared with prior art, the monitoring data processing unit that the present invention is provided is set on each node, is at least included
Receiving module, the monitoring data for receiving monitor in itself affiliated node；Memory module, for by supervising data storage in
In the default queue of itself affiliated node；Acquisition module, for obtaining monitoring data from default queue, is used as pending monitoring
Data；Processing module, for handling pending monitoring data.The technical scheme provided from the present invention, due to this
Device is set on each node so that each node possesses the ability for obtaining monitoring data and then handling, therefore is different from
Distributed node is responsible for the mould that monitoring data processing is responsible in the acquisition of monitoring data, main controlled node in Nagios distributed systems
Formula, the monitoring data processing unit that the present invention is provided eliminates Nagios distributed systems and handles monitoring data band by main controlled node
The main controlled node come needs the operation of synchronous and distributed node information, so as to reduce expense；Simultaneously as the device causes
Each node can be handled independently monitoring data in node itself described, so as to disperse the processing pressure of monitoring data
Power, improves the processing speed of monitoring data.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can be by specification, rights
Specifically noted structure is realized and obtained in claim and accompanying drawing.
Brief description of the drawings
Accompanying drawing is used for providing further understanding technical solution of the present invention, and constitutes a part for specification, with this
The embodiment of application is used to explain technical scheme together, does not constitute the limitation to technical solution of the present invention.
Fig. 1 is a kind of structural representation of monitoring data processing unit provided in an embodiment of the present invention；
Fig. 2 is the structural representation of another monitoring data processing unit provided in an embodiment of the present invention；
Fig. 3 is the structural representation of another monitoring data processing unit provided in an embodiment of the present invention；
Fig. 4 is the structural representation of another monitoring data processing unit provided in an embodiment of the present invention；
Fig. 5 is a kind of schematic flow sheet of monitoring data processing method provided in an embodiment of the present invention；
Fig. 6 is the schematic flow sheet of another monitoring data processing method provided in an embodiment of the present invention；
Fig. 7 is the schematic flow sheet of another monitoring data processing method provided in an embodiment of the present invention；
Fig. 8 is the schematic flow sheet of another monitoring data processing method provided in an embodiment of the present invention；
Fig. 9 is a kind of structural representation of monitoring system provided in an embodiment of the present invention.
Embodiment
For the object, technical solutions and advantages of the present invention are more clearly understood, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case where not conflicting, in the embodiment and embodiment in the application
Feature can mutually be combined.
The embodiment of the present invention provides a kind of monitoring data processing unit, and the device is set on each node, such as Fig. 1 institutes
Show, the device 1 includes：
Receiving module 11, the monitoring data for receiving monitor in itself affiliated node.
Specifically, monitoring data is monitor monitors the data that equipment to be monitored is obtained according to facility information to be monitored, treat
Monitoring device and the quantity of monitor can be one or many, the invention is not limited in this regard.Equipment letter to be monitored
Breath includes the monitoring parameter information of equipment to be monitored and the group information of equipment to be monitored, where it is assumed that selection is with simple network
Management agreement (Simple Network Management Protocol, SNMP) is treated monitoring device and is monitored, then treat
The monitoring parameter information of monitoring device includes procotol (Internet Protocol, IP) address of equipment to be monitored, SNMP
Version number and SNMP community name.Monitored item information includes the interval time of the project to be monitored and monitoring,
Wherein, monitoring interval time refers to once monitor and the adjacent time interval once monitored；The project to be monitored can be with
It is to be directed to computer or applied for some in computer, when the project to be monitored is for meter
During calculation machine, the project to be monitored can include cpu busy percentage, memory usage etc., when the project to be monitored
When being that some being directed in computer is applied, such as database, the project to be monitored can include table space utilization rate.
Specifically, when monitor quantity is larger, receiving module 11 can specifically receive monitoring number using multithread mode
According to.
Memory module 12, for by supervising data storage in the default queue of itself affiliated node.
Specifically, monitoring data may be excessively scrappy in real process, and to be stored in default queue needs by even
Connect, but the connection number of default queue is limited, it is impossible to the memory requirement of monitoring data is met in the same time, therefore will can be supervised
Control data are integrated in advance, then are stored in default queue by connection.
Specifically, have a default queue on each node, the monitoring data for storing monitor in own node,
Because the characteristic of queue is first in first out, therefore by supervising data storage in default queue, it is ensured that the data being first stored in
First it is acquired, so as to keep the order of data.
Acquisition module 13, for obtaining monitoring data from default queue, is used as pending monitoring data.
It should be noted that pending monitoring data can be a part or monitoring data for monitoring data
All.
Specifically, the mode for obtaining pending monitoring data is obstruction mode, once so default queue appearance is vacant, just
Obstruction occurs, so as to stop the acquisition of data.
Processing module 14, for handling pending monitoring data.
The monitoring data processing unit that the embodiment of the present invention is provided, is set on each node, and the device includes being used for
Receive the receiving module of the monitoring data of monitor in itself affiliated node；For by supervising data storage in itself affiliated node
Default queue in memory module；For obtaining monitoring data from default queue, the acquisition of pending monitoring data is used as
Module；For the processing module handled pending monitoring data.So, because the device is set on each node,
So that each node possesses the ability that monitoring data is obtained and then handled that obtains, therefore different from Nagios distributed systems
Distributed node is responsible for the pattern that monitoring data processing is responsible in the acquisition of monitoring data, main controlled node, the monitoring that the present invention is provided
Data processing equipment eliminate Nagios distributed systems by main controlled node handle the main controlled node that brings of monitoring data need it is same
The operation of step and distributed node information, so as to reduce expense；Simultaneously as the device make it that each node can be independently
Monitoring data in itself affiliated node is handled, so as to disperse the processing pressure of monitoring data, monitoring number is improved
According to processing speed.
Further, on the basis of the corresponding embodiments of Fig. 1, the embodiment of the present invention provides another monitoring data processing dress
Put, as shown in Fig. 2 the device 1 also includes：
Module 15 is set up, for presetting queue using producer consumer Model Establishment in itself affiliated node.
Specifically, the establishment model of default queue has two kinds, one kind is publish-subscribe model, and another is producer's consumption
Person's pattern, wherein, producer consumer pattern refers to that the close coupling by a container to solve producers and consumers is asked
Not Direct Communication between the pattern of topic, producers and consumers, and communicated by blocking queue, so the producer
Produce after data and to have been handled without waiting for consumer, directly thrown to obstruction queue, consumer does not look for the producer to want data, but
Directly taken in obstruction queue, obstruction queue is equivalent to a buffering area, balances the disposal ability of producers and consumers.
Processing module 14, specifically for being sentenced according to the monitored item threshold information, state that are pre-set in itself affiliated node
Disconnected standard information, alarm conditions information, notification condition information and associated person information are handled pending data.
Further, on the basis of the corresponding embodiments of Fig. 2, the embodiment of the present invention provides another monitoring data processing dress
Put, as shown in figure 3, processing module 14 includes：
First processing units 141, for using multithread mode, in each thread according to monitored item threshold information, shape
State criterion information and the pending monitoring data in part of current thread processing determine monitored item state, and by monitored item state
It is stored in the shared presetting database of the node.
Specifically, referring to handling data to be monitored, so each thread using multithread mode using multithread mode
It is borne by the processing task of part pending data.
Specifically, monitored item threshold information is that monitored item state is normal and abnormal boundary, for example, it is assumed that to be monitored set
Standby is computer, and monitored item is central processing unit (Central Processing Unit, CPU) occupancy, monitored item threshold value letter
Breath can be that CPU usage is 80%, when pending data shows that monitored CPU occupancy is less than 80%, illustrate that CPU is accounted for
Normal with rate, the occupancy for showing monitored CPU when pending data illustrates that CPU usage is abnormal more than 80%.State
Criterion information is the standard for judging monitored item state, and monitored item state includes normal condition and abnormal state, wherein, no
Normal condition can include slight abnormal state, moderate abnormal state and serious abnormal state, determine monitored item state
Refer to determining that monitored item state is any in this several state, it is assumed that condition adjudgement standard information is more than monitored item threshold
It is slight abnormal state within value 5%, is moderate abnormal state more than monitored item threshold value 5%~10%, more than monitored item
Threshold value 10%~15% is serious abnormal state, then according to condition adjudgement standard information, monitored item threshold information and shown
The data of CPU occupancy situations just can determine that whether CPU state is normal, if abnormal, it is determined that being slight abnormal state, moderate
It is any in abnormal state and serious abnormal state.
It should be noted that situation about hanging may also occur in the part thread in multithreading, it is pre- when exceeding in multithreading
If, it is necessary to restart a number of thread when there is hanging situation about in the thread of number, during avoiding number of threads very few,
The data processing task that each thread undertakes is overweight.
Second processing unit 142, for judging whether to alarm according to monitored item state and alarm conditions information.
It should be noted that each node and presetting database establish connection, after monitored item state is determined, all
Meeting access preset database is so that monitored item state is stored in presetting database.Monitored item state is stored in presetting database
In, and it is also voluntarily to be completed by each thread to judge whether to alert according to monitored item state and alarm conditions information.
Specifically, alarm conditions information, which is monitored item state, can constitute the status information of alarm, for example, it is assumed that monitored item
State includes normal condition, slight abnormal state, moderate abnormal state and serious abnormal state, and alarm conditions information can
To be that monitored item reaches moderate abnormal state or serious abnormal state.
3rd processing unit 143, if for being alerted, generation alarm record is added in presetting database, and root
Judge whether to meet notification condition according to notification condition information.
If it should also be noted that, being alerted, generation alarm record is added in presetting database, and according to notice
Conditional information judges whether that it is also voluntarily to be completed by each thread to meet notification condition.
Specifically, notification condition information is can to send the conditional information notified after alerting to contact person, bar is notified
The notice that part information can include contact person is in opening, contact person in working time etc..
Notification unit 144, if for meeting notification condition, notifying contact person to alert according to associated person information.
If it should be noted that meeting notification condition, notifying alarm occurs in contact person to be also by every according to associated person information
What individual thread was voluntarily completed.
Specifically, the concrete form notified can be the mode of short message, can also be the mode of mail, the present invention to this not
It is restricted.
If specifically, notification condition is in opening for the notice of contact person, then when meeting the notification condition, then
Contact person is notified to alert according to associated person information.
The monitoring data processing unit that the embodiment of the present invention is provided, in addition to multithread mode is used, in each thread
It is middle according to the monitored item threshold information pre-set in itself affiliated node, condition adjudgement standard information and current thread handle
The pending monitoring data in part determines monitored item state, and the first processing that monitored item state is stored in presetting database is single
Member；The second processing unit of alarm is judged whether to according to monitored item state and alarm conditions information；If for being alerted,
Generation alarm record is added in presetting database, and is judged whether according to notification condition information to meet the 3rd of notification condition the
Processing unit；If for meeting notification condition, notifying contact person the notification unit alerted occur according to associated person information.So,
Employ multithread mode to handle the monitoring data of distributed node so that each thread is saved where being independently processed from
Certain part of the monitoring data of point, so as to more improve the processing speed of monitoring data.
Further, on the basis of the corresponding embodiments of Fig. 3, the embodiment of the present invention provides another monitoring data processing dress
Put, as shown in figure 4, the device 1 also includes：
Setup module 16, for setting preset rules.
Wherein, preset rules are the rule for the data that default queue storage how is handled when abnormal conditions occurs in default queue
Then.
It should be noted that when default queue occurs abnormal, the data stored in default queue can not reflect monitoring
The time of day of item, it is therefore desirable to which these data carry out some processing.
Specifically, preset rules are included when the length M of default queue is more than preset length N, discarding is arranged in default team
Line up the preceding S data of head, wherein, S>M-N.
Acquisition module 13, specifically for obtaining monitoring data from default queue according to preset rules, is used as pending prison
Control data.
Specifically, obtaining monitoring data from default queue according to preset rules, include as pending monitoring data：Root
According to preset rules, when the length M of default queue is more than preset length N, the preceding S numbers for being arranged in default queue team head are abandoned
According to, then from default queue monitoring data is obtained, it is used as pending monitoring data.
It should be noted that when the length of default queue is long, some data stored before just lose actual effect,
And be to enter team, enemy from tail of the queue to go out team due to the characteristic of queue, it is therefore desirable to abandon a part of data for being arranged in team's head.
Monitoring data processing unit provided in an embodiment of the present invention, in addition to for setting default queue abnormal conditions occur
When how to handle default queue storing data preset rules setup module, for being obtained according to preset rules from default queue
Take the acquisition module of pending monitoring data.So,, can be to pre- when default queue occurs abnormal there is provided preset rules
If the data stored in queue are handled, so as to ensure that the validity of data storage in default queue.
In actual applications, the receiving module 11, memory module 12, acquisition module 13, the processing of processing module 14, first
Unit 141, second processing unit 142, the 3rd processing unit 143, notification unit 144, set up module 15 and setup module 16 is equal
Can be by positioned at monitoring data processing unit CPU, microprocessor (Micro Processor Unit, MPU), digital signal processor
(Digital Signal Processor, DSP) or field programmable gate array (Field Programmable Gate
Array, FPGA) etc. realize.
The embodiment of the present invention provides a kind of monitoring data processing method, as shown in figure 5, this method includes：
Step 201, the monitoring data for receiving monitor in the affiliated node of target monitoring data processing equipment.
Wherein, the target monitoring data processing equipment is any in monitoring processing unit on each node to set
One.
Step 202, by supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment.
Step 203, from default queue monitoring data is obtained, be used as pending monitoring data.
Step 204, pending monitoring data is handled.
The monitoring data processing method that the embodiment of the present invention is provided, including receive belonging to target monitoring data processing equipment
The monitoring data of monitor in node；Wherein, monitoring of the target monitoring data processing equipment for setting on each node
Any one in processing unit；By supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment
In；Monitoring data is obtained from default queue, pending monitoring data is used as；Pending monitoring data is handled.Due to
This method is to put to good use on each node so that each node possesses the energy for obtaining monitoring data and then handling monitoring data
Power, eliminating main controlled node needs the operation of synchronous and distributed node information, so as to reduce expense；Simultaneously as the party
Method causes each node independently can handle the monitoring data in own node, so as to disperse the place of monitoring data
Pressure is managed, the processing speed of monitoring data is improved.
Further, the embodiment of the present invention provides another monitoring data processing method, as shown in fig. 6, this method includes：
Step 301, in the affiliated node of target monitoring data processing equipment using producer consumer Model Establishment preset
Queue.
Wherein, the target monitoring data processing equipment is any in monitoring processing unit on each node to set
One.
Step 302, the monitoring data for receiving monitor in the affiliated node of target monitoring data processing equipment.
Step 303, by supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment.
Step 304, from default queue monitoring data is obtained, be used as pending monitoring data.
Step 305, according to monitored item threshold information, the shape pre-set in the affiliated node of target monitoring data processing equipment
State criterion information, alarm conditions information, notification condition information and associated person information are handled pending monitoring data.
Further, the embodiment of the present invention provides another monitoring data processing method, as shown in fig. 7, this method includes：
Step 401, in the affiliated node of target monitoring data processing equipment using producer consumer Model Establishment preset
Queue.
Wherein, the target monitoring data processing equipment is any in monitoring processing unit on each node to set
One.
Step 402, the monitoring data for receiving monitor in the affiliated node of target monitoring data processing equipment.
Step 403, by supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment.
Step 404, from default queue monitoring data is obtained, be used as pending monitoring data.
Step 405, using multithread mode, in each thread according in the affiliated node of target monitoring data processing equipment
The pending monitoring data in part of the monitored item threshold information, condition adjudgement standard information and the current thread processing that pre-set is true
Determine monitored item state, and monitored item state is stored in the shared presetting database of all nodes.
Step 406, according to monitored item state and alarm conditions information judge whether to alarm.
If step 407, being alerted, generation alarm record is added in presetting database, and is believed according to notification condition
Breath judges whether to meet notification condition.
If step 408, meeting notification condition, contact person is notified to alert according to associated person information.
The monitoring data processing method that the embodiment of the present invention is provided, in addition to multithread mode is used, in each thread
The monitored item threshold information that is pre-set in the middle affiliated node according to target monitoring data processing equipment, condition adjudgement standard information
Monitored item state is determined with the pending monitoring data in part of current thread processing；According to monitored item state and alarm conditions information
Judge whether to alarm；If being alerted, generation alarm record is added in presetting database, and is believed according to notification condition
Breath judges whether to meet notification condition；If meeting notification condition, contact person is notified to alert according to associated person information.So,
Employ multithread mode to handle the monitoring data of distributed node so that each thread is saved where being independently processed from
Certain part of the monitoring data of point, so as to more improve the processing speed of monitoring data.
The embodiment of the present invention provides another monitoring data processing method, as shown in figure 8, this method includes：
Step 501, in the affiliated node of target monitoring data processing equipment using producer consumer Model Establishment preset
Queue.
Wherein, the target monitoring data processing equipment is any in monitoring processing unit on each node to set
One.
Step 502, the monitoring data for receiving monitor in the affiliated node of target monitoring data processing equipment.
Step 503, by supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment.
Step 504, setting preset rules.
Wherein, the data stored in default queue how to be obtained when preset rules abnormal conditions occur for default queue
Rule.
Specifically, preset rules include：When the length M of default queue is more than preset length N, discarding is arranged in default team
Line up the preceding S data of head, wherein, S>M-N.
Step 505, according to preset rules monitoring data is obtained from default queue, be used as pending monitoring data.
Specifically, obtaining monitoring data from default queue according to preset rules, include as pending monitoring data：Root
According to preset rules, when the length M of default queue is more than preset length N, the preceding S numbers for being arranged in default queue team head are abandoned
According to, then from default queue monitoring data is obtained, it is used as pending monitoring data.
Step 506, using multithread mode, believed in each thread according to monitored item threshold information, condition adjudgement standard
The pending monitoring data in part that breath and current thread are handled determines monitored item state, and monitored item state is stored in into all sections
In the shared presetting database of point.
Step 507, according to monitored item state and alarm conditions information judge whether to alarm.
If step 508, being alerted, generation alarm record is added in presetting database, and is believed according to notification condition
Breath judges whether to meet notification condition.
If step 509, meeting notification condition, contact person is notified to alert according to associated person information.
Monitoring data processing method provided in an embodiment of the present invention, in addition to when setting the default queue abnormal conditions occur such as
What obtains the preset rules of the data stored in default queue；Pending monitoring is obtained from default queue according to preset rules
Data.So, there is provided preset rules, when default queue occurs abnormal, can be carried out to presetting the data stored in queue
Processing, so as to ensure that the validity of data storage in default queue.
The embodiment of the present invention also provides a kind of structural representation of monitoring system, as shown in figure 9, the system includes monitoring
Device, equipment to be monitored, monitoring data processing unit；Wherein, equipment to be monitored includes server, middleware and the network equipment, prison
Control data processing equipment includes monitoring data collection module, producer's module, message queue module, consumer spending module 1, disappeared
The person's of expense consumption module 2, data processing module 1 and data processing module 2.
Wherein, monitor, is monitored to obtain monitoring data for treating monitoring device；Monitoring data collection module,
The monitoring data obtained for acquisition monitoring device；Producer's module, for integrating endlessly monitoring data；Message queue mould
Block, for storing the monitoring data in producer's module in the form of queue；Consumer spending module 1 and consumer spending module
2, for obtaining pending monitoring data from message queue module；Data processing module 1, for handling consumer spending module
The 1 pending monitoring data obtained, data processing module 2, the pending monitoring number for handling the acquisition of consumer spending module 2
According to.
The method of work of the system includes：
The monitoring information of configuration monitoring device, wherein monitoring information include facility information to be monitored and monitored item information.
Monitor monitors equipment to be monitored and obtains monitoring data.
The monitoring data that monitoring data collection module is obtained using the concurrent acquisition monitoring device of multithread mode.
The monitoring data that the module integrated monitoring data collection module of the producer is collected.
Message queue module is by the supervising data storage after integration in the message queue of producer consumer Model Establishment
In.
Consumer spending module 1 obtained from message queue module a part monitoring data, consumer spending module 2 from
The monitoring data of another part is obtained in message queue module
The monitoring data that the processing consumer spending of data processing module 1 module 1 is obtained, the processing consumption of data processing module 2
The monitoring data that person's consumption module 2 is obtained.
The monitoring data that the processing consumer spending of data processing module 1 module 1 is obtained, disappears with the processing of data processing module 2
The process for the monitoring data that expense person's consumption module 2 is obtained is the same, with the processing consumer spending of data processing module 1 module 1
Illustrated exemplified by the monitoring data process of acquisition：
Data processing module 1 determines monitored item state according to monitoring data, and monitored item state is stored in database.
Data processing module 1 judges whether to alarm according to monitored item state and alarm conditions.
If it is determined that being alerted, the record alarm of data processing module 1 is recorded in database, and is judged according to notification condition
Whether notified.
If it is determined that being notified, data processing module 1 notifies contact person to alert according to associated person information.
It should be noted that data processing module disappears after the monitoring data obtained in having handled consumer spending module
Expense person's consumption module can just obtain monitoring data from message queue module again.
It should also be noted that, consumer spending module and the number of data processing module are identicals, their number
Can be such as two in the present embodiment or multiple, be specifically according to monitoring data amount to be dealt with depending on.
Although disclosed herein embodiment as above, described content be only readily appreciate the present invention and use
Embodiment, is not limited to the present invention.Technical staff in any art of the present invention, is taken off not departing from the present invention
On the premise of the spirit and scope of dew, any modification and change, but the present invention can be carried out in the form and details of implementation
Scope of patent protection, still should be subject to the scope of the claims as defined in the appended claims.
Claims (10)
1. a kind of monitoring data processing unit, it is characterised in that set on each node, including：
Receiving module, the monitoring data for receiving monitor in itself affiliated node；
Memory module, for by the supervising data storage in the default queue of itself affiliated node；
Acquisition module, for obtaining monitoring data from the default queue, is used as pending monitoring data；
Processing module, for handling the pending monitoring data.
2. data processing equipment according to claim 1, it is characterised in that also include：
Module is set up, for presetting queue using producer consumer Model Establishment in itself affiliated node；
The processing module, specifically for according to the monitored item threshold information, state pre-set in itself affiliated node
Criterion information, alarm conditions information, notification condition information and associated person information are handled the pending data.
3. data processing equipment according to claim 2, it is characterised in that the processing module, including：
First processing units, for using multithread mode, in each thread according to the monitored item threshold information, the shape
State criterion information and the pending monitoring data in part of current thread processing determine monitored item state, and by the monitored item
State is stored in the shared presetting database of all nodes；
Second processing unit, for judging whether to alarm according to the monitored item state and the alarm conditions information；
3rd processing unit, if for being alerted, generation alarm record is added in the presetting database, and according to institute
Notification condition information is stated to judge whether to meet notification condition；
Notification unit, if for meeting the notification condition, notifying contact person to alert according to the associated person information.
4. the data processing equipment according to claim any one of 1-3, it is characterised in that also include：
Setup module, for setting preset rules；Wherein, the preset rules be when there are abnormal conditions in the default queue such as
Manage the rule for the data that the default queue is stored in where；
The acquisition module, specifically for obtaining monitoring data from the default queue according to the preset rules, is used as institute
State pending monitoring data.
5. data processing equipment according to claim 4, it is characterised in that the preset rules include：
When the length M of the default queue is more than preset length N, the preceding S prison for being arranged in the default queue team head is abandoned
Data are controlled, wherein, S>M-N；
The acquisition module, specifically for according to the preset rules, when the length M of the default queue is more than preset length N
When, the preceding S monitoring data for being arranged in the default queue team head is abandoned, then monitoring data is obtained from the default queue,
It is used as the pending monitoring data.
6. a kind of monitoring data processing method, it is characterised in that including：
Receive the monitoring data of monitor in the affiliated node of target monitoring data processing equipment；Wherein, the target monitoring data
Processing unit is to set any one in monitoring processing unit on each node；
By the supervising data storage in the default queue of the affiliated node of target monitoring data processing equipment；
Monitoring data is obtained from the default queue, pending monitoring data is used as；
The pending monitoring data is handled.
7. data processing method according to claim 6, it is characterised in that the reception target monitoring data processing equipment
In affiliated node before the monitoring data of monitor, methods described also includes：
Queue is preset using producer consumer Model Establishment in the affiliated node of target monitoring data processing equipment；
It is described that pending monitoring data is handled, including：
According to monitored item threshold information, the condition adjudgement mark pre-set in the affiliated node of target monitoring data processing equipment
Calibration information, alarm conditions information, notification condition information and associated person information are handled the pending monitoring data.
8. data processing method according to claim 7, it is characterised in that described according to target monitoring data processing equipment
The monitored item threshold information that is pre-set in affiliated node, condition adjudgement standard information, alarm conditions information, notification condition information
Pending monitoring data is handled with associated person information, including：
Using multithread mode, in each thread according to the monitored item threshold information, the condition adjudgement standard information and
The pending monitoring data in part of current thread processing determines monitored item state, and the monitored item state is stored in into all sections
In the shared presetting database of point；
Alarm is judged whether to according to the monitored item state and the alarm conditions information；
If being alerted, generation alarm record is added in the presetting database, and is sentenced according to the notification condition information
It is disconnected whether to meet notification condition；
If meeting the notification condition, contact person is notified to alert according to the associated person information.
9. the data processing method according to claim any one of 6-8, it is characterised in that described to be obtained from default queue
Monitoring data, before pending monitoring data, methods described also includes：
Preset rules are set；Wherein, the preset rules are how the default queue handles described pre- when there are abnormal conditions
If the rule of the data stored in queue；
Accordingly, it is described to obtain monitoring data from default queue, as pending monitoring data, including：
Monitoring data is obtained from the default queue according to the preset rules, the pending monitoring data is used as.
10. data processing method according to claim 9, it is characterised in that the preset rules include：
When the length M of the default queue is more than preset length N, the preceding S prison for being arranged in the default queue team head is abandoned
Data are controlled, wherein, S>M-N；
Accordingly, it is described to obtain monitoring data from the default queue according to preset rules, it is used as pending monitoring data, bag
Include：
According to the preset rules, when the length M of the default queue is more than preset length N, discarding is arranged in described default
The preceding S monitoring data of queue team head, then monitoring data is obtained from the default queue, it is used as the pending monitoring number
According to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710448768.9A CN107291868A (en) | 2017-06-14 | 2017-06-14 | A kind of monitoring data processing unit and monitoring data processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710448768.9A CN107291868A (en) | 2017-06-14 | 2017-06-14 | A kind of monitoring data processing unit and monitoring data processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107291868A true CN107291868A (en) | 2017-10-24 |
Family
ID=60096292
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710448768.9A Pending CN107291868A (en) | 2017-06-14 | 2017-06-14 | A kind of monitoring data processing unit and monitoring data processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107291868A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108763026A (en) * | 2018-05-31 | 2018-11-06 | 郑州云海信息技术有限公司 | A kind of disk monitoring alarm method, system, equipment and computer storage media |
| CN109039733A (en) * | 2018-07-26 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of alarm method, system and electronic equipment and storage medium |
| CN109120434A (en) * | 2018-07-27 | 2019-01-01 | 郑州云海信息技术有限公司 | A kind of storage cluster alarm method, device and computer readable storage medium |
| CN109800133A (en) * | 2019-01-28 | 2019-05-24 | 浪潮软件集团有限公司 | A kind of method, one-stop monitoring alarm platform and the system of unified monitoring alarm |
| CN112333042A (en) * | 2020-10-27 | 2021-02-05 | 广州助蜂网络科技有限公司 | Monitoring management method and device for Internet of things card middleware |
| CN112882903A (en) * | 2020-12-23 | 2021-06-01 | 沈阳世纪高通科技有限公司 | Distributed monitoring method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103618644A (en) * | 2013-11-26 | 2014-03-05 | 曙光信息产业股份有限公司 | Distributed monitoring system based on hadoop cluster and method thereof |
| CN104410512A (en) * | 2014-10-28 | 2015-03-11 | 国云科技股份有限公司 | Resource monitoring alarm framework suitable for cloud computation and method thereof |
| CN105022833A (en) * | 2015-08-10 | 2015-11-04 | 浪潮(北京)电子信息产业有限公司 | Data processing method, nodes and monitoring system |
| CN106656537A (en) * | 2015-11-03 | 2017-05-10 | ***通信集团公司 | IT cluster system monitoring method, device, terminal and system |
-
2017
- 2017-06-14 CN CN201710448768.9A patent/CN107291868A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103618644A (en) * | 2013-11-26 | 2014-03-05 | 曙光信息产业股份有限公司 | Distributed monitoring system based on hadoop cluster and method thereof |
| CN104410512A (en) * | 2014-10-28 | 2015-03-11 | 国云科技股份有限公司 | Resource monitoring alarm framework suitable for cloud computation and method thereof |
| CN105022833A (en) * | 2015-08-10 | 2015-11-04 | 浪潮(北京)电子信息产业有限公司 | Data processing method, nodes and monitoring system |
| CN106656537A (en) * | 2015-11-03 | 2017-05-10 | ***通信集团公司 | IT cluster system monitoring method, device, terminal and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108763026A (en) * | 2018-05-31 | 2018-11-06 | 郑州云海信息技术有限公司 | A kind of disk monitoring alarm method, system, equipment and computer storage media |
| CN109039733A (en) * | 2018-07-26 | 2018-12-18 | 郑州云海信息技术有限公司 | A kind of alarm method, system and electronic equipment and storage medium |
| CN109120434A (en) * | 2018-07-27 | 2019-01-01 | 郑州云海信息技术有限公司 | A kind of storage cluster alarm method, device and computer readable storage medium |
| CN109800133A (en) * | 2019-01-28 | 2019-05-24 | 浪潮软件集团有限公司 | A kind of method, one-stop monitoring alarm platform and the system of unified monitoring alarm |
| CN112333042A (en) * | 2020-10-27 | 2021-02-05 | 广州助蜂网络科技有限公司 | Monitoring management method and device for Internet of things card middleware |
| CN112882903A (en) * | 2020-12-23 | 2021-06-01 | 沈阳世纪高通科技有限公司 | Distributed monitoring method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107291868A (en) | A kind of monitoring data processing unit and monitoring data processing method | |
| CN107707380B (en) | A kind of monitoring alarm method and apparatus | |
| CN109660380A (en) | Monitoring method, platform, system and the readable storage medium storing program for executing of operation condition of server | |
| CN103716173B (en) | A kind of method for storing monitoring system and monitoring alarm issue | |
| CN103973815A (en) | Method for unified monitoring of storage environment across data centers | |
| CN106685676A (en) | Node switching method and device | |
| TWI397871B (en) | Automated events integration system | |
| EP3962026A1 (en) | Method and system for providing time-critical services | |
| CN111488258A (en) | System for analyzing and early warning software and hardware running state | |
| CN109164720A (en) | Injection molding machine group of planes remote monitoring system and method based on IIoT | |
| CN107948157A (en) | A kind of message processing method and device | |
| CN109005076A (en) | A kind of intelligent substation switch monitoring system and interchanger monitoring method | |
| CN115460051A (en) | Equipment linkage model configuration method based on industry Internet of things scene | |
| EP3843332A1 (en) | Method for monitoring data traffic in a communication network and access control system | |
| CN105071986B (en) | A kind of method of supervisory control system running state | |
| CN105897492A (en) | Cloud data center monitoring system | |
| CN109428745B (en) | JMS message forwarding method, device, electronic equipment and storage medium | |
| CN107911229A (en) | Based reminding method, device, electronic equipment and the storage medium that operating status changes | |
| CN107612755A (en) | The management method and its device of a kind of cloud resource | |
| CN110008085A (en) | A kind of monitoring system of big data platform | |
| CN113381880B (en) | Internet of things equipment management method, device and system | |
| CN115167297A (en) | Intelligent manufacturing industry Internet of things based on thread control and control method | |
| CN107508731A (en) | A kind of large-scale data center monitoring method and system | |
| CN105550094B (en) | A kind of high-availability system state automatic monitoring method | |
| CN110995486B (en) | Intelligent hardware equipment monitoring system based on Internet of things |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171024 |