CN105843724A - Monitoring state index compression analysis method of IT (Information Technology) system - Google Patents
Monitoring state index compression analysis method of IT (Information Technology) system Download PDFInfo
- Publication number
- CN105843724A CN105843724A CN201610153066.3A CN201610153066A CN105843724A CN 105843724 A CN105843724 A CN 105843724A CN 201610153066 A CN201610153066 A CN 201610153066A CN 105843724 A CN105843724 A CN 105843724A
- Authority
- CN
- China
- Prior art keywords
- time
- index
- data
- end time
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3065—Monitoring arrangements determined by the means or processing involved in reporting the monitored data
- G06F11/3072—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting
- G06F11/3082—Monitoring arrangements determined by the means or processing involved in reporting the monitored data where the reporting involves data filtering, e.g. pattern matching, time or event triggered, adaptive or policy-based reporting the data filtering being achieved by aggregating or compressing the monitored data
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention relates to a monitoring state index compression analysis method of an IT (Information Technology) system. According to the characteristics of equipment that a state is seldom changed and a repeat probability is high, a data recording format suitable for storing and analyzing states according to time points is designed, and a compression and analysis algorithm matched with the data recording format is also designed. The monitoring state index compression analysis method comprises the following steps: receiving equipment state index data; inquiring a latest index record of the equipment; comparing the new record and the old record, and updating a historical index library according to a result; and through the historical index library, inquiring the change situation of the equipment state. The monitoring state index compression analysis method has the beneficial effects that the problem of big data processing performance generated during state index monitoring state collection and processing in an IT system monitoring field can be effectively solved, the storage problem of mass data under large-scale surveillance is solved, meanwhile, the real-time efficiency of upper-layer reading data is improved, and a data analysis period is shortened.
Description
Technical field
The present invention relates to IT system monitoring field, a kind of IT system monitoring state index compression analysis method, pass through shape
State index compression analytical technology, solves the storage problem of mass data, improves upper strata simultaneously and reads the Real time Efficiency of data,
Shorten the cycle of data analysis.
Background technology
Modern IT systems underlying basis framework is complicated, needs large number quipments, simultaneously in order to ensure the operation of IT system 7*24 hour
Normally, it is generally required to the underlying basis framework of IT system is monitored in real time, monitor the state of all kinds of index, once find to ask
Topic, can notify that personnel solve in time and repair problem, ensure the high availability of IT system.General device monitoring index is all
Storing according to time series, time length, the disk space taken is increasing, and the reading of data is more and more slower.
Therefore create state index and compress such product technology, solve these problems.
Summary of the invention
Present invention aim to address that tradition IT monitoring system collects and process, at state index, the problem run into, and provide a kind of
IT system monitoring state index compression analysis method, after using state index compress technique, can realize storing state index
Data volume is greatly decreased, and solves under extensive monitoring, and the storage problem of mass data improves upper strata simultaneously and reads data
Real time Efficiency, shorten the cycle of data analysis.
It is an object of the invention to complete by following technical solution.This IT system monitoring state index compression analysis method,
Utilizing the feature that Status Change is few, repetition probability is big of equipment, design is suitable for temporally some storage state and the data of analysis state
Record format, and the compression that matches and parser, its step is as follows:
1) accepting device state index data；
2) nearest this index record of this equipment is inquired about；
3) the old and new's record is compared, according to result more new historical index storehouse；
4) by history index library inquiry equipment state situation of change.
Further, specifically comprise the following steps that
(1), receive achievement data, be labeled as NR, NR=device identification+pointer type+desired value+sampling time；
(2), inquire about corresponding last achievement data, be labeled as LR, LR=device identification+pointer type+desired value
+ time started+end time+sampling number, if inquiry is less than record, then arranging LR is NULL mark；
(3), compare the index state of NR Yu LR, and carry out corresponding data and preserve operation；
(3-1), such as NR desired value=LR desired value, then updating LR and again preserve, more new regulation is as follows:
A) LR end time, LR end time=NR sampling time are updated；
B) LR sampling number, LR sampling number=LR sampling number+1 are increased；
(3-2), such as NR desired value<>LR desired value LR=NULL, then the amendment LR end time, and pass through NR
Generating new LR and preserve, more new regulation is as follows:
A) LR end time, LR end time=NR sampling time are set；
B) LR is preserved；
C) new LR is generated by NR；
D) LR time started, LR time started=NR sampling time are set；
E) LR end time, LR end time=NR sampling time are set；
F) arranging LR sampling number is 1, LR sampling number=1；
(3-3), such as LR=NULL, then generating new LR by NR and preserve, more new regulation is as follows:
A) LR time started, LR time started=NR sampling time are set；
B) LR end time, LR end time=NR end time are set；
C) arranging LR sampling number is 1, LR sampling number=1.
Further, analysis indexes Status Change, specified the LR record in the time period by inquiry, i.e. can quickly realize:
A) inquiry Status Change history, sorted by the LR time started；
B) analyze the total time of certain state, add up to the time interval specifying desired value coupling record in LR.
The invention have the benefit that the present invention can effectively solve in IT system monitoring field, state index monitoring state is collected
The big data processing performance problem run into process, solves under extensive monitoring, and the storage problem of mass data carries simultaneously
Rise upper strata and read the Real time Efficiency of data, shorten the cycle of data analysis.
Accompanying drawing explanation
Fig. 1 is the configuration item mediation schematic flow sheet of the present invention；
Fig. 2 is the primary data sample schematic diagram before the present invention；
Fig. 3 is the data sample schematic diagram after using the present invention；
Fig. 4 is the data volume contrast schematic diagram after using the present invention.
Detailed description of the invention
Below in conjunction with drawings and Examples the present invention done detailed introduction:
State index compress technique of the present invention, relates to 3 unit altogether: data receipt unit, metric history storehouse, data
Preserve processing unit, data analysis unit.1. data receipt unit, accepting device state index data, labelling new record；2.
Metric history storehouse, save historical data offer query interface；3. data preserve processing unit, compare the old and new's record, how determine
Save historical data；4. data analysis unit, by query history storehouse and total, to provide Status Change analytical statement.
The operational flow diagram of the above-mentioned each module in Fig. 1 position；Describe data flow as indicated above；The index that each monitoring system provides
Data, first pass around labelling and generate new record；Secondly locating query history library record；Finally carry out record to compare；
Before Fig. 2 is for using the present invention, the data sample of a network equipment port duty；
After Fig. 3 is for using the present invention, the data sample after above-mentioned data compression；
Before and after Fig. 4 is for using the present invention, the income of data compression compares.
The step that the present invention realizes is as follows:
1, receive achievement data, be labeled as NR.NR=device identification+pointer type+desired value+sampling time
As: NR=switch A+port working state+roll off the production line+2015-03-10 14:42:51
2, the corresponding last achievement data of inquiry, is labeled as LR.LR=device identification+pointer type+desired value+open
Time beginning+end time+sampling number.If inquiry is less than record, then arranging LR is NULL mark.
As: LR=switch A+port working state+online+2015-03-05 18:22:30+2015-03-10 14:32:51
+ 697 times
3, compare the index state of NR Yu LR, and carry out corresponding data preservation operation
1) if " NR desired value=LR desired value ", then updating LR and again preserve, more new regulation is as follows:
A) update the LR end time, make LR end time=NR sampling time
B) increase LR sampling number, make LR sampling number=LR sampling number+1
2) if " NR desired value<>LR desired value or LR=NULL ", then revise the LR end time, and raw by NR
The LR of Cheng Xin also preserves, and more new regulation is as follows:
A) the LR end time is set, makes LR end time=NR sampling time
B) LR is preserved
C) new LR is generated by NR
D) the LR time started is set, makes LR time started=NR sampling time
E) the LR end time is set, makes LR end time=NR sampling time
F) arranging LR sampling number is 1, LR sampling number=1
3) if " LR=NULL ", then generating new LR by NR and preserve, more new regulation is as follows:
A) the LR time started is set, makes LR time started=NR sampling time
B) the LR end time is set, makes LR end time=NR end time
C) arranging LR sampling number is 1, makes LR sampling number=1
According to the example in step 1 and 2, there is " NR desired value<>LR desired value " in this step, therefore the following operation of generation:
1) the LR end time is set, and preserves former LR=switch A+port working state+online+2015-03-05
18:22:30+2015-03-10 14:42:51+697 time
2) generate new LR by NR, and preserve that new LR=switch A+port working state+roll off the production line+2015-03-10
14:42:51+2015-03-10 14:42:51+1 time
4, analysis indexes Status Change, is specified the LR record in the time period, can quickly realize by inquiry:
A) inquiry Status Change history, sorted by the LR time started
B) analyze the total time of certain state, add up to the time interval specifying desired value coupling record in LR.
The present invention is not limited to above-mentioned embodiment, no matter making any change on its shape or material are constituted, every employing this
Bright provided structure design, is all a kind of deformation of the present invention, is all considered as within scope.
Claims (3)
1. an IT system monitoring state index compression analysis method, is characterized in that: the Status Change utilizing equipment is few, repeat
The feature that probability is big, design is suitable for temporally some storage state and the data record format of the state of analysis, and the pressure matched
Contracting and parser, its step is as follows:
1) accepting device state index data；
2) nearest this index record of this equipment is inquired about；
3) the old and new's record is compared, according to result more new historical index storehouse；
4) by history index library inquiry equipment state situation of change.
IT system monitoring state index the most according to claim 1 compression analysis method, it is characterised in that: concrete steps are such as
Under:
(1), receive achievement data, be labeled as NR, NR=device identification+pointer type+desired value+sampling time；
(2), inquire about corresponding last achievement data, be labeled as LR, LR=device identification+pointer type+desired value
+ time started+end time+sampling number, if inquiry is less than record, then arranging LR is NULL mark；
(3), compare the index state of NR Yu LR, and carry out corresponding data and preserve operation；
(3-1), such as NR desired value=LR desired value, then updating LR and again preserve, more new regulation is as follows:
A) LR end time, LR end time=NR sampling time are updated；
B) LR sampling number, LR sampling number=LR sampling number+1 are increased；
(3-2), such as NR desired value<>LR desired value LR=NULL, then the amendment LR end time, and pass through NR
Generating new LR and preserve, more new regulation is as follows:
A) LR end time, LR end time=NR sampling time are set；
B) LR is preserved；
C) new LR is generated by NR；
D) LR time started, LR time started=NR sampling time are set；
E) LR end time, LR end time=NR sampling time are set；
F) arranging LR sampling number is 1, LR sampling number=1；
(3-3), such as LR=NULL, then generating new LR by NR and preserve, more new regulation is as follows:
A) LR time started, LR time started=NR sampling time are set；
B) LR end time, LR end time=NR end time are set；
C) arranging LR sampling number is 1, LR sampling number=1.
IT system monitoring state index the most according to claim 1 compression analysis method, it is characterised in that: analysis indexes
Status Change, is specified the LR record in the time period, i.e. can quickly realize by inquiry:
A) inquiry Status Change history, sorted by the LR time started；
B) analyze the total time of certain state, add up to the time interval specifying desired value coupling record in LR.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610153066.3A CN105843724B (en) | 2016-03-17 | 2016-03-17 | A kind of IT system monitoring state index compression analysis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610153066.3A CN105843724B (en) | 2016-03-17 | 2016-03-17 | A kind of IT system monitoring state index compression analysis method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105843724A true CN105843724A (en) | 2016-08-10 |
| CN105843724B CN105843724B (en) | 2019-03-15 |
Family
ID=56588135
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610153066.3A Active CN105843724B (en) | 2016-03-17 | 2016-03-17 | A kind of IT system monitoring state index compression analysis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105843724B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107276849A (en) * | 2017-06-15 | 2017-10-20 | 北京奇艺世纪科技有限公司 | The method for analyzing performance and device of a kind of cluster |
| CN113688109A (en) * | 2021-08-20 | 2021-11-23 | 招商银行股份有限公司 | IT system monitoring index compression and query method, device and storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040210419A1 (en) * | 2002-11-22 | 2004-10-21 | David Wiebe | Refrigeration monitor |
| CN1553375A (en) * | 2003-05-29 | 2004-12-08 | 华为技术有限公司 | Collecting and processing method for apparatus performance accounting data |
| CN102231081A (en) * | 2011-06-14 | 2011-11-02 | 北京三博中自科技有限公司 | Energy utilization state diagnosis method for process industrial equipment |
-
2016
- 2016-03-17 CN CN201610153066.3A patent/CN105843724B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040210419A1 (en) * | 2002-11-22 | 2004-10-21 | David Wiebe | Refrigeration monitor |
| CN1553375A (en) * | 2003-05-29 | 2004-12-08 | 华为技术有限公司 | Collecting and processing method for apparatus performance accounting data |
| CN102231081A (en) * | 2011-06-14 | 2011-11-02 | 北京三博中自科技有限公司 | Energy utilization state diagnosis method for process industrial equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107276849A (en) * | 2017-06-15 | 2017-10-20 | 北京奇艺世纪科技有限公司 | The method for analyzing performance and device of a kind of cluster |
| CN113688109A (en) * | 2021-08-20 | 2021-11-23 | 招商银行股份有限公司 | IT system monitoring index compression and query method, device and storage medium |
| CN113688109B (en) * | 2021-08-20 | 2024-05-03 | 招商银行股份有限公司 | IT system monitoring index compression and query method, device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105843724B (en) | 2019-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6154542B2 (en) | Time-series data management method and time-series data management system | |
| CN110750524A (en) | Method and system for determining fault characteristics of active power distribution network | |
| WO2012073526A1 (en) | Data processing system, and data processing device | |
| CN105608144A (en) | Big data analysis platform device and method based on multilayer model iteration | |
| CN105787058B (en) | A kind of user tag system and the data delivery system based on user tag system | |
| CN113297135A (en) | Data processing method and device | |
| US20160179936A1 (en) | Processing time-aligned, multiple format data types in industrial applications | |
| CN109245310A (en) | A kind of electric power monitoring system based on real-time data base | |
| CN114238388A (en) | Heterogeneous data collection and retrieval system based on multiple protocols | |
| CN118035249B (en) | Nuclear engineering complex relation data modeling and monitoring method and system | |
| CN105677723B (en) | A kind of data label foundation and search method for industrial signal source | |
| CN105843724A (en) | Monitoring state index compression analysis method of IT (Information Technology) system | |
| CN114416783A (en) | Method and device for evaluating dynamic cost of OLAP (on-line analytical processing) query engine | |
| CN113506098A (en) | Power plant metadata management system and method based on multi-source data | |
| CN109739854A (en) | A kind of date storage method and device | |
| CN111079809A (en) | Intelligent system method for electric connector | |
| CN112162896A (en) | InfluxDB-based cluster data monitoring method | |
| WO2020118928A1 (en) | Distributed time sequence pattern retrieval method for massive equipment operation data | |
| CN103383649A (en) | Design model of complex virtual instrument system | |
| CN112783740B (en) | Server performance prediction method and system based on time series characteristics | |
| CN111625517B (en) | New energy real-time data processing method and device based on change storage | |
| CN109189775B (en) | Industrial monitoring platform mass data processing system and method | |
| CN116956174B (en) | Classification model for cold head state classification detection and life prediction and generation method of prediction model | |
| CN103325011A (en) | Production control method and production control device | |
| CN113721207B (en) | Early warning method and system for replacing life parts in radar based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20191217 Address after: 311305 no.030, building 3, No.6 heting street, Qingshanhu street, Lin'an District, Hangzhou City, Zhejiang Province Co-patentee after: Beijing Guangtong software Limited by Share Ltd XinDa Patentee after: Hangzhou Youyun Software Co., Ltd. Address before: 311305, No. three, No. 6, Ting Ting Street, 030 Qingshan Lake Street, Hangzhou, Zhejiang, Ling'an Patentee before: Hangzhou Youyun Software Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| CP01 | Change in the name or title of a patent holder |
Address after: 311305 No. 030, building 3, No. 6, heting street, Qingshanhu street, Lin'an District, Hangzhou City, Zhejiang Province Patentee after: HANGZHOU YOUYUN SOFTWARE Co.,Ltd. Patentee after: Beijing Guangtong Youyun Technology Co.,Ltd. Address before: 311305 No. 030, building 3, No. 6, heting street, Qingshanhu street, Lin'an District, Hangzhou City, Zhejiang Province Patentee before: HANGZHOU YOUYUN SOFTWARE Co.,Ltd. Patentee before: Beijing Guangtong software Limited by Share Ltd. XinDa |
|
| CP01 | Change in the name or title of a patent holder |