CN102591791A - System and method for reducing data storage capacity by defining strategy - Google Patents
System and method for reducing data storage capacity by defining strategy Download PDFInfo
- Publication number
- CN102591791A CN102591791A CN2011104598932A CN201110459893A CN102591791A CN 102591791 A CN102591791 A CN 102591791A CN 2011104598932 A CN2011104598932 A CN 2011104598932A CN 201110459893 A CN201110459893 A CN 201110459893A CN 102591791 A CN102591791 A CN 102591791A
- Authority
- CN
- China
- Prior art keywords
- data
- storage
- screening
- strategy
- watch
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Remote Monitoring And Control Of Power-Distribution Networks (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a system for reducing data storage capacity by a defining strategy, comprising a device access module, a predefining module, a core module and a device storage data operation module. By screening the data conditions and triggering the judgement on validity of storage events during data storage, the data storage capacity is reduced effectively, the sensitive data are preserved in time, the data operation is simple, the system expenses are reduced remarkably, meanwhile, the accuracy of the data operation is increased, and the response speed of the monitoring system is improved.
Description
Technical field
The present invention relates to rotating ring monitoring technique field, a kind of definition strategy that relates in particular to rotating ring supervisory system data storage reduces the system and method for memory data output.
Background technology
The rotating ring monitoring is the on-site supervision system that a kind of real-time is high, data volume is big, and its system software mainly adopts the mode of real-time communication and watch-dog to carry out data interaction, will store a large amount of local datas thus.Local these data of storage not only need very big storage space, and need more manpower and energy to carry out daily servicing.Though the relative low price of current storage, carrying cost are not high, yet find the reasonable data of operation management decision support in a large amount of storage data the inside, need pay high data mining cost and spend the very long data-analysis time.In order to reduce the cost of data maintenance; At present; The various management system of monitoring trade all attempts adopting the method for data filter and strategy to reduce local datastore, avoids the management puzzlement that mass data brings as much as possible, yet when the local datastore amount descends; The data sheet of Operation Decision support also can't truly reflect the field apparatus situation thereupon, often implements unsatisfactory.
In addition; Relational DBMS is selected as the main flow of current local datastore, but its lower deployment cost is not cheap, often the cost of the large-scale enterprise-level database management system of a cover; With respect to less and distributed computers machine room is unaffordable; Therefore, it is less that the user favors the storage administration capacity mostly, disposes free easily data base management system (DBMS).
Thus; How to define a kind of rational and effective storage policy, when guaranteeing that data can authentic and valid reflection field equipment state, reduce the local datastore amount; And do not influence normal operation management decision support, be one of the research direction in center monitoring field.
Summary of the invention
The purpose of this invention is to provide the system and method that a kind of definition strategy reduces memory data output; When being intended to effectively reduce local datastore; Need be and do not influence the operation management decision support to the operation of monitor data, particularly responsive data, thus the operation of assurance system is reliable and stable.
For achieving the above object, the present invention adopts following technical scheme:
A kind of definition strategy reduces the system of memory data output, it is characterized in that, comprising:
Equipment AM access module is used to obtain watch-dog data and watch-dog information;
The predefine module is used for initialize data screening strategy and data store strategy;
Nucleus module is used for calling the data screening strategy and the data store strategy of predefine module, the watch-dog data screened, and the availability deciding of trigger data storage incident, whether determination data need be stored;
The device storage data operation modules is used for the equipment interaction data is carried out this locality storage and reverse reduction read operation.
Said nucleus module comprises:
Data screening condition storehouse; Generate by the data screening strategy that presets in the predefine module; Nucleus module is according to the data screening condition that provides in the watch-dog information, and the screening conditions of combination selection watch-dog are stored screening to the watch-dog data from data screening condition storehouse;
The data storage event base; Generate by the data store strategy that presets in the predefine module;, triggers the watch-dog data screening storage incident when failing; Nucleus module judges should the storage incident whether to exist and whether reasonable through scan-data storage event base, rationally and the storage incident that exists will carry out that data are local stores, unreasonable or non-existent storage incident is abandoned by nucleus module.
A kind of definition strategy reduces the method for memory data output, it is characterized in that, may further comprise the steps:
(1) system initialization;
(2) obtain the watch-dog data;
The equipment screening conditions of confirming during (3) according to system initialization are screened the watch-dog data, when data screening is failed, trigger a storage incident;
(4) nucleus module scan-data storage event base, judgement should the storage incident whether rationally and whether be present in the data storage event base, unreasonable or non-existent storage incident will be abandoned by nucleus module, system skips back to step (3) and continues data screening;
(5) data storage: realize storage to the watch-dog data according to the data store strategy that presets.
Said step (1) further comprises:
Predefine: describe and storage data screening strategy and data store strategy;
File is preset in generation: generate data screening condition storehouse, data storage event base and reverse reduction of data method;
Generate screening conditions: obtain watch-dog information, according to the data screening condition that provides in the watch-dog information, combination selection equipment screening conditions from data screening condition storehouse.
Whether judgment data need screen before said step (3) also was included in and carries out data screening, if data setting then directly gets into step (5) data are stored for not needing screening.
After data storage was accomplished, in the time of need carrying out data read operation, the reverse reduction of data method that scanning predefine module generates was according to the predetermined reverse strategy that stores strategy, generating run result.
Adopt the supervisory system of method of the present invention, reduced the memory space of data effectively, and timely and effectively preserved responsive data; Operation to data is fairly simple; System overhead also obviously reduces, and has increased the accuracy of service data simultaneously, has improved the response speed of supervisory system.
Description of drawings
Fig. 1 is structure and the treatment scheme synoptic diagram that definition strategy of the present invention reduces the system of memory data output.
Embodiment
In order to make the object of the invention, technical scheme clearer, the present invention is further specified below in conjunction with accompanying drawing.
The system that a kind of definition strategy provided by the invention reduces memory data output is as shown in Figure 1, and this system comprises equipment AM access module, predefine module, nucleus module and device storage data operation modules.Equipment AM access module can be obtained watch-dog data and watch-dog information.Initialize data screening strategy and data store strategy in the predefine module.Data screening strategy and data store strategy that nucleus module calls the predefine module generate data screening condition storehouse and data storage event base.In addition, the data store strategy in the predefine module can also generate reverse reduction of data method, and supply equipment storage data operation modules calls.Nucleus module also supports invocation facility AM access module to obtain watch-dog information, and according to the data screening condition that provides in the watch-dog information, combination selection equipment screening conditions from data screening condition storehouse.So far, the initialization of having accomplished the system-based module is prepared with operation.
After supervisory system begins to obtain the watch-dog data; At first whether judgment data need screen, if data setting is then directly stored data for not needing screening; If need screening, then data screened according to the equipment screening conditions of aforementioned generation.In the present embodiment, suppose to filter successful data for not needing data recorded, the data of filtering failure are the needs data recorded.Then when occurring filtering the data of failure, trigger a storage incident.After the storage Event triggered, nucleus module scans coupling to data storages event base, and whether judgement should the storage incident exists and rationally, rationally and the storage incident that exists be judged as and trigger successfully, according to the data store strategy execution data storage that presets; Unreasonable or non-existent storage incident is judged as and triggers failure, and the storage incident will be dropped, and system proceeds the screening of follow-up watch-dog data.
For example, equipment return data=User Defined data normal value+data fluctuations value.Wherein, User Defined data normal value is the data that this equipment that the user is concerned about runs well, and the data fluctuations value is the normal fluctuation data of customer's approval, in this scope, can work well by definition apparatus.The scope of data fluctuations can be defined in the data screening strategy.Thus, through selection, generate the corresponding apparatus screening conditions: when the data fluctuations scope transfinites data are carried out record to data screening conditions storehouse.Therefore, when the watch-dog data that data fluctuations transfinites occurring, will trigger a storage incident.
Definition has following storage incident in the tentation data storage event base again: in the section data are being stored sometime.At this moment, according to the triggered time of this storage incident, data storage event base is scanned.If triggered time that should the storage incident then should the success of storage Event triggered in the defined time period, data will be stored by the data store strategy that presets; If the triggered time not in the defined time period, then should the storage Event triggered get nowhere, the storage incident will be dropped.
In the time need reading and operate to the data that are stored in this locality; The data store strategy of device storage data module from the predefine module obtains reverse reduction of data method, the data of storage carried out reverse reduction of data generate the user data that can read and operate.
The above embodiment has only expressed several kinds of embodiments of the present invention, and it describes comparatively concrete and detailed, but can not therefore be interpreted as the restriction to claim of the present invention.Should be pointed out that for the person of ordinary skill of the art under the prerequisite that does not break away from the present invention's design, can also make some distortion and improvement, these all belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be as the criterion with accompanying claims.
Claims (6)
1. the system of a definition strategy minimizing memory data output is characterized in that, comprising:
Equipment AM access module is used to obtain watch-dog data and watch-dog information;
The predefine module is used for initialize data screening strategy and data store strategy;
Nucleus module is used for calling the data screening strategy and the data store strategy of predefine module, the watch-dog data screened, and the availability deciding of trigger data storage incident, whether determination data need be stored;
The device storage data operation modules is used for the equipment interaction data is carried out this locality storage and reverse reduction read operation.
2. system according to claim 1 is characterized in that, said nucleus module comprises:
Data screening condition storehouse; Generate by the data screening strategy that presets in the predefine module; Nucleus module is according to the data screening condition that provides in the watch-dog information, and the screening conditions of combination selection watch-dog are stored screening to the watch-dog data from data screening condition storehouse;
The data storage event base; Generate by the data store strategy that presets in the predefine module;, triggers the watch-dog data screening storage incident when failing; Nucleus module judges should the storage incident whether to exist and whether reasonable through scan-data storage event base, rationally and the storage incident that exists will carry out that data are local stores, unreasonable or non-existent storage incident is abandoned by nucleus module.
3. the method for a definition strategy minimizing memory data output is characterized in that, may further comprise the steps:
(1) system initialization;
(2) obtain the watch-dog data;
The equipment screening conditions of confirming during (3) according to system initialization are screened the watch-dog data, when data screening is failed, trigger a storage incident;
(4) nucleus module scan-data storage event base, judgement should the storage incident whether rationally and whether be present in the data storage event base, unreasonable or non-existent storage incident will be abandoned by nucleus module, system skips back to step (3) and continues data screening;
(5) data storage: realize storage to the watch-dog data according to the data store strategy that presets.
4. method according to claim 3 is characterized in that, said step (1) further comprises:
Predefine: describe and storage data screening strategy and data store strategy;
File is preset in generation: generate data screening condition storehouse, data storage event base and reverse reduction of data method;
Generate screening conditions: obtain watch-dog information, according to the data screening condition that provides in the watch-dog information, combination selection equipment screening conditions from data screening condition storehouse.
5. method according to claim 3 is characterized in that, whether judgment data need screen before said step (3) also was included in and carries out data screening, if data setting then directly gets into step (5) data are stored for not needing screening.
6. method according to claim 3 is characterized in that, after data storage was accomplished, in the time of need carrying out data read operation, the reverse reduction of data method that scanning predefine module generates was according to the predetermined reverse strategy that stores strategy, generating run result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110459893.2A CN102591791B (en) | 2011-12-31 | 2011-12-31 | A kind of system and method for reducing data storage capacity by defining strategy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110459893.2A CN102591791B (en) | 2011-12-31 | 2011-12-31 | A kind of system and method for reducing data storage capacity by defining strategy |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102591791A true CN102591791A (en) | 2012-07-18 |
| CN102591791B CN102591791B (en) | 2016-08-03 |
Family
ID=46480481
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110459893.2A Expired - Fee Related CN102591791B (en) | 2011-12-31 | 2011-12-31 | A kind of system and method for reducing data storage capacity by defining strategy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102591791B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105278879A (en) * | 2015-10-14 | 2016-01-27 | 珠海格力电器股份有限公司 | Method and device for processing monitoring data |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6148382A (en) * | 1996-12-23 | 2000-11-14 | Emc Corporation | Arrangement for filtering data item updates to reduce the number of updates to a data item to be stored on mass data storage facility |
| CN1335686A (en) * | 2000-07-25 | 2002-02-13 | 华为技术有限公司 | Data selecting method and device |
| US20050286563A1 (en) * | 2004-06-29 | 2005-12-29 | Samsung Electronics Co., Ltd. | Method and apparatus for filtering section data |
| CN1972297A (en) * | 2005-11-22 | 2007-05-30 | 飞塔信息科技（北京）有限公司 | Computer system and method for policy-based content filtering |
| CN101223510A (en) * | 2005-05-31 | 2008-07-16 | 科学园株式会社 | Monitoring method, monitoring system, system program, and recording medium containing the program |
| CN101267644A (en) * | 2008-04-22 | 2008-09-17 | 广东高新兴通信股份有限公司 | A storage method for monitoring data |
| CN101446964A (en) * | 2008-12-31 | 2009-06-03 | 中国建设银行股份有限公司 | Method of data mining and computer device |
-
2011
- 2011-12-31 CN CN201110459893.2A patent/CN102591791B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6148382A (en) * | 1996-12-23 | 2000-11-14 | Emc Corporation | Arrangement for filtering data item updates to reduce the number of updates to a data item to be stored on mass data storage facility |
| CN1335686A (en) * | 2000-07-25 | 2002-02-13 | 华为技术有限公司 | Data selecting method and device |
| US20050286563A1 (en) * | 2004-06-29 | 2005-12-29 | Samsung Electronics Co., Ltd. | Method and apparatus for filtering section data |
| CN101223510A (en) * | 2005-05-31 | 2008-07-16 | 科学园株式会社 | Monitoring method, monitoring system, system program, and recording medium containing the program |
| CN1972297A (en) * | 2005-11-22 | 2007-05-30 | 飞塔信息科技（北京）有限公司 | Computer system and method for policy-based content filtering |
| CN101267644A (en) * | 2008-04-22 | 2008-09-17 | 广东高新兴通信股份有限公司 | A storage method for monitoring data |
| CN101446964A (en) * | 2008-12-31 | 2009-06-03 | 中国建设银行股份有限公司 | Method of data mining and computer device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105278879A (en) * | 2015-10-14 | 2016-01-27 | 珠海格力电器股份有限公司 | Method and device for processing monitoring data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102591791B (en) | 2016-08-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102203738B (en) | Event queue managing device and event queue managing method | |
| US20060160396A1 (en) | Methods, systems and computer program products for notifying telecommunications system technicians of pending work orders | |
| CN101321207B (en) | Failure processing method of telecommunication customer service system database | |
| CN105868391A (en) | Method and device for recording log | |
| CN109871392B (en) | Slow sql real-time data acquisition method under distributed application system | |
| CN1549969A (en) | Method and system for correlating and determining root causes of system and enterprise events | |
| CN202422195U (en) | Comprehensive application mobile terminal for city management and community service | |
| CN103827878A (en) | Automated password management | |
| CN101729567A (en) | Web alarm monitoring system and method based on Socket protocol | |
| CN101216973A (en) | An ATM monitoring method, system, ATM and monitoring device | |
| CN101604290B (en) | Background module test method and backstage module test system | |
| CN104572123A (en) | Script generation method and device | |
| CN202713533U (en) | TV diagnosis and maintenance system and TV | |
| CN102591791A (en) | System and method for reducing data storage capacity by defining strategy | |
| CN101692249B (en) | Method for performing data access on power demand side system | |
| CN114218046A (en) | Business monitoring method, medium, electronic device and readable storage medium | |
| CN1588459A (en) | Method and system for real time early warning monitoring to bank ATM terminal safety hidden peril | |
| CN102981939A (en) | Disc monitoring method | |
| CN103544098A (en) | Method and device for testing pressure | |
| CN103455391A (en) | Dynamic adjustment data protection device and method | |
| CN101464790B (en) | Apparatus and method for scheduling commands from host systems | |
| CN101060683B (en) | Warning information generation method and device for communication system | |
| CN107331083A (en) | A kind of self-service borrowing-returning books system and bookcase | |
| CN102158823A (en) | Method and system for tracking stolen mobile terminal as well as mobile terminal | |
| CN112463167B (en) | Bank account dynamic account notification service system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160803 Termination date: 20181231 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |