CN104992262A - Power utilization big-data analysis and miningprocessing method - Google Patents
Power utilization big-data analysis and miningprocessing method Download PDFInfo
- Publication number
- CN104992262A CN104992262A CN201510278116.6A CN201510278116A CN104992262A CN 104992262 A CN104992262 A CN 104992262A CN 201510278116 A CN201510278116 A CN 201510278116A CN 104992262 A CN104992262 A CN 104992262A
- Authority
- CN
- China
- Prior art keywords
- data
- analysis
- arff
- file
- platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
he invention provides a power utilization big-data analysis and miningprocessing method and relates to data analysis and mining processing method. The ARFF-format data file, the third-party data source and a platform can be analyzed and mined. The ARFF-format file is characterized in that all records are mutually independent and irreverent and need not to be in sequence. Different third-party data sources can be deployed in different ways and can be searched by manually programmed SQL sentences. The platform is used for power utilization big-data analysis and miningprocessing via cuboid and index configuration. According to the invention, operating data of the power grid can be effectively managed and properly analyzed; operating experience of the power grid can be summarized; operating rules of the power grid can be discovered; and best management and decision services are provided for increasing of working efficiency and a manager, thereby increasing economic benefit and management level of an enterprise.
Description
Technical field
The present invention relates to a kind of data analysis and excavate disposal route, be specifically related to one TV university data analysis and excavate disposal route;
Background technology
Electric system is an important component part of national economy, and the industry of country, agricultural, daily life all be unable to do without electric power; People require more and more higher to the power supply reliability of electric system; Simultaneously, electric system also moves towards market economy model by the planned economy mode in past gradually, and how farthest the equilibrium of supply and demand of stable power load, the economic benefit of raising power supplying and generating enterprises become the major issue that electric system faces; Electric power itself is as a kind of special commodity, and it cannot be preserved, thus the prediction work of electricity needs to reduce resource waste, to improve the benefit of electricity power enterprise significant;
Electricity market be Operation of Electric Systems, load management, supply electricity cooperation, Communications And Computer system comprehensive, nearly all electric power center of calling is provided with Automation of Electric Systems software; The analysis and prediction of electric load is an important component part of energy management, is an important element task, is also the basis of formulating generation schedule simultaneously; For Electric Power Network Planning, the prediction of load can also be used to the start and stop and the maintenance that arrange unit, determines rational rotational volume for subsequent use;
At present, the electricity buying of electrical network is minimum for principle with purchase cost, and load prediction also just becomes the basis of electricity buying, has important impact, directly have influence on the economic benefit of electrical network and electricity power enterprise for bidding strategies; Electrical network is generally carry the previous day to make load prediction, and the distribution that effective short-term load forecasting can make power grid electric purchase is more reasonable, increases benefit; Meanwhile, each generating plant also can be impelled constantly to reduce cost of electricity-generating, improve oneself competitive power in the market;
Present stage, power information deepens continuously, and power supply enterprise builds oneself the management information system with respective characteristic one after another; But all there is the Similar Problems such as cost is high, and efficiency is low, time-consuming in prior art;
Summary of the invention
The object of the invention is to the defect for prior art and deficiency, one TV university data analysis is provided to excavate disposal route, it can effectively manage operation of power networks data and analyse scientifically, operation of power networks experience can be summed up, excavate operation of power networks rule, for increasing work efficiency and providing best management and decision scheme service for supvr, thus improve economic benefit, the management level of enterprise.
For achieving the above object, the technical solution used in the present invention is: it can the data of analysis mining three types, are respectively: ARFF formatted data file, third party's data source, platform;
ARFF formatted data file: the feature of arff formatted file be each record separate, there is no sequence requirement, there is not relation between each record simultaneously; Arff file internals is very simple, is the data file structure of lightweight, is convenient to excavate;
Third party's data source: configuration different pieces of information source, manually writes query SQL; This data set abundance, but require higher to operating personnel, after writing query SQL after Analysis and Screening need being carried out to data, its data are excavated;
Platform: be excavate processing platform, by cubic configuration and index allocation with TV university data analysis; Many tolerance of data, various dimensions logical view are provided; Make user can multi-angle, many sides, investigate data in analytical database at many levels, user can use section, stripping and slicing, lower brill, lower brill and rotation etc. to carry out inquiry and analysis to data easy to operately, and shows with the form of multi-dimensional spreadsheet, figure and chart; And can organize and gather a large amount of data, the data in advance of frequent inquiry being calculated, very rapidly can respond complicated analysis and consult;
After adopting above-mentioned technology, beneficial effect of the present invention is:
1, to the computation and analysis of the various index of electric power, can make to have more comprehensively grid operating conditions, clearly, the understanding of quantification;
2, pass through the analysis to operation of power networks historical data and data mining, contribute to there is a clearer understanding to the more operating complicated relativity problems of scheduling;
3, processing platform is excavated to electricity consumption data analysis and excavation with TV university data analysis, find out electricity consumption Changing Pattern, the daily load of electric power etc. is predicted, can help that power supply enterprise formulates reasonably, short-term plan, be conducive to the Optimized Operation of electric power supply process, improve electricity consumption reliability; To the result of prediction, carry out contrasting and observing, prove accuracy and the validity of analysis mining;
Embodiment
The present invention is further illustrated below;
This embodiment is by the following technical solutions: it can the data of analysis mining three types, are respectively: ARFF formatted data file, third party's data source, platform;
ARFF formatted data file: the feature of arff formatted file be each record separate, there is no sequence requirement, there is not relation between each record simultaneously; Arff file internals is very simple, is the data file structure of lightweight, is convenient to excavate;
Third party's data source: configuration different pieces of information source, manually writes query SQL; This data set abundance, but require higher to operating personnel, after writing query SQL after Analysis and Screening need being carried out to data, its data are excavated;
Platform: be excavate processing platform, by cubic configuration and index allocation with TV university data analysis; Many tolerance of data, various dimensions logical view are provided; Make user can multi-angle, many sides, investigate data in analytical database at many levels, user can use section, stripping and slicing, lower brill, lower brill and rotation etc. to carry out inquiry and analysis to data easy to operately, and shows with the form of multi-dimensional spreadsheet, figure and chart; And can organize and gather a large amount of data, the data in advance of frequent inquiry being calculated, very rapidly can respond complicated analysis and consult;
Present embodiment has following beneficial effect:
1, to the computation and analysis of the various index of electric power, can make to have more comprehensively grid operating conditions, clearly, the understanding of quantification;
2, pass through the analysis to operation of power networks historical data and data mining, contribute to there is a clearer understanding to the more operating complicated relativity problems of scheduling;
3, processing platform is excavated to electricity consumption data analysis and excavation with TV university data analysis, find out electricity consumption Changing Pattern, the daily load of electric power etc. is predicted, can help that power supply enterprise formulates reasonably, short-term plan, be conducive to the Optimized Operation of electric power supply process, improve electricity consumption reliability; To the result of prediction, carry out contrasting and observing, prove accuracy and the validity of analysis mining;
To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned one exemplary embodiment, and when not deviating from spirit of the present invention or essential characteristic, the present invention can be realized in other specific forms; Therefore, no matter from which point, all should embodiment be regarded as exemplary, and be nonrestrictive, scope of the present invention is limited by claims instead of above-mentioned explanation, and all changes be therefore intended in the implication of the equivalency by dropping on claim and scope are included in the present invention; Any mark in claim should be considered as the claim involved by limiting;
In addition, be to be understood that, although this instructions is described according to embodiment, but not each embodiment only comprises an independently technical scheme, this narrating mode of instructions is only for clarity sake, those skilled in the art should by instructions integrally, and the technical scheme in each embodiment also through appropriately combined, can form other embodiments that it will be appreciated by those skilled in the art that.
Claims (1)
1. excavate a disposal route with TV university data analysis, it is characterized in that it can the data of analysis mining three types, be respectively: ARFF formatted data file, third party's data source, platform;
ARFF formatted data file: the feature of arff formatted file be each record separate, there is no sequence requirement, there is not relation between each record simultaneously; Arff file internals is very simple, is the data file structure of lightweight, is convenient to excavate;
Third party's data source: configuration different pieces of information source, manually writes query SQL; This data set abundance, but require higher to operating personnel, after writing query SQL after Analysis and Screening need being carried out to data, its data are excavated;
Platform: be excavate processing platform, by cubic configuration and index allocation with TV university data analysis; Many tolerance of data, various dimensions logical view are provided; Make user can multi-angle, many sides, investigate data in analytical database at many levels, user can use section, stripping and slicing, lower brill, lower brill and rotation etc. to carry out inquiry and analysis to data easy to operately, and shows with the form of multi-dimensional spreadsheet, figure and chart; And can organize and gather a large amount of data, the data in advance of frequent inquiry being calculated, very rapidly can respond complicated analysis and consult.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510278116.6A CN104992262A (en) | 2015-05-27 | 2015-05-27 | Power utilization big-data analysis and miningprocessing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510278116.6A CN104992262A (en) | 2015-05-27 | 2015-05-27 | Power utilization big-data analysis and miningprocessing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104992262A true CN104992262A (en) | 2015-10-21 |
Family
ID=54304072
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510278116.6A Pending CN104992262A (en) | 2015-05-27 | 2015-05-27 | Power utilization big-data analysis and miningprocessing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104992262A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107294093A (en) * | 2017-07-26 | 2017-10-24 | 广东电网有限责任公司电力科学研究院 | Electric power data analysis method, device and intelligent terminal based on K line charts |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567396A (en) * | 2010-12-30 | 2012-07-11 | ***通信集团公司 | Method, system and device for data mining on basis of cloud computing |
| CN103177404A (en) * | 2013-04-17 | 2013-06-26 | 国电南瑞科技股份有限公司 | Energy-using data analysis system based on data mining |
| CN104361110A (en) * | 2014-12-01 | 2015-02-18 | 广东电网有限责任公司清远供电局 | Mass electricity consumption data analysis system as well as real-time calculation method and data mining method |
-
2015
- 2015-05-27 CN CN201510278116.6A patent/CN104992262A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102567396A (en) * | 2010-12-30 | 2012-07-11 | ***通信集团公司 | Method, system and device for data mining on basis of cloud computing |
| CN103177404A (en) * | 2013-04-17 | 2013-06-26 | 国电南瑞科技股份有限公司 | Energy-using data analysis system based on data mining |
| CN104361110A (en) * | 2014-12-01 | 2015-02-18 | 广东电网有限责任公司清远供电局 | Mass electricity consumption data analysis system as well as real-time calculation method and data mining method |
Non-Patent Citations (2)
| Title |
|---|
| 周斌: "数据仓库和数据挖掘技术在电力***中的应用", 《中国优秀博硕士学位论文全文数据库(硕士)工程科技Ⅱ辑》 * |
| 戴红 等主编: "《数据挖掘导论》", 31 January 2015, 清华大学出版社 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107294093A (en) * | 2017-07-26 | 2017-10-24 | 广东电网有限责任公司电力科学研究院 | Electric power data analysis method, device and intelligent terminal based on K line charts |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Siddik et al. | The environmental footprint of data centers in the United States | |
| CN107402976B (en) | Power grid multi-source data fusion method and system based on multi-element heterogeneous model | |
| Zheng et al. | Mitigating curtailment and carbon emissions through load migration between data centers | |
| CN102299555B (en) | Electric energy management system in administrative district | |
| Huang et al. | Two-stage stochastic programming model for the regional-scale electricity planning under demand uncertainty | |
| CN116542430B (en) | Multi-dimensional water carbon emission intelligent analysis method and system | |
| Ott et al. | Global experiences with HPC operational data measurement, collection and analysis | |
| Parygin et al. | A convergent model for distributed processing of Big Sensor Data in urban engineering networks | |
| CN111581927A (en) | Ocean economic operation monitoring and early warning system and computer equipment | |
| Islam et al. | Exploiting spatio-temporal diversity for water saving in geo-distributed data centers | |
| Ganeshalingam et al. | Shining a light on small data centers in the US | |
| Wang et al. | Research on the theory and method of grid data asset management | |
| CN106649461A (en) | Method for automatically cleaning and maintaining elastic search log index file | |
| CN104992262A (en) | Power utilization big-data analysis and miningprocessing method | |
| CN112699162A (en) | System for processing source network load multi-element data | |
| Ren | Optimizing water efficiency in distributed data centers | |
| RU106975U1 (en) | GEOINFORMATION SYSTEM FOR MONITORING ECOLOGICAL AND ELECTROMAGNETIC COMPATIBILITY OF ELECTRIC POWER OBJECTS | |
| CN201838034U (en) | Enterprise comprehensive management system | |
| CN114048493A (en) | Remote intelligent control system for water engineering | |
| CN104463505A (en) | Operation state on-line monitoring method based on detail data | |
| CN114218216A (en) | Resource management method, device, equipment and storage medium | |
| CN103034930A (en) | Automation software life cycle model deployment system | |
| Lv et al. | Research on intelligent power consumption business intelligence system based on cloud computing | |
| KR20200119404A (en) | Method and System for Data Distribution Processing Management for Power-related Big Data Analysis in Heat Treatment Process | |
| Kaneko | Electricity Consumption and Environmental Impact Reduction Measures in Public Blockchain |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151021 |