CN107078541A - System, method and apparatus for the data processing in power system - Google Patents
System, method and apparatus for the data processing in power system Download PDFInfo
- Publication number
- CN107078541A CN107078541A CN201480082936.1A CN201480082936A CN107078541A CN 107078541 A CN107078541 A CN 107078541A CN 201480082936 A CN201480082936 A CN 201480082936A CN 107078541 A CN107078541 A CN 107078541A
- Authority
- CN
- China
- Prior art keywords
- data
- power system
- system resource
- data flow
- flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00006—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment
- H02J13/00028—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network characterised by information or instructions transport means between the monitoring, controlling or managing units and monitored, controlled or operated power network element or electrical equipment involving the use of Internet protocols
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J13/00—Circuit arrangements for providing remote indication of network conditions, e.g. an instantaneous record of the open or closed condition of each circuitbreaker in the network; Circuit arrangements for providing remote control of switching means in a power distribution network, e.g. switching in and out of current consumers by using a pulse code signal carried by the network
- H02J13/00032—Systems characterised by the controlled or operated power network elements or equipment, the power network elements or equipment not otherwise provided for
- H02J13/00034—Systems characterised by the controlled or operated power network elements or equipment, the power network elements or equipment not otherwise provided for the elements or equipment being or involving an electric power substation
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J2203/00—Indexing scheme relating to details of circuit arrangements for AC mains or AC distribution networks
- H02J2203/20—Simulating, e g planning, reliability check, modelling or computer assisted design [CAD]
-
- H—ELECTRICITY
- H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
- H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
- H02J3/00—Circuit arrangements for ac mains or ac distribution networks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
- Y02E60/00—Enabling technologies; Technologies with a potential or indirect contribution to GHG emissions mitigation
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y04—INFORMATION OR COMMUNICATION TECHNOLOGIES HAVING AN IMPACT ON OTHER TECHNOLOGY AREAS
- Y04S—SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS
- Y04S40/00—Systems for electrical power generation, transmission, distribution or end-user application management characterised by the use of communication or information technologies, or communication or information technology specific aspects supporting them
- Y04S40/20—Information technology specific aspects, e.g. CAD, simulation, modelling, system security
Landscapes
- Engineering & Computer Science (AREA)
- Power Engineering (AREA)
- Supply And Distribution Of Alternating Current (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Disclose the system for the data processing in power system, method and apparatus and tangible computer computer-readable recording medium.In one embodiment, the system includes at least one processor；And at least one memory, it stores computer executable instructions.Described at least one memory and computer executable instructions are configured to promote the system using at least one described processor：The data in data flow are grouped based on power system resource group associated there at one or more data reception nodes, the power system resource group be based in part on define electric power net operation it is hierarchy, determined for the data model of the power system；The data in the data flow are based on the power system resource group associated there and one or more data processing nodes are sent to；And handled the data in the data flow based on the power system resource group associated there at one or more of data processing nodes.There is provided for the extensive low cost solution handled in real time in power system, the solution is efficient, expansible, and makes it possible to realize the online change of data handling procedure.
Description
Technical field
Embodiment of the disclosure is related to field of power, and particularly the data processing in power system is
System, method and apparatus and tangible computer computer-readable recording medium.
Background technology
Various industries all have network associated therewith.One such industry is to manage the public utilities production of power network
Industry.Power network can include one or all in the following：Generate electricity, transmit electricity and distribution.Can use such as coal-fired plant,
The power stations such as nuclear power plant generate electricity.For efficiency purposes, the electric power of generation is progressively boosted to very high voltage (for example
345K is lied prostrate) and transmitted by transmission line.Transmission line can with long distance delivery electric power, such as across state circle or across international boundary, until
Untill it reaches its wholesale customers, the wholesale customers can be the company for possessing local power distribution network.Transmission line can become in transmission
Terminated at power station, it can gradually reduce very high voltage to middle pressure (such as 138K volts).Less transmission line is (such as sub
Transmission line) middle press from transmission transformer station is sent to power distribution station.At power distribution station, the medium voltage can be gradually reduced again
To " middle pressure " (being such as that 4K is lied prostrate to 23K volts).One or more feed circuits can be sent from power distribution station.For example, four extremely
Dozens of feed circuit can be sent from power distribution station.Feed circuit is to include 4 wires (every phase that three wires are used in 3 phases
And wire is used for zero line) 3 circuitry phases.Feed circuit can on the ground (on utility poles) or underground laying.Can be with
Periodically the voltage tap on feed circuit is come out using distribution transformer, this makes voltage be gradually reduced from " middle pressure " to visitor
Family voltage (such as 120V).Then client's voltage can be utilized by the customer.
One or more Utilities Electric Co.'s (its major responsibility is that reliable and economic electric power is supplied to its client) management electric power
Net, including planning, operation and the maintenance relevant with power network.In order to improve the efficiency of management and reduce management cost, electric power is public
Department has attempted to escalate into power network " intelligent grid " by application prior art IT and electric power project engineering.Intelligent grid
The sensing device further or system of demand for development huge amount, such as senior measurement basis facility (AMI), phase measurement cells (PMU)
And other in-service monitoring devices.These devices will produce substantial amounts of data, and data scale can be TB grades.For example, in
State, provincial electric power company generally plans to install the instrument more than 10,000,000, and its possible every month produces nearly 4TB data.In addition, figure
1 illustrates from the data growth trend studied recently, therefrom it can be seen that data volume is with senior power distribution automation and AMI
Development and sharply increase, and almost 800TB, this is number quite huge data.Meanwhile, it requires quickly number
According to processing so as to provide useful information in time.Therefore, utility company is faced with huge challenge, especially in memory
Calculate and database purchase aspect.
Therefore, need in the art for data processing and storage, the improvement of more specifically to a large amount of real time datas
Solution.
The content of the invention
Therefore, according to the first aspect of the disclosure, there is provided a kind of system for the data processing being used in power system.Institute
Stating system includes at least one processor；And at least one memory, it stores computer executable instructions.Described at least one
Individual memory and computer executable instructions are configured to promote the system using at least one described processor：At one or
The data in data flow are grouped based on power system resource group associated there at multiple data reception nodes, institute
It is to be based in part on number hierarchy, for the power system for defining electric power net operation to state power system resource group
Determined according to model；By the data in the data flow based on the power system resource group associated there
It is sent to one or more data processing nodes；And by the data flow at one or more of data processing nodes
The data handled based on the power system resource group associated there.
In embodiment of the disclosure, the packet by data flow can include being based on being included in the data
Defined in measurement point identification information in the data and the data model in stream in power system resource and measurement point
Correlation between identification information, to determine power system money associated with the data in the data flow respectively
Source；And divide described in the electric power net operation according to identified power system resource and defined in the data model
Level structure, to determine the power system resource associated with the data in the stream.
In another embodiment of the present disclosure, the data sent in the data flow can depend on current slow
Rush message size and current stand-by period.
According to another embodiment of the present disclosure, when the Current buffer message size reaches consideration current network load condition
Dimension threshold when, the data in the data flow can be sent.
In another embodiment of the present disclosure, when the current stand-by period being longer than consideration current network load condition
Between threshold value when, the data in the data flow can be sent.
In another embodiment of the present disclosure, the data high-speed in the data flow can be buffered in one
Or for being handled in multiple data processing nodes, and data in the data flow are further stored in number
According in storehouse, wherein in the case of the fault recovery or restarting of data processing node, corresponding data are from the database
It is loaded into the Cache of the data processing node.
In another embodiment of the present disclosure, the data in the data flow can be stored in table per year, and
And include information on the year for the title of table, and be wherein used for the keyword of each data in the data be by
Power system resource associated there mark and the data time time of measuring and formed, the time of measuring is institute
In the form of stating time migration of the data time within this year in units of millisecond.
, can be by the data in the data flow according to electricity associated there according to another embodiment of the present disclosure
Force system resource and be divided into one or more segmentations, and it is one or more of segmentation by based on the institute for the data
State keyword and be written to concurrently and in a distributed manner multiple regions of the database sequentially in time.Especially, it is described
The data in data flow are stored in institute to be respectively adapted to its own data type and be suitable for the form of data processing
State in database.
In another embodiment of the present disclosure, the data in the processing data flow can be based on distributed stream
Computing architecture, and the data storage is based on distributed data base.
According to the second aspect of the disclosure, there is provided a kind of method for the data processing being used in power system.The side
Method can include：The data in data flow are based on power system associated there at one or more data reception nodes
Group of resources is grouped, the power system resource group be based in part on define electric power net operation it is hierarchy,
Determined for the data model of the power system；The data in the data flow are based on institute associated there
State power system resource group and be sent to one or more data processing nodes；And in one or more of data processings
The data in the data flow are handled based on the power system resource group associated there at node.
According to the third aspect of the disclosure, there is provided a kind of equipment for the data processing being used in power system.It is described to set
It is standby to include：Packet module, it is configured at one or more data reception nodes the data in data flow being based on
Power system resource group associated there is grouped, and the power system resource group is based in part on described in definition
Electric power net operation it is hierarchy, determined for the data model of power system；Data transmission blocks, it is configured to
The data in the data flow are based on the power system resource group associated there and one are sent to or many
Individual data processing node；And data processing module, it is configured to institute at one or more of data processing nodes
The data stated in data flow are handled based on the power system resource group associated there.
According to the fourth aspect of the disclosure, there is provided another equipment for the data processing in power system.It is described to set
It is standby to include：For the data in data flow to be based on into power system associated there at one or more data reception nodes
The device that group of resources is grouped, the power system resource group is to be based in part on point for defining the electric power net operation
Level structure, determine for the data model of power system；For the data in the data flow to be based on and it
The associated power system resource group and the device for being sent to one or more data processing nodes；And for institute
State the data in the data flow at one or more data processing nodes based on the power train associated there
The device that system group of resources is handled.
It is described according to the 5th of the disclosure the aspect there is provided a kind of tangible computer computer-readable recording medium with multiple instruction
Instruction can be executed by processor to perform the data processing in power system.The tangible computer computer-readable recording medium can include quilt
The instruction for the step of being configured to perform the method according to the second aspect of the disclosure.
Using embodiment of the disclosure, provided at one or more receiving nodes based on power system associated with data
Source group and by data stream packet, be distributed to according to power system resource group processing node at, and processing node at enter
Row processing.In the disclosure there is provided a kind of extensive low cost solution handled in real time being used in power system, its
It is efficient, expansible, and makes it possible to realize the online change of data handling procedure.
Brief description of the drawings
By the detailed description of the embodiment illustrated on such as refer to the attached drawing in embodiment, addressed in the disclosure
Further feature will become apparent, wherein, throughout disclosure accompanying drawing, identical reference represents same or like portion
Part, and in the drawing：
Fig. 1 schematically illustrates the song increased according to the electron electric power data of nearest result of study of the prior art
Line；
Fig. 2 schematically illustrate in accordance with an embodiment of the present disclosure can wherein realize being used for for embodiment of the disclosure
The diagram of the exemplary architecture of power network；
Fig. 3 schematically illustrates data processing in accordance with an embodiment of the present disclosure and the diagram of data storage；
Fig. 4 schematically illustrates the method for the data processing being used in power system in accordance with an embodiment of the present disclosure
Flow chart；
Fig. 5 A to 5C schematically illustrate electric power net operation hierarchy in accordance with an embodiment of the present disclosure, exemplary original
The diagram of beginning data and exemplary map data；
Fig. 6 schematically illustrates the data processing operation in the case of fault recovery in accordance with an embodiment of the present disclosure
Diagram；
Fig. 7 A and 7B schematically illustrate the diagram of exemplary data tables design in accordance with an embodiment of the present disclosure；
Fig. 8 A and 8B schematically illustrate the diagram of example data storage mode in accordance with an embodiment of the present disclosure；
Fig. 9 A and 9B schematically illustrate simulation case result in accordance with an embodiment of the present disclosure；
The system that Figure 10 schematically illustrates the data processing being used in power system in accordance with an embodiment of the present disclosure
Block diagram；
The equipment that Figure 11 schematically illustrates the data processing being used in power system in accordance with an embodiment of the present disclosure
Block diagram；
Figure 12 schematically illustrates the data processing being used in power system according to another embodiment of the present disclosure
The block diagram of another equipment；And
Figure 13 schematically illustrates general-purpose computing system, and the general-purpose computing system is programmed for special-purpose computer system
System, it can represent referenced herein any computing device.
Embodiment
Hereinafter, embodiment of the disclosure will be described in reference to the drawings.In the following description, many certain details are elaborated
Save to provide the thorough understanding of embodiment.However, it will be apparent to those skilled in the art that the implementation of the disclosure
Mode can not have these details, and the disclosure is not limited to the specific embodiment as being described herein.On the contrary, can be with
Consider any any combination of following characteristics and element to realize and implement the disclosure, no matter whether it is related to different realities
Apply example.Therefore, following aspect, feature and embodiment being merely illustrative property purpose, and should not be understood as to appended right
It is required that element or limitation, unless clearly indicated in addition in the claims.In addition, in some cases, not in detail
Well-known method and structure is described in order to avoid unnecessarily making embodiment of the disclosure ambiguous hard to understand.
In current power system, substantial amounts of data will be generated daily, and require quick data processing so as to timely
Ground provides useful information.Therefore, in the disclosure, propose it is a kind of be used for power system in data processing solution so that
Can in real time or near real-time ground processing data, so as to meet the requirement of current power system.
Fig. 2 schematically illustrate in accordance with an embodiment of the present disclosure can wherein realize being used for for embodiment of the disclosure
The diagram of the exemplary architecture of power system.As shown in Figure 2, data source 110-1 to 110-n (such as various monitoring systems, prison
View apparatus, sensor, instrument etc.) various types of data are generated, these data pass through real time data bus 120-1 or real-time things
Part bus 120-2 is sent to processing ＆ storage systems 130 in real time.In processing ＆ storage systems 130 in real time, real-time processing module
140 reception these data and the information based on the information obtained from data model 160 and in data handled, and
Processed result is stored in holder 150.Via unified information access modules 170, various analyses and application program 180 can
To access data model 160, and handle result or other data in holder 150.This as shown in the disclosure
Structure will not be merely provided for the real time data processing and storage of mass data, and there is provided fairly good reliability, scalable
Property and easy data access, processing storage in real time will be hereinafter described in detail with reference to Fig. 3-Figure 12.
Fig. 3 schematically illustrates data processing in accordance with an embodiment of the present disclosure and the diagram of data storage.As schemed
Show, including monitor that the data source 110 setting device AMI will be generated by it such as supervisory control and data acquisition (SCADA) (SCADA) system, device
Or the data obtained are supplied to real time processing system 140.Herein, real time processing system 140 can be based at distributed stream
Reason technology, such as Apache Storm systems, it is the distributed real time computation system for handling quick large data stream.
Real-time processing module 140 can include one or more receiving node 141-1,141-2 ..., 141-m；One or more data
Handle node 142-1142-2,142-3,142-4 ..., 142-k-1,142-k；And alternatively one or more data outputs
Node 143-1 ..., 143-j.One or more of receiving nodes be configured to from data source 110 receive data flow, its
Data spout (spout) is properly termed as in Apache Storm systems.One or more of data processing node 142-1,
142-2,142-3,142-4 ..., 142-k-1,142-k each wherein include multiple processes, and be configured to processing to
Its data sent, this is properly termed as processing pipeline (bolts) in Apache Storm systems.One or more of data
Output node 143-1,143-j may be configured to collect processed result from processing node, and send it to data storage
Device 150 is to store, and this is referred to as handling pipeline in Apache Storm systems.Distributed Calculation (example can be utilized
Such as based on cloud computing) in a distributed way come perform it is described receive, processing and export.It is, therefore, possible to provide cloud computing platform 190
To perform Data Stream Processing.Finally, can be by the result obtained from Data Stream Processing storage into data storage 150, the number
There can be at least one database wherein according to holder 150, and alternatively, the database can be distributed data
Storehouse, such as HbaseTM, it is Hadoop databases, according to Google Bigtable model increase income, distributed, versioned
Non-relevant data storehouse.
Figure 4 illustrates the flow of the method for the data processing being used in power system in accordance with an embodiment of the present disclosure
Figure.As shown in Figure 4, the data flow at one or more data reception nodes is based on and its phase as step S401 first
The power system resource group of association and be grouped.Can based on measurement point identification and for power system data model come
Determine power system resource group adjacent thereto.
In power network, the data model of the commonly provided hierarchy for being defined power network operation, it can be covered respectively
Various elements and object in introduces a collection, such as power transmission network, power distribution network and client domain, and the various numbers in power network can be provided
According to unification and centralization Data View.Fig. 5 A schematically illustrate example data mould in accordance with an embodiment of the present disclosure
Type.As illustrated, in exemplary data model, in the hierarchy of the electric power net operation in transmission of electricity, distribution and client domain
Arrange electric device.For example, for transmission of electricity, there is the different voltage levels for power equipment, 500kV, 220kV etc.；
For some voltage level, there is different types of power equipment, transformer station, circuit etc.；For in some level
, there are different power equipments, such as ST0082, ST0083 in the power equipment of some type, such as transformer station in 500KV
Deng.Each transformer station ST0082, ST0083 also include different electronic installations, such as bus section, busbar section, capacitor, breaker, transformation
Device etc., each includes multiple measurement points, active power, reactive power, bottom oil temperature etc..Therefore, it is such
The hierarchy of electric power net operation is clearly defined in data model.In addition, in data model, comprising on electrical equipment, electricity
The identification information of power equipment and measurement point, its reflect these components to its identify between it is related., can be by based on the information
Data in data flow are grouped.
Fig. 5 B illustrate from data sources to exemplary initial data.As shown in Figure 5 B, initial data includes surveying
ID " MeaslD " is measured, it is the mark of measurement point associated with data；Time of measuring " timeStamp ", it indicates measurement number
According to when time；Measured value " Value ", it indicates the value of measurement data；The quality of data " Quality ", it indicates the matter of data
Amount, " 0 " represents high-quality.According to the information included in data, especially measure ID " MeaslD " and carried in data model
The correlation of confession, power system resource associated with data can be determined first, such as by using measurement ID " MeasID "
The respective table searched for as search condition in data model.Therefore can be by using the measurement point identification included in data
To determine and the associated measurement point of measurement record or power system resource.In addition, based on data model, may further determine that
Power equipment belonging to measurement point, such as TR1122.Based on the data model, it may be determined that the power equipment belongs to electricity therein
Force system resource.For example, for transformer TR1122, from data model it will be clear that, it belongs to power system
Group of resources ST0082, i.e. transformer station ST0082.
Can by power system resource identify and power system resource group determination packet include in data with
For then using.Exemplary map data are only shown for exemplary purposes in figure 5 c.It is included in as illustrated, removing
Outside information in initial data, " PSRID " and instruction electric power of the mapping data also comprising the mark for indicating power system resource
" PSRGrpID " of the mark of system resource group.
Referring back to Fig. 4, at step S402, the data in data flow are by based on power system resource associated there
Group and be sent to processing node.After data in a stream are grouped, it will be based on power system associated there
Group of resources and subsequent treatment node is sent to be further processed.That is, belonging to same unified power system
The data of group of resources will be sent to the one or more processing nodes of identical.
In embodiment of the disclosure, it further can optimize message transmission to improve efficiency of transmission.Inventor notices
For some messaging bus, performance is the variable changed according to message size, and generally presence can be realized most preferably
The optimal message size of performance.For example, for using Apache Storm systems of the zeroMQ as internal message bus, with
100k message size can realize optimum performance.Table 1 below gives performance and message size in Apache Storm systems
Between relation.
Relation between the performance of table 1 and message size
According to table 1, it is evident that realize optimum performance when message size is 100k, and greater or lesser size will not
Better performance can be provided.Given this find, in the disclosure, design optimization algorithm, it considers bus performance and for real-time
Both deadline dates of data transfer, it can for example be expressed as below：
BooleanSend=(t ＞=T*a*w) or (s ＞ S*b*w)
Wherein, BolleanSend is to determine whether the Boolean of data to be sent, and t represents the current stand-by period；T is pin
The maximum traffic delay time allowed real time data, S is the amount of Current buffer real time data；S is the data of each message
Maximum number, determined by optimal message size and data size, be such as that 100k and each data have in optimal message size
It is 4.17k (that is, 100k/24) in the case of having the size of 24 bytes；W represents scope from the network load ratio in 0 to 1 value,
Its reaction network loading condiction, i.e. current network load or bandwidth；A is the optimization ratio for time delay；And b is to be used to disappear
Cease the optimization ratio of size.A, b value are by so that the optimization ratio that data are sent with small size, it can be according to network load bar
Part is set., can be with however, in the case where network load is relatively light for example, its default value can be set to such as 1
A and b value are set as lower value.
Therefore, in embodiment of the disclosure, the transmission of the data in data flow can depend on Current buffer message chi
The very little and current stand-by period.For example, when the Current buffer message size reaches the size threshold of consideration current network load condition
During value, the data in the data flow will be sent.Additionally, or alternatively, work as when the current stand-by period is longer than consideration
During the time threshold of preceding network loading conditions, the data in the data flow will be sent.So, it can allow when message reaches
Sent to message is sent during specified size to obtain optimal performance, or when network idle with reduced size so that can be true
Protect the real-time performance of data transfer.
Referring back to Fig. 4, at step S403, the data in data flow at one or more data processing nodes are by base
Handled in power system resource group associated there.At each processing node, one or more mistakes are currently running
Journey is to handle the data being sent to.These processes can be configured according to the type of power system resource group and according to need
To update., can be anti-by embedded script executing engine (python etc.) and/or java at each processing node
Mechanism is penetrated, carrys out easily online updating or changes Processing Algorithm or process.The processing of data is well known in the art, and
Therefore by do not elaborate herein for purposes of clarity on these processing nodes operation detailed description.
In embodiment of the disclosure, the data belonged in the data flow of same power system resource group will be sent to
One or more processing nodes of identical, and at these processing nodes, can simultaneously processing data, this can realize electricity
Real time data processing in Force system, for extensive real time data.In addition, in the disclosure, processing procedure
Node can be based on different distributed stream computing techniques, and therefore its useful good scalability, it means that can be with
Stream calculation cluster is dynamically increased to meet new requirement, such as when data volume increases or needs reduction time cost.Separately
Outside, according to the disclosure, various types of data processings can be performed according to related PSR groups, it reduces repeated data transmission
And improve the efficiency of data processing.Further, since the data in belonging to same PSR data flow will be mapped, pack and send
To same processing node, it is possible to promote to realize the data processing towards electric power net operation.
In addition, in order to ensure the high efficiency and high reliability of data processing, in embodiment of the disclosure, being sent to each
The data of processing node are cached in processing node, while ground, initial data be also stored on such as HBase it
In the database of class.Cached data will be used for data processing, and be stored in the data in database can at one or
Used in the case of the fault recovery or initialization of multiple processing nodes.For example, when processing node is restarted due to such as failure
When can first from database load data.
Fig. 6 illustrates the flow chart of the data processing operation in the case of fault recovery in accordance with an embodiment of the present disclosure.
As illustrated, data will be loaded into Cache from database first at step 601, and at step 602, processing
Node starts to receive grouped data, and then caches the data high-speed of reception in the cache.At step 603,
Processing node further by the data Cun Chudao databases of reception to be used in the case of such as fault recovery.Then exist
Obtained and processing data, and store processed result into database using each process in step 604 at step 605.
After data have been successfully processed, at step 606, ACK can be sent to receiving node and be used as answer.
According to flow chart, it can be seen that even if there is failure, initial data can be still obtained from database, and therefore may be used
To provide higher reliability.In addition, handling these numbers when the number of data dramatically increases and needs more to handle node
According to when can perform similar operations.
Apart from the above, in the disclosure, a kind of Data Storage Solution of application program-oriented method is additionally provided, so that
Extensive real-time data memory and the high-performance accessed are realized, is described in detail next with reference to Fig. 7 to Figure 12.
Will be with reference first to Fig. 7 A and 7B, it illustrates the design of example data storage table in accordance with an embodiment of the present disclosure.
In the disclosure, it is proposed that store measurement data per year, i.e., annual measurement data will be stored in same table, and be used
It will be stored in the data of different year in different tables.Annual measurement data table can have such as
The table name of " Historydata2014 " etc is with the annual information of the time of measuring including the data on being stored therein.
The table can include the row keyword " Rowkey " for being used to recognize a block number evidence.More particularly, row keyword " Rowkey " can be with
Including two parts, the i.e. information on power system resource and the information on time of measuring.On power system resource
Information can be power system resource mark " PSRID "." PSRID " is the unified id of power system resource, as described above, its
With the data type (4 byte) without symbol int.Information on time of measuring can be only comprising the information on the moon and day
There is no year, because the information on year can be reflected by the title of table.Especially, it is used herein on time of measuring
Information is not common time format, but is represented with the when in-migration in the year of data time in units of millisecond.This means
Information on time of measuring does not include the information on the year, and it is used and 0 of first day in such as this year:
00am time shift.It therefore, it can be without symbol int forms, 4 bytes on the information design of time of measuring.Therefore, in this public affairs
In the embodiment opened, row keyword only needs to 8 bytes, and this will greatly compared with the design of row keyword of the prior art
Save memory space.
Furthermore it is possible to including row race " CF ", row " qualifier " and value Value." CF " represents the race belonging to data, its
In, ' r ' refers to initial data；" s " refers to statistics；" e " refers to event.Row qualifier is the measurement class for representing value
The code of type and form.Performed during table can be defined in measurement type as shown in fig.7b and form by using the code
Search for determine the measurement type and form of value.The format memory data of " Value " to be represented with row qualifier.Furthermore it is possible to
Including " Region ", it represents that measurement data is stored in position therein.Can be pre- according to data scale and computing resource
" Region " first is distributed, to avoid any influence on the performance of adjust automatically.
In conventional methods where, usually using row keyword, but this will require about 24 bytes, and in the disclosure, lead to
Cross and use PSRID and the time shift in units of millisecond, it is only necessary to 8 bytes.Therefore, traditional row keyword will take the disclosure
Row keyword almost 3 times of memory space, it means that very big memory space is saved.In addition, in the disclosure, in data flow
Data by be respectively adapted to the data type of its own and be suitable for data processing form and be not only with character string
Form is stored in database.For example, numerical value (voltage, electric current, power etc.) is by the form storage with such as double precision, and
It is not general used character string.The data types such as double precision, floating-point need the memory space less than character string, and
And it can be directly processed in the case of no conversion.Therefore, this can not only save memory space, and improvement is handled
Efficiency.In addition, if to add the measurement data of new type, then required sole act is that a note is inserted into Fig. 7 B table
Record to define measurement type and value form.
Fig. 8 A illustrate the diagram of the parallel memorizing of data in accordance with an embodiment of the present disclosure., can be with according to the disclosure
Sequence of event concurrently and is stored data into database in a distributed manner.In the disclosure, row keyword includes
PSRID and the time shift in units of millisecond.Data will be divided into multiple segmentations based on PSRID, and sequentially in time
Concurrently by fragmented storage into different zones, as seen in fig. 8b.Due to the particular design of row keyword, in such as HBase
Etc database in, storing process is would automatically carry out, because HBase can support such mechanism in itself.
Such storage mode can provide the data access of application program-oriented method.As it is known, application program generally will be
The data for belonging to same power system resource group are accessed in special time period, the mode of data storage will significantly in database
Ground promotes the access of data, because required all data are generally consecutively stored in region, as seen in fig. 8b.This number
It is will ensure that according to storage mode when by PSR and period to access data, data can be accessed with a relatively high efficiency.Therefore,
In embodiment of the disclosure, Data Storage Solution will help to realize high data access performance.
Above-mentioned storage solution not only supports extensive real-time data memory, and provides good scalability.This
Outside, it is quite appropriate for the analysis of this large data, other analytic units that for example it can easily with the Hadoop ecosystems
With reference to.
Fig. 9 A and Fig. 9 B schematically illustrate simulation case result in accordance with an embodiment of the present disclosure.In simulations, make
With 3 to 15 host nodes, each there is 16G memories, 8 core CPU, 1T holders, 1Gbit networks；Made using 3,000,000 instrument
For data source, each there are 33 measurement data.Fig. 9 A illustrate data processing and write performance, wherein, X-axis shows main section
The number of point, Y-axis shows the number of the instrument of processing per second and write-in.According to Fig. 9 A, it is evident that processing and write performance are several
Linearly increase with the increase of cluster, and it realizes 50000 instrument/seconds (45,000,000 for 15 host nodes
Individual instrument/15 minute) write performance.Fig. 9 B illustrate the digital independent performance obtained from simulation case.It is very bright according to the table
It is aobvious that data can be read within the very short time, and for the instrument of identical number, bigger thread amount can be provided
Higher reading performance.
Therefore, embodiment of the disclosure is utilized, enabling with low cost and high-performance treatments and a large amount of numbers in real time of storage
According to this facilitate extract information from real time data and carry out more preferable business decision in time.In addition, additionally providing for being directed to
The large-scale and broadly distributed real time data processing of utility company and the crucial and basic solution of storage.
In the disclosure, a kind of system for the data processing being used in power system is additionally provided, and hereinafter, will
This system is described with reference to Figure 10, Figure 10 schematically illustrates the number being used in power system in accordance with an embodiment of the present disclosure
According to the block diagram of the system of processing.
As shown in Figure 10, system 1000 includes at least one processor 1010；And storage computer executable instructions
1030 at least one memory 1020.Described at least one memory 1020 and computer executable instructions 1030 are configured to
Promote the system 1000 using at least one described processor 1010：By data flow at one or more data reception nodes
In data be grouped based on power system resource group associated there, the power system resource group is partly
Based on define electric power net operation it is hierarchy, determined for the data model of the power system；By the data
The data in stream are based on the power system resource group associated there and are sent to one or more data processings
Node；And at one or more of data processing nodes by the data in the data flow be based on it is associated with it
The power system resource group handled.
Especially, in embodiment of the disclosure, the packet in data flow to be processed can be included：Based on bag
Defined in the measurement point identification information and the data model being contained in the data in the data flow in power system
Correlation between resource and measurement point identification information, to determine institute associated with the data in the data flow respectively
State power system resource；And the power network according to identified power system resource and defined in the data model
The hierarchy of operation, to determine the power system resource associated with the data in the stream.
In embodiment of the disclosure, the transmission of the data in data flow can be optimized to realize superior performance.For example,
The transmission of data can depend on Current buffer message size and current stand-by period.When the Current buffer message size reaches
When considering the dimension threshold of current network load condition, the data in the data flow can be sent.Or alternatively, when
When the current stand-by period is longer than the time threshold for considering current network load condition, the institute in the data flow can be sent
State data.
In embodiment of the disclosure, the data high-speed in the data flow can be buffered in one or many
For being handled in individual data processing node, and data in the data flow are further stored in database
In.In the case of the fault recovery or restarting of processing node, corresponding data can be loaded into data from database
Handle the Cache of node.The data in the data flow can be stored in table per year, and for table
Title includes the information on the year.Keyword for each data in the data can be by electric power associated there
System resource mark and the data time time of measuring and formed, the time of measuring is the data time in the year
In the form of the interior time migration in units of millisecond.
, can be by the data in the data flow according to power train associated there in embodiment of the disclosure
System resource and be divided into one or more segmentations, and it is one or more of segmentation by based on the pass for the data
Key word and be written to concurrently and in a distributed manner multiple regions of the database sequentially in time.In addition, the data flow
In the data can by be respectively adapted to its own data type and be suitable for the form of data processing be stored in it is described
In database.
In embodiment of the disclosure, the processing of the data in data flow can be based on distributed stream computing architecture, such as
Apache Storm systems, and data storage is based on distributed data base, such as HBase.
In fig. 11, it is illustrated that according to setting for the data processing being used in power system of another embodiment of the present disclosure
It is standby.Equipment 1100 includes：Packet module 1110, data transmission blocks 1120 and data processing module 1130.Data point
Group module 1110 may be configured to the data in data flow at one or more data reception nodes based on associated therewith
The power system resource group of connection is grouped, and the power system resource group, which is based in part on, defines electric power net operation
Hierarchy, determine for the data model of the power system.Data transmission blocks 1120 may be configured to by
The data in the data flow are based on the power system resource group associated there and are sent to one or more
Data processing node.Data processing module 1130 may be configured to will be described at one or more of data processing nodes
The data in data flow are handled based on the power system resource group associated there.
In embodiment of the disclosure, packet module 1110 can be primarily based on the institute included in the data flow
State defined in the measurement point identification information and the data model in data in power system resource and measurement point identification information
Between correlation, to determine the power system resource associated with the data in the data flow respectively.Then
The hierarchy of electric power net operation according to identified power system resource and defined in data model, packet module
1110 can with so that determine with flow in the associated power system resource group of data.
In another embodiment of the present disclosure, data transmission blocks 1120 can be further configured to according to Current buffer
Message size and current stand-by period send the data in data flow.For example, being examined when the Current buffer message size reaches
When considering the dimension threshold of current network load condition, the data in the data flow can be sent.Additionally, or alternatively,
When the current stand-by period being longer than the time threshold for considering current network load condition, it can send in the data flow
The data.
In embodiment of the disclosure, the data high-speed in data flow can be buffered in one or more data processing sections
For being handled in point.Meanwhile, optional data memory module 1140 can be by the data Cun Chudao databases in data flow
In.In the case of the fault recovery or initialization of processing node, corresponding data can be loaded at data from database
Manage the Cache of node.Data memory module 1140 may be configured to the data in data flow being stored in table per year
In.Title for table can include the information on the year, and can for the keyword of each data in the data
To be formed, the time of measuring by the mark of power system resource associated there and the time of measuring of the data time
In the form of being time migration of the data time within this year in units of millisecond.Can be by the number in the data flow
One or more segmentations are divided into according to according to the PSRID for being used for the data, and one or more of segmentations are by based on use
In the data its keyword and be written to concurrently and in a distributed manner multiple regions of the database sequentially in time.
Especially, the data in the data flow are by be respectively adapted to its own data type and be suitable for the lattice of data processing
Formula is stored in the database.
In addition, in embodiment of the disclosure, the data handled in the data flow are based on distributed stream calculating support
Structure, and the data storage is based on distributed data base.
In fig. 12, the data processing being used in power system according to another embodiment of the present disclosure is further illustrated
Another equipment.Equipment 1200 includes being used for being based on the data in data flow and it at one or more data reception nodes
The device 1210 that associated power system resource group is grouped, the power system resource group is to be based in part on to determine
The justice electric power net operation it is hierarchy, determined for the data model of power system；For by the data flow
In the data be based on the power system resource group associated there and be sent to one or more data processing sections
The device 1220 of point；And at one or more of data processing nodes by the data base in the data flow
The device 1230 handled in the power system resource group associated there.
As shown in Figure 12, equipment 1200 can include being used for by the data Cun Chudao databases in data flow in addition
Device 1240.In the case of the fault recovery or restarting of data processing node, corresponding data are loaded from database
To the Cache of data processing node.Device 1240 for data storage can be further configured in data flow
Data be stored in per year in table, and include information on the year for the title of table, and be wherein used for the number
The keyword of each data can be by power system resource associated there in mark and the measurement of the data time
Time and formed, in the form of the time of measuring is time migration of the data time within this year in units of millisecond.This
Outside, can by the data in the data flow according to for the data PSRID and be divided into one or more segmentations, and
And one or more of segmentations are by sequentially in time concurrently and distributed based on its keyword for the data
Ground is written to multiple regions of the database.Especially, the data in the data flow by be respectively adapted to its from
Body data type and be suitable for data processing form storage in the database.
Further it is provided that a kind of tangible computer computer-readable recording medium with multiple instruction, the multiple instruction can be processed
Device is performed to perform the data processing in power system, and the tangible computer computer-readable recording medium can include being configured to perform basis
The instruction of the method and step of any embodiment of disclosed method.
It should be noted that each module being included in system 1000, equipment 1100 and equipment 1200 or the operation of device
Correspond essentially to foregoing various method steps.Accordingly, with respect to each in system 1000, equipment 1100 and equipment 1200
The detailed operation of module or device, refers to being previously described referring to figs. 2 to the 9B disclosed methods carried out.
In addition, although hereinbefore propose specific embodiment, but it is provided merely for the sake of the purpose of illustration,
So that those skilled in the art can fully and thoroughly understand the thought of the disclosure so that it can implement this public affairs
The solution opened.According to the instruction content such as provided herein, those skilled in the art is contemplated that various modifications；Institute
There are these modifications to be within the purview of the appended claims.For example, although including data reception node, data processing node
Or stream processing system is described in the topology of data out node, it is also possible to using at the stream without independent data out node
Reason topology.In embodiment of the disclosure, some electronic installation such as ST0082 in some voltage level will be belonged to) number
According to being divided into same power system resource group；However, it is also possible to by belong in some electronic installation ST0082 some or certain
The data of the power equipment (for example, transformer, TRl122) of individual type are divided into same power system resource group.In addition, being
There is provided specific optimization method for improvement efficiency of transmission；However, it is also possible to contemplate it according to instruction content provided herein
Its different optimization method.
General-purpose computing system 1300 is further illustrated in fig. 13, and it can be expressed herein any meter referred to
Calculate device.For example, all-purpose computer 1300 can with-partially or completely-represent control centre, head end, integrated network transport
Battalion and management system (NOMS), failure, performance and configuration management (FPCM) module or referenced herein any other meter
Calculate device, such as terminal installation, instrument, telemetry interface module (TIU), collector and/or any networking components, such as herein
Router, interchanger or the server of middle discussion.Computer system 1300 can include being performed to promote department of computer science
System 1300 performs having for method disclosed hereins or one group of instruction 1302 based on any one or more in computer function
Sequence table.Computer system 1300 can serve as self-contained unit, or for example can be connected to other meters using network 115,125
Calculation machine system or peripheral unit.
In networked deployment, computer system 1300 in the capacity of server or can be used as server-client
Client user computer in user network environment is used as opposite end computer in equity (or distributed) network environment
System operatio.Computer system 1300 can also be embodied as to various devices or be incorporated therein, such as personal computer or shifting
Dynamic computing device, it is able to carry out one group of instruction 1302 for specifying the action that will be taken by the machine, and the action is included but not
Any type of browser is limited by access network 115,125.In addition, described each system can include individually or
One or more instruction set are jointly performed with any set for the subsystem for performing one or more computer functions.
Computer system 1300 can include processor 1307, such as central processing module (CPU) and/or graphics process mould
Block (GPU).Processor 1307 can include one or more general processors, digital signal processor, application specific integrated circuit, existing
Field programmable gate array, digital circuit, optical circuit, analog circuit, its combination or for parse and processing data it is other existing
At device that is known or developing later.Processor 1307 can realize instruction set 1302 or other software programs, such as reality
The manual programming or computer generation code of existing logic function.Described logic function or any system element except other functions it
Outside can with and handle such as simulate electricity, audio or video signal or its combination etc audio data sources and/or be converted
Into the digital number for audiovisual purpose or other digital processing purposes (such as with the compatibility of computer disposal or connected network communication)
According to source.
Computer system 1300 can include being used to transmit the memory 1305 in the bus 1320 of information.It is able to will can grasp
The code for promoting computer system to perform any action as described herein or operate is acted on to be stored in memory 1305.Storage
Device 1305 can be random access memory, read-only storage, programmable storage, hard disk drive or any other type
Volatibility or nonvolatile memory or storage device.
Computer system 300 can also include disk, solid-state driving CD-ROM module 1315.Disk drive module 1315 can be with
Non-provisional or tangible computer computer-readable recording medium including can wherein be embedded in one or more instruction set 1302 (such as software)
1340.In addition, executable one or more of the operation as described herein of instruction 1302.Instruction 1302 is at it by department of computer science
System 1300 can be resided in completely or at least partially during performing in memory 1305 and/or in processor 1307.Above-mentioned data
Storehouse or any other database can be stored in memory 1305 and/or disk cell 1315.
Memory 1305 and processor 1307 can also include computer-readable medium as discussed above." computer
Computer-readable recording medium ", " computer-readable recording medium ", " machine readable media ", " transmitting signal medium " and/or " signaling bearer Jie
Matter " can include comprising, storage, transmission, propagate or conveying software for instruction executable system, equipment or equipment using or with
Combined use any equipment.Machine readable media can optionally be but not limited to electronics, magnetic, optics, electromagnetism, red
Outer or semiconductor system, device, equipment or propagation medium.
In addition, computer system 1300 can be including input unit 1325, such as keyboard or mouse, it is configured for
User and any component of system 1300 interact, including user's selection of display menu or menu entries.It can also include
Display 1330, such as liquid crystal display (LCD), cathode-ray tube (CRT) or any other display for being suitable for transmitting information
Device.Display 1330, which can be served as, to be seen the interface of the operation of processor 1307 for user or specifically serves as and be stored in
The interface of software or drive module 1315 in reservoir 1305.
Computer system 1300 can include the communication interface for making it possible to realize the communication via communication network 125
1336.Network 125 can include cable network, wireless network or its combination.The network of communication interface 1336 can enable to through
Communicated by any number of communication standard, such as Ethernet AVB, 802.11,802.13,802.20, WiMax or other lead to
Beacon is accurate.
It therefore, it can realize system with the combination of hardware, software or hardware and software.Can be with centralized fashion extremely
Different elements are realized across the distributed way that multiple interconnected computer systems are spread in a computer system or wherein less
The system.Any kind of computer system or miscellaneous equipment for being adapted for carrying out method described herein are all appropriate.Firmly
The typical combination of part and software can be the general-purpose computing system with computer program, the computer program being loaded and
Computer system is controlled during execution so that it performs method described herein.Such programmed computer can be considered as special meter
Calculation machine.
As described herein, any module or process block are defined as software, the hardware for including to be performed by processor 1307
Or its certain combination.Software module can include being stored in memory 1305 or its storage arrangement can be by processor 1307
Or the instruction of other computing devices.Hardware module can include can perform by processor 1307, command and/or control to hold
Capable various devices, component, circuit, door, circuit board etc..
Can also by system embedment computer program product, it include making it possible to realizing operation described herein and its
It is loaded all features that these operations are able to carry out when in computer systems.Computer program herein means to be intended to promote
Make the system with information processing capability directly or specific function is performed after any one of the following or both
Any expression of any language of use of one group of instruction, code or annotation：A) conversion of another language, code or annotation is arrived；B) use
The reproduction of different materials form.
Up to the present, the disclosure has been described with reference to the drawings by certain preferred embodiment.It is to be understood, however, that this
It is open that specific embodiment that is shown and providing is provided, but various modifications can be carried out in the scope of the present disclosure.
Furthermore, it is possible to realize embodiment of the disclosure with software, hardware or its combination.It can be realized with special logic
Nextport hardware component NextPort；Can be by software section storage in memory and by the appropriate of such as microprocessor or special designs hardware etc
Instruction execution system is performed.It will also be recognized by those skilled in the art that can be can perform with comprising computer within a processor
Instruction and/or control routine realize the above method and system, for example, be situated between in the carrying of such as disk, CD or DVD-ROM etc
The programmable storage of matter or such as read-only storage (firmware) etc or the data of such as optics or electrical signal carrier etc are carried
This category code provided on body.Such as hardware circuit of super large-scale integration OR gate array etc, such as logic can be used
The semiconductor of chip or transistor etc or such as field programmable gate array or PLD etc it is programmable hard
Part device realizes to realize the equipment and its component in the present embodiment, or with by the software of various computing devices, Huo Zheyong
The combination (for example, with firmware) of above-mentioned hardware circuit and software is realized.
Although having been described for the various embodiments of the disclosure, it will become apparent to for a person skilled in the art
It is can have many embodiments and embodiment in the scope of the present disclosure.Therefore, the disclosure remove according to appended claims and
It is unrestricted outside its equivalence.
Claims (23)
1. a kind of system for the data processing being used in power system, including：
At least one processor；And
At least one memory, it stores computer executable instructions,
At least one wherein described memory and the computer executable instructions are configured to utilize at least one described processing
Device promotes the system：
By the data in data flow according to power system resource associated there group at one or more data reception nodes
Group be grouped, the power system resource group be based in part on define electric power net operation it is hierarchy, for institute
State the data model of power system and determine；
The data in the data flow are based on the power system resource group associated there and one is sent to
Or multiple data processing nodes；And
The data in the data flow are based on institute associated there at one or more of data processing nodes
Power system resource group is stated to be handled.
2. system according to claim 1, includes wherein the data by the data flow carry out packet：
Defined in the measurement point identification information and the data model in the data included in the data flow
Correlation between power system resource and measurement point identification information, come determine respectively with the data in the data flow
The associated power system resource；And
The classification knot of the electric power net operation according to the power system resource of determination and defined in the data model
Structure, to determine the power system resource associated with the data in the stream.
3. system according to claim 1 or 2, wherein the data sent in the data flow are depended on currently
The message size of buffering and current stand-by period.
4. the system according to any one of claims 1 to 3, wherein being examined when the message size of the Current buffer reaches
When considering the dimension threshold of current network load condition, the data in the data flow are sent.
5. the system according to any one of Claims 1-4, wherein when the current stand-by period is longer than consideration currently
During the time threshold of network loading conditions, the data in the data flow are sent.
6. the system according to any one of claim 1 to 5, wherein the data in the data flow are delayed at a high speed
Exist in one or more of data processing nodes for being handled, and the data in the data flow are entered
One step is stored in database, wherein in the case of the fault recovery or initialization of data processing node, corresponding data from
The database is loaded into the Cache of the data processing node.
7. the system according to any one of claim 1 to 6, wherein the data in the data flow are deposited per year
In Chu Biao, and include the information on the year for the title of table, and be wherein used for each data in the data
Keyword be by power system resource associated there mark and the data time time of measuring and formed, it is described
In the form of time of measuring is time migration of the data time within this year in units of millisecond.
8. system according to claim 7, wherein the data in the data flow are according to electric power associated there
System resource and be divided into one or more segmentations, and it is one or more of segmentation based on for described in the data
Keyword and be written to concurrently and in a distributed manner multiple regions of the database sequentially in time.
9. the system according to claim 7 or 8, wherein data in the data flow by be respectively adapted to its from
Body data type and be suitable for data processing form storage in the database.
10. the system according to any one of claim 1 to 9, wherein the number in the processing data flow
According to be based on distributed stream computing architecture, and the data storage be based on distributed data base.
11. a kind of method for the data processing being used in power system, including：
The data in data flow are based on power system resource associated there group at one or more data reception nodes
Group be grouped, the power system resource group be based in part on define electric power net operation it is hierarchy, for institute
State the data model of power system and determine；
The data in the data flow are based on the power system resource group associated there and one is sent to
Or multiple data processing nodes；And
The data in the data flow are based on institute associated there at one or more of data processing nodes
Power system resource group is stated to be handled.
12. method according to claim 11, wherein the packet by the data flow includes：
Defined in the measurement point identification information and the data model in the data included in the data flow
Correlation between power system resource and measurement point identification information, come determine respectively with the data in the data flow
The associated power system resource；And
The classification of the electric power net operation according to identified power system resource and defined in the data model
Structure, to determine the power system resource associated with the data in the stream.
13. the method according to claim 11 or 12, wherein the data sent in the data flow are depended on
The message size of Current buffer and current stand-by period.
14. the method according to any one of claim 11 to 13, wherein when the message size of the Current buffer reaches
During to the dimension threshold for considering current network load condition, the data in the data flow are sent.
15. the method according to any one of claim 11 to 14, wherein when the current stand-by period is longer than consideration
During the time threshold of current network load condition, the data in the data flow are sent.
16. the method according to any one of claim 11 to 15, wherein the data in the data flow are high
Speed is buffered in one or more of data processing nodes for being handled, and the data in the data flow
It is further stored in database, wherein in the case of the fault recovery or initialization of data processing node, corresponding data
The Cache of the data processing node is loaded into from the database.
17. the method according to any one of claim 11 to 16, wherein data in the data flow by by
Year is stored in table, and includes the information on the year for the title of table, and is wherein used for each in the data
The keyword of data is formed by the mark of power system resource associated there and the time of measuring of the data time,
In the form of the time of measuring is time migration of the data time within this year in units of millisecond.
18. method according to claim 17, wherein the data in the data flow are according to electricity associated there
Force system resource and be divided into one or more segmentations, and it is one or more of segmentation based on the institute for the data
State keyword and be written to concurrently and in a distributed manner multiple regions of the database sequentially in time.
19. the system according to claim 17 or 18, wherein data in the data flow are by be respectively adapted to
Its own data type and be suitable for data processing form storage in the database.
20. the method according to any one of claim 11 to 19, wherein described in the processing data flow
Data are to be based on distributed stream computing architecture, and the data storage is to be based on distributed data base.
21. a kind of equipment for the data processing being used in power system, the equipment includes：
Packet module, it is configured at one or more data reception nodes the data in data flow being based on and it
Associated power system resource group is grouped, and the power system resource group is to be based in part on to define the electric power
Net operation it is hierarchy, determined for the data model of power system；
Data transmission blocks, it is configured to the data in the data flow being based on the power train associated there
System group of resources and be sent to one or more data processing nodes；And
Data processing module, it is configured to described in the data flow at one or more of data processing nodes
Data are handled based on the power system resource group associated there.
22. a kind of equipment for the data processing being used in power system, the equipment includes：
For the data in data flow to be provided based on power system associated there at one or more data reception nodes
The device that source group is grouped, the power system resource group is to be based in part on the classification for defining the electric power net operation
Structure, determine for the data model of power system；
It is sent to for the data in the data flow to be based on into the power system resource group associated there
The device of one or more data processing nodes；And
It is associated with it for being based on the data in the data flow at one or more of data processing nodes
The device that is handled of the power system resource group.
23. a kind of tangible computer computer-readable recording medium with multiple instruction, the instruction can be executed by processor to perform electric power
Data processing in system, the tangible computer computer-readable recording medium includes being configured to perform according in claim 11 to 20
The instruction of the step of method described in any one.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2014/085227 WO2016029367A1 (en) | 2014-08-26 | 2014-08-26 | System, method and apparatuses for data processing in power system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107078541A true CN107078541A (en) | 2017-08-18 |
| CN107078541B CN107078541B (en) | 2019-11-22 |
Family
ID=55398582
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201480082936.1A Active CN107078541B (en) | 2014-08-26 | 2014-08-26 | System, method and apparatus for the data processing in electric system |
Country Status (3)
| Country | Link |
|---|---|
| CN (1) | CN107078541B (en) |
| AU (1) | AU2014405046B2 (en) |
| WO (1) | WO2016029367A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115081158B (en) * | 2022-08-23 | 2022-11-11 | 成都中科合迅科技有限公司 | Graphic element display method based on digital expression |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1761124A (en) * | 2005-09-09 | 2006-04-19 | 东南大学 | Full networked digital protection platform |
| CN201518429U (en) * | 2009-10-26 | 2010-06-30 | 江西省电力科学研究院 | Electric energy qualitative data concentrator for digitalization transforming plant |
| US20140025321A1 (en) * | 2007-04-03 | 2014-01-23 | Electro Industries/Gaugetech | System and method for performing data transfers in an intelligent electronic device |
| US20140218882A1 (en) * | 2013-02-06 | 2014-08-07 | Chet Sandberg | System to connect and multiplex sensor signals |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| RU2563970C2 (en) * | 2011-03-03 | 2015-09-27 | Абб Текнолоджи Аг | Circuit breaker control device and control methods |
| US20120310559A1 (en) * | 2011-05-31 | 2012-12-06 | Cisco Technology, Inc. | Distributed data collection for utility grids |
| US20130219279A1 (en) * | 2012-02-21 | 2013-08-22 | Ambient Corporation | Aggregating nodes for efficient network management system visualization and operations |
-
2014
- 2014-08-26 CN CN201480082936.1A patent/CN107078541B/en active Active
- 2014-08-26 AU AU2014405046A patent/AU2014405046B2/en active Active
- 2014-08-26 WO PCT/CN2014/085227 patent/WO2016029367A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1761124A (en) * | 2005-09-09 | 2006-04-19 | 东南大学 | Full networked digital protection platform |
| US20140025321A1 (en) * | 2007-04-03 | 2014-01-23 | Electro Industries/Gaugetech | System and method for performing data transfers in an intelligent electronic device |
| CN201518429U (en) * | 2009-10-26 | 2010-06-30 | 江西省电力科学研究院 | Electric energy qualitative data concentrator for digitalization transforming plant |
| US20140218882A1 (en) * | 2013-02-06 | 2014-08-07 | Chet Sandberg | System to connect and multiplex sensor signals |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2016029367A1 (en) | 2016-03-03 |
| CN107078541B (en) | 2019-11-22 |
| AU2014405046B2 (en) | 2018-06-28 |
| AU2014405046A1 (en) | 2017-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104769582B (en) | For the real time data releasing of power grid | |
| CN105069690B (en) | A kind of grid operation data processing method | |
| CN109635127B (en) | Power equipment portrait knowledge map construction method based on big data technology | |
| CN107730394A (en) | The polynary isomeric data fusion method of panorama power network based on big data | |
| CN106651188A (en) | Electric transmission and transformation device multi-source state assessment data processing method and application thereof | |
| CN104036025A (en) | Distribution-base mass log collection system | |
| CN106547882A (en) | A kind of real-time processing method and system of big data of marketing in intelligent grid | |
| CN110489407A (en) | Data filling mining method, apparatus, computer equipment and storage medium | |
| CN103489139A (en) | Comprehensive analysis and management system for urban distribution network planning | |
| CN114565779A (en) | Low-voltage transformer area household change topology identification method and system | |
| CN107078541B (en) | System, method and apparatus for the data processing in electric system | |
| CN107357919A (en) | User behaviors log inquiry system and method | |
| Zhonghua | Seismic data attribute extraction based on Hadoop platform | |
| CN107545007A (en) | Electric power big data quick-searching engine | |
| CN111553040B (en) | Power grid topology analysis high-performance computing method and device based on GPU acceleration | |
| CN109408466B (en) | Agricultural Internet of things redundant data processing method and device | |
| CN108763665A (en) | Grid simulation analyzes date storage method and device | |
| Gao | Research on Dynamically Configurable Data Acquisition System in the Big Data Era | |
| Li et al. | Node Resource Balance Scheduling Algorithm of Power Internet of Things Based on Big Data | |
| Shayesteh | Efficient simulation methods of large power systems with high penetration of renewable energy resources: theory and applications | |
| Zhu et al. | Design and Implementation of Air Quality Data Processing System Based on Big Data Technology | |
| Ma et al. | Analysis and Prediction of Massive Electricity Information Based on Hadoop Ha Architecture | |
| Xu et al. | Multi-source power address data fusion based on data mining technology | |
| Cao et al. | Analysis and Application of Power Information System Log Based on Microservice | |
| CN206209402U (en) | Power system saturation load forecasting device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |