CN102073767B - Method for managing metadata of virtual data warehouse of electric power information system group - Google Patents

Method for managing metadata of virtual data warehouse of electric power information system group Download PDF

Info

Publication number
CN102073767B
CN102073767B CN2011100055373A CN201110005537A CN102073767B CN 102073767 B CN102073767 B CN 102073767B CN 2011100055373 A CN2011100055373 A CN 2011100055373A CN 201110005537 A CN201110005537 A CN 201110005537A CN 102073767 B CN102073767 B CN 102073767B
Authority
CN
China
Prior art keywords
data
public
attribute
type
services
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN2011100055373A
Other languages
Chinese (zh)
Other versions
CN102073767A (en
Inventor
解凯
曾坚永
金浩
卢建刚
周荃
刘洋
潘玉春
徐展强
钱锋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING
NR Electric Co Ltd
Original Assignee
GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING
NR Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING, NR Electric Co Ltd filed Critical GUANGDONG CENTER OF ELECTRIC DISPATCHING AND TRANSFORMING
Priority to CN2011100055373A priority Critical patent/CN102073767B/en
Publication of CN102073767A publication Critical patent/CN102073767A/en
Application granted granted Critical
Publication of CN102073767B publication Critical patent/CN102073767B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a method for managing metadata of a virtual data warehouse of an electric power information system group. The method comprises the following steps of: a) managing an object data service of a public electric power information system, and managing the public data service attribute provided by a public object for query; b) managing the mapping relationship between a public data service and a private multi-dimension data service of each heterogeneous database, wherein the established mapping relationship of the public data service and the private multi-dimension data service of each heterogeneous database is finished through the incidence relation from the public data service attribute to each heterogeneous source table column; and c) managing a public data service interface and a maintenance interface, and managing a set of open standard interface (API) function library for providing external data services. The public data service interface comprises a unified retrieve definition interface and a unified data query service interface. By using the method, private data services provided by each power information system are integrated, and the public data services provided for a third party are summarized. The method can be conveniently applied to integration work of the electric power information group.

Description

Power information system crowd's virtual data warehouse metadata management method
Technical field
The present invention relates to the integrated technology of power information system database; Especially special relate to a kind of metadata management method that in the power information system crowd, makes up the virtual data warehouse; Virtual data warehouse metadata management system through this method structure; The private data service that each power information system provides is integrated, be generalized into the public data services open, thereby realize a unified public data services platform being provided electric power enterprise to the third party.
Background technology
The infosystem of a new generation's electric power enterprise need be considered safe operation and the requirement of commercial operation in the Power Market.The basis of its application is common data platform of structure; Surely arrange management system, technical support system for power market, Fault Management System, equipment monitoring system, water to transfer automated system, scheduling MIS and lightning location system etc. to unify interconnection Real-Time Scheduling system, electric energy metering system, relay protection, automatic safety device and intelligence, realize that the height of data and resource is shared.
At present, prefecture-level and above network system has all been set up several power information systems that comprise power network dispatching system.Have following difficult point alternately between these systems: the interface language that there is the data of different types model in (1) each system, handle data is different, the data, services that therefore provides have nothing in common with each other be difficult to unified; (2) different, the memory location dispersion of each system database running environment.On logic and space, form the isomery infosystem thus.
Existing data demonstration, though now a lot of relevant for the integrated approach of electric power dispatching system uniform data platform,, have certain defective.Reason is following:
Data-interface unitized aspect, generally be to the data structure and the interface language of different application systems, develop different interfaces and method.New system of every like this access just need develop a socket again, and construction cycle and cost are too high.The data structure of each application system all is privately owned simultaneously, is included in each system database and manages, and lacks the management of the multidimensional data of concentrating.Therefore lack a common interface that public service is provided for upper layer application based on standard data structure.
At the unitized management aspect of data, services; Because each professional system all has separately model and object; Privately owned professional service is provided separately, can not unifies between each system, existing method is to set up the service call table for each system; Call when supplying data query, but can't embody in each system common public data services attribute like this same physical equipment.Each database lack of uniform data, services management method.
The storage of each system data unitized aspect, existing method is to set up a large-capacity data warehouse, is drawn into each data of database in the warehouse.The capacity of data warehouse is the summation of each database volume often, and this has brought the additional investment on the storage hardware, and large-capacity data extracts the load that has also increased each system and network.
In view of existing method can not cope well power information system crowd integration problem; Thereby press for a kind of mode of new virtual data warehouse; Utilize the metadata management system of virtual varehouse; Model, service and the data-interface of unified each power information system of centralized management, and summarize public model, service and the data-interface that a whole set of can be open to the third party.Definition and modeling method that a patented claim " integrated model and the modeling method of a kind of power information system heterogeneous database multidimensional data " has provided concrete database have been submitted simultaneously.
Summary of the invention
The present invention seeks to: can't conclude unified problem in order to solve model, service and the data-interface that a plurality of databases of existing power infosystem crowd exist when integrated; A kind of metadata management method that in the power information system crowd, makes up the virtual data warehouse has been proposed; Utilize the metadata management system of virtual varehouse; Model, service and the data-interface of unified each power information system of centralized management; And summarize public model, service and the data-interface that a whole set of can be open to the third party, solved the integration Management problem of power information system crowd's multidimensional data.
Technical scheme of the present invention is: a kind of power information system crowd's virtual data warehouse metadata management method is characterized in that comprising following steps:
The Service Management of step a) public power infosystem object data; Adopt a kind of method of self study,, constantly expand public power infosystem object type and public service attribute according to object type in the model of existing power information system and the privately owned Service Properties that provides.Through the metadata system management public power infosystem object is carried out the management of model; It is method through a kind of doublet (common object--common object type is corresponding); Common object for each type; Metadata management system is distributed to a kind of Container Type and is used to load this object, is associated with a kind of common object type simultaneously, has managed the public data services attribute to inquiry that this common object provides; Step a) further comprises:
The first step is investigated the 1st public power infosystem object, its type of coupling in existing common object and data type;
In second step, if in the first step, fail to find the type of this public power infosystem object, then newly-built a kind of public power infosystem object type is with public power infosystem object and type matching;
The 3rd step, investigate the public data services attribute of common object type, each data rows of this service is associated with under this common object;
Investigate the 2nd public power infosystem object, repeated for first to three step;
Until the investigation of accomplishing N public power infosystem object;
Step b): the mapping relations management of the various dimensions data, services that public data services and each heterogeneous database are privately owned; The mapping relations of the various dimensions data, services that the public data services attribute of setting up and the database of each multidimensional are privately owned are to accomplish to the incidence relation of each isomery source database row through the public data services attribute; The public data services attribute is a multidimensional to the incidence relation to the database column of each multidimensional, and promptly the common object type can comprise a plurality of public data services attributes; The database column of multidimensional also is a multidimensional to last relation simultaneously, and promptly a common object type can be associated with the heterogeneous database private data Service Properties of a plurality of multidimensional through a plurality of public data services attributes.Thereby accomplished integrated to the public data services attribute of the multidimensional data of common object type.
The first step, the data source of investigating the 1st power information system is the public data services of the 1st inquiry that common object provides, and extracts its data structure about certain private data service;
Second step, in the multi-dimensional database of metadata management system, set up data structure about the private data service of the 1st power information system data source, insert " origin system table ", " source database table ", " source database row " respectively;
In the 3rd step, extract the public data services attribute and insert " public data services attribute list ", the incidence relation of the private data service of setting up at the external key place and setting up in second step;
The 4th step, this public service attribute in " public data services attribute list " is inserted " common object type " this public data services is configured on the pairing common object type, match concrete common object again;
Investigate the 2nd power information system data source, repeat first to fourth step;
Until the N step, accomplish the investigation of N power information system data source.
Step c) public data services interface and maintenance interface: standard interface (API) function library that the data clothes externally are provided that a cover is open.The public data services interface comprises unified retrieval definition service interface and uniform data inquiry service interface:
Unified retrieval defining interface function:
(1) for application system the object that supplies retrieval is provided in the common object model or one group of common object of the scope of dividing according to electric network composition or other dimensions.
(2) for application system tables of data and data attribute in the common data structures are provided.
(3) with above the two combine as the query and search condition, submit the uniform data query interface to.
The uniform data query interface function:
(1) to one or the data query of one group of common object in the individual data source
(2) to one or the data query of one group of common object in a plurality of data sources
(3) to one or one group of common object data basic statistics in the individual data source
(4) to one or one group of common object data basic statistics in a plurality of data sources
(5) data pick-up of each data source Query Result, conversion, purification
(6) output unified data result set.
The private data service that each power information system that the inventive method is integrated provides, and summarize the public data services open to the third party.Through the following information of metadata management: service of power information system common object and interface, power information public data services and interface, privately owned various dimensions data, services and interface, public service and privately owned service and their mapping relations of each isomery power information system database.Utilize this method; Each power information system has constituted a virtual data warehouse; Metadata management is in the middle layer of integrated common data virtual data Stores Stressed Platform; It provides the various public model service of power information system, device object and data-interface service to upper layer application, comprises complete standard interface (API) function library of a cover; To down and each heterogeneous data source carry out alternately, obtain the information such as model, device object, data structure of each database.
The invention has the beneficial effects as follows: under the information automation system of electric power enterprise of new generation need the active demand with a plurality of power information data system integrations and the unified platformization; Utilize the inventive method, can set up the power information system common data platform of many isomeric datas origin system through the mode in virtual data warehouse.The public data services interface comprises unified retrieval definition service interface and uniform data inquiry service interface.The private data service that integrated each power information system provides, and summarize the public data services open to the third party.Each power information system has constituted a virtual data warehouse; Through the following information of metadata management: power information public data services and interface, privately owned various dimensions data, services and interface, public service and privately owned service and their mapping relations of each isomery power information system database, thus instruct each system interaction, externally the common object service be provided by metadata management system.The virtual data warehouse that utilizes this metadata management method to set up; Need not build extra data storage center; But utilize each power information system legacy data storage, and having very low hardware-software requirement, can be applied to easily in power information system crowd's the integrated work.What mode was different in the past is; This method need not set up huge data storage center; But service and data-interface through each infosystem of metadata management system unified management; Raw data still is stored in the database of each infosystem, has saved integrated work and cost greatly, is a kind of very practical method.
Description of drawings
Below in conjunction with accompanying drawing and embodiment to further explain of the present invention.
The mapping relations of Fig. 1 public data services and each data source systems private data service
The extraction of Fig. 2 public data services and conversion
Fig. 3 public data services model multidimensional data table is integrated
Fig. 4 public data services interface querying flow
Metadata management general frame in Fig. 5 power information system crowd virtual data warehouse
Embodiment
Integrated for each heterogeneous database system of power information system of accomplishing convenient quick low-cost; The invention provides a kind of metadata management system of the virtual data warehouse that constitutes by the power information system crowd, comprise following content: mapping relations management (3) public data services and the open interface function storehouse of the various dimensions data, services that (1) public power object information model management (2) public data services and each heterogeneous database are privately owned.
One, public power object information model management
The management of virtual varehouse metadata system is the method through a kind of doublet (common object-common object type) to the management of public power object information model; Object for each type; Metadata management system can be distributed to a kind of Container Type and be used to load this object; Be associated with a kind of common object type simultaneously, managed the public data services that this object is provided.
As shown in Figure 1; Be loaded into the common object of container for each; There is unique common object type (PubObjectType) described, wherein comprises the public data services attribute (PubDataAttribute) that public data services attribute (DContains_DataAttribute) has been described inquiry that this common object provides.
The definition of PubObjectType (common object type) is following:
Attribute-name Data type Describe
name DT_STRING Title
DMemberOf_ObjectTypeDefine DT_S_DARRAY_MATE Belong to the object type definition
DContains_DataAttribute DT_S_DARRAY_COMP Comprise the public data services attribute
The definition of PubDataAttribute (public data services attribute) is following:
Attribute-name Data type Describe
name DT_STRING Title
alias DT_STRING Another name
RefSourceTableColumn DT_S_REF_SIM Point to unidirectional the quoting of source data row
DMemberOf_ObjectType DT_S_DARRAY_MATE Belong to object type
Concrete establishment step is following:
The first step is investigated the 1st public power infosystem object, its type of coupling in existing common object type;
In second step, if in the first step, fail to find the type of this object, then newly-built a kind of common object type is with object and type matching;
The 3rd step, investigate the public data services attribute of common object type, each data rows of this service is associated with under this common object;
Investigate the 2nd public power infosystem object, repeated for first to three step;
Until the N step, accomplish the investigation of N public power infosystem object.
Two, the mapping relations of the privately owned various dimensions data, services of public data services and each heterogeneous database management
The service of virtual varehouse metadata system management data is divided into two parts: the data, services management and the mapping relations between the two of public data services management, each isomery database source.Through metadata management integrated the private data service that provides of each power information system, and summarize the public data services open to the third party.Public data services provides unified data query structure to the application of common data platform; The data, services of each isomery database source is to the subquery based on each data source Agent agency, provide its privately owned service data structure; And common query is according to above-mentioned mapping relations between the two to the association of the subquery of each data source.
Through hierarchical relationship the source data structure of each heterogeneous database is described out: origin system-source data-source database table-source database row.
The definition of SourceSystem (origin system) is following:
Attribute-name Data type Describe
name DT_STRING Title
alias DT_STRING Another name
DContains_SourceDB DT_S_DARRAY_COMP Comprise source database
The definition of SourceDB (source database) is following:
Attribute-name Data type Describe
name DT_STRING Title
alias DT_STRING Another name
dataSourceType DT_ENUM Data source type (referring to real-time storehouse/history library etc.)
appName DT_STRING Apply names
mdlInputFile DT_STRING Model imports file
dllFile DT_STRING Dynamic library file
DContains_SourceTable DT_S_DARRAY_COMP Comprise the source database table
DMemberOf_SourceSystem DT_S_DARRAY_MATE Belong to origin system
lastMaintainTimestamp DT_STIME The last maintenance time
The definition of SourceTable (source database table) is following:
Attribute-name Data type Describe
name DT_STRING Title
alias DT_STRING Another name
tableID DT_ULONG Table I D
DMemberOf_SourceDB DT_S_DARRAY_MATE Belong to source database
DContams_SourceTableColumn DT_S_DARRAY_COMP Comprise the source data row
The definition of SourceTableColumn (source database row) is following:
Attribute-name Data type Describe
?name DT_STRING Title
?alias DT_STRING Another name
?columnID DT_ULONG Row ID
?DMemberOf_SourceTable DT_S_DARRAY_MATE Belong to the source data table
The mapping relations of the various dimensions data, services that public data services and each heterogeneous database are privately owned; Be to accomplish the process of setting up of each data source of conclusion as shown in Figure 2 " remote measurement amount " data, services attribute to the incidence relation of source database row (SourceTableColumn) through public data services attribute (PubDateAttribute):
The first step is investigated the 1st power information system data source, extracts its data structure about certain private data service
Second step, in metadata system, set up data structure about the private data service of this data source, insert " origin system table ", " source database table ", " source database row " respectively
In the 3rd step, extract public data services and insert " public data services attribute list ", the incidence relation of the private data service of setting up at the external key place and setting up in second step
The 4th step, this public service attribute in " public data services attribute list " is inserted " common object type " this public data services is configured on the pairing common object container,
Investigate the 2nd power information system data source, repeat first to fourth step
Until the N step, accomplish the investigation of N power information system data source;
The public data services attribute is a multidimensional to last relation, and promptly the common object container can comprise a plurality of public data services attributes; It also is multidimensional that the while source database is listed as last relation, and promptly a container can be associated with the heterogeneous database private data Service Properties of a plurality of multidimensional through a plurality of public data services attributes.Thereby accomplished integrated to the public data services attribute of privately owned multidimensional data Service Properties.
As shown in Figure 3, be the integrated data dictionary that leaves meta-data region in of multidimensional data service of having accomplished a plurality of heterogeneous systems, comprise following data structure:
System's table:
ID (PK), system description, access mode, act on behalf of Agent, comprise object ID, comprise original table ID
The data dictionary table:
ID (PK), object range describe, comprise common object ID, come Source Type, apply names, database name, class name
The common object table:
ID (PK), data dictionary ID (PK), public name, comprise primary object ID, object type ID, the markers that comes into force, inefficacy markers
The primary object table:
ID (PK, system identifier (PK), common object ID (PK), inner ID, inner ID data type, inner ID data length, object type ID, the markers that comes into force, inefficacy markers
The object type table:
ID (PK), title, treatment type, come Source Type, the rationality upper limit, rationality lower limit, measure unit
The public sheet table:
ID (PK), table name claim, show type, comprise row ID, model class ID, model class name,
Common list:
ID (PK), public sheet ID (PK), row title, whether major key, data type, data length, model attributes ID, model member name
The Object Dimension table:
ID (PK), title, dimension type, comprise common object ID, comprise object type ID, comprise regional ID, comprise electric pressure ID, comprise factory station ID, comprise device id
Segment table during day:
ID (PK), title, type, period begin, the period finishes
The time dimension kilsyth basalt:
ID (PK), dimension name, dimension type, time quantity, chronomere, comprise data interval I D, comprise a day interval I D, comprise special typical period of time ID
Segment table during data:
ID (PK), title, type, period begin, the period finishes, special typical period of time ID (PK), title, type, period begin, the period finishes
Three, public data services and open interface function storehouse
The public data services interface is to the mutual data-interface of the unification of upper layer application, consistent standard data interface that can be after types of applications provides integration.Implementation is on the basis of commercialization universal middleware component interface standard, to expand, and cross-platform service encapsulates form is provided.The public data services interface comprises two funtion parts: unified retrieval defining interface and uniform data query interface.
Unified retrieval defining interface function:
The first step is for application system provides in the common object model object that supplies retrieval or a group objects of the scope of dividing according to electric network composition or other dimensions.
Second step is for application system provides tables of data and data attribute in the common data structures.
In the 3rd step, as the query and search condition, submit above the two combination to the uniform data query interface.
The uniform data query interface function, as shown in Figure 4:
(1) to one or the data query of one group of common object in the individual data source
(2) to one or the data query of one group of common object in a plurality of data sources
(3) to one or one group of common object data basic statistics in the individual data source
(4) to one or one group of common object data basic statistics in a plurality of data sources
(5) data pick-up of each data source Query Result, conversion, purification
(6) output unified data result set
Concrete query interface function definition is as follows:
Figure BDA0000043544690000081
Open standard interface function library comprises a group polling interface and one group of maintenance interface, comprising:
* describe: open metadatabase
virtual?int?open(itn?flag)=0;//flag:
* describe: close metadatabase
virtual?int?close()=0;
* describe: according to object global title and global property name getattr value
virtual?result_set_ptr?get_attrs_value(const?QStringList&objs_name,
const?QString&attrs_name)=0;
* describe: according to object Global ID and global property name getattr value
virtual?result_set_ptr?get_attrs_value(const?QList<ULongLong>&o?bjs_id,
const?QString&attrs_name)=0;
* describe: obtain the period property value according to object global title and global property name
virtual?result_set_ptr?get_attrs_value(const?QStringList&objs_name,
const?QString&attrs_name,
int?type,
int?interval,
ULong?start_time,
ULong?end_time)=0;
* describe: obtain the period property value according to object global title and global property name
virtual?result_set_ptr?get_attrs_value(const?QList<ULongLong>&objs_id,
const?QString&attrs_name,
inttype,
int?interval,
ULong?start_time,
ULong?end_time)=0;
* describe: obtain Global ID according to the object global title
virtual?int?get_obj_id(const?QString&obj_name,
ULongLong&obj_id,
QList<vdb_obj_attr_desc>&additional_attrs)=0;
* describe: obtain Global ID according to the object global title
virtual?int?get_objs_id(const?QStringList&objs_name,
QList<ULongLong>&objs_id)=0;
* describe: Global ID obtains global title according to object
virtual?int?get_objs_name(const?QList<ULongLong>&objs_id,QStringList&objs_name)=0;
// following be maintenance interface
* describe: register single object interface
virtual?int?register_obj(const?char*obj_name,
const?char*datasrc_name,
ULongLong?id_in_datasrc,
const?char*id_str_in_datasrc,
int?id_datatype,
const?QList<vdb_obj_attr_desc>&additional_attrs)=0;
* describe: delete single object
virtual?int?delete_obj(const?char*obj_name)=0;
* describe: revise the object global title
virtual?int?modify_obj_name(const?char*old_name,const?char*new_name)=0;
* describe: revise object adeditive attribute value
virtual?int?modify_obj(const?char*obj_name,const?QList<vdb_obj_attr_desc>&additional_attrs)=0;
* describe: increase global property
virtual?int?add_attr(const?char*vdb_attr_name,
const?char*datasrc_name,
const?char*table_name_in_datasrc,
const?char*attr_name_in_datasrc,
const?char*obj_type)=0;
* describe: the deletion global property
virtual?int?delete_attr(const?char*vdb_attr_name)=0;
* describe: revise the global property name
virtual?int?modify_attr_name(const?char*old_name,const?char*new_name)=0;
* describe: the batch registration object
virtual?int?register_objs(const?QList<vdb_obj_desc>&objs_desc,
const?char*datasrc_name,
QList<Short>&ret_codes)=0;
* describe: delete object in batches
virtual?int?delete_objs(const?QStringList&objs_name,QList<Short>&ret_codes)=0;
Four, in the power information system crowd virtual data warehouse based on the general frame of metadata management
As shown in Figure 5, in a power information system crowd, formed a virtual data warehouse through metadata management system, the public data services platform is provided.Metadata management system be in integrated system the middle layer, it provides public model, device object and public data services interface to upper layer application; To down and each heterogeneous data source carry out alternately, obtain the information such as model, device object, data structure of each database.
The mapping relations that metadata management system has been stored the public power information object, served to each data source private data with the public data services of object association, by public data services; Can well cooperate with each data source agency (AGENT) through this mechanism; Obtain the information and the data of each data source, to the data warehouse particularly the distributed virtual data warehouse good support is provided.Because the public data services interface section of metadata management system provides standardized open function interface to the upper strata, can directly be used for the data access of common data platform simultaneously.

Claims (1)

1. power information system crowd virtual data warehouse metadata management method is characterized in that comprising following steps:
The Service Management of step a) public power infosystem object data; According to object type in the model of existing power information system and the privately owned Service Properties that provides, expand public power infosystem object type and public service attribute, until the investigation of N public power infosystem object of completion; Through the metadata system management public power infosystem object is carried out the management of model; Be through a kind of doublet; Be common object--the method that the common object type is corresponding, for the common object of each type, metadata management system is distributed to a kind of Container Type and is used to load this object; Be associated with a kind of common object type simultaneously, managed public data services attribute inquiry that this common object provides;
The mapping relations management of the various dimensions data, services that step b) public data services attribute and each heterogeneous database are privately owned: the mapping relations of the various dimensions data, services that the public data services attribute of foundation and each heterogeneous database are privately owned are to accomplish to the incidence relation of each isomery database column through the public data services attribute; The public data services attribute is a multidimensional to the incidence relation of the database column of the privately owned various dimensions data, services of each heterogeneous database, and promptly the common object type can comprise a plurality of public data services attributes; The database column of the multidimensional data service that each heterogeneous database of while is privately owned also is a multidimensional to last relation of plane, and promptly a common object type is associated with the privately owned various dimensions data, services of a plurality of heterogeneous databases attribute through a plurality of public data services attributes; Thereby the multidimensional data of having accomplished the common object type is integrated to the public data services attribute;
Step c) public data services interface and maintenance interface: be the open standard interface API function library that data, services externally is provided of a cover; The public data services interface comprises unified retrieval definition service interface and uniform data inquiry service interface; Comprise following data structure in the wherein related metadata system management:
The definition of PubObjectType common object type is following:
Attribute-name Data type Describe Name DT_STRING Title DMemberOf_ObjectTypeDefine DT_S_DARRAY_MATE Belong to the object type definition DContains_DataAttribute DT_S_DARRAY_COMP Comprise the public data services attribute
The definition of PubDataAttribute public data services attribute is following:
Attribute-name Data type Describe Name DT_STRING Title Alias DT_STRING Another name RefSourceTableColumn DT_S_REF_SIM Point to unidirectional the quoting of source data row DMemberOf_ObjectType DT_S_DARRAY_MATE Belong to object type
The definition of SourceSystem origin system is following:
Attribute-name Data type Describe Name DT_STRING Title Alias DT_STRING Another name DContains_SourceDB DT_S_DARRAY_COMP Comprise source database
The definition of SourceDB source database is following:
Attribute-name Data type Describe Name DT_STRING Title Alias DT_STRING Another name dataSourceType DT_ENUM The data source type refers to real-time storehouse/history library appName DT_STRING Apply names mdlInputFile DT_STRING Model imports file dllFile DT_STRING Dynamic library file DContains_SourceTable DT_S_DARRAY_COMP Comprise the source database table DMemberOf_SourceSystem DT_S_DARRAY_MATE Belong to origin system lastMaintainTimestamp DT_STIME The last maintenance time
The definition of SourceTable source database table is following:
Attribute-name Data type Describe Name DT_STRING Title Alias DT_STRING Another name tableID DT_ULONG Table I D DMemberOf_SourceDB DT_S_DARRAY_MATE Belong to source database ?DContains_SourceTableColumn DT_S_DARRAY_COMP Comprise the source data row
The definition of SourceTableColumn source database row is following:
Attribute-name Data type Describe Name DT_STRING Title Alias DT_STRING Another name columned DT_ULONG Row ID ?DMemberOf_SourceTable DT_S_DARRAY_MATE Belong to the source data table
Wherein uniform data inquiry service interface is the calling interface function library that common data platform provides standard;
Step a) also comprises:
The first step is investigated the 1st public power infosystem object, its type of coupling in existing common object and data type;
In second step, if in the first step, fail to find the type of this public power infosystem object, then newly-built a kind of public power infosystem object type is with public power infosystem object and type matching;
The 3rd step, investigate the public data services attribute of common object type, with each data association of this service under this common object;
Investigate the 2nd public power infosystem object, repeated for first to three step;
Until the investigation of accomplishing N public power infosystem object;
Step b) further comprises:
The first step, the data source of investigating the 1st power information system is the public data services of the 1st inquiry that common object provides, and extracts its data structure about certain private data service;
Second step, in the multi-dimensional database of metadata management system, set up data structure about the private data service of the 1st power information system data source, insert " origin system table ", " source database table ", " source database row " respectively;
In the 3rd step, extract the public data services attribute and insert " public data services attribute list ", the incidence relation of the private data service of setting up and setting up in second step;
The 4th step, this public service attribute in " public data services attribute list " is inserted " common object type ", this public data services is configured on the pairing common object type, match concrete common data object again;
Investigate the 2nd power information system data source, repeat first to fourth step;
Until the N step, accomplish the investigation of N power information system data source;
Unified retrieval defining interface function in the step c):
(1) for application system the object that supplies retrieval is provided in the common object model or one group of common object of the scope of dividing according to electric network composition;
(2) for application system tables of data and data attribute in the common data structures are provided;
(3) with above the two combine as the query and search condition, submit the uniform data query interface to;
The uniform data query interface function:
(1) to one or the data query of one group of common object in the individual data source
(2) to one or the data query of one group of common object in a plurality of data sources
(3) to one or one group of common object data basic statistics in the individual data source
(4) to one or one group of common object data basic statistics in a plurality of data sources
(5) data pick-up of each data source Query Result, conversion, purification
(6) output unified data result set.
CN2011100055373A 2011-01-12 2011-01-12 Method for managing metadata of virtual data warehouse of electric power information system group Active CN102073767B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011100055373A CN102073767B (en) 2011-01-12 2011-01-12 Method for managing metadata of virtual data warehouse of electric power information system group

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011100055373A CN102073767B (en) 2011-01-12 2011-01-12 Method for managing metadata of virtual data warehouse of electric power information system group

Publications (2)

Publication Number Publication Date
CN102073767A CN102073767A (en) 2011-05-25
CN102073767B true CN102073767B (en) 2012-10-31

Family

ID=44032305

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011100055373A Active CN102073767B (en) 2011-01-12 2011-01-12 Method for managing metadata of virtual data warehouse of electric power information system group

Country Status (1)

Country Link
CN (1) CN102073767B (en)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102236735B (en) * 2011-06-30 2014-04-02 内蒙古电力勘测设计院 Method and system for processing data relationships in power design
CN102243676B (en) * 2011-07-13 2012-12-05 国电南瑞科技股份有限公司 Three-level modeling method of new energy comprehensive monitoring system
CN102360470A (en) * 2011-10-14 2012-02-22 广东电网公司电力科学研究院 Information matching method and system for electric power system
CN102682051B (en) * 2011-12-09 2015-03-11 国家电网公司 Method for integrating time series database with intelligent grid scheduling technology support system
CN102542005A (en) * 2011-12-13 2012-07-04 中国电子科技集团公司第十五研究所 System and method for counting and inquiring data in growth-type database
CN102609884A (en) * 2012-02-07 2012-07-25 中国南方电网有限责任公司 System for managing electric power dispatching logs
CN102684307B (en) * 2012-05-17 2014-07-23 云南电力试验研究院(集团)有限公司电力研究院 Information intelligent layering and propelling method for comprehensively and automatically monitoring centralized control station and transformer substation
CN103034928B (en) * 2012-12-11 2015-11-18 清华大学 The plug and play data platform of self-discipline dispersion and management method and application
JPWO2014122732A1 (en) * 2013-02-06 2017-01-26 株式会社日立製作所 Computer system, metadata management method, and recording medium
CN103559189B (en) * 2013-08-22 2017-10-24 国家电网公司 Electric analog training resource management system and method based on Metadata integration model
CN103970900B (en) * 2014-05-27 2017-04-26 重庆大学 Multi-dimensional cross data flexible management method and system based on industrial field
CN104331426B (en) * 2014-10-20 2018-06-19 国电南瑞科技股份有限公司 A kind of method for quickly retrieving of the electric system searcher based on browser
CN105335900A (en) * 2015-11-19 2016-02-17 南方电网科学研究院有限责任公司 Integrated data processing method based on power equipment state monitoring system
CN108073635B (en) * 2016-11-18 2021-08-27 中国电力科学研究院有限公司 System for loading data scene of electric power information system and loading method thereof
CN106897550B (en) * 2017-02-04 2019-07-09 中国石油天然气股份有限公司 Logging data processing method and device
CN106909645B (en) * 2017-02-21 2019-03-26 中国科学院电子学研究所 A kind of space-time data organization of unity method of expansible definition
CN107368588B (en) * 2017-07-24 2020-09-01 人教数字出版有限公司 Heterogeneous resource isomorphism method and device
CN107563925A (en) * 2017-08-31 2018-01-09 上海德衡数据科技有限公司 A kind of intelligent region emergency medical integrated data centric system architecture
CN107610760A (en) * 2017-08-31 2018-01-19 上海德衡数据科技有限公司 A kind of intelligent region emergency medical integrated data centric system architecture based on software definition
CN107491662A (en) * 2017-10-09 2017-12-19 上海德衡数据科技有限公司 A kind of intelligent region portable medical integrated data centric system architecture based on metadata
CN107818148A (en) * 2017-10-23 2018-03-20 南京南瑞集团公司 Self-service query and statistical analysis method based on natural language processing
CN109345293A (en) * 2018-09-17 2019-02-15 上海宝尊电子商务有限公司 A kind of big data information service method and system towards brand electric business
CN109582695A (en) * 2018-12-04 2019-04-05 用友网络科技股份有限公司 Data general-purpose querying method and inquiry system under a kind of micro services framework
CN110012070B (en) * 2019-03-06 2022-02-15 中国南方电网有限责任公司 Method for applying homologous data of intelligent wave recorder in multiple domains based on name space
CN111767332B (en) * 2020-06-12 2021-07-30 上海森亿医疗科技有限公司 Data integration method, system and terminal for heterogeneous data sources
CN112383138A (en) * 2020-10-14 2021-02-19 北京四方继保工程技术有限公司 Relay protection data service method and master station system thereof
CN114647716B (en) * 2022-05-13 2022-08-30 天津南大通用数据技术股份有限公司 System suitable for generalized data warehouse

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8730056B2 (en) * 2008-11-11 2014-05-20 Itron, Inc. System and method of high volume import, validation and estimation of meter data
CN101770518A (en) * 2010-01-29 2010-07-07 华东电网有限公司 Metadata management method of power grid enterprise integrated information die
CN101908176A (en) * 2010-08-02 2010-12-08 国电南瑞科技股份有限公司 Method for modeling on basis of power information data and applying metadata management

Also Published As

Publication number Publication date
CN102073767A (en) 2011-05-25

Similar Documents

Publication Publication Date Title
CN102073767B (en) Method for managing metadata of virtual data warehouse of electric power information system group
CN102063509B (en) Model and modeling method of multi-dimensional data integration of heterogeneous databases of electric power information system
CN102609463B (en) Data cluster management system based on quasi-realtime platform
CN104391948B (en) The data normalization construction method and system of data warehouse
CN105278373A (en) Substation integrated information processing system realizing method
CN102426525B (en) Panoramic modeling method of multi-application system
CN106951552A (en) A kind of user behavior data processing method based on Hadoop
CN102799620A (en) IEC 61850 universal database information model and design method for interface of IEC 61850 universal database information model
CN105224613A (en) Based on integrating heterogeneous data source system and the integration method thereof of the federal technology of data
CN104317864A (en) Automatic identification method of information model based on IEC61850 logical nodes
CN102495916A (en) Multi-application-system panoramic modeling method based on object matching
CN102314480A (en) Distributed data storage method specific to mass data
CN104200331A (en) Power grid model joining method and system of power system
CN105743870A (en) Design method of intelligent substation integrated business platform service interfaces
CN106257460A (en) Data base&#39;s general-purpose accessing implementation method for micro-capacitance sensor monitoring system
Lv et al. Design of cloud data warehouse and its application in smart grid
JP5659757B2 (en) Distributed database management system and distributed database management method
CN108446145A (en) A kind of distributed document loads MPP data base methods automatically
CN101867185A (en) System and method for automatically maintaining PI measuring point of power system
CN103197926A (en) Method for establishing IEC61970 electric energy quality common information model
CN103198041A (en) Method for establishing IEC61970 GID (general interface definition) interface
CN105740296B (en) Intelligent substation data subscription method based on access model
CN101840427A (en) Data processing method and device
CN103294878A (en) Unified modeling method of multidimensional grid models based on DMS (database management system)
CN107729410A (en) A kind of database engine suitable for power equipment big data

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant