CN104809597A - Data resource management platform based on data fusion - Google Patents
Data resource management platform based on data fusion Download PDFInfo
- Publication number
- CN104809597A CN104809597A CN201510245576.9A CN201510245576A CN104809597A CN 104809597 A CN104809597 A CN 104809597A CN 201510245576 A CN201510245576 A CN 201510245576A CN 104809597 A CN104809597 A CN 104809597A
- Authority
- CN
- China
- Prior art keywords
- data
- data resource
- unit
- interface
- management platform
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data resource management platform based on data fusion. The data resource management platform based on data fusion comprises a data resource management platform front and back end, a data resource management platform database, four major data center data resources and each business system data resource of an electric power company, wherein the data resource management platform is in butt joint with a database of each business system of the electric power company; the data resource management platform database comprises four organized major data center data resources and each business system data resource of the electric power company; the data resource management front and back end comprises a data resource view module, a data resource application module, a data resource maintenance module, a data resource obtaining module, a data center requirement management module, an on-line data resource operation maintenance module and a data interface configuration and management module. The data resource management platform has the advantages that the unified management on the data of each service system is realized, the effective management and the integral utilization on enterprise level data resources are realized, the data is directly shown in front of a user, and the data information is simpler and can be more easily understood.
Description
Technical field
The present invention relates to a kind of business data resource management system, specifically a kind of data resource management platform based on data fusion.
Background technology
Along with the propelling of informatization work, Shandong companies has built up structuring data center, unstructured data management platform, magnanimity history/near-realtime data management platform and power grid GIS data platform (hereinafter referred to as " four class data centers "), and shares the data, services such as exchange, analysis displaying for operation system provides corresponding.
From SG186 engineering, since SG-ERP builds, build more than 100 and overlapped operation system, define a large amount of, complicated data resource, and at present in Enterprise Data resource management, do not form unified data resource management mechanism, technical support means are on the weak side, each data resource relative distribution, user often can not see the information that data reflect intuitively, therefore company is in the urgent need to studying the Enterprise Data resource management mechanism that a whole set of is suitable for grid company business characteristic, realize the effective management to Enterprise Data resource and comprehensive utilization, the each layer personnel of company are allowed to see data, understand data, usage data, abundant mining data is worth.
Current, strong intelligent grid and SG-ERP engineering is built under the new situation in Shandong company, in order to better support the large System Construction of three collection five, construct the integrated information platform of longitudinally through horizontal integrating, build up the operating information system covering corporate HQ, provinces and cities, districts and cities, create a large amount of diversified data.How to realize carrying out effective unified management and application to Enterprise Data resource, promoting the work efficiency of company, is a huge challenge that need face in present stage and future.
Summary of the invention
For solving each operation system relative distribution of current electric system, there is no unified data resource management, the effective management to Enterprise Data resource and comprehensive utilization can not be realized, the each layer personnel of company cannot be allowed to see data intuitively, understand the problem of data and usage data, one is the object of the present invention is to provide each operation system to be implement resource integration, the associated data set of each operation system is incorporated in a management platform, the data resource management platform based on data fusion of unified management and utilization.
For solving the problem, the data resource management platform based on data fusion provided by the invention comprises: the data resource of data resource management platform front and back end, data resource management platform database, each operation system data resource of Utilities Electric Co. and structural data center, unstructured data management platform, magnanimity history/near-realtime data management platform and power grid GIS data platform four class data center;
This data resource management platform has user name password and the associated rights of each operation system database of Utilities Electric Co., and by the connection of system interface and each operation system of described Utilities Electric Co., described system interface comprises manual typing module and interface load module;
Described data resource management platform database comprises the data resource of the described four class data centers carrying out combing, and through each operation system data resource of described Utilities Electric Co. of combing, and carry out regularly or manually upgrading;
The data of described data resource management platform database carry out arranging and showing by described data resource management platform front and back end, and it comprises:
Data resource views module, it comprises data resource statistical views unit, application domain view unit and SG-CIM view unit, described data resource statistical views unit is used for display data resource overall distribution situation and variation tendency, and company data general status and each business categorizing data resource rising tendency can be checked, described application domain view unit is used for relation between displaying application system directly perceived, and model and the integrated interface information of a certain system can be checked, described SG-CIM view unit is for showing secondary subject area;
Data resource application module, it comprises distortion analytic unit, blood relationship management/impact analysis unit, version management unit and model comparing unit, described distortion analytic unit is used for carrying out similarity analysis to new model and the original model of system, described blood relationship management/impact analysis unit is for representing the relation chain of model dependence and relying on the relation chain of model, described version management unit is for checking the old version of data resource account, and described model comparing unit is compared to the resource safeguarded in system and database actual conditions;
Data resource maintenance module, it comprises data resource classification maintenance unit and data resource maintenance unit, described data resource classification maintenance unit carries out classification to data relevant departments, business categorizing, operation system, integrated technology classification, data center region, main subject heading territory, secondary subject area and database instance to be safeguarded, described data resource maintenance unit comprises model conservation of resources unit, model attributes maintenance unit, interface maintenance unit and data stream maintenance unit;
Data resource acquisition module, it comprises database acquiring unit and ETL acquiring unit, described database acquiring unit obtains the resource of structural data, Resource Properties and data amount information by data resource management platform database, carry out statistics to the data amount information obtained to show, described ETL acquiring unit maps by ETL the graphical representation that the information extracted carries out the page, analyze with this graphics mode the logical relation that ETL maps again, and obtained by the mode of ETL and flow to graph of a relation between each data model;
Data center's demand management module, it comprises data application maintenance unit, data application approval unit and data application query unit, described data application maintenance unit be used for the data resource of described data resource management platform database inquire about, newly-built, revise and delete function safeguard, the application of described data application approval unit to business department is examined, and described data application query unit provides department to inquire about the demand application submitted to from application title, proposition department and data.
Further, described data resource management platform front and back end also comprises online data resource O&M module, this module comprises data resource modification application unit, data resource changes examination & approval unit, data resource changes performance element, data resource changes historical query unit and data resource changes statistical views unit, the change of this module to data resource is applied for, is examined and executable operations, and realize to data resource change supervision and review.
Further, described data resource management platform front and back end also comprises data-interface configuration and administration module, this module manages the configuration of data-interface and change, and monitor-interface running status, show interface statistics view, it comprises interface configuration unit, interface running state monitoring unit and interface statistics view unit.
Further, described interface configuration unit comprises interface source configurator, interface target end configurator, interface link configurator and interface scheduling rule configurator, and described interface source configurator is used for the configuration of source end system information, database information and table information; Described interface target end configurator is used for the configuration of target system information, database information and table information; Described interface link configurator is used for field corresponding relation and the processing logic information of source and destination end table; Described interface scheduling rule configurator is mainly used in configuration interface allocating time and call number.
Preferably, described data resource statistical views unit comprises resource general view view, business categorizing statistical views and structuring, destructuring, magnanimity and GIS tetra-class data statistics view.
Further, described application domain view unit comprises application system correlator, and the application system line of association is connected by described application system correlator, and arranges numeral on line, wherein line representative of data flow converting interface, the digitized representation interface quantity on line.
Preferably, in described model comparing unit the information of comparison comprise his-and-hers watches name, literary name name section, field type, field length consistance compare.
Further, comprise corresponding secondary subject area under boring each main subject heading territory of the page under the described SG-CIM periodic table of elements, the lower brill page of each secondary subject area comprises model and interface list unit.
Further, described version management unit also comprises the version comparative device can compared to any two versions of data resource peripheral account.
Beneficial effect of the present invention is:
The data resource of four class data centers and each operation system is pooled to data resource management platform database by system interface, system interface adopts manual typing and interface to input two kinds of modes, not only the data of each operation system are collected automatically, and can the corresponding information of manual typing as required, so that data under the manual typing line of staff; At data resource application module, distortion and blood relationship management/impact are analyzed after data resource acquisition module obtains data, then the displaying of data amount information statistical views is carried out, and by the mode of ETL, view shows is carried out to the relation that flows between the data flow between each operation system and data model, to make between current each operation system that chaotic, that unorganized data are able to view form is clear to be represented, for the upgrading of sorts of systems, integrated services provide Information base.
For Utilities Electric Co.'s operation system and department more, the unsharp problem of Data classification, the present invention devises data resource maintenance module, this module to the data of each operation system according to data relevant departments, business categorizing, operation system, integrated technology is classified, data center region, main subject heading territory, secondary subject area and database instance carry out classification to be safeguarded, user can be according to demand, according to different taxonomic properties data inquired about and edit, solve the data resource relative distribution of each operation system at present, each layer personnel can not check the problem of data according to the wish of oneself.
Data resource views module of the present invention adopts statistical form, the mode that broken line graph and histogram combine intuitively embodies the total data message of each operation system and each business categorizing data resource rising tendency, and utilize module map the stream compression relation between each application system to be shown, and user can select certain module map to enter the lower brill page to show the information such as model and integrated interface of correspondence system, this pictorial representation simplifies current each operation system with the situation of too much table view display data resource, and user can be allowed faster, find desired data resource more easily.
In order to manage the rights of using of each business department to total data resource, the present invention devises data center's demand management module, application approval program is carried out by this module when certain department's usage data, ensure that the data of each business department are collecting the security in use procedure, and can inquire about in detail application information by application situation.And, when changing data, by line data resource O&M module change being applied for and examining, and history is changed in inquiry, and change is also carried out statistical views displaying by this module, and data message is easily understood more.
Modules of the present invention together constitutes data resource management platform, indispensable in the large data handling procedure of whole electric system, they carry out analyzing and processing according to the respective division of labor to data resource, achieve the unified of all operation system data resources show and safeguard, solve the data resource management mechanism that current electric system is ununified, each data resource relative distribution, unified difficult in maintenance, user often can not see the problem of the information that data reflect and overview all data information intuitively.
Accompanying drawing explanation
Fig. 1 is system construction drawing of the present invention;
Fig. 2 is the function framework figure of data resource management platform front and back end of the present invention;
Fig. 3 is the one-level business categorizing view of application domain view unit;
Fig. 4 is the secondary application system view under application domain view unit " huge construction program ".
Embodiment
Below in conjunction with drawings and the specific embodiments, the present invention is described in detail.
As shown in Figure 1, the existing each operation system database of electric system should be comprised based on the data resource management platform of data fusion, the existing each operation system database of the electric system i.e. data resource of four class data centers and each operation system data resource of Utilities Electric Co., wherein, four class data centers comprise structural data center, unstructured data management platform, magnanimity history/near-realtime data management platform and power grid GIS data platform.The basis of existing each operation system database devises this data management platform, it also comprises data resource management platform front and back end and data resource management platform database, this data resource management platform has user name password and the associated rights of each operation system database, its data resource management platform database is by system interface and the existing each operation system connection of electric system, by existing for electric system each operation system data fusion to data resource management platform database, system interface comprises manual typing module and interface load module, manual typing module comprises a data upload software, the data needing to collect are obtained by the mode of man-machine interaction.Interface load module comprises application development interface and transmission program, receives external application and sends data to data resource management platform database.By system interface by data resource management platform database and the existing each operation system connection of electric system, can realize manual for the data of complicate statistics input database.
Data resource management platform database comprises pre-service, sorting, transmission, reception and warehouse-in to data fusion, pre-service is according to collecting platform file format specification, by obtain to become unified with the typing file received, interface document and reception file transform sorting required for input file form.Sorting is landed in file by the write of the preprocessed file of all inputs, feeds library software by data write into Databasce, and meanwhile, preprocessed file writes in transmission file by configuration according to system respectively.Send refer to according to transmission file with the mapping relations of node, the data (good according to the communication protocol definition of data resource management platform database) in this file are mail to corresponding node.Receive the data (according to the packet that the communication protocol definition of data resource management platform database is good) referring to and receive from other node.Warehouse-in refers to and will land the data of file stored in corresponding database according to various information coding standard.
Described data resource management platform database comprises the described four class data center data resources carrying out merging, and each operation system data resource of described Utilities Electric Co. through merging, and carries out regularly or manually upgrading.As shown in Figure 2, described data resource management platform front and back end comprises the configuration of data resource views module, data resource application module, data resource maintenance module, data resource acquisition module, data center's demand management module, online data resource O&M module and data-interface and administration module.
Below each module of data resource management platform front and back end of the present invention is described in detail:
Data resource management platform front and back end comprises data resource management platform front end and data resource management platform rear end, and data resource management platform front end comprises display screen, for showing data; Data resource management platform rear end is used for carrying out analytic operation to data, comprises the configuration of data resource views module, data resource application module, data resource maintenance module, data resource acquisition module, data center's demand management module, online data resource O&M module and data-interface and administration module.
Data resource views module, it comprises data resource statistical views unit, application domain view unit and SG-CIM view unit.
User, after client selects data resource statistical views unit, can check company data general status and each business categorizing data resource rising tendency in data resource management platform front end.Data resource statistical views unit comprises resource general view view, business categorizing statistical views and structuring, destructuring, magnanimity and GIS tetra-class data statistics view, the mode that these views all adopt chart to combine, to embody general status and the variation tendency of data, allows user to the understanding having data simple and clear.Wherein, being designed to of resource general view view: the top of view is the general view statistical form of " on system number, line pattern number, line drag number, number of ports, data fluxion, record number and take up room ", and the below of statistical form is column statistical graph and the broken line graph of data resource variation tendency.For being designed to of four class data statistics views: the top of view is the rising tendency curve map of four class data resources, below is the distribution of four class data resources at each business categorizing and the statistical form of accounting situation.To being designed to of business categorizing statistical views: top is the change trend curve figure of each business categorizing data resource, below is the bar graph of each business categorizing current data number.
Application domain view unit is used for directly perceived showing relation between application system, and can check model and the integrated interface information of a certain system further, and model information comprises the attribute of model, data volume, authority, place database and data dictionary and describes.Integrated interface information comprises integration mode between system, the text description of interface illustrates and data flow information.Application domain view unit comprises one-level business categorizing, secondary application system and application system correlator, the application system of association is connected with service class line by described application system correlator, and numeral is set on line, wherein line representative of data flow converting interface, the digitized representation interface quantity on line.As shown in Figure 3, one-level business categorizing view, the line of each service class with arrow connects by this view, represent stream compression interface, line statistics have shown, the interface quantity of this this interface of numeral, the secondary application system view under this service class is entered after clicking a certain service class on this view, as the secondary application system view that Fig. 4 is under " huge construction program ", in like manner, the line of application system with arrow connects by this view, represent stream compression interface, line statistics have shown, the interface quantity of this this interface of numeral, model and the integrated interface displayed page of this system is entered after clicking a certain system of secondary application system view.Relation between each service class and application system is not only expressed by this pictorial representation intuitively, but also illustrate data-interface quantity, and click and under after each service class and application system, to get into the corresponding concrete page, make to show confusion between current each service class and application system, ununified makes mode in order, and business personnel will wonder that the situation of each service class and application system needs the system of entering in turn to go to arrange the difficult problem made in order and solved.
Described SG-CIM view unit is for showing secondary subject area, and it for entrance, shows secondary subject area with the SG-CIM periodic table of elements.After clicking secondary subject area, display model and interface list unit, by system demonstration specifying information when the model (interface) in display frames shows.
Data resource application module, it comprises distortion analytic unit, blood relationship management/impact analysis unit, version management unit and model comparing unit.
When newly-increased model is preserved, described distortion analytic unit is used for carrying out similarity analysis to new model and the original model of system, if original model is similar to the structure of new model, then gives corresponding prompting, prompting Similarity value.And eject two models statistics table separately of compare of analysis, and go out inconsistent field and non-existent field between two models with coloured font tags on statistical form.
Consanguinity analysis in described blood relationship management/impact analysis unit is from a certain model, graphically represents the relation chain that this model relies on.Impact analysis is from a certain model, graphically represents the relation chain relying on model.
Described version management unit is for checking the old version of data resource account.User clicks the old version that " version management " function can check data resource account on the display screen of client or control center, further, described version management unit also comprises the version comparative device can compared to any two versions, and any two versions can be selected to compare.
Described model comparing unit is compared to the resource safeguarded in system and database actual conditions, preferably, in described model comparing unit the information of comparison comprise his-and-hers watches name, literary name name section, field type, field length consistance compare.If exist inconsistent, statistical form is adopted to list the statistical conditions of inconsistent data for operating personnel's reference.
Data resource maintenance module, it comprises data resource classification maintenance unit and data resource maintenance unit.Described data resource classification maintenance unit carries out classification to data relevant departments, business categorizing, operation system, integrated technology classification, data center region, main subject heading territory, secondary subject area and database instance to be safeguarded.
Wherein, the maintenance of data relevant departments comprises:
A, query function: can by the condition query such as department name, industry number data relevant departments.
B, newly-increased/modify feature: when preserving " data relevant departments ", required information item needs to fill in complete, specification, and system prompt " is preserved successfully "; System prompt " please fill in complete by required item if required item is filled in not exclusively or filled in lack of standardization! "; Select the data relevant departments that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: eject " deleting selected department? " information, deletes selected department after confirming.
The maintenance of business categorizing comprises:
A, query function: can by condition query business information such as Business Name, business numberings.
B, newly-increased/modify feature: when preserving " new business ", required information item needs to fill in complete, specification, and system prompt " is preserved successfully "; System prompt " please fill in complete by required item if required item is filled in not exclusively or filled in lack of standardization! "; Select the business that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: eject " deleting selected business? " information, deletes selected business after confirming.
Operation system is safeguarded and is comprised:
A, query function: can by the condition query such as systematic name, System Number operation system.
B, newly-built/modify feature: click " increasing newly " button in query page, enter system new added pages, fill in the required item with No. * in the page on request, click " preservation " button, eject information " operation system is preserved successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! "; Select the operation system that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: in Query List, select an operation system, click " deletion " button, deletes selected operation system.
Integrated technology classification maintenance comprises:
A, query function: can by condition query integrated technologies such as integrated technology title, integrated technology numberings.
B, newly-built/modify feature: click " increasing newly " button, enter new added pages, fill in the required item with No. * in the page on request, click [preservation] button, eject information " integrated technology is preserved successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! "; Select the integrated technology that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: in Query List, select an integrated technology, click " deletion " button, deletes selected integrated technology.
Data center's regional maintenance comprises:
A, query function: can by condition query data centers such as data center's zone name, data center's zone numbers.
B, newly-built/modify feature: click " increasing newly " button, enter new added pages, fill in the required item with No. * in the page on request, click [preservation] button, eject information " data center preserves successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! " amendment time select the data center that will revise, click " amendment " button ejection similar " increasing newly " page, modify according to modification item.
C, delete function: in Query List, select an integrated technology, click " deletion " button, deletes selected data center.
Main subject heading territory is safeguarded and is comprised:
A, query function: can to claim by main subject heading domain name, the condition query main subject heading territory such as main subject heading Field Number.
B, newly-built/modify feature: click " increasing newly " button, enter new added pages, fill in the required item with No. * in the page on request, click [preservation] button, eject information " main subject heading territory is preserved successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! "; Select the subject area that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: in Query List, select a subject area, click " deletion " button, deletes institute's subject area.
Secondary subject area is safeguarded and is comprised:
A, query function: can by condition query secondary subject areas such as secondary subject area title, secondary subject area numberings.
B, newly-built/modify feature: click " increasing newly " button, enter new added pages, fill in the required item with No. * in the page on request, click [preservation] button, eject information " secondary subject area is preserved successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! "; Select the subject area that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: in Query List, select a subject area, click " deletion " button, deletes institute's subject area.
Database instance is safeguarded and is comprised:
A, query function: can by condition query database instances such as database instance title, database instance numberings.
B, newly-built/modify feature: click " increasing newly " button, enter new added pages, fill in the required item with No. * in the page on request, click [preservation] button, eject information " database instance is preserved successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! "; Select the database instance that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
C, delete function: in Query List, select a database instance, click " deletion " button, deletes institute's database instance.
Described data resource maintenance unit comprises model conservation of resources unit, model attributes maintenance unit, interface maintenance unit and data stream maintenance unit;
The maintenance of model conservation of resources unit comprises:
A, click " model resource distribution ", the relevant configuration information of interrogation model resource.
B, newly-increased/modify feature: business personnel or operation maintenance personnel are according to certain rule configuration model resource information, and system can be tested model resource distribution rule automatically, meets specification, system prompt " configuration successful ", otherwise, prompting " configure wrong, cannot preserve "; Select the model resource that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify by modification item.
C, delete function: select invalid or lost efficacy model resource distribution carry out deletion action, system eject confirmation " determining to delete this model resource distribution? ", delete after confirming.
D, support to import model resource information by excel template batch.
The maintenance of model attributes maintenance unit comprises:
A, click " model attributes configuration ", the relevant configuration information of interrogation model attribute.
B, newly-increased/modify feature: business personnel or operation maintenance personnel are according to certain rule configuration model attributes information, and system can be tested model attributes configuration rule automatically, meets specification, system prompt " configuration successful ", otherwise, prompting " configure wrong, cannot preserve "; Select the model attributes that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify by modification item.
C, delete function: selected model attributes configuration that is invalid or that lost efficacy to carry out deletion action, system eject confirmation " determining to delete the configuration of this model attributes? ", delete after confirming.
D, support to import model attributes information by excel template batch.
The maintenance of interface maintenance unit comprises:
A, click " interface configuration ", the relevant configuration information of query interface.
B, newly-increased/modify feature: business personnel or operation maintenance personnel are according to certain rule configuration interface message, and system can automatic butt mouth configuration rule be tested, and meets specification, system prompt " configuration successful ", otherwise, prompting " configure wrong, cannot preserve "; Select the interface that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify by modification item.
C, delete function: select invalid or lost efficacy interface configuration carry out deletion action, system eject confirmation " determining to delete this interface configuration? ", delete after confirming.
D, to support by excel template batch introducting interface information.
The maintenance of data stream maintenance unit comprises:
A, click " data stream configuration ", the relevant configuration information of data query stream.
B, newly-increased/modify feature: business personnel or operation maintenance personnel are according to certain rule configuration traffic flow information, and system automatically can be banishd data and be put rule and test, and meets specification, system prompt " configuration successful ", otherwise, prompting " configure wrong, cannot preserve "; Select the data stream that will revise during amendment, click " amendment " button and eject similar " increasing newly " page, modify by modification item.
C, delete function: selected data stream configuration that is invalid or that lost efficacy to carry out deletion action, system eject confirmation " determining to delete the configuration of this data stream? ", delete after confirming.
D, support by excel template batch import traffic flow information.
Data resource acquisition module, it comprises database acquiring unit and ETL acquiring unit, described database acquiring unit obtains the resource of structural data, Resource Properties and data amount information by data resource management platform database, carries out statistics displaying to the data amount information obtained; By the information such as numbering, resource Chinese, resource English name, resource type, said system of the database Gains resources of database server.By the information such as numbering, resource Chinese, resource English name, resource type, said system of the database Gains resources attribute of database server.The data amount information of data resource is obtained by resource management instrument.
Described ETL acquiring unit maps by ETL the information extracted and carries out the graphical representation of the page, then analyzes with this graphics mode the logical relation that ETL maps, and is obtained by the mode of ETL and flow to graph of a relation between each data model.ETL maps to extract and extracts ETL mapped file by access interface, knowledge base form.ETL map analysis maps by ETL the graphical representation that the information extracted carries out the page, then analyzes the logical relation (analyzing the data flow between each operation system) of ETL mapping with this graphics mode.
Data center's demand management module, it comprises data application maintenance unit, data application approval unit and data application query unit.
Described data application maintenance unit be used for the data resource of described data resource management platform database inquire about, newly-built, revise and delete function safeguard;
A, query function: can by all data application records of condition query such as application form type, application form titles.
B, newly-built function: click " database request for utilization " button, enter application new added pages, fill in the required item with No. * in the page on request, click " preservation " button, eject information " database request for utilization is preserved successfully "; If required item information is wrong or be empty, then " required item please be filled in complete in ejection! "; " data sharing application " and " data source Notification of Changes list " is the same.
C, modify feature: select the application record will revised in Query List to click " amendment " button and eject similar " increasing newly " page, modify according to modification item.
D, delete function: to not having the application record examined to carry out deletion action, in Query List, select an application record, click " deletion " button and can remove this application record.
The application of described data application approval unit to business department is examined; After business department proposes demand application, the business department related to and Xintong Co need examine application.
Data providing is examined the demand application relating to this department: download detailed requirements annex, carry out under line being confirmed whether to provide, if provide, line carries out examination & approval to pass through, the demand described in annex as applied in detail is indefinite can return, and illustration, can refuse as do not provided, and illustration.Xintong Co examines all demand applications: download detailed requirements annex, analyzing in common data resource pool and whether satisfy the demands, passing through, if do not met as met directly to examine, need and data providing formulate the technology path (0: resource pool supports of data access, 1:Webservice, 2:JDBC, 3: data Replica, 4:APUB, 5: batch bus, 6:ETL), and examination & approval pass through.Access demand data under data providing line.
Described data application query unit provides department to inquire about the demand application submitted to from application title, proposition department and data; There is provided department etc. to inquire about the demand application submitted to from application title, proposition department, data, comprise in Query Result: application title, proposition department, data provide department, demand data system, expected performance time, demand treatment state (" waiting to examine ", " finishing " and " calcellation " three kinds of states), demand deadline etc.And detailed demand information can be inquired about, comprising: approval record (comprising nodename, application reason, handler, running time, suggestion) and approval process.For query function, arrange the authority of all departments, as business department inquires about the demand relating to this department only, the demand of all business departments can be inquired about by Xintong Co (letter portion of section).
Online data resource O&M module comprises data resource modification application unit, data resource changes examination & approval unit, data resource changes performance element, data resource changes historical query unit and data resource changes statistical views unit, the change of this module to data resource is applied for, is examined and executable operations, and realize to data resource change supervision and review.By online data resource O&M can realize to data resource change supervision and review, reach the object that the carrying out of data resource is managed.The information spinner that data resource change statistical views unit represents will comprise: change resource information, applicant, approver, executor, change the time.
Data-interface configuration and administration module, this module manages the configuration of data-interface and change, and monitor-interface running status, show interface statistics view, it comprises interface configuration unit, interface running state monitoring unit and interface statistics view unit.
Described interface configuration unit comprises interface source configurator, interface target end configurator, interface link configurator and interface scheduling rule configurator,
The configuration information of interface source configurator comprises: source end system information, database information, table information etc.
The configuration information of interface target end configurator comprises: target system information, database information, table information etc.
The configuration information of interface link configurator mainly comprises the field corresponding relation of source and destination end table, the information such as processing logic.
Source and aiming field map as follows:
The configuration information of interface scheduling rule configurator mainly comprises: interface interchange time, call number etc.
The main monitor-interface running status of interface running state monitoring unit, source end system database state, destination end system database connection status.
Interface statistics view unit is mainly analyzed from aspects such as interface name, scheduling time, source operation system, source table, target service system, destination end tables and is done statistics and represent.
The above has made detailed description to the preferred embodiment of the present invention and embodiment by reference to the accompanying drawings; but the present invention is not limited to the above-described embodiment and examples; for those skilled in the art; without departing from the inventive concept of the premise; can also make some improvement and modification, these improve and modification also should be considered as protection scope of the present invention.
Claims (9)
1. the data resource management platform based on data fusion, it is characterized in that, comprise the data resource of data resource management platform front and back end, data resource management platform database, each operation system data resource of Utilities Electric Co. and structural data center, unstructured data management platform, magnanimity history/near-realtime data management platform and power grid GIS data platform four class data center;
This data resource management platform has user name password and the associated rights of each operation system database of Utilities Electric Co., and by the connection of system interface and each operation system of described Utilities Electric Co., described system interface comprises manual typing module and interface load module;
Described data resource management platform database comprises the data resource of the described four class data centers carrying out combing, and through each operation system data resource of described Utilities Electric Co. of combing, and carry out regularly or manually upgrading;
The data of described data resource management platform database carry out arranging and showing by described data resource management platform front and back end, and it comprises:
Data resource views module, it comprises data resource statistical views unit, application domain view unit and SG-CIM view unit, described data resource statistical views unit is used for display data resource overall distribution situation and variation tendency, and company data general status and each business categorizing data resource rising tendency can be checked, described application domain view unit is used for relation between displaying application system directly perceived, and model and the integrated interface information of a certain system can be checked, described SG-CIM view unit is for showing secondary subject area;
Data resource application module, it comprises distortion analytic unit, blood relationship management/impact analysis unit, version management unit and model comparing unit, described distortion analytic unit is used for carrying out similarity analysis to new model and the original model of system, described blood relationship management/impact analysis unit is for representing the relation chain of model dependence and relying on the relation chain of model, described version management unit is for checking the old version of data resource account, and described model comparing unit is compared to the resource safeguarded in system and database actual conditions;
Data resource maintenance module, it comprises data resource classification maintenance unit and data resource maintenance unit, described data resource classification maintenance unit carries out classification to data relevant departments, business categorizing, operation system, integrated technology classification, data center region, main subject heading territory, secondary subject area and database instance to be safeguarded, described data resource maintenance unit comprises model conservation of resources unit, model attributes maintenance unit, interface maintenance unit and data stream maintenance unit;
Data resource acquisition module, it comprises database acquiring unit and ETL acquiring unit, described database acquiring unit obtains the resource of structural data, Resource Properties and data amount information by data resource management platform database, carry out statistics to the data amount information obtained to show, described ETL acquiring unit maps by ETL the graphical representation that the information extracted carries out the page, analyze with this graphics mode the logical relation that ETL maps again, and obtained by the mode of ETL and flow to graph of a relation between each data model;
Data center's demand management module, it comprises data application maintenance unit, data application approval unit and data application query unit, described data application maintenance unit be used for the data resource of described data resource management platform database inquire about, newly-built, revise and delete function safeguard, the application of described data application approval unit to business department is examined, and described data application query unit provides department to inquire about the demand application submitted to from application title, proposition department and data.
2. the data resource management platform based on data fusion according to claim 1, it is characterized in that, described data resource management platform front and back end also comprises online data resource O&M module, this module comprises data resource modification application unit, data resource changes examination & approval unit, data resource changes performance element, data resource changes historical query unit and data resource changes statistical views unit, the change of this module to data resource is applied for, is examined and executable operations, and realize to data resource change supervision and review.
3. the data resource management platform based on data fusion according to claim 1, it is characterized in that, described data resource management platform front and back end also comprises data-interface configuration and administration module, this module manages the configuration of data-interface and change, and monitor-interface running status, show interface statistics view, it comprises interface configuration unit, interface running state monitoring unit and interface statistics view unit.
4. the data resource management platform based on data fusion according to claim 3, it is characterized in that, described interface configuration unit comprises interface source configurator, interface target end configurator, interface link configurator and interface scheduling rule configurator, and described interface source configurator is used for the configuration of source end system information, database information and table information; Described interface target end configurator is used for the configuration of target system information, database information and table information; Described interface link configurator is used for field corresponding relation and the processing logic information of source and destination end table; Described interface scheduling rule configurator is mainly used in configuration interface allocating time and call number.
5. the data resource management platform based on data fusion according to claim 1, it is characterized in that, described data resource statistical views unit comprises resource general view view, business categorizing statistical views and structuring, destructuring, magnanimity and GIS tetra-class data statistics view.
6. the data resource management platform based on data fusion according to claim 1, it is characterized in that, described application domain view unit comprises application system correlator, the application system line of association is connected by described application system correlator, and numeral is set on line, wherein line representative of data flow converting interface, the digitized representation interface quantity on line.
7. the data resource management platform based on data fusion according to claim 1, is characterized in that, in described model comparing unit the information of comparison comprise his-and-hers watches name, literary name name section, field type, field length consistance compare.
8. the data resource management platform based on data fusion according to claim 1, it is characterized in that, comprise corresponding secondary subject area bore each main subject heading territory of the page under the described SG-CIM periodic table of elements under, the lower brill page of each secondary subject area comprises model and interface list unit.
9. the data resource management platform based on data fusion according to claim 1, is characterized in that, described version management unit also comprises the version comparative device can compared to any two versions of data resource peripheral account.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510245576.9A CN104809597B (en) | 2015-05-14 | 2015-05-14 | Data resource management platform based on data fusion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510245576.9A CN104809597B (en) | 2015-05-14 | 2015-05-14 | Data resource management platform based on data fusion |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104809597A true CN104809597A (en) | 2015-07-29 |
| CN104809597B CN104809597B (en) | 2018-02-13 |
Family
ID=53694405
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510245576.9A Active CN104809597B (en) | 2015-05-14 | 2015-05-14 | Data resource management platform based on data fusion |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104809597B (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105260835A (en) * | 2015-10-13 | 2016-01-20 | 北京凯行同创科技有限公司 | Method for modeling, analyzing, and self-optimizing multi-source business big data |
| CN105893593A (en) * | 2016-04-18 | 2016-08-24 | 国网山东省电力公司信息通信公司 | Data fusion method |
| CN106126199A (en) * | 2016-06-13 | 2016-11-16 | 乐视控股（北京）有限公司 | The building method of viewdata model and device |
| CN106709000A (en) * | 2016-12-22 | 2017-05-24 | 河海大学 | Key view discovery method based on PageRank and origin graph abstraction |
| CN106874373A (en) * | 2016-12-30 | 2017-06-20 | 江苏瑞中数据股份有限公司 | A kind of implementation method of the electric network data asset management platform based on SOA |
| CN106933835A (en) * | 2015-12-29 | 2017-07-07 | 航天信息软件技术有限公司 | The data lead-in method and system of a kind of compatibility parsing Excel file |
| CN107146165A (en) * | 2017-04-24 | 2017-09-08 | 国网江西省电力公司经济技术研究院 | A kind of distribution layout data management method and system |
| CN108269214A (en) * | 2017-06-30 | 2018-07-10 | 勤智数码科技股份有限公司 | The quick carding method of data and system in a kind of knowledge based library |
| CN108492028A (en) * | 2018-03-21 | 2018-09-04 | 徐欣 | Demand data standardized method and standardized system |
| CN108573371A (en) * | 2018-04-18 | 2018-09-25 | 平安科技（深圳）有限公司 | The data measures and procedures for the examination and approval, device, computer equipment and storage medium |
| CN108701176A (en) * | 2016-02-17 | 2018-10-23 | 开利公司 | The mandate time of system and Credential data passage view |
| CN109189394A (en) * | 2018-08-02 | 2019-01-11 | 山东浪潮通软信息科技有限公司 | A kind of method of adaptive domestic mainstream vendor's grain feelings data structure |
| CN109522292A (en) * | 2018-08-29 | 2019-03-26 | 云南电网有限责任公司信息中心 | Data processing equipment and method based on power grid standard uniform information model |
| CN109902117A (en) * | 2019-02-19 | 2019-06-18 | 新华三大数据技术有限公司 | Operation system analysis method and device |
| CN110753939A (en) * | 2017-06-07 | 2020-02-04 | 三菱电机大楼技术服务株式会社 | Data name classification support device and data name classification support program |
| CN111061794A (en) * | 2019-12-19 | 2020-04-24 | 无锡市耘林养老信息技术有限公司 | Method for butt joint of self system and third-party service system |
| CN111080261A (en) * | 2019-12-19 | 2020-04-28 | 国网安徽省电力有限公司信息通信分公司 | Visual data asset management system based on big data |
| CN111581223A (en) * | 2020-04-11 | 2020-08-25 | 北京城市网邻信息技术有限公司 | Data updating method and device, terminal equipment and storage medium |
| CN113992457A (en) * | 2021-09-09 | 2022-01-28 | 北京思特奇信息技术股份有限公司 | Configuration method and system for telecommunication industry convergence service model |
| CN116383537A (en) * | 2023-05-23 | 2023-07-04 | 飞狐信息技术（天津）有限公司 | Page data preloading method, device, equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103942646A (en) * | 2014-04-16 | 2014-07-23 | 国家电网公司 | Power communication resource management system |
| CN104102973A (en) * | 2014-07-04 | 2014-10-15 | 云南电力调度控制中心 | Realization method of integral operation and distributed deployment provincial and prefectural electric power scheduling data center |
-
2015
- 2015-05-14 CN CN201510245576.9A patent/CN104809597B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103942646A (en) * | 2014-04-16 | 2014-07-23 | 国家电网公司 | Power communication resource management system |
| CN104102973A (en) * | 2014-07-04 | 2014-10-15 | 云南电力调度控制中心 | Realization method of integral operation and distributed deployment provincial and prefectural electric power scheduling data center |
Non-Patent Citations (2)
| Title |
|---|
| 刘殷等: "《电力企业信息***数据融合与共享方案研究》", 《电力信息与通信技术》 * |
| 梁寿愚等: "《南方电网一体化运行数据中心建设方案研究》", 《南方电网一体化运行数据中心建设方案研究》 * |
Cited By (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105260835A (en) * | 2015-10-13 | 2016-01-20 | 北京凯行同创科技有限公司 | Method for modeling, analyzing, and self-optimizing multi-source business big data |
| CN106933835A (en) * | 2015-12-29 | 2017-07-07 | 航天信息软件技术有限公司 | The data lead-in method and system of a kind of compatibility parsing Excel file |
| CN108701176A (en) * | 2016-02-17 | 2018-10-23 | 开利公司 | The mandate time of system and Credential data passage view |
| US11297062B2 (en) | 2016-02-17 | 2022-04-05 | Carrier Corporation | Authorized time lapse view of system and credential data |
| CN108701176B (en) * | 2016-02-17 | 2022-10-14 | 开利公司 | Authorized time lapse view of system and credential data |
| CN105893593A (en) * | 2016-04-18 | 2016-08-24 | 国网山东省电力公司信息通信公司 | Data fusion method |
| CN105893593B (en) * | 2016-04-18 | 2019-04-19 | 国网山东省电力公司信息通信公司 | A kind of method of data fusion |
| CN106126199A (en) * | 2016-06-13 | 2016-11-16 | 乐视控股（北京）有限公司 | The building method of viewdata model and device |
| CN106709000A (en) * | 2016-12-22 | 2017-05-24 | 河海大学 | Key view discovery method based on PageRank and origin graph abstraction |
| CN106709000B (en) * | 2016-12-22 | 2020-07-14 | 河海大学 | Key view discovery method based on PageRank and origin graph abstraction |
| CN106874373A (en) * | 2016-12-30 | 2017-06-20 | 江苏瑞中数据股份有限公司 | A kind of implementation method of the electric network data asset management platform based on SOA |
| CN107146165A (en) * | 2017-04-24 | 2017-09-08 | 国网江西省电力公司经济技术研究院 | A kind of distribution layout data management method and system |
| CN107146165B (en) * | 2017-04-24 | 2021-04-13 | 国网江西省电力公司经济技术研究院 | Distribution network planning data management method and system |
| CN110753939A (en) * | 2017-06-07 | 2020-02-04 | 三菱电机大楼技术服务株式会社 | Data name classification support device and data name classification support program |
| CN110753939B (en) * | 2017-06-07 | 2024-03-01 | 三菱电机楼宇解决方案株式会社 | Data name classification auxiliary device |
| CN108269214A (en) * | 2017-06-30 | 2018-07-10 | 勤智数码科技股份有限公司 | The quick carding method of data and system in a kind of knowledge based library |
| CN108492028A (en) * | 2018-03-21 | 2018-09-04 | 徐欣 | Demand data standardized method and standardized system |
| CN108573371A (en) * | 2018-04-18 | 2018-09-25 | 平安科技（深圳）有限公司 | The data measures and procedures for the examination and approval, device, computer equipment and storage medium |
| CN109189394A (en) * | 2018-08-02 | 2019-01-11 | 山东浪潮通软信息科技有限公司 | A kind of method of adaptive domestic mainstream vendor's grain feelings data structure |
| CN109189394B (en) * | 2018-08-02 | 2021-11-16 | 浪潮通用软件有限公司 | Method for self-adapting to grain situation data structure of domestic mainstream manufacturer |
| CN109522292B (en) * | 2018-08-29 | 2020-02-18 | 云南电网有限责任公司信息中心 | Data processing device and method based on power grid standard unified information model |
| CN109522292A (en) * | 2018-08-29 | 2019-03-26 | 云南电网有限责任公司信息中心 | Data processing equipment and method based on power grid standard uniform information model |
| CN109902117B (en) * | 2019-02-19 | 2021-07-06 | 新华三大数据技术有限公司 | Business system analysis method and device |
| CN109902117A (en) * | 2019-02-19 | 2019-06-18 | 新华三大数据技术有限公司 | Operation system analysis method and device |
| CN111080261A (en) * | 2019-12-19 | 2020-04-28 | 国网安徽省电力有限公司信息通信分公司 | Visual data asset management system based on big data |
| CN111061794A (en) * | 2019-12-19 | 2020-04-24 | 无锡市耘林养老信息技术有限公司 | Method for butt joint of self system and third-party service system |
| CN111581223A (en) * | 2020-04-11 | 2020-08-25 | 北京城市网邻信息技术有限公司 | Data updating method and device, terminal equipment and storage medium |
| CN111581223B (en) * | 2020-04-11 | 2023-08-22 | 北京城市网邻信息技术有限公司 | Data updating method, device, terminal equipment and storage medium |
| CN113992457A (en) * | 2021-09-09 | 2022-01-28 | 北京思特奇信息技术股份有限公司 | Configuration method and system for telecommunication industry convergence service model |
| CN113992457B (en) * | 2021-09-09 | 2024-04-26 | 北京思特奇信息技术股份有限公司 | Configuration method and system for converged service model in telecommunication industry |
| CN116383537A (en) * | 2023-05-23 | 2023-07-04 | 飞狐信息技术（天津）有限公司 | Page data preloading method, device, equipment and storage medium |
| CN116383537B (en) * | 2023-05-23 | 2023-09-08 | 飞狐信息技术（天津）有限公司 | Page data preloading method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104809597B (en) | 2018-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104809597A (en) | Data resource management platform based on data fusion | |
| CN101821710B (en) | System, method and graphical user interface for workflow generation, deployment and/or execution | |
| CN105893593B (en) | A kind of method of data fusion | |
| CN112687097A (en) | Highway highway section level data center platform system | |
| CN108492028A (en) | Demand data standardized method and standardized system | |
| CN105159951A (en) | Open tourism multi-source heterogeneous data fusion method and system | |
| CN110007913A (en) | Visual flow chart of data processing setting method, device, equipment and storage medium | |
| US20120143831A1 (en) | Automatic conversion of multidimentional schema entities | |
| CN101821709A (en) | System, method and graphical user interface for workflow generation, deployment and/or execution | |
| TW201205320A (en) | Optimizing data cache when applying user-based security | |
| CN104715047A (en) | Social network data acquisition and analysis system | |
| CN109784643A (en) | A kind of double random administration system and methods, information data processing terminal | |
| CN113741883B (en) | RPA lightweight data middling station system | |
| CN104766240A (en) | Electronic banking data processing system and method | |
| CN113919680A (en) | Method for constructing management information system based on general tasks | |
| CN104504527A (en) | Client-based intellectual property management system | |
| CN115567563B (en) | Comprehensive transportation hub monitoring and early warning system based on end edge cloud and control method thereof | |
| CN112328667A (en) | Shale gas field ground engineering digital handover method based on data blooding margin | |
| CN105245519A (en) | Construction machinery industry intellectual property service platform and platform structure | |
| Qiao et al. | Constructing a data warehouse based decision support platform for China tourism industry | |
| CN103488693A (en) | Data processing device and data processing method | |
| CN112819423A (en) | Enterprise information management system based on big data | |
| Kim et al. | Apache storm configuration platform for dynamic sampling and filtering of data streams | |
| CN101546397A (en) | Method for extracting outgoing characteristics of urban residents | |
| CN1617146A (en) | Deparatment personal work attendance checking system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |