CN116340287A - Data warehouse visual modeling system and method based on communication operator management information data - Google Patents
Data warehouse visual modeling system and method based on communication operator management information data Download PDFInfo
- Publication number
- CN116340287A CN116340287A CN202310182529.9A CN202310182529A CN116340287A CN 116340287 A CN116340287 A CN 116340287A CN 202310182529 A CN202310182529 A CN 202310182529A CN 116340287 A CN116340287 A CN 116340287A
- Authority
- CN
- China
- Prior art keywords
- data
- model
- module
- data warehouse
- logic model
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 41
- 230000000007 visual effect Effects 0.000 title claims abstract description 38
- 238000000034 method Methods 0.000 title claims abstract description 12
- 238000013461 design Methods 0.000 claims abstract description 48
- 238000007726 management method Methods 0.000 claims description 104
- 238000012800 visualization Methods 0.000 claims description 17
- 238000010276 construction Methods 0.000 claims description 7
- 238000013499 data model Methods 0.000 claims description 6
- 238000011161 development Methods 0.000 claims description 6
- 238000012360 testing method Methods 0.000 claims description 4
- 238000011084 recovery Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 239000000284 extract Substances 0.000 description 2
- 230000008676 import Effects 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000012550 audit Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000001556 precipitation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/211—Schema design and management
- G06F16/212—Schema design and management with details for data modelling support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/26—Visual data mining; Browsing structured data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/283—Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a data warehouse visual modeling system and method based on communication operator management information data, belongs to the technical field of data warehouse modeling, and aims to solve the technical problem of how to efficiently and normally realize data warehouse modeling. Comprising the following steps: the data source configuration module is used for realizing the configuration of the designated data source and comprises the steps of acquiring metadata of the management information data of the communication operator so as to acquire the data source corresponding to the management information data of the communication operator; the topic domain and hierarchical management module is used for establishing a hierarchical relationship of the data warehouse; the logic model design module is interacted with the data source configuration module, the theme domain and the hierarchical management module and is used for constructing a logic model based on the designated hierarchical relationship of the data source and the data warehouse; the physical model management module is interacted with the logic model design module and is used for forming a physical model based on the logic model; and the table management module is used for forming an actual table based on the physical model by taking the physical model as input.
Description
Technical Field
The invention relates to the technical field of data warehouse modeling, in particular to a data warehouse visual modeling system and method based on communication operator management information data.
Background
The data warehouse is a warehouse which adopts computer storage equipment to organize, store and manage data according to the characteristics of data types, structures and the like, can be regarded as a file cabinet of the data from the essence, and can carry out management operations such as adding, intercepting, updating, deleting and the like on the data in the warehouse according to the requirements of users. With the rapid development of society and the arrival of large data age, the requirements of the communication operator industry on the storage, management and analysis of communication operator management information data are higher and higher, and different data warehouses are established according to different types of communication operator management information data, so that the construction of the communication operator management information data warehouses becomes an unavoidable problem of communication operators.
The traffic of the current communication carrier is very complex, the data volume in the management information field is huge, and the data application becomes the main development direction of the carrier gradually, so that the dependence of mass data of management information precipitation is stronger and stronger, and the high-efficiency through data flow plays a decisive role in making a quick and flexible decision for the decision-making department of the communication carrier. The best result can be ensured only by constructing the correct data flow and data structure, so that a set of fluent and efficient data management and data storage modeling system is required to be established.
How to realize data warehouse modeling with high efficiency and normalization is a technical problem to be solved.
Disclosure of Invention
The technical task of the invention is to provide a data warehouse visual modeling system and a method based on communication carrier management information data to solve the technical problem of how to realize data warehouse modeling efficiently and normally.
In a first aspect, the present invention is a data warehouse visualization modeling system based on communication carrier management information data, comprising:
the data source configuration module is used for realizing the configuration of the designated data source and comprises the steps of obtaining metadata of the communication operator management information data so as to obtain the data source corresponding to the communication operator management information data;
the system comprises a theme domain and a hierarchical management module, wherein the theme domain and the hierarchical management module are used for establishing a hierarchical relationship of a data warehouse;
the logic model design module is interacted with the data source configuration module, the theme domain and the hierarchical management module and is used for constructing a logic model based on the designated hierarchical relationship of the data source and the data warehouse;
the physical model management module is interacted with the logic model design module and is used for forming a physical model based on the logic model by taking the logic model as input;
and the table management module is interacted with the physical model management module and is used for taking the physical model as input, forming an actual table based on the physical model and maintaining the data warehouse table through the actual table.
Preferably, the hierarchy of the data warehouse includes a data caching layer, a base data layer, a summary data layer, and an application data layer.
Preferably, the logic model design module is configured to provide a custom visualization model design based on a specified hierarchical relationship of the data source and the data repository, the custom visualization model design being configured to provide the following services:
creating a data warehouse logic model test question and field attributes thereof on a design panel;
deriving a logic model from the logic model design interface, and providing the logic model for a developer to perform data application development;
importing a logical model created by other tools;
preferably, the logic model design module is further configured to provide a reverse build logic model of the data warehouse model based on the specified hierarchical relationship of the data sources and the data warehouses,
the reverse construction logic model of the data warehouse model is expressed as: automatically extracting data warehouse table metadata information from a source data warehouse through the logic model design management module, automatically generating a logic model of the data warehouse table, and supporting manual adjustment of the logic model without manually creating the data warehouse model;
wherein the metadata is an attribute of a data warehouse table.
Preferably, the logic model design module is provided with a visual data modeling tool module, a visual data warehouse modeling tool module and a reverse engineering module,
the visual data modeling tool module is used for transmitting the changed metadata to the visual data warehouse modeling module and transmitting the large-platform data capable of reversely generating the logic model to the reverse engineering module;
the visual data modeling tool module, the visual data warehouse modeling tool module and the reverse engineering module are matched with each other and used for establishing a logic model design management module, so that a logic model function is realized.
Preferably, the physical model management module is used for generating a data warehouse execution script based on the logic model, and creating a physical model by executing the data warehouse execution script;
wherein the metadata of the physical model changes with the corresponding logical model.
Preferably, the table management module is configured to generate an executable data warehouse script based on the physical model, and create an actual table by executing the executable data warehouse script.
In a second aspect, the present invention provides a method for data warehouse visualization modeling based on communication carrier management information data, based on the data warehouse visualization modeling system according to any one of the first aspects, the method comprising the following steps:
the layering rules of the data warehouse are designated according to the service requirements and the metadata conditions, and are transmitted to the logic model design module;
accessing the management information domain data into a data source configuration module to obtain metadata, and transmitting the metadata to a logic model data module;
generating a logic model through a logic model design management module based on layering rules and metadata of the data warehouse layer, and transmitting the logic model to a theme zone and layering management module;
based on the logic model, generating a complete management information data warehouse logic model of each layer of communication operators through a theme domain and a hierarchical management module, and transmitting the complete management information data warehouse logic model of each layer to a physical model management module;
generating a physical model through a physical model management module based on a complete communication operator management data warehouse logic model of each layer, and transmitting the physical model to a table management module;
based on a physical model, realizing automatic synchronous recovery of data of the data table through a table management module;
a data model specifying the data is derived, wherein the data model includes a data structure, data operations, and data constraints.
The data warehouse visual modeling system and method based on the communication carrier management information data have the following advantages:
1. the database modeling platform meeting the requirements can be quickly and efficiently constructed, and the modeling efficiency of the operator management information database and the normalization of data modeling are improved;
2. the visual mode is provided for carrying out the database modeling interface, the complexity involved in the data warehouse modeling is reduced, the functions of creating, modifying and deleting the database model are simplified, and the design efficiency is improved;
3. the entity table reverse generation logic model function is provided, the automatic establishment of association relation between database tables in the logic model, the dynamic check and update of metadata, the record change information and the unified management of the logic model, the physical model and the database tables are realized.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments or the description of the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
The invention is further described below with reference to the accompanying drawings.
Fig. 1 is a block diagram of a data warehouse visualization modeling system based on communication carrier management data according to embodiment 1.
Detailed Description
The invention will be further described with reference to the accompanying drawings and specific examples, so that those skilled in the art can better understand the invention and implement it, but the examples are not meant to limit the invention, and the technical features of the embodiments of the invention and the examples can be combined with each other without conflict.
The embodiment of the invention provides a data warehouse visual modeling system and a data warehouse visual modeling method based on communication operator management information data, which are used for solving the technical problem of how to efficiently and normally realize data warehouse modeling.
Example 1:
the invention discloses a data warehouse visual modeling system based on communication operator management information data, which comprises a data source configuration module, a theme domain and layering management module, a logic model design module, a physical model management module and a table management module.
The data source configuration module is used for realizing the configuration of the designated data source and comprises the step of acquiring metadata of the communication operator management information data so as to acquire the data source corresponding to the communication operator management information data.
The topic domain and the hierarchical management module are used for establishing a hierarchical relationship of the data warehouse.
In this embodiment, each level of the data warehouse includes a data caching layer (STG), a base data layer (ODM), a summary data layer (DW), and an application data layer (ADS).
The logic model design module interacts with the data source configuration module and the topic domain and hierarchical management module for constructing a logic model based on the specified hierarchical relationship of the data source and the data warehouse.
In this embodiment, the logic model design management module may implement custom visualization model design and reverse construction of the database model using the mentioned specified data sources and the mentioned hierarchical relationships of the data warehouse.
The custom visualization model design supports creation of database logical model test questions and their field attributes on the design panel and support export of models from the logical model design interface to the developer for data application development or import of models created through other tools.
The reverse construction logic model of the database model automatically extracts database table metadata information from the source database through the mentioned logic model design management module, automatically generates the logic model of the database table, simultaneously supports manual adjustment, and does not need to manually create the database model, wherein the metadata refers to attributes of the database table.
The logic model design management module further comprises a visual data modeling tool module, a visual database modeling tool module and a reverse engineering module, wherein the visual data modeling tool module is connected with the visual database modeling tool module, and the visual database modeling tool module is connected with the reverse engineering module. The visual data modeling tool module is used for transmitting the change metadata to the visual database modeling module and transmitting the large-platform data capable of reversely generating the logic model to the reverse engineering module.
The logical model design management module is built through the mutual combination among the visual data modeling tool module, the visual database modeling tool module and the reverse engineering module, so that the logical model function is realized.
The physical model management module is interacted with the logic model design module and is used for forming a physical model based on the logic model by taking the logic model as input.
In this embodiment, the physical model management module is configured to generate a data warehouse execution script based on a logical model, and create a physical model by executing the data warehouse execution script; wherein the metadata of the physical model changes with the corresponding logical model.
The table management module is interacted with the physical model management module and is used for taking the physical model as input, forming an actual table based on the physical model and maintaining the data warehouse table through the actual table.
In this embodiment, the table management module is configured to generate an executable data warehouse script based on the physical model, and create an actual table by executing the executable data warehouse script.
Example 2:
the invention relates to a data warehouse visual modeling method based on communication operator management information data, which carries out data warehouse visual modeling based on the system disclosed in the embodiment 1, and comprises the following steps:
s100, designating layering rules of the data warehouse according to service requirements and metadata conditions, and transmitting the layering rules of the data warehouse to a logic model design module;
s200, accessing the management information domain data into a data source configuration module to obtain metadata, and transmitting the metadata to a logic model data module;
s300, generating a logic model through a logic model design management module based on layering rules and metadata of a data warehouse layer, and transmitting the logic model to a theme zone and layering management module;
s400, generating a complete management information data warehouse logic model of each layer of communication operators through a theme domain and a hierarchical management module based on the logic model, and transmitting the complete management information data warehouse logic model of each layer to a physical model management module;
s500, generating a physical model through a physical model management module based on a communication operator management data warehouse logic model with complete layers, and transmitting the physical model to a table management module;
s600, realizing automatic synchronous recovery of data of the data table through a table management module based on a physical model;
s700, a data model of the specified data is exported, wherein the data model comprises a data structure, data operation and data constraint.
In this embodiment, each level of the data warehouse includes a data caching layer (STG), a base data layer (ODM), a summary data layer (DW), and an application data layer (ADS).
The reverse construction of the logic model is realized by a logic model design management module based on the specified data source and the mentioned data warehouse hierarchical relationship to realize the custom visual model design and the database model.
The custom visualization model design supports creation of database logical model test questions and their field attributes on the design panel and support export of models from the logical model design interface to the developer for data application development or import of models created through other tools.
The reverse construction logic model of the database model automatically extracts database table metadata information from the source database through the mentioned logic model design management module, automatically generates the logic model of the database table, simultaneously supports manual adjustment, and does not need to manually create the database model, wherein the metadata refers to attributes of the database table.
Generating a data warehouse execution script through a physical model management module based on a logic model, and creating a physical model through executing the data warehouse execution script; wherein the metadata of the physical model changes with the corresponding logical model.
And generating an executable data warehouse script through a table management module based on the physical model, and creating an actual table through executing the executable data warehouse script.
While the invention has been illustrated and described in detail in the drawings and in the preferred embodiments, the invention is not limited to the disclosed embodiments, and it will be appreciated by those skilled in the art that the code audits of the various embodiments described above may be combined to produce further embodiments of the invention, which are also within the scope of the invention.
Claims (8)
1. A data warehouse visualization modeling system based on communication carrier management information data, comprising:
the data source configuration module is used for realizing the configuration of the designated data source and comprises the steps of obtaining metadata of the communication operator management information data so as to obtain the data source corresponding to the communication operator management information data;
the system comprises a theme domain and a hierarchical management module, wherein the theme domain and the hierarchical management module are used for establishing a hierarchical relationship of a data warehouse;
the logic model design module is interacted with the data source configuration module, the theme domain and the hierarchical management module and is used for constructing a logic model based on the designated hierarchical relationship of the data source and the data warehouse;
the physical model management module is interacted with the logic model design module and is used for forming a physical model based on the logic model by taking the logic model as input;
and the table management module is interacted with the physical model management module and is used for taking the physical model as input, forming an actual table based on the physical model and maintaining the data warehouse table through the actual table.
2. The communication carrier management data based data warehouse visualization modeling system of claim 1, wherein the hierarchy of data warehouse comprises a data caching layer, a base data layer, a summary data layer, and an application data layer.
3. The data warehouse visualization modeling system based on communication carrier management data of claim 1, wherein the logic model design module is configured to provide a custom visualization model design based on a specified hierarchical relationship of data sources and data warehouses, the custom visualization model design being configured to provide the following services:
creating a data warehouse logic model test question and field attributes thereof on a design panel;
deriving a logic model from the logic model design interface, and providing the logic model for a developer to perform data application development;
the logical model created by the other tool is imported.
4. The data warehouse visualization modeling system based on communication carrier management data of claim 3, wherein the logic model design module is further configured to provide a reverse build logic model of the data warehouse model based on the specified hierarchical relationship of the data sources and the data warehouses,
the reverse construction logic model of the data warehouse model is expressed as: automatically extracting data warehouse table metadata information from a source data warehouse through the logic model design management module, automatically generating a logic model of the data warehouse table, and supporting manual adjustment of the logic model without manually creating the data warehouse model;
wherein the metadata is an attribute of a data warehouse table.
5. The visual modeling system of data warehouse based on communication carrier management information data as claimed in claim 4, wherein the logic model design module is configured with a visual data modeling tool module, a visual data warehouse modeling tool module and a reverse engineering module,
the visual data modeling tool module is used for transmitting the changed metadata to the visual data warehouse modeling module and transmitting the large-platform data capable of reversely generating the logic model to the reverse engineering module;
the visual data modeling tool module, the visual data warehouse modeling tool module and the reverse engineering module are matched with each other and used for establishing a logic model design management module, so that a logic model function is realized.
6. The data warehouse visualization modeling system based on communication carrier management data as claimed in any of claims 1-5, wherein the physical model management module is configured to generate a data warehouse execution script based on a logical model, and create a physical model by executing the data warehouse execution script;
wherein the metadata of the physical model changes with the corresponding logical model.
7. The communication carrier management data based data warehouse visualization modeling system of any of claims 1-5, wherein the table management module is configured to generate an executable data warehouse script based on the physical model, and create an actual table by executing the executable data warehouse script.
8. A data warehouse visual modeling method based on communication carrier management information data, which is characterized in that the data warehouse visual modeling method is based on the data warehouse visual modeling system as claimed in any one of claims 1-7, and comprises the following steps:
the layering rules of the data warehouse are designated according to the service requirements and the metadata conditions, and are transmitted to the logic model design module;
accessing the management information domain data into a data source configuration module to obtain metadata, and transmitting the metadata to a logic model data module;
generating a logic model through a logic model design management module based on layering rules and metadata of the data warehouse layer, and transmitting the logic model to a theme zone and layering management module;
based on the logic model, generating a complete management information data warehouse logic model of each layer of communication operators through a theme domain and a hierarchical management module, and transmitting the complete management information data warehouse logic model of each layer to a physical model management module;
generating a physical model through a physical model management module based on a complete communication operator management data warehouse logic model of each layer, and transmitting the physical model to a table management module;
based on a physical model, realizing automatic synchronous recovery of data of the data table through a table management module;
a data model specifying the data is derived, wherein the data model includes a data structure, data operations, and data constraints.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310182529.9A CN116340287A (en) | 2023-03-01 | 2023-03-01 | Data warehouse visual modeling system and method based on communication operator management information data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310182529.9A CN116340287A (en) | 2023-03-01 | 2023-03-01 | Data warehouse visual modeling system and method based on communication operator management information data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116340287A true CN116340287A (en) | 2023-06-27 |
Family
ID=86881484
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310182529.9A Pending CN116340287A (en) | 2023-03-01 | 2023-03-01 | Data warehouse visual modeling system and method based on communication operator management information data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116340287A (en) |
-
2023
- 2023-03-01 CN CN202310182529.9A patent/CN116340287A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104966239A (en) | Intelligent underwriting platform based on rule engine | |
| CN103049251B (en) | A kind of data base persistence layer device and database operation method | |
| CN105930344B (en) | A kind of database application system quick development platform based on product development process | |
| CN111666355B (en) | Model construction method and device for field, data and scene three-layer model | |
| CN112966118A (en) | Operation and maintenance knowledge map construction method | |
| CN104216845A (en) | Process-oriented complex product final assembly data information transmitting method | |
| Alzraiee | Cost estimate system using structured query language in BIM | |
| CN105243237A (en) | Assembly technology structure tree and building method thereof | |
| CN111177227B (en) | Power data self-service analysis system and decision application migration method | |
| CN113254543A (en) | Digital-analog separation system and method based on BIM model | |
| CN114461600A (en) | Engineering project data multidimensional multiplexing method based on BIM and component identity label | |
| CN113486418B (en) | BIM model cloud coding method and system | |
| CN114327458A (en) | Method and system for quickly building enterprise informatization system | |
| CN114168117A (en) | Credit low-code development tool based on designer and storage device | |
| CN111784192A (en) | Industrial park emergency plan executable system based on dynamic evolution | |
| CN111831696A (en) | Asset information storage method and system based on graph theory | |
| CN116340287A (en) | Data warehouse visual modeling system and method based on communication operator management information data | |
| CN115884235A (en) | 5G network digital twin modeling method and device, computer equipment and storage medium | |
| US20070153706A1 (en) | Design time support for service adaptation | |
| CN115858810A (en) | Method, system, computer device and storage medium for automatically constructing knowledge graph | |
| CN116029648A (en) | Relationship modeling management method, device and system based on product BOM structure | |
| CN114612056A (en) | Unified report service method and device based on data middlebox and electronic equipment | |
| CN114281797A (en) | Method for quickly creating basic level data aggregation warehouse based on agile low-code platform | |
| CN110221827A (en) | Data processing method and relevant apparatus | |
| CN117850764B (en) | Design modeling method and device based on integrated model driving architecture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |