CA3152835A1 - Dimension data processing method and apparatus, computer device, and storage medium - Google Patents

Dimension data processing method and apparatus, computer device, and storage medium Download PDF

Info

Publication number
CA3152835A1
CA3152835A1 CA3152835A CA3152835A CA3152835A1 CA 3152835 A1 CA3152835 A1 CA 3152835A1 CA 3152835 A CA3152835 A CA 3152835A CA 3152835 A CA3152835 A CA 3152835A CA 3152835 A1 CA3152835 A1 CA 3152835A1
Authority
CA
Canada
Prior art keywords
data
dimension
target
dimension table
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3152835A
Other languages
French (fr)
Inventor
Fuping Wang
Xiaoqing ZHAI
Sheng Yang
Naishuai CHEN
Qian Sun
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
10353744 Canada Ltd
Original Assignee
10353744 Canada Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 10353744 Canada Ltd filed Critical 10353744 Canada Ltd
Publication of CA3152835A1 publication Critical patent/CA3152835A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28Databases characterised by their database models, e.g. relational or object models
    • G06F16/283Multi-dimensional databases or data warehouses, e.g. MOLAP or ROLAP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present application relates to a dimension data processing method and apparatus, a computer device, and a storage medium. The method comprises: acquiring a target dimension table of a data warehouse; configuring, according to preset dimension attribute information, a dimension parameter of the target dimension table so as to obtain first dimension data; configuring, according to preset dimension table attribute information, a data table parameter of the target dimension table so as to obtain second dimension data; and configuring, according to the first dimension data and the second dimension data of the target dimension table, data services corresponding to the target dimension table, wherein the data services comprise a first data service created according to the first dimension data and a second data service created according to the second dimension data. The method can be used to perform data management and data processing on dimension data of data warehouses.

Description

DIMENSION DATA PROCESSING METHOD AND APPARATUS, COMPUTER
DEVICE, AND STORAGE MEDIUM
BACKGROUND OF THE INVENTION
Technical Field [0001] The present application relates to the field of data warehouse technology, and more particularly to a method of and a device for processing dimension data, a computer equipment and a storage medium.
Description of Related Art
[0002] The data center station is a data platform for collecting, calculating, storing and processing colossal quantities of data through data technology. With the daily increasing popularization of the data center station, it is an essential construction target of the data center to construct the data center station. The basis of a data center station is the data warehouse, while dimension data is the most important basic data of the data warehouse, so how to define and manage dimension data of the data warehouse is an important constituent in well constructing the data warehouse. There lacks effective management of dimension data of the data warehouse in the currently available data managing systems of data warehouses, whereby is made relatively low the efficiency in the data processing process when a data warehouse is utilized to construct a data center station.
SUMMARY OF THE INVENTION
[0003] In view of the above technical problems, there is an urgent need to provide a method of and a device for processing dimension data, a computer equipment and a storage medium capable of data-managing and data-processing the dimension data of a data warehouse.
[0004] There is provided a method of processing dimension data of a data warehouse, and the method comprises:

Date Recue/Date Received 2022-02-28
[0005] obtaining a target dimension table of a data warehouse;
[0006] setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data;
[0007] setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data; and
[0008] setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
[0009] In one of the embodiments, the step of setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data includes:
[0010] defining dimension parameters of the target dimension table according to preset dimension attribute information, mapping the dimension parameters with field data in the target dimension table, and taking the data to which the mapped dimension parameters correspond as the first dimension data.
[0011] In one of the embodiments, the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes:
[0012] setting, according to the first dimension data of the target dimension table, the first data service, which is to enquire field data in the target dimension table on the basis of the dimension parameters.
[0013] In one of the embodiments, the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes:
[0014] setting, according to the second dimension data of the target dimension table, the second Date Recue/Date Received 2022-02-28 data service, which is to enquire data in the target dimension table on the basis of the datasheet parameters.
[0015] In one of the embodiments, the method further comprises:
[0016] setting field parameters of the target dimension table according to preset dimension table field attribute information, and obtaining third dimension data; wherein
[0017] the data service to which the target dimension table corresponds includes a third data service, and the third data service is a data service that is set according to the third dimension data and that is to enquire corresponding field data in the target dimension table on the basis of the field parameters.
[0018] In one of the embodiments, the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes:
[0019] setting a data connection service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table; wherein
[0020] the data connection service is employed to perform data connection on data in the target dimension table with other data outside the target dimension table by invoking an association method according to the first dimension data and/or the second dimension data.
[0021] In one of the embodiments, the method further comprises:
[0022] invoking a preset detecting task to perform quality monitor on the data in the target dimension table according to a preset monitoring rule.
[0023] There is provided a device for processing dimension data of a data warehouse, and the device comprises:
[0024] an obtaining module, for obtaining a target dimension table of a data warehouse;

Date Recue/Date Received 2022-02-28
[0025] a first setting module, for setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data;
[0026] a second setting module, for setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data; and
[0027] a data service setting module, for setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
[0028] There is provided a computer equipment comprising a memory, a processor and a computer program stored on the memory and operable on the processor, and the method steps according to any of the aforementioned embodiments are realized when the processor executes the computer program.
[0029] There is provided a computer-readable storage medium storing a computer program thereon, and the method steps according to any of the aforementioned embodiments are realized when the computer program is executed by a processor.
[0030] In the aforementioned method of and device for processing dimension data, computer equipment and storage medium, dimension parameters of the target dimension table are set according to preset dimension attribute information, and first dimension data is obtained, so that data dimensions of the target dimension table are uniformly administered.
Further, datasheet parameters of the target dimension table are set according to preset dimension table attribute information, and second dimension data is obtained, so that table dimensions of the target dimension table are uniformly administered.
Moreover, a data service to which the target dimension table corresponds is set according to the first dimension data and the second dimension data of the target dimension table, so as to Date Recue/Date Received 2022-02-28 realize feeding back of the data service of the first dimension data and the second dimension data in the target dimension table according to a data service request.
Accordingly, data administration and data processing of dimension data of the data warehouse are achieved.
BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Fig. 1 is a view illustrating an application environment for a method of processing dimension data of a data warehouse in an embodiment;
[0032] Fig. 2 is a flowchart schematically illustrating a method of processing dimension data of a data warehouse in an embodiment;
[0033] Fig. 3 is a view schematically illustrating a dimension information display page of preset dimension attribute information in an embodiment;
[0034] Fig. 4 is a view schematically illustrating a dimension table information display page of preset dimension table attribute information in an embodiment;
[0035] Fig. 5 is a view schematically illustrating a dimension value information display page of preset dimension table field attribute information in an embodiment;
[0036] Fig. 6 is a block diagram illustrating the structure of a device for processing dimension data of a data warehouse in an embodiment; and
[0037] Fig. 7 is a view illustrating the internal structure of a computer equipment in an embodiment.
DETAILED DESCRIPTION OF THE INVENTION
[0038] To make more lucid and clear the objectives, technical solutions and advantages of the present application, the present application is described in greater detail below with reference to accompanying drawings and embodiments. As should be understood, the specific embodiments as described here are merely meant to explain the present application, rather than to restrict the present application.
Date Recue/Date Received 2022-02-28
[0039] The method of processing dimension data of a data warehouse provided by the present application is applicable to the application environment as shown in Fig. 1, in which data source terminal 20 communicates with database equipment 10 through network 30.
There can be plural data source terminals 20 to upload various types of data to database equipment 10. Data source terminal 20 can be, but is not limited to be, any of a personal computer, a notebook computer, a smart mobile phone, a panel computer, and a portable wearable device. Database equipment 10 is internally equipped with a data warehouse for storing various types of data uploaded by data source terminal 20. The data warehouse contains dimension tables. The dimension tables are employed for storing different types of data. Database equipment 10 can be embodied as an independent data administration server or a data administration server cluster consisting of a plurality of data administration servers for storing and administering data uploaded by data source terminal(s) 20. In addition, data administration equipment 40 communicates with database equipment 10 through network for sending data processing instructions to database equipment 10, to instruct database equipment 10 to correspondingly data-process the data inside the data warehouse.
[0040] In one embodiment, as shown in Fig. 2, a method of processing dimension data of a data warehouse is provided, and the method is explained with an example of its being applied to data warehouse 10 in Fig. 1, to comprise the following steps.
[0041] S100 - obtaining a target dimension table of a data warehouse.
[0042] The data warehouse stores therein a plurality of dimension tables for storing various types of data. The dimension tables are set by technical personnel according to user requirements. However, various dimensions and parameter information to which the various dimensions correspond are not definitely defined in the plural dimension tables.
The data administration server also does not have standard dimension administration for the dimension tables of the data warehouse. Accordingly, utilization of data in the data Date Recue/Date Received 2022-02-28 warehouse cannot cover dimension data service requirements under various scenarios. In this embodiment, the data administration server obtains a target dimension table of the data warehouse. Specifically, each dimension table has identification information, such as dimension table name, dimension table number, etc. The data administration server obtains the target dimension table through the identification information.
[0043] S200 - setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data.
[0044] In this embodiment, the data administration server stores plural types of preset dimension attribute information. The preset dimension attribute information is employed to set dimensions for the dimension tables in the data warehouse. The data administration server bases on the characteristics of the target dimension table to obtain the corresponding preset dimension attribute information from plural types of preset dimension attribute information, and bases on this preset dimension attribute information to set dimension parameters of the target dimension table, so as to obtain the first dimension data. As shown in Fig. 3, the preset dimension attribute information can include dimension name information, dimension description information, business field information to which the data recorded in the dimensions pertains, and dimension type information, etc.
Different dimension tables have different preset dimension attribute information according to different characteristics of the dimension tables. Dimension parameters of the target dimension table are set according to the corresponding preset dimension attribute information to determine numerical values of the dimension parameters of the target dimension table, so as to perform unified administration on the data dimensions of the target dimension table according to the preset dimension attribute information.
[0045] In one embodiment, step S200 includes: defining dimension parameters of the target dimension table according to preset dimension attribute information, mapping the dimension parameters with field data in the target dimension table, and taking the data to Date Recue/Date Received 2022-02-28 which the mapped dimension parameters correspond as the first dimension data.
[0046] Specifically, the data administration server defines dimension parameters of the target dimension table according to the preset dimension attribute information. As shown in Fig.
3, there are such parameters as dimension value number, dimension value name, dimension value order, dimension value validation time, and dimension value invalidation time, etc. Moreover, the dimension parameters are mapped with field data in the target dimension table, and the corresponding field data in the target dimension table is taken as the first dimension data. Accordingly, it is made possible to further combine dimensions with data in the target dimension table to administer the dimension data.
[0047] In one mode of execution of this embodiment, the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes: setting, according to the first dimension data of the target dimension table, the first data service, which is to enquire field data in the target dimension table on the basis of the dimension parameters.
[0048] Specifically, the data administration server maps the dimension parameters with field data in the target dimension table, and takes the data to which the mapped dimension parameters correspond as the first dimension data. At this time, the first data service is a data service that bases on the dimension parameters to enquire field data in the target dimension table, whereby is made possible to enquire field data in the target dimension table according to the dimension parameters. See Fig. 3 for details.
Accordingly, the efficiency in data-processing dimension data of a data warehouse can be enhanced.
[0049] In one embodiment, the method of processing dimension data of a data warehouse further comprises: setting dimension related characteristics of the target dimension table according to preset dimension attribute information, and obtaining dimension characteristics data, wherein the first dimension data includes dimension characteristics Date Recue/Date Received 2022-02-28 data.
[0050] Specifically, the data administration server not only sets dimension parameters of the target dimension table according to preset dimension attribute information, but also sets dimension related characteristics of the target dimension table according to the preset dimension attribute information, assigns the data obtained after setting of the two to the first dimension data, and hence creates the first data service according to the first dimension data. Accordingly, administration of dimension data of the target dimension table is made more standard, and data processing efficiency is thereby enhanced during the process of using the dimension data of the target dimension table to perform the first data service. The dimension related characteristics of the target dimension table include a date dimension. Setting the dimension related characteristics of the target dimension table according to preset dimension attribute information includes setting a time format of the date dimension and granularity of the date dimension.
[0051] S300 - setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data.
[0052] In this embodiment, the data administration server stores plural types of preset dimension table attribute information. The preset dimension table attribute information is employed to set datasheet parameters for the dimension tables in the data warehouse.
The data administration server bases on the characteristics of the target dimension table to obtain the corresponding preset dimension table attribute information from plural types of preset dimension table attribute information, and bases on this preset dimension table attribute information to set datasheet parameters of the target dimension table, so as to obtain the second dimension data. As shown in Fig. 4, the preset dimension table attribute information can include name of the datasheet and configuration type of the datasheet, etc. The configuration type of the datasheet includes manual configuration and non-manual configuration. Datasheet parameters of the target dimension table are set Date Recue/Date Received 2022-02-28 according to the corresponding preset dimension table attribute information to determine numerical values of the datasheet parameters of the target dimension table, so as to perform unified administration on the data dimensions of the target dimension table according to the preset dimension table attribute information.
[0053] S400 - setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
[0054] In this embodiment, after having completed the setting of the dimension parameters and datasheet parameters of the target dimension table, the data administration server further sets the data service to which the target dimension table corresponds. The data service is employed to invoke data in the target dimension table according to a received data service request to realize feeding back of corresponding data service. Generally, the data service is determined on the basis of business requirements. The data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data. That is to say, with respect to the dimension parameters set according to the preset dimension attribute information, and with respect to the datasheet parameters set according to the preset dimension table attribute information, the data administration server bases on the two respectively to create different data services. Accordingly, the data administration server not only performs dimension administration on the target dimension table, but also performs corresponding data processing on the dimension data after dimension administration, so that administration of dimension data of the target dimension table of the data warehouse is made more standard, thus facilitating to enhance the efficiency in data processing of the data warehouse.
[0055] In one embodiment, step S400 includes: setting, according to the second dimension data Date Recue/Date Received 2022-02-28 of the target dimension table, the second data service, which is to enquire data in the target dimension table on the basis of the datasheet parameters.
[0056] In this embodiment, the second data service can enquire data in the target dimension table according to the datasheet parameters. For instance, it can participate in the table structure data according to the datasheet name in the datasheet parameters. Accordingly, the efficiency in processing dimension data of the target dimension table can be enhanced.
[0057] In a specific mode of execution, data services to which the target dimension table corresponds as set by the data administration server includes:
[0058] Data service 1: dimension information service, specifically, enquiring dimension information according to dimension numbers;
[0059] Data service 2: dimension table information service, specifically, enquiring dimension table information services according to datasheet names of the data warehouse;
[0060] Data service 3: services of conversion between dimension value numbers and dimension value names, as shown below:
[0061] weater tone dinienion I ¨ =-calor tone dimension: 021. ShanOlai C,
[0062] Data service 4: dimension value searching services, as shown below:
[0063] reater tone dimension: search in, kev \Nords: - .. calor tone dimension: 10 IL njing, 0771 Nanning
[0064] In the aforementioned method of processing dimension data, dimension parameters of the target dimension table are set according to preset dimension attribute information, and first dimension data is obtained, so that data dimensions of the target dimension table are uniformly administered. Further, datasheet parameters of the target dimension table are set according to preset dimension table attribute information, and second dimension data is obtained, so that table dimensions of the target dimension table are unifolinly administered. Moreover, a data service to which the target dimension table corresponds is set according to the first dimension data and the second dimension data of the target Date Recue/Date Received 2022-02-28 dimension table, so as to realize feeding back of the data service of the first dimension data and the second dimension data in the target dimension table according to a data service request. Accordingly, data administration and data processing of dimension data of the data warehouse are achieved.
[0065] In one embodiment, the method of processing dimension data further includes: setting field parameters of the target dimension table according to preset dimension table field attribute information, and obtaining third dimension data. At this time, the data service to which the target dimension table corresponds includes a third data service, and the third data service is a data service that is set according to the third dimension data and that is to enquire corresponding field data in the target dimension table on the basis of the field parameters.
[0066] In this embodiment, the data administration server not only correspondingly sets dimension parameters and datasheet parameters of the target dimension table, but also sets field parameters of the target dimension table according to preset dimension table field attribute information, and simultaneously sets the third data service that bases on the field parameters to enquire corresponding field data in the target dimension table according to the third dimension data. See Fig. 5 for specifics. Accordingly, the efficiency in processing dimension data of the target dimension table can be enhanced.
[0067] In one embodiment, step S400 includes: setting a data connection service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table. The data connection service is employed to perform data connection on data in the target dimension table with other data outside the target dimension table by invoking an association method according to the first dimension data and/or the second dimension data.
[0068] Specifically, the data connection service is realized by a join servicing plug-in component Date Recue/Date Received 2022-02-28 of a real-time dimension table. The plug-in component is supplied in the form of jar (Java archive file), and supports the mainstream real-time processing framework.
Relevant data is transmitted by invoking an association method according to the first dimension data and/or the second dimension data. For instance, corresponding dimension table names, dimension codes and dimension value codes are transmitted according to dimension table names, dimension codes and dimension value codes, table data information is obtained in real time, and real-time join operation is performed.
[0069] In one embodiment, the method of processing dimension data further comprises:
collecting dimension data from the target dimension table as set, and storing the dimension data in a unified database. In this case, step S400 includes:
setting the data service according to the dimension data in the unified database.
[0070] Specifically, after having set the dimension parameters and the datasheet parameters of the target dimension table, the data administration server automatically generates a spark task, makes use of the spark task to collect dimension table data, and stores the data in an Hbase database and an Es database. The Hbase database and the Es database are data-storing databases in the unified database. Finally, the data service is set according to the unified database. Accordingly, it is made possible to perform unified administration on the data in the data warehouse.
[0071] In one embodiment, the method of processing dimension data further comprises: invoking a preset detecting task to perform quality monitor on the data in the target dimension table according to a preset monitoring rule.
[0072] Specifically, the data administration server performs data quality monitor on the data in the target dimension table. The monitoring mode is to configure a preset monitoring rule, generate a corresponding preset detecting task, and perform quality monitor on the data in the target dimension table by scheduling the preset detecting task. If a quality problem Date Recue/Date Received 2022-02-28 occurs to the data in the target dimension table, alarming information is sent to an alarming center. On receiving the alarming information, the alarming center forwards the alarming information to the person in charge. Accordingly, it is made possible to perform quality monitor on the data of the target dimension table in the data warehouse, and to enhance administration quality of data in the data warehouse.
[0073] As should be understood, although the various steps in the flowcharts are sequentially displayed as indicated by arrows, these steps are not necessarily executed in the sequences indicated by arrows. Unless otherwise explicitly noted in this paper, execution of these steps is not restricted by any sequence, as these steps can also be executed in other sequences (than those indicated in the drawings). Moreover, at least partial steps in the accompanying drawings may include plural sub-steps or multi-phases, these sub-steps or phases are not necessarily completed at the same timing, but can be executed at different timings, and these sub-steps or phases are also not necessarily sequentially performed, but can be performed in turns or alternately with other steps or with at least some of sub-steps or phases of other steps.
[0074] In one embodiment, as shown in Fig. 6, there is provided a device for processing dimension data of a data warehouse, and the device comprises an obtaining module 100, a first setting module 200, a second setting module 300 and a data service setting module 400, of which:
[0075] the obtaining module 100 is employed for obtaining a target dimension table of a data warehouse;
[0076] the first setting module 200 is employed for setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data;
[0077] the second setting module 300 is employed for setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data; and Date Recue/Date Received 2022-02-28
[0078] the data service setting module 400 is employed for setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
[0079] In one of the embodiments, the first setting module 200 can include (not shown in Fig.
6):
[0080] a first setting unit, for defining dimension parameters of the target dimension table according to preset dimension attribute information, mapping the dimension parameters with field data in the target dimension table, and taking the data to which the mapped dimension parameters correspond as the first dimension data.
[0081] At this time, the data service setting module 400 can include:
[0082] a first data servicing unit, for setting, according to the first dimension data of the target dimension table, the first data service, which is to enquire field data in the target dimension table on the basis of the dimension parameters.
[0083] In one of the embodiments, the data service setting module 400 can include (not shown in Fig. 6):
[0084] a second data servicing unit, for setting, according to the second dimension data of the target dimension table, the second data service, which is to enquire data in the target dimension table on the basis of the datasheet parameters.
[0085] In one of the embodiments, the device for processing dimension data of a data warehouse further comprises (not shown in Fig. 6):
[0086] a third setting module, for setting field parameters of the target dimension table according to preset dimension table field attribute information, and obtaining third dimension data;
and Date Recue/Date Received 2022-02-28
[0087] a third data servicing unit, for setting a data service to which the target dimension table corresponds according to the first dimension data, the second dimension data and the third dimension data of the target dimension table, wherein the data service includes a third data service that is set according to the third dimension data and that is to enquire corresponding field data in the target dimension table on the basis of the field parameters.
[0088] In one of the embodiments, the data service setting module 400 can include (not shown in Fig. 6):
[0089] a fourth data servicing unit, for setting a data connection service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table; wherein the data connection service is employed to perform data connection on data of the target dimension table with other data by invoking an association method according to the first dimension data and/or the second dimension data.
[0090] In one of the embodiments, the device for processing dimension data of a data warehouse further comprises (not shown in Fig. 6):
[0091] a monitoring module, for invoking a preset detecting task to perform quality monitor on the data in the target dimension table according to a preset monitoring rule.
[0092] Specific definitions relevant to the device for processing dimension data of a data warehouse may be inferred from the aforementioned definitions to the method of processing dimension data of a data warehouse, while no repetition is made in this context.
The various modules in the aforementioned device for processing dimension data of a data warehouse can be wholly or partly realized via software, hardware, and a combination of software with hardware. The various modules can be embedded in the form of hardware in a processor in a computer equipment or independent of any computer equipment, and can also be stored in the form of software in a memory in a computer equipment, so as to facilitate the processor to invoke and perform operations Date Recue/Date Received 2022-02-28 corresponding to the aforementioned various modules.
[0093] In one embodiment, a computer equipment is provided, the computer equipment can be a data administration server, and its internal structure can be as shown in Fig. 7. The computer equipment comprises a processor, a memory, a network interface and a database connected to each other via a system bus. The processor of the computer equipment is employed to provide computing and controlling capabilities. The memory of the computer equipment includes a nonvolatile storage medium, and an internal memory. The nonvolatile storage medium stores therein an operating system, a computer program and a database. The internal memory provides environment for the running of the operating system and the computer program in the nonvolatile storage medium. The network interface of the computer equipment is employed to connect to an external data source terminal via network for communication, so as to receive data uploaded by the data source terminal. The computer program realizes a method of processing dimension data of a data warehouse when it is executed by a processor.
[0094] As understandable to persons skilled in the art, the structure illustrated in Fig. 7 is merely a block diagram of partial structure relevant to the solution of the present application, and does not constitute any restriction to the computer equipment on which the solution of the present application is applied, as the specific computer equipment may comprise component parts that are more than or less than those illustrated in Fig. 7, or may combine certain component parts, or may have different layout of component parts.
[0095] In one embodiment, there is provided a computer equipment that comprises a memory, a processor and a computer program stored on the memory and operable on the processor, and the following steps are realized when the processor executes the computer program:
[0096] obtaining a target dimension table of a data warehouse; setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data; setting datasheet parameters of the target dimension table Date Recue/Date Received 2022-02-28 according to preset dimension table attribute information, and obtaining second dimension data; and setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
[0097] In one embodiment, when the processor executes the computer program to realize the step of setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data, the following steps are further realized:
[0098] defining dimension parameters of the target dimension table according to preset dimension attribute information, mapping the dimension parameters with field data in the target dimension table, and taking the data to which the mapped dimension parameters correspond as the first dimension data.
[0099] In one embodiment, when the processor executes the computer program to realize the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, the following step is further realized:
[0100] setting, according to the first dimension data of the target dimension table, the first data service, which is to enquire field data in the target dimension table on the basis of the dimension parameters.
[0101] In one embodiment, when the processor executes the computer program to realize the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, the following step is further realized:
[0102] setting, according to the second dimension data of the target dimension table, the second Date Recue/Date Received 2022-02-28 data service, which is to enquire data in the target dimension table on the basis of the datasheet parameters.
[0103] In one embodiment, when the processor executes the computer program, the following step is further realized:
[0104] setting field parameters of the target dimension table according to preset dimension table field attribute information, and obtaining third dimension data; wherein
[0105] the data service to which the target dimension table corresponds includes a third data service, and the third data service is a data service that is set according to the third dimension data and that is to enquire corresponding field data in the target dimension table on the basis of the field parameters.
[0106] In one embodiment, when the processor executes the computer program to realize the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, the following step is further realized:
[0107] setting a data connection service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table; wherein
[0108] the data connection service is employed to perform data connection on data in the target dimension table with other data outside the target dimension table by invoking an association method according to the first dimension data and/or the second dimension data.
[0109] In one embodiment, when the processor executes the computer program, the following step is further realized:
[0110] invoking a preset detecting task to perform quality monitor on the data in the target dimension table according to a preset monitoring rule.

Date Recue/Date Received 2022-02-28
[0111] In one embodiment, there is provided a computer-readable storage medium storing thereon a computer program, and the method of processing dimension data of a data warehouse according to any of the aforementioned embodiments is realized when the computer program is executed by a processor.
[0112] In one embodiment, there is provided a computer-readable storage medium storing thereon a computer program, and the following steps are realized when the computer program is executed by a processor:
[0113] obtaining a target dimension table of a data warehouse; setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data; setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data; and setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
[0114] In one embodiment, when the computer program is executed by a processor to realize the step of setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data, the following steps are further realized:
[0115] defining dimension parameters of the target dimension table according to preset dimension attribute information, mapping the dimension parameters with field data in the target dimension table, and taking the data to which the mapped dimension parameters correspond as the first dimension data.
[0116] In one embodiment, when the computer program is executed by a processor to realize the step of setting a data service to which the target dimension table corresponds according Date Recue/Date Received 2022-02-28 to the first dimension data and the second dimension data of the target dimension table, the following step is further realized:
[0117] setting, according to the first dimension data of the target dimension table, the first data service, which is to enquire field data in the target dimension table on the basis of the dimension parameters.
[0118] In one embodiment, when the computer program is executed by a processor to realize the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, the following step is further realized:
[0119] setting, according to the second dimension data of the target dimension table, the second data service, which is to enquire data in the target dimension table on the basis of the datasheet parameters.
[0120] In one embodiment, when the computer program is executed by a processor, the following step is further realized:
[0121] setting field parameters of the target dimension table according to preset dimension table field attribute information, and obtaining third dimension data; wherein
[0122] the data service to which the target dimension table corresponds includes a third data service, and the third data service is a data service that is set according to the third dimension data and that is to enquire corresponding field data in the target dimension table on the basis of the field parameters.
[0123] In one embodiment, when the computer program is executed by a processor to realize the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, the following step is further realized:
[0124] setting a data connection service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target Date Recue/Date Received 2022-02-28 dimension table; wherein
[0125] the data connection service is employed to perform data connection on data in the target dimension table with other data outside the target dimension table by invoking an association method according to the first dimension data and/or the second dimension data.
[0126] In one embodiment, when the computer program is executed by a processor, the following step is further realized:
[0127] invoking a preset detecting task to perform quality monitor on the data in the target dimension table according to a preset monitoring rule.
[0128] As comprehensible to persons ordinarily skilled in the art, the entire or partial flows in the methods according to the aforementioned embodiments can be completed via a computer program instructing relevant hardware, the computer program can be stored in a nonvolatile computer-readable storage medium, and the computer program can include the flows as embodied in the aforementioned various methods when executed. Any reference to the memory, storage, database or other media used in the various embodiments provided by the present application can all include nonvolatile and/or volatile memory/memories. The nonvolatile memory can include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable and programmable ROM (EEPROM) or a flash memory. The volatile memory can include a random-access memory (RAM) or an external cache memory. To serve as explanation rather than restriction, the RAM is obtainable in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM
(SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct Rambus dynamic RAM (DRDRAM), and Rambus dynamic RAM
(RDRAM), etc.

Date Recue/Date Received 2022-02-28
[0129] Technical features of the aforementioned embodiments are randomly combinable, while all possible combinations of the technical features in the aforementioned embodiments are not exhausted for the sake of brevity, but all these should be considered to fall within the scope recorded in the Description as long as such combinations of the technical features are not mutually contradictory.
[0130] The foregoing embodiments are merely directed to several modes of execution of the present application, and their descriptions are relatively specific and detailed, but they should not be hence misunderstood as restrictions to the inventive patent scope. As should be pointed out, persons with ordinary skill in the art may further make various modifications and improvements without departing from the conception of the present application, and all these should pertain to the protection scope of the present application.
Accordingly, the patent protection scope of the present application shall be based on the attached Claims.

Date Recue/Date Received 2022-02-28

Claims (10)

What is claimed is:
1. A method of processing dimension data of a data warehouse, characterized in that the method comprises:
obtaining a target dimension table of a data warehouse;
setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data;
setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data; and setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
2. The method according to Claim 1, characterized in that the step of setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data includes:
defining dimension parameters of the target dimension table according to preset dimension attribute information, mapping the dimension parameters with field data in the target dimension table, and taking the data to which the mapped dimension parameters correspond as the first dimension data.
3. The method according to Claim 2, characterized in that the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes:
setting, according to the first dimension data of the target dimension table, the first data service, which is to enquire field data in the target dimension table on the basis of the dimension parameters.
4. The method according to Claim 1, characterized in that the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes:
setting, according to the second dimension data of the target dimension table, the second data service, which is to enquire data in the target dimension table on the basis of the datasheet parameters.
5. The method according to Claim 1, characterized in further comprising:
setting field parameters of the target dimension table according to preset dimension table field attribute information, and obtaining third dimension data; wherein the data service to which the target dimension table corresponds includes a third data service, and the third data service is a data service that is set according to the third dimension data and that is to enquire corresponding field data in the target dimension table on the basis of the field parameters.
6. The method according to Claim 1, characterized in that the step of setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table includes:

setting a data connection service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table; wherein the data connection service is employed to perform data connection on data in the target dimension table with other data outside the target dimension table by invoking an association method according to the first dimension data and/or the second dimension data.
7. The method according to Claim 1, characterized in further comprising:
invoking a preset detecting task to perform quality monitor on the data in the target dimension table according to a preset monitoring rule.
8. A device for processing dimension data of a data warehouse, characterized in that the device comprises:
an obtaining module, for obtaining a target dimension table of a data warehouse;
a first setting module, for setting dimension parameters of the target dimension table according to preset dimension attribute information, and obtaining first dimension data;
a second setting module, for setting datasheet parameters of the target dimension table according to preset dimension table attribute information, and obtaining second dimension data; and a data service setting module, for setting a data service to which the target dimension table corresponds according to the first dimension data and the second dimension data of the target dimension table, wherein the data service includes a first data service created according to the first dimension data and a second data service created according to the second dimension data.
9. A computer equipment, comprising a memory, a processor and a computer program stored on the memory and operable on the processor, characterized in that the method steps according to any of Claims 1 to 7 are realized when the processor executes the computer program.
10. A computer-readable storage medium, storing a computer program thereon, characterized in that the method steps according to any of Claims 1 to 7 are realized when the computer program is executed by a processor.
CA3152835A 2019-08-27 2020-06-24 Dimension data processing method and apparatus, computer device, and storage medium Pending CA3152835A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201910798079.X 2019-08-27
CN201910798079.XA CN110716989A (en) 2019-08-27 2019-08-27 Dimension data processing method and device, computer equipment and storage medium
PCT/CN2020/097835 WO2021036449A1 (en) 2019-08-27 2020-06-24 Dimension data processing method and apparatus, computer device, and storage medium

Publications (1)

Publication Number Publication Date
CA3152835A1 true CA3152835A1 (en) 2021-03-04

Family

ID=69209521

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3152835A Pending CA3152835A1 (en) 2019-08-27 2020-06-24 Dimension data processing method and apparatus, computer device, and storage medium

Country Status (3)

Country Link
CN (1) CN110716989A (en)
CA (1) CA3152835A1 (en)
WO (1) WO2021036449A1 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110716989A (en) * 2019-08-27 2020-01-21 苏宁云计算有限公司 Dimension data processing method and device, computer equipment and storage medium
CN111402066B (en) * 2020-02-22 2023-06-23 中国平安财产保险股份有限公司 Data processing method, server and storage medium
CN112732712A (en) * 2020-12-29 2021-04-30 望海康信(北京)科技股份公司 Chart information data storage method and system, corresponding equipment and storage medium
CN113393190B (en) * 2021-06-10 2023-12-05 北京京东振世信息技术有限公司 Warehouse information processing method and device, electronic equipment and readable medium
CN113449024B (en) * 2021-06-23 2023-02-14 平安普惠企业管理有限公司 Insurance data analysis method, device, equipment and medium based on big data
CN114648316B (en) * 2022-05-18 2022-08-23 国网浙江省电力有限公司 Digital processing method and system based on inspection tag library
CN117150348A (en) * 2023-10-30 2023-12-01 宁德时代新能源科技股份有限公司 Battery external damage data processing method, system, electronic equipment and storage medium

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9652516B1 (en) * 2008-03-07 2017-05-16 Birst, Inc. Constructing reports using metric-attribute combinations
CN104252452B (en) * 2013-06-25 2019-03-15 腾讯科技(深圳)有限公司 The method and device of data management
CN107908631B (en) * 2017-07-25 2021-04-20 平安科技(深圳)有限公司 Data processing method, data processing device, storage medium and computer equipment
CN109561326B (en) * 2017-09-26 2021-02-12 北京国双科技有限公司 Data query method and device
CN110019551B (en) * 2017-12-19 2022-11-01 阿里巴巴集团控股有限公司 Data warehouse construction method and device
CN109614402B (en) * 2018-12-11 2020-09-29 京东数字科技控股有限公司 Multidimensional data query method and device
CN110716989A (en) * 2019-08-27 2020-01-21 苏宁云计算有限公司 Dimension data processing method and device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN110716989A (en) 2020-01-21
WO2021036449A1 (en) 2021-03-04

Similar Documents

Publication Publication Date Title
CA3152835A1 (en) Dimension data processing method and apparatus, computer device, and storage medium
CN111563368B (en) Report generation method, report generation device, computer equipment and storage medium
US8572023B2 (en) Data services framework workflow processing
WO2020232884A1 (en) Data table migration method, apparatus, computer device and storage medium
CN109902224A (en) Source of houses recommended method, device, equipment and medium based on user behavior analysis
WO2019134340A1 (en) Salary calculation method, application server, and computer readable storage medium
CN109408746A (en) Portrait information query method, device, computer equipment and storage medium
CN111061766A (en) Business data processing method and device, computer equipment and storage medium
CN109767098A (en) Processing method, device, computer equipment and the storage medium of product attribute
CN117273429A (en) Event monitoring method, system, electronic equipment and storage medium
CN111538754A (en) Data collection management system, method, device, equipment and storage medium
CN111897843B (en) Configuration method and device of data flow strategy of Internet of things and computer equipment
US9652630B2 (en) Enhanced view compliance tool
CN109840250B (en) Method, device, equipment and storage medium for managing access authority of intermediate field
US20150100888A1 (en) Providing a common interface for accessing and presenting component configuration settings
CN114254278A (en) User account merging method and device, computer equipment and storage medium
CN113467823A (en) Configuration information acquisition method, device, system and storage medium
CN112445811A (en) Data service method, device, storage medium and component based on SQL configuration
WO2020233093A1 (en) Association graph generation method and apparatus, computer device, and storage medium
US8453166B2 (en) Data services framework visibility component
CN110008346A (en) Blacklist conducts map construction method, apparatus, computer equipment and storage medium
CN109684158A (en) Method for monitoring state, device, equipment and the storage medium of distributed coordination system
CN113505389B (en) Data authority management method, electronic device, server and readable storage medium
CN114238292B (en) Data cleaning method, device, computer equipment and computer readable storage medium
CN117271449A (en) Batch file generation method, apparatus, device, storage medium and program product

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228

EEER Examination request

Effective date: 20220228