CN109165238A - It is a kind of for generating the data processing method and device of cyclical indicator data - Google Patents
It is a kind of for generating the data processing method and device of cyclical indicator data Download PDFInfo
- Publication number
- CN109165238A CN109165238A CN201810646630.4A CN201810646630A CN109165238A CN 109165238 A CN109165238 A CN 109165238A CN 201810646630 A CN201810646630 A CN 201810646630A CN 109165238 A CN109165238 A CN 109165238A
- Authority
- CN
- China
- Prior art keywords
- index
- dimension
- data
- cyclical indicator
- cyclical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a kind of for generating the data processing method and device of cyclical indicator data, comprising: receives the application request of cyclical indicator data；Determine that the dimension of applied cyclical indicator data and the index dimensional relationships of index, index dimensional relationships are used to indicate the combination of dimension and index from pre-set index dimensional relationships table；Determine statistical time period and the current date of applied cyclical indicator data；Priority ranking is carried out to applied cyclical indicator according to the statistical time period, generates cyclical indicator table；The dimensional attribute of applied cyclical indicator data is associated with cyclical indicator table, obtains the combination of the dimension, dimensional attribute and index of applied cyclical indicator data；Combination according to applied dimension and index obtains corresponding cyclical indicator data according to the statistical time period from data warehouse, is written to cyclical indicator table.The present invention generates index in such a way that periodic table goes out number, is conducive to the statistics and analysis of cyclical indicator.
Description
Technical field
The present invention relates to technical field of data processing, and in particular to a kind of for generating the data processing of cyclical indicator data
Method and device.
Background technique
Currently, big data analysis is more and more favored, especially artificial intelligence is risen instantly, and big data is that its is important
Support.For some Internet companies, it is provided in particular in the Internet company of platform, it, can to the statistical analysis of its data target
Think that the strategic decision of company provides intelligence basis.
Achievement data stream has the characteristics that acquisition speed is fast, contains much information, the index generation method that data are unstable, traditional
When carrying out data analysis, difference index amount obtained in analytic process of the database from user data uses thousands of items
User data carries out duplicate removal and accumulation calculating.However, this mode can not very good solution period statistical problem.
Summary of the invention
The technical issues of can not solving period statistics the invention solves the prior art, to provide a kind of for generating week
The data processing method and device of phase achievement data.
An aspect of of the present present invention provides a kind of for generating the data processing method of cyclical indicator data, comprising: receives
The application of cyclical indicator data is requested, wherein the application request carries dimension, the dimension of applied cyclical indicator data
Attribute and index；The dimension and index of applied cyclical indicator data are determined from pre-set index dimensional relationships table
Index dimensional relationships, the index dimensional relationships are used to indicate the combination of dimension and index；Determine applied cyclical indicator
The statistical time period of data and current date；Priority is carried out to applied cyclical indicator according to the statistical time period
Sequence generates cyclical indicator table；The dimensional attribute of applied cyclical indicator data and the cyclical indicator table are associated,
Obtain the combination of the dimension, dimensional attribute and index of applied cyclical indicator data；According to applied dimension and index
Combination obtains corresponding cyclical indicator data according to the statistical time period from data warehouse, is written to the cyclical indicator
Table.
Optionally, the combination according to applied dimension and index is obtained from data warehouse according to the statistical time period
Corresponding cyclical indicator data are taken to comprise determining that the corresponding SQL statement of the combination of applied dimension and index；To the SQL
Current date described in input by sentence, the time summarized according to the statistical time period and the current date automatically generated data
Section；The SQL statement determined is executed, from the cyclical indicator data obtained in the period in the data warehouse.
Optionally, the statistical time period includes: day, week and the moon, and the combination according to applied dimension and index is pressed
It includes: that the same SQL statement is sentenced that corresponding cyclical indicator data are obtained from data warehouse according to the statistical time period
Break the statistical time period whether be week or the moon；When the statistical time period is week or the moon, the system is first obtained
Counting the time cycle is all or the moon the cyclical indicator data, then obtains the cyclical indicator data that the statistical time period is day.
Optionally, the corresponding SQL statement write in advance of the combination of each dimension and index.
Optionally it is determined that the corresponding SQL statement of the combination of applied dimension and index includes: from index S QL allocation list
It is middle to search the corresponding SQL template of applied index, wherein configured with index and its corresponding in the index S QL allocation list
The SQL template of different dimensions；Applied dimension and index are determined from the SQL template found according to applied dimension
The corresponding SQL statement of combination.
Optionally, determined from pre-set index dimensional relationships table applied cyclical indicator data dimension and
The index dimensional relationships of index include: that the dimension name and dimension of applied cyclical indicator data are obtained from dimensional attribute table
ID；The index name and index ID of applied cyclical indicator data are obtained from indication information table；It is closed in the index dimension
It is that the dimension name got and dimension ID and index name and index ID are searched in table to determine that the applied period refers to
Mark the combination of the dimension and index of data.
Optionally, the dimensional attribute table is configured with dimension ID, dimension code, dimension name, dimensional attribute ID, attribute value
And the corresponding relationship of Property Name.
Optionally, the indication information table is configured with index classification ID, index classification code, index classification title, index
The corresponding relationship of ID, guideline code and index name.
Optionally, the dimensional attribute of applied cyclical indicator data and the cyclical indicator table are associated, are obtained
The combination of the dimension, dimensional attribute and index of applied cyclical indicator data includes: determining from dimensional attribute table applied
Cyclical indicator data dimensional attribute title and dimensional attribute and dimension between corresponding relationship；According to the dimensional attribute
Dimensional attribute and the cyclical indicator table are associated by the corresponding relationship between dimension.
Another aspect of the present invention provides a kind of for generating the data processing equipment of cyclical indicator data, comprising: connect
Unit is received, the application for receiving cyclical indicator data is requested, wherein the application request carries applied cyclical indicator
Dimension, dimensional attribute and the index of data；First determination unit, for being determined from pre-set index dimensional relationships table
The dimension of applied cyclical indicator data and the index dimensional relationships of index, the index dimensional relationships for indicate dimension and
The combination of index；Second determination unit, for determining statistical time period and the current date of applied cyclical indicator data；
Generation unit, for carrying out priority ranking to applied cyclical indicator according to the statistical time period, the generation period refers to
Mark table；Associative cell is obtained for the dimensional attribute of applied cyclical indicator data and the cyclical indicator table to be associated
To the combination of the dimension, dimensional attribute and index of applied cyclical indicator data；Acquiring unit, for according to applied dimension
The combination of degree and index obtains corresponding cyclical indicator data according to the statistical time period from data warehouse, is written to institute
State cyclical indicator table.
According to embodiments of the present invention, by forming cyclical indicator table according to statistical time period progress priority ranking, from
In data warehouse index dimensional relationships table, after being calculated according to the dimension index applied, write cycle index table, generating the period refers to
Data are marked, so that index be made to generate in such a way that periodic table goes out number, are conducive to the statistics and analysis of cyclical indicator.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is in the embodiment of the present invention for generating a specific example of the data processing method of cyclical indicator data
Flow chart；
Fig. 2 is the process that a specific example of index dimensional relationships for dimension and index is determined in the embodiment of the present invention
Figure；
Fig. 3 is the flow chart that a specific example of cyclical indicator data is obtained in the embodiment of the present invention；
Fig. 4 is the flow chart of a specific example of data flow in the embodiment of the present invention；
Fig. 5 is in the embodiment of the present invention for generating a specific example of the data processing equipment of cyclical indicator data
Functional block diagram.
Specific embodiment
Technical solution of the present invention is clearly and completely described below in conjunction with attached drawing, it is clear that described implementation
Example is a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill
Personnel's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
As long as technical characteristic involved in invention described below different embodiments does not constitute punching each other
It is prominent to be combined with each other.
The present embodiment provides a kind of for generating the data processing method of cyclical indicator data, is applied to computer equipment
On, as shown in Figure 1, this method comprises:
Step S101 receives the application request of cyclical indicator data, wherein the application request carries applied week
Dimension, dimensional attribute and the index of phase achievement data.
This application request can be initiated by user (company leader, product manager etc.), and this application request can be more human hairs
It rises, is also possible to what a people initiated.For example, the leader of certain Internet company needs to check that the internet of the said firm's maintenance is flat
The cyclical indicator of platform, to understand current platform operating condition, at this point it is possible to the index and corresponding dimension that need to check are selected,
This application request is initiated by terminal.
Optionally, in the embodiment of the present invention, can application request after approval process is set, be pre-configured with approver and
The rules such as the index of examination & approval.Specific approval process includes: to examine to application request.Whether specific approval request side gathers around
There is the permission for checking the corresponding index period, if so, then passing through examination & approval；Conversely, then rejecting.
Step S102 determines the dimension of applied cyclical indicator data from pre-set index dimensional relationships table
With the index dimensional relationships of index, the index dimensional relationships are used to indicate the combination of dimension and index.
Step S103 determines statistical time period and the current date of applied cyclical indicator data.
Step S104 carries out priority ranking to applied cyclical indicator according to the statistical time period, generates week
Phase index table.
The embodiment of the present invention can carry out priority ranking according to the length in statistical time period, for example, the period is shorter, it is excellent
First grade is higher.Cyclical indicator table is generated after sequence, which is the list not comprising cyclical indicator data, is wrapped thereon
Contain the index and corresponding dimension to be counted and statistical time period and priority.
The dimensional attribute of applied cyclical indicator data and the cyclical indicator table are associated, obtain by step S105
To the combination of the dimension, dimensional attribute and index of applied cyclical indicator data.
Dimensional attribute is the subdivision carried out to dimension, for example, " city " includes the attributes such as Beijing, Shanghai, Shenzhen and Guangzhou；
" platform " includes the attributes such as small routine, the end APP, PC.
Step S106, the combination according to applied dimension and index is according to the statistical time period from data warehouse
Corresponding cyclical indicator data are obtained, the cyclical indicator table is written to.
According to the dimension index applied, calculated from the index dimensional relationships table of data warehouse according to the statistical time period
It obtains cyclical indicator data, is written in above-mentioned cyclical indicator table, thus the statistics of execution cycle index.By the cyclical indicator table
It exports and is checked to applicant.When carrying out statistics calculating, can be obtained one by one from data warehouse according to priority orders
The corresponding cyclical indicator data of the combination of applied dimension and index.
According to embodiments of the present invention, by forming cyclical indicator table according to statistical time period progress priority ranking, from
In data warehouse index dimensional relationships table, after being calculated according to the dimension index applied, write cycle index table, generating the period refers to
Data are marked, cyclical indicator is generated, is conducive to the statistics and analysis of cyclical indicator.
As a kind of optional embodiment of the embodiment of the present invention, as shown in Fig. 2, the step of described in above-described embodiment
S102 is specifically included:
Step S1021 obtains the dimension name and dimension ID of applied cyclical indicator data from dimensional attribute table；
Step S1022 obtains the index name and index ID of applied cyclical indicator data from indication information table；
Step S1023 searches the dimension name got and dimension ID and index name in index dimensional relationships table
The combination of the dimension and index of applied cyclical indicator data is determined with index ID.
Wherein, dimensional attribute table is configured with dimension ID, dimension code, dimension name, dimensional attribute ID, attribute value and category
The corresponding relationship of property title；Indication information table configured with index classification ID, index classification code, index classification title, index ID,
The corresponding relationship of guideline code and index name.
With the achievement data of soil bar rabbit finishing net for example, indication information table is as shown in table 1:
Table 1
Dimensional attribute table is as shown in table 2:
Table 2
Index classification code described in above-mentioned Tables 1 and 2, guideline code and dimension code are mainly used in SQL statement
Represent corresponding classification, index and dimension.
The combination of the index and dimension determined from above-mentioned two tables, example are as shown in table 3:
| Index name | Dimension name | Index ID | Dimension ID |
| GMV | Summarize | 1001 | 0 |
| Dress enterprise income | Summarize | 1002 | 0 |
| UV | Platform | 2003 | 2 |
| UV | Small routine | 2003 | 4 |
| Active users | APP title | 2006 | 5 |
| Newly-increased clue number | Summarize | 3003 | 0 |
| Initiate clue number | Summarize | 3002 | 0 |
| Number can be sold | Summarize | 4003 | 0 |
| Newly-increased clue can sell rate | Summarize | 4005 | 0 |
| Assignment information number | Summarize | 5001 | 0 |
| Number waste rate | Summarize | 5003 | 0 |
| It withholds Information Number | Summarize | 5005 | 0 |
| Signing order numbers | Summarize | 5008 | 0 |
| Dress enterprise GMV | Summarize | 5009 | 0 |
| Supply chain GMV | Summarize | 6001 | 0 |
| Auxiliary material order numbers | Summarize | 6002 | 0 |
| The auxiliary material order amount of money | Summarize | 6003 | 0 |
| Main material order numbers | Summarize | 6006 | 0 |
| The main material order amount of money | Summarize | 6007 | 0 |
| It is newly-increased to complain number | Summarize | 7001 | 0 |
| Existing complaint number | Summarize | 7002 | 0 |
| It closes and complains number | Summarize | 7003 | 0 |
Table 3
As optional embodiment in another, above-mentioned steps S104 may include: that institute Shen is determined from dimensional attribute table
Corresponding relationship between the dimensional attribute title and dimensional attribute and dimension of cyclical indicator data please；According to dimensional attribute with
Dimensional attribute and cyclical indicator table are associated by the corresponding relationship between dimension.
In the embodiment of the present invention, by the incidence relation established between dimensional attribute and cyclical indicator table, so that carrying out
When cyclical indicator data statistics, the achievement data of each dimensional attribute under respective dimensions can be counted, to obtain the dimension
Accurate achievement data.
Optionally, in the embodiment of the present invention, it can be pre-configured with index S QL allocation list, wherein distribu-tion index and its right
The SQL template for the different dimensions answered, multiple indexs can be write out with a SQL, and a SQL can only belong to index point
Class, this to directly acquire corresponding SQL statement, correspondence can be got by executing the sentence when carrying out cyclical indicator statistics
Cyclical indicator data.Specifically, as shown in figure 3, above-mentioned steps S106 may include:
Step S1061 determines the corresponding SQL statement of the combination of applied dimension and index；
Step S1062 inputs the current date to the SQL statement, according to the statistical time period and described works as
The period that preceding date automatically generated data summarizes；
Step S1063 executes the SQL statement determined, obtains in the period from the data warehouse
Cyclical indicator data.
Corresponding SQL statement is combined with the flow indicator of " small routine " dimension are as follows:
Select'MPRO'as plat, sum (1 else of case when event='pv'then, 0 end) as pv,
count(distinct cookie)as uv from ods.ods_user_event_tracking where dt between
${date_begin}and${date_curr}and from_unixtime(int(substr(cur_time,1,10)),'
YyyyMMdd') between $ { date_begin } and $ { date_curr } and (app='houseDesign'or instr
(app,'mpro')<>0)
Specifically, in measurement period achievement data, incoming at least two parameters are needed, 1 is the statistical time period, and 2 are
Current date, 3 be configuration sql id (optional, for selecting corresponding SQL statement).
Script effect: in data billboard fairground, generation is related with Traffic Domain summarizes cyclical indicator (the index packet of Traffic Domain
Containing the index that can not be added up, such as au, uv, if later have the index that can not be added up addition, need to redesign one it is similar
Script).
Usage:panel_flow_ind.sh [1: day, 2: week, 3: the moon]<yyyymmdd>
1: statistical time period, control are to generate day table, weekly form or menology data.
2: current date, input 20180419 cooperate the period 2: week, then can generate this week of 20180412-20180419
Summarized data before the expiration data date, cooperates the period 3: can then generate this month expiration data of 20180319-20180419 in year
Summarized data before date.
Further, the statistical time period described in the embodiment of the present invention includes: day, week and the moon, according to applied dimension
Combination with index obtains corresponding cyclical indicator data according to the statistical time period from data warehouse and includes:
For the same SQL statement, judge whether the statistical time period is week or the moon；
The period that the statistical time period is week or the moon is first obtained when the statistical time period is all perhaps moons
Achievement data, then obtain the cyclical indicator data that the statistical time period is day.
Specifically, if the script period is 1, the record that cycle is 1 and comes into force only is traversed.
If the script period is 2, the same conf_id, preferentially taking cycle is the record of 2 (week summarizes), then is taken
Cycle is 1 record (without week summary record, then summarizing in week is to add what data interval obtained by day summary record).
If the script period is 3, the same conf_id, preferentially taking cycle is the record of 3 (moon summarizes), then is taken
Cycle is 1 record.
It is further preferred that the corresponding SQL statement of combination of the applied dimension of above-mentioned determination and index includes: from index
The corresponding SQL template of applied index is searched in SQL allocation list；According to applied dimension from the SQL template found
Determine the corresponding SQL statement of the combination of applied dimension and index.
The data flow of the embodiment of the present invention is as shown in Figure 4, wherein hive layers to dim layers are counting out on the way for current index
Diameter.Depot layer indicates to go out to count in accordance with ad hoc rules to dm layers, as group by asks sum and count (distinct).In depot layer
Flow direction expression can refer to data backstage be aggregated into fairground bore generate depot data.
Additionally providing for the embodiment of the present invention is a kind of for generating the data processing equipment of cyclical indicator data, which can
With the provided data processing method for executing the embodiment of the present invention, as shown in figure 5, the device include: receiving unit 10,
First determination unit 20, the second determination unit 30, generation unit 40, associative cell 50 and acquiring unit 60.
Receiving unit 10 is used to receive the application request of cyclical indicator data, wherein the application request carries Shen
Dimension, dimensional attribute and the index of cyclical indicator data please；
First determination unit 20 is for determining applied cyclical indicator from pre-set index dimensional relationships table
The dimension of data and the index dimensional relationships of index, the index dimensional relationships are used to indicate the combination of dimension and index；
Second determination unit 30 is used to determine statistical time period and the current date of applied cyclical indicator data；
Generation unit 40 is used to carry out priority ranking to applied cyclical indicator according to the statistical time period, raw
At cyclical indicator table；
Associative cell 50 is for closing the dimensional attribute of applied cyclical indicator data and the cyclical indicator table
Connection, obtains the combination of the dimension, dimensional attribute and index of applied cyclical indicator data；
Acquiring unit 60 is used for the combination according to applied dimension and index according to the statistical time period from data
Corresponding cyclical indicator data are obtained in warehouse, are written to the cyclical indicator table.The receiving unit 10 of the embodiment of the present invention,
One determination unit 20, the second determination unit 30, generation unit 40, associative cell 50 and acquiring unit 60 concrete function can join
See the step S101-S106 of the data processing method of the above embodiment of the present invention, which is not described herein again.
According to embodiments of the present invention, by forming cyclical indicator table according to statistical time period progress priority ranking, from
In data warehouse index dimensional relationships table, after being calculated according to the dimension index applied, write cycle index table, generating the period refers to
Data are marked, cyclical indicator is generated, is conducive to the statistics and analysis of cyclical indicator.
It should be understood by those skilled in the art that, the embodiment of the present invention can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the present invention
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the present invention, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Obviously, the above embodiments are merely examples for clarifying the description, and does not limit the embodiments.It is right
For those of ordinary skill in the art, can also make on the basis of the above description it is other it is various forms of variation or
It changes.There is no necessity and possibility to exhaust all the enbodiments.And it is extended from this it is obvious variation or
It changes among still in the protection scope of the application.
Claims (10)
1. a kind of for generating the data processing method of cyclical indicator data characterized by comprising
Receive the application request of cyclical indicator data, wherein the application request carries applied cyclical indicator data
Dimension, dimensional attribute and index；
The dimension of applied cyclical indicator data and the index of index are determined from pre-set index dimensional relationships table
Dimensional relationships, the index dimensional relationships are used to indicate the combination of dimension and index；
Determine statistical time period and the current date of applied cyclical indicator data；
Priority ranking is carried out to applied cyclical indicator according to the statistical time period, generates cyclical indicator table；
The dimensional attribute of applied cyclical indicator data and the cyclical indicator table are associated, the applied period is obtained
The combination of the dimension, dimensional attribute and index of achievement data；
Combination according to applied dimension and index obtains corresponding week according to the statistical time period from data warehouse
Phase achievement data is written to the cyclical indicator table.
2. data processing method according to claim 1, which is characterized in that the combination according to applied dimension and index
Corresponding cyclical indicator data are obtained from data warehouse according to the statistical time period includes:
Determine the corresponding SQL statement of the combination of applied dimension and index；
The current date is inputted to the SQL statement, is automatically generated according to the statistical time period and the current date
The period of data summarization；
The SQL statement determined is executed, from the cyclical indicator data obtained in the period in the data warehouse.
3. data processing method according to claim 2, which is characterized in that the statistical time period includes: day, Zhou He
Month, the combination according to applied dimension and index obtains the corresponding period according to the statistical time period from data warehouse
Achievement data includes:
For the same SQL statement, judge whether the statistical time period is week or the moon；
The cyclical indicator that the statistical time period is week or the moon is first obtained when the statistical time period is all perhaps moons
Data, then obtain the cyclical indicator data that the statistical time period is day.
4. data processing method according to claim 2, which is characterized in that the combination of each dimension and index corresponding one
A SQL statement write in advance.
5. data processing method according to claim 2, which is characterized in that determine the combination of applied dimension and index
Corresponding SQL statement includes:
The corresponding SQL template of applied index is searched from index S QL allocation list, wherein match in the index S QL allocation list
It is equipped with the SQL template of index and its corresponding different dimensions；
Determine that the combination of applied dimension and index is corresponding from the SQL template found according to applied dimension
SQL statement.
6. data processing method according to claim 1, which is characterized in that from pre-set index dimensional relationships table
The index dimensional relationships of the dimension and index of determining applied cyclical indicator data include:
The dimension name and dimension ID of applied cyclical indicator data are obtained from dimensional attribute table；
The index name and index ID of applied cyclical indicator data are obtained from indication information table；
Searched in the index dimensional relationships table dimension name got and dimension ID and index name and index ID with
Determine the combination of the dimension and index of applied cyclical indicator data.
7. data processing method according to claim 6, which is characterized in that the dimensional attribute table configured with dimension ID,
Dimension code, dimension name, dimensional attribute ID, attribute value and Property Name corresponding relationship.
8. data processing method according to claim 6, which is characterized in that the indication information table is configured with index classification
ID, index classification code, index classification title, index ID, guideline code and index name corresponding relationship.
9. data processing method according to claim 1, which is characterized in that by the dimension of applied cyclical indicator data
Attribute is associated with the cyclical indicator table, obtains the dimensions of applied cyclical indicator data, dimensional attribute and index
Combination includes:
Determined from dimensional attribute table applied cyclical indicator data dimensional attribute title and dimensional attribute and dimension it
Between corresponding relationship；
Dimensional attribute and the cyclical indicator table are associated according to the corresponding relationship between the dimensional attribute and dimension.
10. a kind of for generating the data processing equipment of cyclical indicator data characterized by comprising
Receiving unit, the application for receiving cyclical indicator data are requested, wherein the application request carries applied week
Dimension, dimensional attribute and the index of phase achievement data；
First determination unit, for determining applied cyclical indicator data from pre-set index dimensional relationships table
The index dimensional relationships of dimension and index, the index dimensional relationships are used to indicate the combination of dimension and index；
Second determination unit, for determining statistical time period and the current date of applied cyclical indicator data；
Generation unit generates week for carrying out priority ranking to applied cyclical indicator according to the statistical time period
Phase index table；
Associative cell is obtained for the dimensional attribute of applied cyclical indicator data and the cyclical indicator table to be associated
To the combination of the dimension, dimensional attribute and index of applied cyclical indicator data；
Acquiring unit, for the combination according to applied dimension and index according to the statistical time period from data warehouse
Corresponding cyclical indicator data are obtained, the cyclical indicator table is written to.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646630.4A CN109165238B (en) | 2018-06-21 | 2018-06-21 | Data processing method and device for generating period index data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810646630.4A CN109165238B (en) | 2018-06-21 | 2018-06-21 | Data processing method and device for generating period index data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109165238A true CN109165238A (en) | 2019-01-08 |
| CN109165238B CN109165238B (en) | 2022-09-09 |
Family
ID=64897205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810646630.4A Active CN109165238B (en) | 2018-06-21 | 2018-06-21 | Data processing method and device for generating period index data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109165238B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851676A (en) * | 2019-10-08 | 2020-02-28 | 支付宝(杭州)信息技术有限公司 | Index data processing method and device and electronic equipment |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104424339A (en) * | 2013-09-11 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Method, device and system for data analysis |
| CN104809130A (en) * | 2014-01-27 | 2015-07-29 | 腾讯科技（深圳）有限公司 | Method, equipment and system for data query |
| CN104809254A (en) * | 2015-05-19 | 2015-07-29 | 郑州悉知信息技术有限公司 | Data query method and device |
| CN105243167A (en) * | 2015-11-10 | 2016-01-13 | 中国建设银行股份有限公司 | Data processing method and device |
| CN105843945A (en) * | 2016-04-08 | 2016-08-10 | 联动优势科技有限公司 | Report generation method and system |
| US20160267135A1 (en) * | 2015-03-10 | 2016-09-15 | Oracle International Corporation | Adaptive handling of skew for distributed joins in a cluster |
| US20170024435A1 (en) * | 2015-07-22 | 2017-01-26 | Oracle International Corporation | Use Of Dynamic Dictionary Encoding With An Associated Hash Table To Support Many-To-Many Joins And Aggregations |
| CN106557498A (en) * | 2015-09-25 | 2017-04-05 | 北京国双科技有限公司 | Date storage method and device and data query method and apparatus |
| CN106776834A (en) * | 2016-11-28 | 2017-05-31 | 中通服公众信息产业股份有限公司 | A kind of data analysis based on index is from access method and system |
| CN107729399A (en) * | 2017-09-21 | 2018-02-23 | 北京京东尚科信息技术有限公司 | The method and apparatus of data processing |
-
2018
- 2018-06-21 CN CN201810646630.4A patent/CN109165238B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104424339A (en) * | 2013-09-11 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Method, device and system for data analysis |
| CN104809130A (en) * | 2014-01-27 | 2015-07-29 | 腾讯科技（深圳）有限公司 | Method, equipment and system for data query |
| US20160267135A1 (en) * | 2015-03-10 | 2016-09-15 | Oracle International Corporation | Adaptive handling of skew for distributed joins in a cluster |
| CN104809254A (en) * | 2015-05-19 | 2015-07-29 | 郑州悉知信息技术有限公司 | Data query method and device |
| US20170024435A1 (en) * | 2015-07-22 | 2017-01-26 | Oracle International Corporation | Use Of Dynamic Dictionary Encoding With An Associated Hash Table To Support Many-To-Many Joins And Aggregations |
| CN106557498A (en) * | 2015-09-25 | 2017-04-05 | 北京国双科技有限公司 | Date storage method and device and data query method and apparatus |
| CN105243167A (en) * | 2015-11-10 | 2016-01-13 | 中国建设银行股份有限公司 | Data processing method and device |
| CN105843945A (en) * | 2016-04-08 | 2016-08-10 | 联动优势科技有限公司 | Report generation method and system |
| CN106776834A (en) * | 2016-11-28 | 2017-05-31 | 中通服公众信息产业股份有限公司 | A kind of data analysis based on index is from access method and system |
| CN107729399A (en) * | 2017-09-21 | 2018-02-23 | 北京京东尚科信息技术有限公司 | The method and apparatus of data processing |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110851676A (en) * | 2019-10-08 | 2020-02-28 | 支付宝(杭州)信息技术有限公司 | Index data processing method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109165238B (en) | 2022-09-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9367601B2 (en) | Cost-based optimization of configuration parameters and cluster sizing for hadoop | |
| CN108090225B (en) | Database instance running method, device and system and computer readable storage medium | |
| CN105718565B (en) | The construction method and construction device of data warehouse model | |
| CN109034993A (en) | Account checking method, equipment, system and computer readable storage medium | |
| CN103595780B (en) | Cloud computing resource scheduling method based on the weight that disappears | |
| CN109033173A (en) | It is a kind of for generating the data processing method and device of multidimensional index data | |
| CN106815254A (en) | A kind of data processing method and device | |
| CN107480188B (en) | Audit service data processing method and computer equipment | |
| CN109086339A (en) | It is a kind of for generating the data processing method and device of index recombination rate | |
| Levin et al. | Stratified-sampling over social networks using mapreduce | |
| CN111737325A (en) | Power data analysis method and device based on big data technology | |
| CN108243046A (en) | A kind of evaluation the quality method and device based on data auditing | |
| CN110134646A (en) | The storage of knowledge platform service data and integrated approach and system | |
| CN109165238A (en) | It is a kind of for generating the data processing method and device of cyclical indicator data | |
| CN110267717B (en) | Method and device for automatically generating automatic scaling call rules according to different independent tenants in multi-tenant environment | |
| Zhou et al. | Group dynamics in discussing incidental topics over online social networks | |
| Ji et al. | Query execution optimization in spark SQL | |
| CN115618825A (en) | Financial statement merging method and device, computer readable medium and terminal equipment | |
| CN110069349A (en) | A kind of resource consumption accounting system based on big data platform | |
| CN109902258A (en) | Data processing method and equipment based on block chain | |
| CN108519909A (en) | A kind of stream data processing method and device | |
| CN111367980B (en) | Method and system for managing upstream tasks according to E-commerce indexes | |
| CN108959485A (en) | It is a kind of for generating the data processing method and device of flow indicator data | |
| CN110517009A (en) | Real-time common layer building method, device and server | |
| TW202121157A (en) | Method and quantifying a data based on final value and estimate |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518000 R & D room 3501, block a, building 7, Vanke Cloud City Phase I, Xingke 1st Street, Xili community, Xili street, Nanshan District, Shenzhen City, Guangdong Province Applicant after: Tubatu Group Co.,Ltd. Address before: 1001-a, 10th floor, bike technology building, No.9, Keke Road, high tech Zone, Nanshan District, Shenzhen, Guangdong 518000 Applicant before: SHENZHEN BINCENT TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |