CN1949223A - Multidimensional data reading and writing method and apparatus in on-line analysing processing system - Google Patents

Multidimensional data reading and writing method and apparatus in on-line analysing processing system Download PDF

Info

Publication number
CN1949223A
CN1949223A CN 200610145081 CN200610145081A CN1949223A CN 1949223 A CN1949223 A CN 1949223A CN 200610145081 CN200610145081 CN 200610145081 CN 200610145081 A CN200610145081 A CN 200610145081A CN 1949223 A CN1949223 A CN 1949223A
Authority
CN
China
Prior art keywords
data
sign
combination
disk
internal memory
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200610145081
Other languages
Chinese (zh)
Other versions
CN100578499C (en
Inventor
林志贤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kingdee Software China Co Ltd
Original Assignee
Kingdee Software China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kingdee Software China Co Ltd filed Critical Kingdee Software China Co Ltd
Priority to CN200610145081A priority Critical patent/CN100578499C/en
Publication of CN1949223A publication Critical patent/CN1949223A/en
Application granted granted Critical
Publication of CN100578499C publication Critical patent/CN100578499C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses many dimensions data read-write method and device in on-line analytical processing system. The method includes the following steps: preliminarily setting threshold value of the stored many dimensions data quantity; getting original data from the data source; setting each dimensionality member random combination for the original data; storing the metric value data of the combination and its corresponding original data in the internal memory; if it exceeds the threshold value, dividing the exceeded combination into at least one aggregate; generating the aggregate corresponding identification and storing it in the internal memory; storing the metric value data, identification corresponding with the aggregate in disk; using the combination from the internal, or the combination and the identification from the disk to read corresponding metric value data.

Description

The method and apparatus of multidimensional data read-write in a kind of on-line analysing processing system
Technical field
The present invention relates to field of computer technology, be meant the method and apparatus of multidimensional data read-write in a kind of on-line analysing processing system especially.
Background technology
In today of science and technology fast development, the data of the needs statistics in the social every field all rapidly increase, and the record of mass data, inquiry bring new developing direction for computer technology, and new technical task is provided.
Enterprise Resources Plan (ERP, Enterprise Recourse Planning) system is the new data management mode of bringing of enterprise.By ERP system, enterprise can use more efficiently, all kinds of resources of management enterprise.Store lot of data in the ERP database, from the analyzing and processing process, analyze the working time that generally needs the multilist operation, grows, if directly utilize existing data are made a strategic decision in the database of ERP operation system analysis and reasoning, will influence the efficient of ERP system, and cause busy network data transmission.Therefore need be in conjunction with on-line analysing processing system (OLAP, Online Analytic Processing).
The management decision personnel carry out multidimensional analysis from different angles, fast and flexible ground to the data the data warehouse by OLAP and handle.The OLAP system mainly comprises multidimensional on-line analysing processing system MOLAP (Multidimensional OLAP) and concerns on-line analysing processing system ROLAP (Relational OLAP).From in logic, the OLAP abstract model comprises structural model and interrogation model, and structural model is represented the various objects of cube, and interrogation model is illustrated in these inquiries above object.During realization structural model and interrogation model are mapped as the physics realization model.In the OLAP structural model, core is the cube cube, i.e. cube (Cube).Contain a large amount of generation data and aggregated data among the Cube, aggregated data is by the decision of dimension hierarchical structure, and the complexity of dimension number, dimension number of members and hierarchical structure has determined the data volume of aggregated data.Wherein, dimension is the special angle of people's observed data, as time dimension, geography dimensionality etc.The user on certain dimension, can also have the level of detail different levels during observed data each describe aspect.As, time dimension comprises: date, month, season, year.Value during the member that comprises in the dimension on the dimension is the description of data position in certain dimension.As, " certain year is in such a month, and on such a day " is the description of position on time dimension.By each different dimensions, observation data more flexibly.Each data among the Cube are all corresponding to a member in each dimension, and the combination by member in each dimension can inquire corresponding data.
Data structure for multidimensional, olap server has different implementations in the storage of data with inquiring about, but mostly be applied to mass data, during processing, olap server stores in advance from the mass data in the data source, and generation Cube data, the user by olap server when different dimensions are carried out data analysis, the magnanimity Cube data that generate in the olap server are divided into a plurality of partial datas, a part of data are read at every turn and set up report data in the internal memory, after again the report data of setting up in the internal memory being combined into complete form, be shown on user's the terminal.
Above-mentioned when carrying out the OLAP data analysis, mainly be inquiry, the analysis that is applied to mass data, and the Cube data of inquiry generate in olap server.For the storage and the inquiry of small data quantity, if still adopt olap server to generate the Cube data, carry out inquiry, the analysis of Cube data again by olap server, will be to producing bigger waste on the olap server utilization ratio.And, also do not have total solution at present for multidimensional inquiring, the analysis of small data quantity.
Summary of the invention
In view of this, the invention reside in the method and apparatus that multidimensional data read-write in a kind of on-line analysing processing system is provided, with multidimensional data storage that solves above-mentioned small data quantity and the problem of inquiring about.
For addressing the above problem, the method that the invention provides multidimensional data read-write in a kind of on-line analysing processing system comprises:
Preestablish in the internal memory threshold value of storage multidimensional data amount, from data source, obtain primary data, set in the primary data member's combination in any in each dimension, with the metric data storage in the corresponding primary data of described combination with it in internal memory;
If exceed described memory threshold, then described each combination that exceeds memory threshold is divided at least more than one the set, generate with the corresponding sign of described set and store in the internal memory, with the metric data of described each combination that exceeds memory threshold in the corresponding primary data with it, reach the corresponding sign of described set and store in the disk, utilize described combination from internal memory or utilize described combination and described sign reads corresponding metric data from disk.
Wherein, generation comprises with the corresponding sign of described set:
Utilize the member in each dimension to generate tree form data structure, with the combination of all member's father nodes in the described combination as described sign.
Wherein, generation is stored in the internal memory with the corresponding sign of described set and is comprised:
In internal memory, create index, described sign is stored in the tabulation.
Wherein, described storing in the disk further comprises:
Utilize described generation sign to judge whether there is identical sign in the index,, then the metric data storage in the corresponding multidimensional data with it of described combination should be identified in the corresponding set in disk if exist.
Wherein, describedly from disk, read corresponding metric data and comprise:
Utilize described combination from internal memory, to read corresponding metric data, if there is not described combination in the internal memory, then generate described sign and judge whether there is identical sign in the index, if exist, then judge in the disk in the corresponding set of this sign and whether have described combination, if exist, then return the corresponding metric data of described combination; Otherwise return sky.
The present invention also provides the device of multidimensional data read-write in a kind of on-line analysing processing system, comprising:
Data capture unit is used for obtaining primary data from data source, and is sent to the combination generation unit;
Make up generation unit, be used for setting the combination in any of member in each dimension of multidimensional data that receives, and the information after will making up is sent to date read-write cell and set division unit;
The threshold decision unit, be used to store the threshold value of predefined memory multidimensional data amount, and before the date read-write cell execution writes at every turn, after judging this write memory, whether the multidimensional data amount of storing in the internal memory can exceed predetermined threshold, and judged result is sent to date read-write cell and set division unit;
The set division unit is used for after receiving the judged result that exceeds predetermined threshold, utilizes the combined information that receives, and each combination is divided at least more than one the set, generates with the corresponding sign of described set and is sent to date read-write cell;
Date read-write cell, be used for before execution writes at every turn, this information that writes is sent to the threshold decision unit, after receiving the judged result of threshold decision unit, with the metric data in the corresponding multidimensional data of described combination with it, and the corresponding sign of described set store in internal memory or the disk, utilize described combination and described sign from disk, to read corresponding metric data.
Wherein, described set division unit is used for utilizing the member of each dimension to generate tree form data structure, with the combination of all member's father nodes in the described combination as described sign.
Wherein, described date read-write cell is used for creating index at internal memory, and described sign is stored in the tabulation.
Wherein, described device also comprises:
Identify judgement unit, be used for obtaining the generation sign, utilize described generation sign to judge whether there is identical sign in the index, if existence, then notification data read-write cell from the set division unit;
Date read-write cell also is used for after the notice that receives the sign judgement unit, and the metric data storage in the corresponding multidimensional data with it of described combination should be identified in the corresponding set in disk.
Wherein, described date read-write cell is used for after the notice that receives the sign judgement unit, reads in the set of this sign correspondence from disk and the corresponding metric data of described combination.
Method and apparatus of the present invention, the OLAP storage and the inquiry of small data quantity have been solved, storage and the inquiry of the OLAP of small data quantity are handled in internal memory, and the threshold value of set memory, when the processing load is big in the internal memory, the storage of multidimensional data is stored in the disk with the structure of gathering, and by the set sign read, carry out reading of metric by set identification and member's combination, can not produce bottleneck to the system performance of terminal, with the father node combination of member combination sign as piece, can reduce the reading times of hard disk, improve metric data write efficient, ideally solved small data quantity OLAP storage and inquiry based on internal memory and disk.
Description of drawings
Fig. 1 is the process flow diagram of the inventive method;
Fig. 2 is the data structure diagram of dimension member relation in the embodiment of the invention;
Fig. 3 is the corresponding relation figure of dimension member and data in the embodiment of the invention;
Fig. 4 is the process flow diagram of the embodiment of the invention;
Fig. 5 is the structural drawing of apparatus of the present invention.
Embodiment
No matter are transregional company, enterprise or government bodies today of global economy fast development, all can have every day lot of data to need to handle, and these data comprise each classification, as producing and selling, routine office work etc.The decision maker makes a strategic decision to market sale, manufacturing schedule by the mass data that generates is analyzed.But for some small company, the data of the generation of every day are less, if terminal then can be wasted bigger system resource from the Cube data that the OLAP of large-scale analysis mass data obtains the small data quantity of generation.
Be the storage of solution small data quantity multidimensional data and the problem of inquiry.The invention provides the storage of the multidimensional data of realizing small data quantity and the method and apparatus of inquiry.Below by embodiment and be described with reference to the accompanying drawings method and apparatus of the present invention.Referring to Fig. 1,
Method of the present invention comprises following step:
Step S101: preestablish the threshold value of storage multidimensional data amount in the internal memory, from data source, obtain primary data, member's combination in any in each dimension in the setting primary data;
Step S102: with the metric data storage in the corresponding primary data of described combination with it in internal memory, if exceed described memory threshold, then described each combination that exceeds memory threshold is divided at least more than one the set, generate with the corresponding sign of described set and store in the internal memory, with the metric data in the described corresponding primary data of each combination that exceeds memory threshold, reach the corresponding sign of described set and store in the disk with it;
Step S103: utilize described combination from internal memory or utilize described combination and described sign reads corresponding metric data from disk.
Provide specific embodiments of the invention below.For more clearly understanding the present invention, dimension in the present invention is example with the three-dimensional.
For the data that company produces, need the dimension (Dimension) of preliminary setting data, dimension: being the special angle of people's observed data, is the generic attribute when considering a problem, and community set constitutes a dimension (time dimension, geography dimensionality etc.).
The level of dimension (Level): be that certain special angle (be certain dimension) of people's observed data can also exist different each of level of detail to describe the aspect.As: time dimension: date, month, season, year.
The member of dimension (Member): the value on the dimension is the description of data position in certain dimension.As: " certain year is in such a month, and on such a day " is the description of position on time dimension.
By each different dimensions, observation data more flexibly.The hierarchical relationship of each dimension is to store with the data structure of tree type, is convenient to like this carry out gathering and assembling of data.
Provide specific embodiments of the invention below.For ease of more clearly understanding the present invention, dimension in an embodiment of the present invention is example with the three-dimensional.
With the data instance of Express Mail Service company, when carrying out olap analysis, terminal needs to obtain earlier data from data source, and data source can be a database or with the data of all kinds of format software storages.After obtaining multidimensional data, take out the dimension member in the multidimensional data, member's combination in any in each dimension by the corresponding relation of dimension member and metric data, generates dimension member's the combination and the corresponding relation of metric data in the setting multidimensional data.As, the data that Express Mail Service company produces comprise three dimensions, are respectively source, route and time.The hierarchical relationship of each dimension is referring to Fig. 2.The dimension member in source comprises: aviation, sea route, highway, four members of railway; The dimension member of route comprises: Africa, Asia, Australia, Europe, North America, six members of South America; The dimension member of time comprises: the first quarter, the second quarter, the third season, fourth quarter four members.Take out a member on each dimension arbitrarily, the combination of composition is called tuple, as (aviation, Africa, the first quarter); (aviation, South America, the second quarter) etc.Corresponding to one group of metric data, in these group metric data, comprise one or more data in each tuple.
The member in each dimension and the corresponding relation of data are referring to Fig. 3.In Fig. 3, dimension member and corresponding data show with cubical form.In cube, three dimensions and two metrics are arranged, what the cell in the cube was stored is metric, metric is represented factual data.The cell corresponding as tuple (aviation, Africa, the first quarter) is 190 and 99/02/17 to two metrics should be arranged, and (aviation, South America, the second quarter), corresponding cell was 490 and 99/06/03 to two metrics should be arranged.Each cell in the cube is also corresponding to a member on each dimension.
After terminal gets access to the data of Express Mail Service company from data source, generate the Cube data presentation by these data in terminal self and give the user.Before generating the Cube data, terminal is handled the data of Express Mail Service company, and the process of reading and writing during processing is referring to Fig. 4,
Step S401: preestablish the threshold value of storage multidimensional data amount in the internal memory, from data source, obtain multidimensional data.When the olap analysis that carries out the small data quantity multidimensional data is handled, because the configuration difference of each terminal, the multidimensional data amount that can store in the internal memory is different, can preestablish a threshold value by the configuration of terminal, if the resource anxiety of internal memory, threshold value can be turned down, if the resource free time of internal memory is more, threshold value can be heightened, can accelerate the time that olap analysis is handled like this.
Step S402: member's combination in any in each dimension in the setting primary data, the metric data in the corresponding primary data with it of described combination are stored in internal memory;
In the present embodiment, the metric data in the corresponding primary data with it of described combination are stored in internal memory.The process of storage can have multiple implementation, as combination in any and the metric data form with Hash table is stored in the internal memory.Can also be in internal memory be the corresponding Multidimensional numerical of each combination application space, with the metric data storage in the space.
Step S403: judge whether data quantity stored has exceeded predetermined threshold value in the internal memory after this writes; If do not exceed, execution in step S404 then, if exceed, execution in step S405 then.
Step S404: the metric data storage in the corresponding primary data with it of just described combination is in internal memory;
Step S405: described each combination that exceeds memory threshold is divided at least more than one the set, generates with the corresponding sign of described set and store in the internal memory.
In the present embodiment, utilize the member of each dimension to generate tree form data structure, the combination of all member's father nodes was as described sign during the member was made up.Father node as tuple (aviation, Africa, the first quarter) is combined as (non-land, the Eastern hemisphere, the first half of the year).The pseudo-language of corresponding JAVA is described when providing computer realization below:
Piece Chunk promptly stores the set that a plurality of members make up, and is the set of a plurality of nodes in the hyperspace, and the Chunk size is variable.Chunk is made up of a plurality of nodal information Entry, each Entry represents the information of a node, comprise coordinate points point, coordinate points is member's combination, metric data with the coordinate points correspondence, whether these metric data were revised is kept in the disk again, and coordinate points is a dimension member array, by the member composition in each dimension:
Point
{
Member members[]; //Member is a member on the dimension
Int getPointKey (); The numbering of this point of // calculating
}
Entry
{
Point point; // definition member point;
Object values[]; // metric data;
Boolean isDirty; Whether // these metric data were revised again and were kept in the disk
}
Chunk
{
Int chunkID; The sign of // piece;
Entry entrys[]; // nodal information array;
Add (Point point, Object values[]); // interpolation coordinate points and metric data;
Entry getEntry (int pointKey); // obtain this nodal information;
Object[] getValue (int pointKey); // attainment degree magnitude data;
Save (); // storage;
}
Member's combination of coordinate points is converted to key assignments;
CalcKey (Point point), the key assignments key of a coordinate points of calculating, input Point point obtains the Int value of key.
Member[] ms=point.getMembers (); // the coordinate points member is composed to array;
Int?key=0;
for(int?i=ms.length-1;i>-1;i--)
{
Dimension dim=ms[i] .getDimension (); //getDimension () obtains to the member in the dimension;
Int memberCount=dim.memberCount; // this dimension member is counted;
Key=ms[i] .globalOrdinal+key*memberCount; //globalOrdinal is the global sequence number of this member in dimension;
}
Key is the key assignments of this Point.This key assignments overall situation is unique.
The key assignments that the father node of the coordinate points computing method by key assignments are obtained is as the ID of this coordinate points place piece.Be the process that generates piece ID below.
Int calcChunkID (Point point) calculates pairing ID of a coordinate points.
Member[]members=point.getMembers();
int?len=members.length;
Member[]m2=new?Member[len];
for(int?i=0;i<len;i++)
{
Member parent=members[i] .getParentMember (); // obtain father member
if(parent==null)
m2[i]=members[i];
else
m2[i]=parent;
}
Point?point2=new?Point(m2);
Int key=calcKey (point2); // call calcKey (Point point) function;
The key that obtains is the sign ID of corresponding blocks.
When the sign with described set stores in the internal memory, create index, the sign that generates is saved in the tabulation.
Step S406: utilize described generation sign to judge whether there is identical sign in the index.
Call function searchChunk (int chunk ID), ID searches piece according to piece, from index, search for,
If exist, then execution in step S407; Otherwise execution in step S408.
Step S407: the metric data storage in the corresponding multidimensional data with it of member's combination should be identified in the corresponding set in disk.Implementation algorithm comprises:
Read this piece from disk, antitone sequence changes into memory object.When the metric data are read and write, at first search the Entry that in this piece, whether has this point, if exist, revise this Entry.values,
Call function saveChunk (Chunk chunk, Point point, Object values[]), the value values on the coordinate points point is deposited among the piece chunk;
Otherwise, increase an Entry,
Entry?entry=new?Entry(point,values);
Chunk.entrys.add(entry);
Call function saveChunk (Chunk chunk, Point point, Object values[]), the value values on the coordinate points point is deposited among the piece chunk.
Step S408: newly-built should the sign in disk should identify the metric data storage in the corresponding primary data with it of member's combination in the corresponding set in disk.
There is not this piece, generates a new Chunk, compose the ID value.In this piece, store entry.
To make up and its corresponding metric data when being written in the disk, need earlier the data that write to be converted to byte arrays, is that unit stores in the disk with byte arrays with bucket Bucket, each bucket is a physical allocation unit, form by a plurality of pages of Page, preceding four bytes of bucket are used to write down the size of current use, and real data are since the 5th, and bucket provides basic input-output operation.When the disk storage data, use two files, data file and index files.Data file storage data, the distribution condition of index file recording data files, data file empty bucket situation can occur through after the repeated dispensing, writes down these information by index file.
With the metric data in the corresponding multidimensional data of member combination with it, and under gather corresponding sign and store in internal memory or the disk after, in the process of carrying out olap analysis, need read the metric data of having stored, if the metric data in internal memory, then can be read by member's combination; If the metric data in disk, are then searched by member's combination and being identified in the disk of its generation.Search procedure on disk is,
Step S409: utilize described generation sign to judge whether there is identical sign in the index,, search piece according to ID by call function searchChunk.
If exist, then execution in step S409; Otherwise return sky;
Step S410: judge whether there is the member's combination that to inquire about in the set of this sign; After in judging index, having identical sign, show and store the corresponding collective data of this sign in the disk, in disk, find the corresponding collective data of this sign, travel through the entrys array of this piece, for each entry, if entry.point=imports point, then show to have this member's combination.
If have the member's combination that to inquire about in this set, then execution in step S411; Otherwise return sky.
Step S411: from disk, read the corresponding metric data of this combination, return the metric data entry.values of this coordinate points.
Terminal is by the read-write to multidimensional data, and then generation OLAP form.Because it is to make up with the father node in member's combination to store as being identified in the disk of piece that the metric data are stored in disk, the correlativity of multidimensional data is big in the strategy of this piecemeal, and the data in the piece are moderate, more help analysis and the inquiry of OLAP, when the gathering and assemble of data, more can embody its advantage.
The present invention also provides the device of multidimensional data read-write in a kind of on-line analysing processing system, comprising:
Data capture unit 501 is used for obtaining primary data from data source, and is sent to combination generation unit 502;
Make up generation unit 502, be used for setting the combination in any of member in each dimension of multidimensional data that receives, and the information after will making up is sent to date read-write cell 505 and set division unit 503;
Threshold decision unit 504, be used to store the threshold value of predefined memory multidimensional data amount, and before the date read-write cell execution writes at every turn, after judging this write memory, whether the multidimensional data amount of storing in the internal memory can exceed predetermined threshold, and judged result is sent to date read-write cell 505 and set division unit 504;
Set division unit 504, be used for after receiving the judged result that exceeds predetermined threshold, the combined information that utilization receives is divided into each combination at least more than one the set, generates with the corresponding sign of described set and is sent to date read-write cell 505;
Date read-write cell 505, be used for before execution writes at every turn, this information that writes is sent to threshold decision unit 504, after receiving the judged result of threshold decision unit, with the metric data in the corresponding multidimensional data of described combination with it, and the corresponding sign of described set store in internal memory or the disk, utilize described combination and described sign from disk, to read corresponding metric data.
In device of the present invention, described set division unit 503 is used for utilizing the member of each dimension to generate tree form data structure, with the combination of all member's father nodes in the described combination as described sign.
In device of the present invention, described date read-write cell 505 is used for creating index at internal memory, and described sign is stored in the tabulation.
Device of the present invention also comprises:
Sign judgement unit 506 is used for obtaining the generation sign from set division unit 503, utilizes described generation sign to judge whether there is identical sign in the index, if exist, then the notification data read-write cell 505;
Date read-write cell 505 also is used for after the notice that receives sign judgement unit 506, and the metric data storage in the corresponding multidimensional data with it of described combination should be identified in the corresponding set in disk.
In device of the present invention, described date read-write cell 505 also is used for after the notice that receives sign judgement unit 506, reads in the set of this sign correspondence from disk and the corresponding metric data of described combination.
For method and apparatus of the present invention, within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within protection scope of the present invention.

Claims (10)

1, the method for multidimensional data read-write in a kind of on-line analysing processing system is characterized in that, comprising:
Preestablish in the internal memory threshold value of storage multidimensional data amount, from data source, obtain primary data, set in the primary data member's combination in any in each dimension, with the metric data storage in the corresponding primary data of described combination with it in internal memory;
If exceed described memory threshold, then described each combination that exceeds memory threshold is divided at least more than one the set, generate with the corresponding sign of described set and store in the internal memory, with the metric data of described each combination that exceeds memory threshold in the corresponding primary data with it, reach the corresponding sign of described set and store in the disk, utilize described combination from internal memory or utilize described combination and described sign reads corresponding metric data from disk.
2, method according to claim 1 is characterized in that, generates with the corresponding sign of described set to comprise:
Utilize the member in each dimension to generate tree form data structure, with the combination of all member's father nodes in the described combination as described sign.
3, method according to claim 2 is characterized in that, generation is stored in the internal memory with the corresponding sign of described set and comprised:
In internal memory, create index, described sign is stored in the tabulation.
4, method according to claim 3 is characterized in that, described storing in the disk further comprises:
Utilize described generation sign to judge whether there is identical sign in the index,, then the metric data storage in the corresponding multidimensional data with it of described combination should be identified in the corresponding set in disk if exist.
5, method according to claim 3 is characterized in that, describedly reads corresponding metric data comprise from disk:
Utilize described combination from internal memory, to read corresponding metric data, if there is not described combination in the internal memory, then generate described sign and judge whether there is identical sign in the index, if exist, then judge in the disk in the corresponding set of this sign and whether have described combination, if exist, then return the corresponding metric data of described combination; Otherwise return sky.
6, the device of multidimensional data read-write in a kind of on-line analysing processing system is characterized in that, comprising:
Data capture unit is used for obtaining primary data from data source, and is sent to the combination generation unit;
Make up generation unit, be used for setting the combination in any of member in each dimension of multidimensional data that receives, and the information after will making up is sent to date read-write cell and set division unit;
The threshold decision unit, be used to store the threshold value of predefined memory multidimensional data amount, and before the date read-write cell execution writes at every turn, after judging this write memory, whether the multidimensional data amount of storing in the internal memory can exceed predetermined threshold, and judged result is sent to date read-write cell and set division unit;
The set division unit is used for after receiving the judged result that exceeds predetermined threshold, utilizes the combined information that receives, and each combination is divided at least more than one the set, generates with the corresponding sign of described set and is sent to date read-write cell;
Date read-write cell, be used for before execution writes at every turn, this information that writes is sent to the threshold decision unit, after receiving the judged result of threshold decision unit, with the metric data in the corresponding multidimensional data of described combination with it, and the corresponding sign of described set store in internal memory or the disk, utilize described combination and described sign from disk, to read corresponding metric data.
7, device according to claim 6 is characterized in that, described set division unit is used for utilizing the member of each dimension to generate tree form data structure, with the combination of all member's father nodes in the described combination as described sign.
8, device according to claim 7 is characterized in that, described date read-write cell is used for creating index at internal memory, and described sign is stored in the tabulation.
9, device according to claim 8 is characterized in that, described device also comprises:
Identify judgement unit, be used for obtaining the generation sign, utilize described generation sign to judge whether there is identical sign in the index, if existence, then notification data read-write cell from the set division unit;
Date read-write cell also is used for after the notice that receives the sign judgement unit, and the metric data storage in the corresponding multidimensional data with it of described combination should be identified in the corresponding set in disk.
10, device according to claim 9 is characterized in that, described date read-write cell is used for after the notice that receives the sign judgement unit, reads in the set of this sign correspondence from disk and the corresponding metric data of described combination.
CN200610145081A 2006-12-01 2006-12-01 Multidimensional data reading and writing method and apparatus in on-line analysing processing system Active CN100578499C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200610145081A CN100578499C (en) 2006-12-01 2006-12-01 Multidimensional data reading and writing method and apparatus in on-line analysing processing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200610145081A CN100578499C (en) 2006-12-01 2006-12-01 Multidimensional data reading and writing method and apparatus in on-line analysing processing system

Publications (2)

Publication Number Publication Date
CN1949223A true CN1949223A (en) 2007-04-18
CN100578499C CN100578499C (en) 2010-01-06

Family

ID=38018738

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200610145081A Active CN100578499C (en) 2006-12-01 2006-12-01 Multidimensional data reading and writing method and apparatus in on-line analysing processing system

Country Status (1)

Country Link
CN (1) CN100578499C (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262636A (en) * 2010-05-25 2011-11-30 ***通信集团浙江有限公司 Method and device for generating database partition execution plan
CN102902776A (en) * 2012-09-28 2013-01-30 用友软件股份有限公司 Time dimension member generation device and time dimension member generation method for online analytic processing system
WO2015051499A1 (en) * 2013-10-08 2015-04-16 华为技术有限公司 Method and system for processing content information
CN106503024A (en) * 2015-09-08 2017-03-15 北京国双科技有限公司 Log information processing method and device
CN109407985A (en) * 2018-10-15 2019-03-01 郑州云海信息技术有限公司 A kind of method and relevant apparatus of data management
CN109947705A (en) * 2017-11-28 2019-06-28 中国石油化工股份有限公司 A kind of access System and method for of petroleum works data

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102262636A (en) * 2010-05-25 2011-11-30 ***通信集团浙江有限公司 Method and device for generating database partition execution plan
CN102262636B (en) * 2010-05-25 2012-10-10 ***通信集团浙江有限公司 Method and device for generating database partition execution plan
CN102902776A (en) * 2012-09-28 2013-01-30 用友软件股份有限公司 Time dimension member generation device and time dimension member generation method for online analytic processing system
CN102902776B (en) * 2012-09-28 2016-03-30 用友网络科技股份有限公司 For time dimension member generating apparatus and the method for on-line analysing processing system
WO2015051499A1 (en) * 2013-10-08 2015-04-16 华为技术有限公司 Method and system for processing content information
CN106503024A (en) * 2015-09-08 2017-03-15 北京国双科技有限公司 Log information processing method and device
CN109947705A (en) * 2017-11-28 2019-06-28 中国石油化工股份有限公司 A kind of access System and method for of petroleum works data
CN109407985A (en) * 2018-10-15 2019-03-01 郑州云海信息技术有限公司 A kind of method and relevant apparatus of data management

Also Published As

Publication number Publication date
CN100578499C (en) 2010-01-06

Similar Documents

Publication Publication Date Title
CN1949226A (en) Multidimensional data reading and writing method and apparatus in on-line analytical processing system
CN110019396B (en) Data analysis system and method based on distributed multidimensional analysis
CN1150475C (en) Map data base management method and system therefor
US20190332610A1 (en) Interactive on-demand hypercube synthesis based multi-dimensional drilldown and a pivotal analysis tool and methods of use
CN111124679B (en) Multi-source heterogeneous mass data-oriented time-limited automatic processing method
CN1949223A (en) Multidimensional data reading and writing method and apparatus in on-line analysing processing system
Yoon et al. Exploring technological opportunities by linking technology and products: Application of morphology analysis and text mining
CN112433998B (en) Multisource heterogeneous data acquisition and convergence system and method based on power system
CN101038559A (en) Batch task scheduling engine and dispatching method
CN1384939A (en) Method and apparatus for populating multiple data marts in single aggregation process
CN1956456A (en) Method and apparatus for presenting resource demand in mesh computing system
CN1956457A (en) Method and apparatus for arranging mesh work in mesh computing system
CN1955958A (en) Sort data storage and split catalog inquiry method based on catalog tree
CN1609859A (en) Search result clustering method
CN1359068A (en) Files management method and storage information reproducing device and storage information recording medium
CN106599052B (en) Apache Kylin-based data query system and method
CN1877583A (en) Accessing identification index system and accessing identification index library generation method
CN1920866A (en) Bulletin board system, server for bulletin board system, thread display method for client of bulletin board system, and program
CN1790327A (en) System and method for interactively linking data shapes in a diagram
CN1097796C (en) Method for presenting information on display devices of varying sizes
CN110147377A (en) General polling algorithm based on secondary index under extensive spatial data environment
CN109739882B (en) Big data query optimization method based on Presto and Elasticissearch
CN110175175A (en) Secondary index and range query algorithm between a kind of distributed space based on SPARK
CN108984506A (en) A kind of generation method and device of configurable intelligent report forms
JPWO2017170459A1 (en) Method, program, and system for automatic discovery of relationships between fields in a heterogeneous data source mixed environment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant