CN105224663A - A kind of data-accessing tasks management method based on multiple data source and device - Google Patents
A kind of data-accessing tasks management method based on multiple data source and device Download PDFInfo
- Publication number
- CN105224663A CN105224663A CN201510645218.7A CN201510645218A CN105224663A CN 105224663 A CN105224663 A CN 105224663A CN 201510645218 A CN201510645218 A CN 201510645218A CN 105224663 A CN105224663 A CN 105224663A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- information table
- executable operations
- accessing tasks
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention is a kind of data-accessing tasks management method based on multiple data source and device, and described method comprises: step a, by the task in data-accessing tasks file after dividing, screen, sorting, generates data source information table and operation information table; Step b, analyzes described data source information table, judges data source isomorphism or isomery; If isomorphism, perform step c; If isomery, perform steps d step c, data access is carried out to described data source, and result feedback is returned report tool; Steps d, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source; Described device comprises the information table generation unit corresponding with each step, analysis of data source unit, isomorphism processing unit and isomery processing unit.Like this, the efficiency of multiple data source being carried out to data access can be improved.
Description
Technical field
The present invention relates to data access technology field, be specifically related to a kind of data-accessing tasks management method based on multiple data source and device.
Background technology
Society, data imply important information and rule because of it, become the basis that user provides service.Flourish along with infotech and internet, data have penetrated into each industry current as the important factor of production, and become large constantly expanding.Extend a lot of concepts of infusion data thus, as data access, be exactly briefly realize the operation such as inquiry, insertion, renewal, deletion to tables of data, data source, be to provide device or the original media of data required for certain, in data source, store the information that all building databases connect.
Many systems and platform all will be faced with the data of magnanimity, and this just requires that the ability of these platform processes data must constantly be strengthened, and namely form is one of them.Form, briefly carry out Dynamic Announce data with the form such as form, chart exactly, the function of general computer processing data and interface generates, shows form.Report data usually needs to obtain from multiple data source, and along with the continuous expansion of data volume, the efficiency of data access has been the important factor in order realizing report capability.
Traditional data-accessing tasks manner of execution performs successively according to task order, and when having task duplication or covering, the method still mechanically performs, and wastes the time.The technology of existing raising data access efficiency comprises: be Database index; The data access authority of user is set, user has been set up the reading of permission or forbidden data, copy, revise or the one, multiple or whole of deletion etc.; Asked data are stored into a file server, and note down, first inquiring about institute's request msg when again receiving data access request whether in file server, if so, directly obtaining from file server.
But above-mentioned technology can not meet the requirement of growing data access amount to the raising of data access efficiency, in the urgent need to the method for data access efficiency more can be improved.
In view of above-mentioned defect, creator of the present invention is through research and test propose a kind of data-accessing tasks management method based on multiple data source and device finally for a long time.
Summary of the invention
The object of the present invention is to provide a kind of data-accessing tasks management method based on multiple data source and device, in order to overcome above-mentioned technological deficiency, how flexible solution is manages data-accessing tasks, improve the data access efficiency to multi-data source, and target data is fed back to the problem of report tool.
For achieving the above object, the technical solution used in the present invention is: first provide a kind of data-accessing tasks management method based on multiple data source, it comprises:
Step a, by the task in data-accessing tasks file after dividing, screen, sorting, generates data source information table and operation information table;
Step b, analyzes described data source information table, judges data source isomorphism or isomery; If isomorphism, perform step c; If isomery, perform steps d;
Step c, carries out data access to described data source, and result feedback is returned report tool;
Steps d, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source.
Like this, the efficiency of multiple data source being carried out to data access can be improved by four steps.By carrying out Homogeneous to the isomeric data extracted, after feeding back to report tool, being conducive to carrying out information exchanging and sharing between these isomeric datas, avoiding and causing because structure is different chart data information displaying complete or clash.
Preferably, described step a comprises:
Task division in described data-accessing tasks file is data source association attributes and concrete executable operations by step a1, and concrete executable operations described in Further Division, the described concrete executable operations after dividing is numbered in order;
Rapid a2, is recorded as described data source information by described data source association attributes and Action number and screens described data source information, generates described data source information table;
Step a3, screens described concrete executable operations, puts together to the described concrete executable operations of same described data source by described Action number order;
Step a5, regularly sorts to operation, generates described operation information table.
Task, by sequence is adjusted in task screening, simplifies, avoids repetitive operation and lose time, and then improve the efficiency of multiple data source being carried out to data access most by the method under the prerequisite not affecting result.
Preferably, described step a also comprises:
Step a4, the described concrete executable operations of same described data source is divided into query manipulation and renewal rewards theory, and described query manipulation has precedence over described renewal rewards theory.
Preferably, in described step a2, described data source information comprises data source, association attributes and Action number.
Preferably, in described step a4, described renewal rewards theory comprises update, deletion action and retouching operation.
Preferably, described steps d comprises:
Steps d 1, performs sequence number according to operation and carries out data access to described data source, be stored in buffer memory by the data of extraction;
Steps d 2, is converted to the data of isomorphism to the data from heterogeneous data source of buffer memory, then the data after conversion are fed back to described report tool as target data.
Secondly, provide the data-accessing tasks management devices based on multiple data source that a kind of with described data-accessing tasks management method is corresponding, it comprises:
Information table generation unit, by the task in described data-accessing tasks file after dividing, screen, sorting, generates described data source information table and described operation information table;
Analysis of data source unit, analyzes described data source information table, judges described data source isomorphism or isomery; If isomorphism, import isomorphism processing unit; If isomery, import isomery processing unit;
Described isomorphism processing unit, carries out data access to described data source, and result feedback is returned described report tool;
Described isomery processing unit, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source.
Preferably, described information table generation unit comprises:
Task division in described data-accessing tasks file is described data source association attributes and described concrete executable operations by task division module, and concrete executable operations described in Further Division, the described concrete executable operations after dividing is numbered in order;
Data source generation module, is recorded as described data source information by described data source association attributes and described Action number and screens described data source information, generates described data source information table;
Operation screening module, screens described concrete executable operations, puts together to the described concrete executable operations of same described data source by described Action number order;
Division of operations module, the described concrete executable operations of same described data source is divided into described query manipulation and described renewal rewards theory, and described query manipulation has precedence over described renewal rewards theory;
Operation generation module, regularly sorts to operation, generates described operation information table.
By to operation filtering screening, will not perform repetitive operation, also namely only perform one time to the operation of the same data of request access, after therefore not needing to use middle temporary storage equipment to facilitate, the access of same request, further increases access speed.
Preferably, described isomery processing unit comprises:
Data cache module, performs sequence number according to described operation and carries out data access to described data source, be stored in buffer memory by the data of extraction;
Data conversion module, is converted to the data of isomorphism to the data from described heterogeneous data source of buffer memory, then the data after conversion are fed back to described report tool as target data.
Beneficial effect of the present invention is compared with the prior art: provide a kind of data-accessing tasks management method based on multiple data source and device, can improve the efficiency of multiple data source being carried out to data access; By carrying out Homogeneous to the isomeric data extracted, after feeding back to report tool, being conducive to carrying out information exchanging and sharing between these isomeric datas, avoiding and causing because structure is different chart data information displaying complete or clash; Task, by sequence is adjusted in task screening, simplifies, avoids repetitive operation and lose time, and then improve the efficiency of multiple data source being carried out to data access most by the method under the prerequisite not affecting result; By to operation filtering screening, will not perform repetitive operation, also namely only perform one time to the operation of the same data of request access, after therefore not needing to use middle temporary storage equipment to facilitate, the access of same request, further increases access speed.
Accompanying drawing explanation
Fig. 1 is the process flow diagram of the data-accessing tasks management method that the present invention is based on multiple data source;
Fig. 2 is the process flow diagram of step a in the data-accessing tasks management method that the present invention is based on multiple data source;
Fig. 3 is the list structure figure of data source information table in the data-accessing tasks management method that the present invention is based on multiple data source;
Fig. 4 is the list structure figure of operation information table in the data-accessing tasks management method that the present invention is based on multiple data source;
Fig. 5 is the process flow diagram of the data-accessing tasks management method steps d that the present invention is based on multiple data source;
Fig. 6 is the structural drawing of the data-accessing tasks management devices that the present invention is based on multiple data source;
Fig. 7 is the structural drawing of information table generation unit in the data-accessing tasks management devices that the present invention is based on multiple data source;
Fig. 8 is the structural drawing of isomery processing unit in the data-accessing tasks management devices that the present invention is based on multiple data source.
Embodiment
Below in conjunction with accompanying drawing, to above-mentioned being described in more detail with other technical characteristic and advantage of the present invention.
As shown in Figure 1, it is the process flow diagram of the data-accessing tasks management method that the present invention is based on multiple data source; Wherein, described data-accessing tasks management method comprises:
Step a, by the task in data-accessing tasks file after dividing, screen, sorting, generates data source information table and operation information table;
Content inside data-accessing tasks file mainly comprises data source association attributes and concrete executable operations two parts information, needs to be divided out; The information of data source association attributes being extracted, through screening, sequence, is described data source information table after information generated table; The information of concrete executable operations being extracted, through screening, sequence, is described operate source information table after information generated table.
Described division includes but not limited to that the division of teaching contents inside by data-accessing tasks file is data source association attributes and concrete executable operations two parts; Described screening includes but not limited to delete or merge the data source correlation attribute information of repetition or concrete executable operations information, makes it retain one; Described sequence includes but not limited to arrange data source correlation attribute information or concrete executable operations information according to established rule.
Step b, analyzes described data source information table, judges data source isomorphism or isomery; If isomorphism, perform step c; If isomery, perform steps d;
Analyze data source information table, judge data source whether isomery, data source isomery here mainly refers to the pattern isomery between data management system.There is difference in the data source format that different data management systems inputs or outputs, for the data source of different-format, if different from the standard format of data management system, then there is incomplete and mistake in the information that data management system cannot identify this data source, read or identify, read.Therefore whether identically need to judge before identifying data source, reading between the form of data source with data management system required standard form, i.e. data source and data management system whether pattern isomery.
This step is in order to a point situation executable operations, also inputs in integrating apparatus by target data, cause operational redundancy, lose time under can avoiding data source isomorphism situation like this.
Step c, carries out data access to described data source, and result feedback is returned report tool;
If data source isomorphism, then perform sequence number according to operation and data access is carried out to data source, and the target data of extraction is fed back to report tool; Namely the associative operation read in table according to data source information table is numbered and data source property, open data source to connect, the all concrete executable operations to this data source is found at operation information table, perform sequence number according to operation and data access is carried out to data source, and the target data of extraction is fed back to report tool.
Steps d, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source.
If data source isomery, then perform sequence number according to operation and data access is carried out to data source, then carry out data Homogeneous, and the target data of extraction is fed back to report tool; Namely the associative operation read in table according to data source information table is numbered and data source property, open data source to connect, the all concrete executable operations to this data source is found at operation information table, perform sequence number according to operation and data access is carried out to data source, Homogeneous is carried out to the heterogeneous target data extracted, and the target data of Homogeneous is fed back to report tool.
Step c of the present invention and steps d can individually perform, and namely arrange different performance elements or execution module performs step c and steps d respectively, and this is the information interchange problem that take into account between isomeric data.Different performance element is set to facilitate the data-accessing tasks of process different situations, the efficiency of data access can be improved.
Step c of the present invention and steps d also can comprehensively perform, namely arrange addressed location and isomorphism unit perform respectively to the data access of data source with to the data Homogeneous of accessing, the flexibility ratio performed when can improve data access like this.
In the present invention, the efficiency of multiple data source being carried out to data access can be improved by four steps.By carrying out Homogeneous to the isomeric data extracted, after feeding back to report tool, being conducive to carrying out information exchanging and sharing between these isomeric datas, avoiding and causing because structure is different chart data information displaying complete or clash.
Embodiment one
Data-accessing tasks management method as described above, the present embodiment and its difference are, as Fig. 2 the present invention is based on shown in the process flow diagram of step a in the data-accessing tasks management method of multiple data source, described step a comprises:
Task division in described data-accessing tasks file is data source association attributes and concrete executable operations by step a1, and concrete executable operations described in Further Division, the described concrete executable operations after dividing is numbered in order;
Content inside data-accessing tasks file mainly comprises data source association attributes and concrete executable operations two parts information, needs the division of teaching contents be just input to inside the data-accessing tasks file of operation filtration unit to become data source association attributes and concrete executable operations two parts.
In this step, concrete executable operations refers to access to a field or amendment, and a concrete executable operations not only correspond to a field, and the access that correspond to this field or amendment; To the numbering that concrete executable operations numbers in order, be Action number, to the access of field or be revised as concrete operations content; Concrete executable operations is numbered in order, then this Action number correspond to this concrete executable operations access or amendment field and to the access of this field or amendment.If desired same field is extracted, revises and stored, then need three concrete executable operations, each concrete executable operations is respectively to should field and to the extraction of this field, this field and to the amendment of this field, this field and the storage to this field; Need three Action numbers, each Action number is respectively to should field and to the extraction of this field, this field and to the amendment of this field, this field and the storage to this field simultaneously.
In this step, field is the data source in data source information, the access of field or amendment is belonged to the content of operation in operation information.
Step a2, is recorded as described data source information by described data source association attributes and Action number and screens described data source information, generates described data source information table;
Data source association attributes and Action number are recorded, as data source information, then data source information comprises data source, association attributes and Action number; Screening data source information, is delete the data source information of making up the number, same data source in this operation and the data source information for repetition of same data source association attributes.
If duplicate, by the data source information repeated, then make it keep a data source information by merging or deleting, then generate data source information table, the data source information table list structure of generation as shown in Figure 3.
By screening, delete the data source information repeated, when not affecting concrete operations, can greatly reduce and needing data source quantity to be processed, improving the access efficiency to data source.
Step a3, screens described concrete executable operations, puts together to the described concrete executable operations of same described data source by described Action number order;
Concrete executable operations information is extracted, if two concrete executable operations are for carry out same operation to same data source, then the operation for repeating; If two concrete executable operations are for carrying out same to same data source but not same operation (as modified to same data source, but amended content is different), are the operation covered.
Concrete operations are screened, exactly by the operation of repetition by merging or deleting (its Action number can be deleted or do not give operation in step a5 and perform sequence number), only retain a concrete executable operations; To the operation covered, cover previous concrete executable operations (a rear Action number can be deleted or operation not in allocation step a5 performs sequence number) by a rear concrete executable operations.
Put together to the operation of same data source by Action number order, perform to get up to perform continuously the operation of same data source like this, avoid not stopping to change data source, improve the access efficiency of the data to multiple data source.
Step a4, the described concrete executable operations of same described data source is divided into query manipulation and renewal rewards theory, and described query manipulation has precedence over described renewal rewards theory;
In this step, query manipulation is the reading to concrete executable operations, and renewal rewards theory comprises update, deletion action and retouching operation etc. to concrete executable operations.
Inquiry is topmost operation, and query manipulation is had precedence over renewal rewards theory, can preferentially perform main operation, improves the access efficiency to the data of multiple data source further.
Step a5, regularly sorts to operation, generates described operation information table.
Rule in this step refers to the rule in step a2, a3 and a4, namely to after data source sequence, put together, and query manipulation has precedence over renewal rewards theory to the concrete executable operations of same data source by Action number order.
Give after sequence to operate and perform sequence number (order that this sequence number performs as operation), generating run information table, the list structure of operation information table as shown in Figure 4.
Task, by sequence is adjusted in task screening, simplifies, avoids repetitive operation and lose time, and then improve the efficiency of multiple data source being carried out to data access most by the method under the prerequisite not affecting result.
In addition, the present embodiment, by operation filtering screening, will not perform repetitive operation, also namely only perform one time to the operation of the same data of request access, therefore after not needing to use middle temporary storage equipment to facilitate, the access of same request, further increases access speed.
Embodiment two
Data-accessing tasks management method as described above, the present embodiment and its difference are, as Fig. 5 the present invention is based on shown in the process flow diagram of the data-accessing tasks management method steps d of multiple data source, described steps d comprises:
Steps d 1, performs sequence number according to operation and carries out data access to described data source, be stored in buffer memory by the data of extraction;
Number and data source property according to the associative operation that data source information table reads in table, open each heterogeneous data source respectively to connect, the all concrete executable operations to this data source is found at operation information table, perform sequence number according to operation and data access is carried out to data source, the data of extraction are stored in buffer memory.
Steps d 2, is converted to the data of isomorphism to the data from heterogeneous data source of buffer memory, then the data after conversion are fed back to described report tool as target data.
The isomeric data stored in the buffer is carried out Homogeneous, be exactly using a certain structure as standard, the data of other structures are all converted to normal structure (normal structure in this step is determined according to the requirement in native system) again by conversion after data feedback to report tool.
In the present embodiment, steps d 1 can be same performance element or same execution module with step c, also can be independently two performance elements or execution module; If same performance element or same execution module, then save a performance element or module, improve the utilization factor of performance element or module; If independently performance element or module, then can process the problem of isomorphism and isomery simultaneously, when the data volume of isomorphism and isomery is all very large, improve the data access efficiency to multiple data source.
Embodiment three
The present embodiment is a kind of data-accessing tasks management devices based on multiple data source, and it is corresponding with data-accessing tasks management method described above; As Fig. 6 the present invention is based on shown in the structural drawing of the data-accessing tasks management devices of multiple data source, it is that wherein, described data-accessing tasks management devices comprises:
Information table generation unit 1, by the task in data-accessing tasks file after dividing, screen, sorting, generates data source information table and operation information table;
Analysis of data source unit 2, analyzes described data source information table, judges data source isomorphism or isomery; If isomorphism, import isomorphism processing unit 3; If isomery, import isomery processing unit 4;
Isomorphism processing unit 3, carries out data access to described data source, and result feedback is returned report tool;
Isomery processing unit 4, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source.
Like this, described data-accessing tasks management devices completes high efficiency data access to multiple data source by four unit.By carrying out Homogeneous to the isomeric data extracted, after feeding back to report tool, being conducive to carrying out information exchanging and sharing between these isomeric datas, avoiding and causing because structure is different chart data information displaying complete or clash.
Embodiment four
Data-accessing tasks management devices as described above, the present embodiment and its difference are, as Fig. 7 the present invention is based on shown in the structural drawing of information table generation unit in the data-accessing tasks management devices of multiple data source, described information table generation unit 1 comprises:
Task division in described data-accessing tasks file is data source association attributes and concrete executable operations by task division module 11, and concrete executable operations described in Further Division, the described concrete executable operations after dividing is numbered in order;
Data source generation module 12, is recorded as described data source information by described data source association attributes and Action number and screens described data source information, generates described data source information table;
Operation screening module 13, screens described concrete executable operations, puts together to the described concrete executable operations of same described data source by described Action number order;
Division of operations module 14, the described concrete executable operations of same described data source is divided into query manipulation and renewal rewards theory, and described query manipulation has precedence over described renewal rewards theory;
Operation generation module 15, regularly sorts to operation, generates described operation information table.
In the present embodiment, task, by sequence is adjusted in task screening, simplifies, avoids repetitive operation and lose time, and then improve the efficiency of multiple data source being carried out to data access most by described information table generation unit under the prerequisite not affecting result.
In addition, the present embodiment, by operation filtering screening, will not perform repetitive operation, also namely only perform one time to the operation of the same data of request access, therefore after not needing to use middle temporary storage equipment to facilitate, the access of same request, further increases access speed.
Embodiment five
Data-accessing tasks management devices as described above, the present embodiment and its difference are, as Fig. 8 the present invention is based on shown in the structural drawing of isomery processing unit in the data-accessing tasks management devices of multiple data source, described isomery processing unit 4 comprises:
Data cache module 41, performs sequence number according to operation and carries out data access to described data source, be stored in buffer memory by the data of extraction;
Data conversion module 42, is converted to the data of isomorphism to the data from heterogeneous data source of buffer memory, then the data after conversion are fed back to described report tool as target data.
In the present embodiment, data cache module 41 can be same execution module with isomorphism processing unit 3, also can be independently two execution modules; If same execution module, then save an execution module, improve the utilization factor of execution module; If independently execution module, then make described data-accessing tasks management devices can process the problem of isomorphism and isomery simultaneously, when the data volume of isomorphism and isomery is all very large, improve the data access efficiency to multiple data source.
The foregoing is only preferred embodiment of the present invention, is only illustrative for the purpose of the present invention, and nonrestrictive.Those skilled in the art is understood, and can carry out many changes in the spirit and scope that the claims in the present invention limit to it, amendment, even equivalence, but all will fall within the scope of protection of the present invention.
Claims (9)
1., based on a data-accessing tasks management method for multiple data source, it is characterized in that, comprising:
Step a, by the task in data-accessing tasks file after dividing, screen, sorting, generates data source information table and operation information table;
Step b, analyzes described data source information table, judges data source isomorphism or isomery; If isomorphism, perform step c; If isomery, perform steps d;
Step c, carries out data access to described data source, and result feedback is returned report tool;
Steps d, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source.
2. data-accessing tasks management method according to claim 1, is characterized in that, described step a comprises:
Task division in described data-accessing tasks file is data source association attributes and concrete executable operations by step a1, and concrete executable operations described in Further Division, the described concrete executable operations after dividing is numbered in order;
Rapid a2, is recorded as data source information by described data source association attributes and Action number and screens described data source information, generates described data source information table;
Step a3, screens described concrete executable operations, puts together to the described concrete executable operations of same described data source by described Action number order;
Step a5, regularly sorts to operation, generates described operation information table.
3. data-accessing tasks management method according to claim 2, is characterized in that, described step a also comprises:
Step a4, the described concrete executable operations of same described data source is divided into query manipulation and renewal rewards theory, and described query manipulation has precedence over described renewal rewards theory.
4. data-accessing tasks management method according to claim 3, is characterized in that, in described step a2, described data source information comprises described data source, association attributes and described Action number.
5. data-accessing tasks management method according to claim 3, is characterized in that, in described step a4, described renewal rewards theory comprises update, deletion action and retouching operation.
6., according to described data-accessing tasks management method arbitrary in claim 1-5, it is characterized in that, described steps d comprises:
Steps d 1, performs sequence number according to operation and carries out data access to described data source, be stored in buffer memory by the data of extraction;
Steps d 2, is converted to the data of isomorphism to the data from heterogeneous data source of buffer memory, then the data after conversion are fed back to described report tool as target data.
7. a data-accessing tasks management devices based on multiple data source corresponding with described data-accessing tasks management method arbitrary in claim 1-7, it is characterized in that, described data-accessing tasks management devices comprises:
Information table generation unit, by the task in described data-accessing tasks file after dividing, screen, sorting, generates described data source information table and described operation information table;
Analysis of data source unit, analyzes described data source information table, judges described data source isomorphism or isomery; If isomorphism, import isomorphism processing unit; If isomery, import isomery processing unit;
Described isomorphism processing unit, carries out data access to described data source, and result feedback is returned described report tool;
Described isomery processing unit, carries out data Homogeneous again after carrying out data access, and result feedback is returned described report tool to described data source.
8. data-accessing tasks management devices according to claim 7, is characterized in that, described information table generation unit comprises:
Task division in described data-accessing tasks file is described data source association attributes and described concrete executable operations by task division module, and concrete executable operations described in Further Division, the described concrete executable operations after dividing is numbered in order;
Data source generation module, is recorded as described data source information by described data source association attributes and described Action number and screens described data source information, generates described data source information table;
Operation screening module, screens described concrete executable operations, puts together to the described concrete executable operations of same described data source by described Action number order;
Division of operations module, the described concrete executable operations of same described data source is divided into described query manipulation and described renewal rewards theory, and described query manipulation has precedence over described renewal rewards theory;
Operation generation module, regularly sorts to operation, generates described operation information table.
9. the data-accessing tasks management devices according to claim 7 or 8, is characterized in that, described isomery processing unit comprises:
Data cache module, performs sequence number according to described operation and carries out data access to described data source, be stored in buffer memory by the data of extraction;
Data conversion module, is converted to the data of isomorphism to the data from described heterogeneous data source of buffer memory, then the data after conversion are fed back to described report tool as target data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510645218.7A CN105224663A (en) | 2015-09-30 | 2015-09-30 | A kind of data-accessing tasks management method based on multiple data source and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510645218.7A CN105224663A (en) | 2015-09-30 | 2015-09-30 | A kind of data-accessing tasks management method based on multiple data source and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105224663A true CN105224663A (en) | 2016-01-06 |
Family
ID=54993631
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510645218.7A Pending CN105224663A (en) | 2015-09-30 | 2015-09-30 | A kind of data-accessing tasks management method based on multiple data source and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105224663A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106055654A (en) * | 2016-06-01 | 2016-10-26 | 东软集团股份有限公司 | Heterogeneous data integration method and device |
| CN106846559A (en) * | 2016-12-20 | 2017-06-13 | 杭州古北电子科技有限公司 | A kind of intelligent district access control system |
| CN109034207A (en) * | 2018-06-29 | 2018-12-18 | 华南理工大学 | Data classification method, device and computer equipment |
| CN111324652A (en) * | 2020-02-17 | 2020-06-23 | 苏宁云计算有限公司 | Resource distribution method and device |
| CN115408401A (en) * | 2022-10-31 | 2022-11-29 | 北京百分点科技集团股份有限公司 | Data storage method and device, computer equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103412956A (en) * | 2013-08-30 | 2013-11-27 | 北京中科江南软件有限公司 | Data processing method and system for heterogeneous data sources |
| CN103916368A (en) * | 2012-12-31 | 2014-07-09 | ***通信集团公司 | Method and apparatus for realizing data processing among different data sources |
-
2015
- 2015-09-30 CN CN201510645218.7A patent/CN105224663A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103916368A (en) * | 2012-12-31 | 2014-07-09 | ***通信集团公司 | Method and apparatus for realizing data processing among different data sources |
| CN103412956A (en) * | 2013-08-30 | 2013-11-27 | 北京中科江南软件有限公司 | Data processing method and system for heterogeneous data sources |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106055654A (en) * | 2016-06-01 | 2016-10-26 | 东软集团股份有限公司 | Heterogeneous data integration method and device |
| CN106055654B (en) * | 2016-06-01 | 2019-06-25 | 东软集团股份有限公司 | The integration method and device of isomeric data |
| CN106846559A (en) * | 2016-12-20 | 2017-06-13 | 杭州古北电子科技有限公司 | A kind of intelligent district access control system |
| CN109034207A (en) * | 2018-06-29 | 2018-12-18 | 华南理工大学 | Data classification method, device and computer equipment |
| CN109034207B (en) * | 2018-06-29 | 2021-01-05 | 华南理工大学 | Data classification method and device and computer equipment |
| CN111324652A (en) * | 2020-02-17 | 2020-06-23 | 苏宁云计算有限公司 | Resource distribution method and device |
| CN115408401A (en) * | 2022-10-31 | 2022-11-29 | 北京百分点科技集团股份有限公司 | Data storage method and device, computer equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106934014B (en) | Hadoop-based network data mining and analyzing platform and method thereof | |
| CN105224663A (en) | A kind of data-accessing tasks management method based on multiple data source and device | |
| CN107003935A (en) | Optimize database duplicate removal | |
| CN112749194A (en) | Visualized data processing method and device, electronic equipment and readable storage medium | |
| CN104598376A (en) | Data driving layered automation test system and method | |
| CN105389402A (en) | Big-data-oriented ETL (Extraction-Transformation-Loading) method and device | |
| CN102663076B (en) | Method for processing file data | |
| CN103488706A (en) | Processing method and device for mass data base | |
| CN104881466A (en) | Method and device for processing data fragments and deleting garbage files | |
| CN111382226A (en) | Database query retrieval method and device and electronic equipment | |
| CN105786808A (en) | Method and apparatus for executing relation type calculating instruction in distributed way | |
| US5586239A (en) | Computer controlled graphics display system for supporting information classification | |
| CN106802905B (en) | Collaborative data exchange method of isomorphic PLM system | |
| CN103810219A (en) | Line storage database-based data processing method and device | |
| CN107526746A (en) | The method and apparatus of management document index | |
| CN103678715A (en) | Snapshot supporting metadata information management method for distributed file system | |
| CN104834650A (en) | Method and system for generating effective query tasks | |
| CN110941629A (en) | Metadata processing method, device, equipment and computer readable storage medium | |
| CN111177244A (en) | Data association analysis method for multiple heterogeneous databases | |
| CN111427865A (en) | Method and device for managing objects of database | |
| CN114090695A (en) | Query optimization method and device for distributed database | |
| CN115391427A (en) | System, method, medium, and apparatus for automatic scaling of Impala | |
| CN113704248B (en) | Block chain query optimization method based on external index | |
| JP2007133624A (en) | Information management method and device using connection relation information | |
| CN113553458A (en) | Data export method and device in graph database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160106 |