CN104317850A - Data processing method and device - Google Patents
Data processing method and device Download PDFInfo
- Publication number
- CN104317850A CN104317850A CN201410542598.7A CN201410542598A CN104317850A CN 104317850 A CN104317850 A CN 104317850A CN 201410542598 A CN201410542598 A CN 201410542598A CN 104317850 A CN104317850 A CN 104317850A
- Authority
- CN
- China
- Prior art keywords
- affairs
- mode bit
- data
- run
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data processing method and a data processing device. The data processing method comprises the following steps of acquiring data to be processed; respectively running multiple transactions to process the data to be processed, wherein the multiple transactions are split from preset transactions in advance and are mutually independent, the preset transactions are used for processing the data to be processed and comprise multiple sub transactions, each transaction in the multiple transactions corresponds to one sub transaction in the multiple sub transactions; judging whether abnormal transactions exist in the multiple transactions; rerunning the abnormal transactions if the abnormal transactions are judged to exist in the multiple transactions. Through the data processing method and the data processing device, the problem of low data processing efficiency in the prior art is solved, and the effect of improving the data processing efficiency is achieved.
Description
Technical field
The present invention relates to data processing field, in particular to a kind of data processing method and device.
Background technology
Affairs are elementary cells that database program performs, and can unify to submit execution result to after an affairs content all executes, and in program, any step execute exception can cause data mode to roll back to before affairs perform, and then causes re-executing this affairs.Affairs can be a Structured Query Language (SQL) (Structured Query Language, referred to as SQL) statements in relational database (as SQL server), also can be programs.
Usually can comprise multiple subtransaction in affairs, in affairs, part separate for function can be divided into multiple subtransaction, these subtransactions of executed in parallel, thus effectively improve data processing performance.Subtransaction refers to the affairs be included in affairs, as the SQL statement of in certain transaction program.
Current for ensureing program parallelization and not broken ring complete function, adopt the method for parallel subtransaction to carry out the parallel processing of fulfillment database program.Namely, in merit can completely affairs, part separate for built-in function is divided into multiple subtransaction executed in parallel.As in the data warehouse ablation process of Conceptual Modeling engineering, after the dimension table data in data warehouse is filled, can walk abreast and fill the data of fact table, between each fact table, data are separate, but all rely on the data in dimension table.Using the process in whole padding data warehouse as complete affairs, so the process of the process of dimension data and each fact table data can be regarded as subtransaction, and each fact table data can be written in parallel to, and are namely multiple parallel subtransactions.The write efficiency of data warehouse can be improved by the parallel processing of subtransaction.
But, because affairs have atomicity, namely to need etc. all completely unifiedly to submit execution result to afterwards.In the meantime any step occur abnormal can cause data rewind start to affairs before state.Such as, in parallel subtransaction, although subtransaction function is separate, if but occur in any one subtransaction that process is abnormal, then can affect other all parallel subtransactions, when certain subtransaction processes again, need again all subtransactions in processing transactions, and not only process the subtransaction occurring exception.Like this, owing to causing the affairs belonging to this subtransaction all to re-execute after certain subtransaction exception, finally cause data-handling efficiency low.
For the problem that data-handling efficiency in prior art is low, at present effective solution is not yet proposed.
Summary of the invention
Fundamental purpose of the present invention is to provide a kind of data processing method and device, to solve the low problem of data-handling efficiency.
To achieve these goals, according to an aspect of the embodiment of the present invention, a kind of data processing method is provided.Method according to data processing of the present invention comprises: obtain pending data; Run multiple affairs respectively to process pending data, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs; Judge the affairs that whether there is operation exception in multiple affairs; And if judge the affairs that there is operation exception in multiple affairs, then rerun the affairs of this operation exception.
Further, running multiple affairs respectively to before processing pending data, data processing method also comprises: obtain the multiple subtransactions preset in affairs; And multiple subtransaction is extracted as multiple independently affairs, obtain multiple affairs.
Further, judge that the affairs that whether there is operation exception in multiple affairs comprise: record the mode bit that in multiple affairs, each affairs are corresponding, mode bit is for reflecting the running status of each affairs in multiple affairs, wherein, when mode bit is for presetting mark, the affairs operation exception that mode bit is corresponding; By judging whether mode bit is preset the affairs that mark judges whether to exist in multiple affairs operation exception.
Further, running multiple affairs respectively to before processing pending data, data processing method also comprises: create the state table being used for flag state position; The mode bit upgraded in state table is operation starting time, operation starting time is the time that multiple affairs bring into operation, wherein, when in multiple affairs during each affairs end of run, the mode bit of the affairs of end of run is updated to the end of run time of the affairs of end of run by state table, judge whether mode bit is that default mark comprises: judge whether mode bit is operation starting time, wherein, if judge that mode bit is operation starting time, then determine the affairs operation exception that mode bit is corresponding.
Further, mode bit is digital state position, wherein, when digital state position is the first numerical value, the affairs end of run of digital state position correspondence, when digital state position is second value, the affairs operation exception of digital state position correspondence, judges that the affairs that whether there is operation exception in multiple affairs comprise: judge that digital state position is the first numerical value or second value, wherein, if when judging that digital state position is the first numerical value, determine the affairs end of run of digital state position correspondence; If when judging that digital state position is second value, determine the affairs operation exception of digital state position correspondence.
To achieve these goals, according to the another aspect of the embodiment of the present invention, provide a kind of data processing equipment.Data processing equipment according to the present invention comprises: the first acquiring unit, for obtaining pending data; Processing unit, for running multiple affairs respectively to process pending data, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs; Judging unit, for judging the affairs that whether there is operation exception in multiple affairs; And running unit, if for judging the affairs that there is operation exception in multiple affairs, then rerun the affairs of this operation exception.
Further, data processing equipment also comprises: second acquisition unit, for running multiple affairs respectively to before processing pending data, obtains the multiple subtransactions preset in affairs; And extraction unit, for multiple subtransaction is extracted as multiple independently affairs, obtain multiple affairs.
Further, judging unit comprises: logging modle, for recording the mode bit that in multiple affairs, each affairs are corresponding, mode bit is for reflecting the running status of each affairs in multiple affairs, wherein, when mode bit is for presetting mark, the affairs operation exception that mode bit is corresponding; First judge module, for by judging that whether mode bit is preset the affairs that mark judges whether to exist in multiple affairs operation exception.
Further, data processing equipment also comprises: creating unit, for running multiple affairs respectively to before processing pending data, creates the state table being used for flag state position; Updating block, be operation starting time for the mode bit upgraded in state table, operation starting time is the time that multiple affairs bring into operation, wherein, when in multiple affairs during each affairs end of run, the mode bit of the affairs of end of run is updated to the end of run time of the affairs of end of run by state table, judge module is also for judging whether mode bit is operation starting time, wherein, if judge that mode bit is operation starting time, then determine the affairs operation exception that mode bit is corresponding.
Further, mode bit is digital state position, wherein, when digital state position is the first numerical value, the affairs end of run of digital state position correspondence, when digital state position is second value, the affairs operation exception of digital state position correspondence, judging unit comprises: the second judge module, for judging that digital state position is the first numerical value or second value, wherein, if when judging that digital state position is the first numerical value, determine the affairs end of run of digital state position correspondence; If when judging that digital state position is second value, determine the affairs operation exception of digital state position correspondence.
According to the embodiment of the present invention, pending data are processed by running multiple affairs respectively, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple parallel subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs, when judging the affairs that there is operation exception in multiple affairs, then only need rerun the affairs of this exception, without the need to running other affairs.And adopt in prior art affairs as default affairs process pending data time, when wherein certain subtransaction occurs abnormal, because affairs have atomicity, need to rerun all subtransactions, in embodiments of the present invention, only need rerun and occur abnormal affairs, substantially increase the efficiency of data processing like this, solve the problem that data-handling efficiency in prior art is low, reach the effect of the efficiency improving data processing.
Accompanying drawing explanation
The accompanying drawing forming a application's part is used to provide a further understanding of the present invention, and schematic description and description of the present invention, for explaining the present invention, does not form inappropriate limitation of the present invention.In the accompanying drawings:
Fig. 1 is the process flow diagram of the data processing method according to the embodiment of the present invention;
Fig. 2 is the process flow diagram according to the preferred data processing method of the embodiment of the present invention;
Fig. 3 is the process flow diagram according to the another preferred data processing method of the embodiment of the present invention;
Fig. 4 is the schematic diagram of the multiple affairs according to the embodiment of the present invention; And
Fig. 5 is the schematic diagram of the data processing equipment according to the embodiment of the present invention.
Embodiment
It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.Below with reference to the accompanying drawings and describe the present invention in detail in conjunction with the embodiments.
The present invention program is understood better in order to make those skilled in the art person, below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the embodiment of a part of the present invention, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, should belong to the scope of protection of the invention.
It should be noted that, term " first ", " second " etc. in instructions of the present invention and claims and above-mentioned accompanying drawing are for distinguishing similar object, and need not be used for describing specific order or precedence.Should be appreciated that the data used like this can be exchanged, in the appropriate case so that embodiments of the invention described herein.In addition, term " comprises " and " having " and their any distortion, intention is to cover not exclusive comprising, such as, contain those steps or unit that the process of series of steps or unit, method, system, product or equipment is not necessarily limited to clearly list, but can comprise clearly do not list or for intrinsic other step of these processes, method, product or equipment or unit.
Embodiments provide a kind of data processing method.
Fig. 1 is the process flow diagram of the data processing method according to the embodiment of the present invention.As shown in Figure 1, to comprise step as follows for this data processing method:
Step S102, obtains pending data.
Pending data can be need processed data, such as, and dimension data (as time data) and/or factual data (as production marketing data).
Step S104, run multiple affairs respectively to process pending data, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple parallel subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs.
Wherein, affairs are program execution unit in database, and can be a SQL statement in relational database (as SQL server), also can be a program.When processing data, affairs being divided into multiple subtransactions of functional independence, and running these subtransactions, effectively can improve data processing performance.Multiple affairs can be: the affairs of write dimension data and the affairs of write factual data.
Default affairs can be the standalone transactions corresponding to pending data, these default affairs are the affairs for the treatment of pending data, such as, in the data that pending data are for being written to data warehouse, so, default affairs are then the affairs pending data being write data warehouse corresponding with it.Particularly, default affairs can be write in data warehouse by SSIS (SQL Server Integration Services) engineering by raw data, for storing the database of multi-dimensional data in data warehouse and Conceptual Modeling, be usually divided into dimension table and fact table.Dimension table stores the dimensional information of all kinds of factual data, and fact table stores achievement data, and is associated with dimension table.If dimension table is timetable, fact table is production marketing table, then have achievement data in production marketing table, and join with time correlation, then dimension table when being associated with.
Default affairs can comprise multiple subtransaction, can there is parallel subtransaction in the plurality of subtransaction.Multiple affairs of the embodiment of the present invention are according to multiple affairs that the function of multiple subtransaction splits out from these default affairs, that is to say, in multiple affairs, each affairs have identical function with the subtransaction of in default affairs, such as, default affairs comprise subtransaction A ', subtransaction B ' and subtransaction C ', the multiple affairs so split into comprise: affairs A, affairs B and affairs C, wherein, affairs A has identical function with subtransaction A ', affairs B has identical function with subtransaction B ', and affairs C has identical function with subtransaction C '.Affairs A, affairs B and affairs C are independently affairs, and each affairs all have atomicity.Like this, utilize and process pending data by multiple affairs, a part for the pending data of each issued transaction, because affairs each in multiple affairs all have independence, in the pending data procedures of process, when certain affairs occurs abnormal, such as, when affairs perform unsuccessfully, then only can re-execute the affairs of this exception.
Step S106, judges the affairs that whether there is operation exception in multiple affairs.
Step S108, if judge the affairs that there is operation exception in multiple affairs, then reruns the affairs of this operation exception.
Judge the affairs that whether there is operation exception in multiple affairs, if existed, then rerun the affairs of this exception, due to separate between multiple affairs, other affairs in multiple affairs are then without the need to reruning; If there is no abnormal transaction, then pending ED.Particularly, the affairs judging whether to exist in multiple affairs operation exception can be the marks by detection record affairs running status, judge that the mode whether this mark shows affairs operation exception judges.
According to the embodiment of the present invention, pending data are processed by running multiple affairs respectively, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple parallel subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs, when judging the affairs that there is operation exception in multiple affairs, then only need rerun the affairs of this exception, without the need to running other affairs.And adopt in prior art affairs as default affairs process pending data time, when wherein certain subtransaction occurs abnormal, because affairs have atomicity, need to rerun all subtransactions, in embodiments of the present invention, only need rerun and occur abnormal affairs, substantially increase the efficiency of data processing like this, solve the problem that data-handling efficiency in prior art is low, reach the effect of the efficiency improving data processing.
Preferably, running multiple affairs respectively to before processing pending data, the data processing method of the embodiment of the present invention also comprises: obtain the multiple subtransactions preset in affairs; Multiple subtransaction is extracted as multiple independently affairs, obtains multiple affairs.
Here default affairs comprise multiple subtransaction, namely in affairs, part separate for function are divided into multiple subtransaction.For ensureing program parallelization and not destroying complete function, adopt the method for parallel subtransaction to carry out the parallel processing of fulfillment database program, the write efficiency of data warehouse can be improved like this.Such as, in the data warehouse ablation process of Conceptual Modeling engineering, after the dimension data table data stuffing of data warehouse, can walk abreast and fill the data of fact table, between each fact table, data are separate, but all rely on the data in dimension table.Using the process in whole padding data warehouse as complete affairs, so the process of the process of dimension data and each fact table data can be regarded as subtransaction, and each fact table data can be written in parallel to, and are namely multiple parallel subtransactions.But, because affairs have atomicity, could unify to submit to after namely needing to wait all operations to complete.In the meantime any step occur abnormal all can cause data rewind start to affairs before state.In parallel subtransaction, although subtransaction function is separate, if occur in any one subtransaction that process is abnormal, then can affect other all parallel subtransactions.When again processing, need again all processes in processing transactions, and be not only occur abnormal branch.In the present invention, parallel subtransaction is extracted as parallel standalone transaction by function, wherein, any one subtransaction occurs abnormal, capital is only occurring reruning this affairs in abnormal subtransaction, and each subtransaction is independent submission to, with this avoid interactional situation between parallel subtransaction (as needs etc. all transaction operation could unify submission after completing).
The embodiment of the present invention, obtain the multiple word subtransactions preset in affairs, multiple subtransaction is extracted as multiple affairs of the embodiment of the present invention, particularly, each subtransaction completed in same affairs is extracted as multiple independently affairs can by a SQL program is split as multiple program or data warehouse write in by the Sequence Container instrument in SSIS engineering, a Container is split as multiple Container by function and completes.Like this, obtain multiple separate affairs by original multiple subtransactions, when making the affairs occurring operation exception in multiple affairs, only need rerun the affairs of this exception.
Fig. 2 is the process flow diagram according to the preferred data processing method of the embodiment of the present invention.The data processing method of this embodiment can be a kind of preferred implementation of the data processing method of above-described embodiment.As shown in Figure 2, to comprise step as follows for this data processing method:
Step S202, obtains pending data.
Step S204, runs multiple affairs respectively to process pending data.
Step S202 and step S204 are identical with step S104 with the step S102 shown in Fig. 1 successively, do not repeat here.
Step S206, records the mode bit that in multiple affairs, each affairs are corresponding, and mode bit is for reflecting the running status of each affairs in multiple affairs.
It should be noted that, mode bit may be used for the running status representing multiple affairs, and wherein, the corresponding mode bit of each affairs in multiple affairs, this mode bit can be for representing the timestamp that affairs are run, and also may be used for the numerical value representing that affairs are run.Such as, when affairs are run successfully, the mode bit of these affairs becomes the first mark, when affairs operation exception (or failure), this mode bit becomes the second mark, like this, just can judge whether these affairs are run successfully or exception by detecting mode bit corresponding to affairs.
By record status bit, the affairs that this mode bit is corresponding judge whether multiple affairs have been run.By the mode of record status bit, the operation conditions of the affairs corresponding to mode bit can be detected fast, thus processed, effectively improve data processing performance.
Step S208, by judging whether mode bit is preset the affairs that mark judges whether to exist in multiple affairs operation exception.Wherein, when mode bit is for presetting mark, then the affairs operation exception that mode bit is corresponding, that is, default mark is that of arranging before affairs are run is used for judging this affairs normal operation whether mark.
Step S210, if judge, in affairs, existence position is the affairs presetting mark, then determine this affairs operation exception.
Step S212, reruns and occurs abnormal affairs.
According to the embodiment of the present invention, by recording the mode bit that in multiple affairs, each affairs are corresponding, judging whether the mode bit of multiple affairs is preset mark, if the mark of presetting, then determining that the affairs that this mode bit is corresponding occur abnormal, reruning abnormal affairs.The affairs of operation exception are determined in utilization state position, improve the detection speed of abnormal transaction, improve the efficiency of data processing further.
Fig. 3 is the process flow diagram according to the another preferred data processing method of the embodiment of the present invention.The data processing method of this embodiment can be a kind of preferred implementation of the data processing method of above-described embodiment.As shown in Figure 3, to comprise step as follows for this data processing method:
Step S302, obtains pending data.
Step S304, creates the state table being used for flag state position.
Step S306, the mode bit upgraded in state table is operation starting time, and operation starting time is the time that multiple affairs bring into operation.
Step S308, runs multiple affairs respectively to process pending data.
Step S310, when in multiple affairs during each affairs end of run, the mode bit of the affairs of end of run is updated to by state table the end of run time of the affairs of end of run.
Step S312, judges whether mode bit is operation starting time.
Step S314, if judge that mode bit is operation starting time, then determines to rerun this affairs by the affairs operation exception that mode bit is corresponding.
Particularly, timestamp can be used in embodiments of the present invention as the mark of running status.The timestamp that record affairs are run wherein, can be when affairs are run successfully, the end of run time corresponding with these affairs in change state table; If run unsuccessfully, then the mode bit in state table is still operation starting time, like this, and can by judging that whether this mode bit is that operation starting time judges whether this state is for being preset mark, thus determine affairs whether operation exception.
Such as, as shown in Figure 4, data in embodiments of the invention are written with 5 affairs and comprise: affairs A (write dimension data), affairs B (write factual data), affairs C (write factual data), affairs D (write factual data) and affairs E (write factual data), wherein, the parallel branch that 4 (affairs B, affairs C, affairs D and affairs E) write factual data is had.
State table is as shown in table 1, when multiple affairs bring into operation, time more in row state table is operation starting time, such as, first time operation starting time is set to 0:00:00, record paralleling transaction end of run time first time, if the end time of paralleling transaction normal operation first time is 15:00:00, then can judge that the paralleling transaction end of run time whether is equally 15:00:00, if equal, then think the success of this issued transaction, and using time that this end of run time 15:00:00 brings into operation as affairs next time.Before program enters each parallel branch, first judge whether timestamp corresponding to this branch equals the time 15:00:00 of this end of run, if unequal, then this branch's affairs operation exception, re-execute the affairs of this branch, other affairs are without the need to reruning; If equal, then directly jump out branch, and using this end of run time 15:00:00 as running the start time next time.If this step judgement is used for ensureing that a certain parallel branch occurs abnormal before, then only process this branch, and do not need normal branch between process after reruning.The efficiency again processed is improved with this.
After branch's affairs end of run of this operation exception, upgrading corresponding timestamp is end of run time 15:00:00.When whole branches, affairs have been run, and again judge whether the operation starting time of 4 paralleling transaction equals the end of run time, if equal, then these affairs are run and all completed.If operation starting time and end of run time are all 15:00:00 in the present embodiment, then these affairs are run and are all completed.
Table 1:
Alternatively, mode bit can also be digital state position.Wherein, when digital state position is the first numerical value, the affairs end of run of digital state position correspondence, when digital state position is second value, the affairs operation exception of digital state position correspondence.
First numerical value and second value can be the data representing different running status, and the first numerical value can be 1, and second value can be 0, and such as, when supposing that mode bit is 1, the affairs of mode bit 1 correspondence terminate, and namely judge affairs normal operation; When supposing that mode bit is 0, the affairs operation exception of mode bit 0 correspondence.
Particularly, before multiple paralleling transaction runs first, the mode bit of the plurality of affairs is set to 0, when end of run first, judge the mode bit that multiple affairs are corresponding respectively, if mode bit becomes 1, the then whole normal operation of multiple affairs, directly runs affairs next time; If the mode bit having at least 1 affairs corresponding between multiple affairs is 0, then the mode bit of this correspondence be 0 affairs rerun, the affairs of other normal operations are not by the impact of the affairs of this operation exception, and when the affairs of this operation exception complete, upgrading corresponding mode bit is 1.When whole affairs have been run, again judge whether the mode bit that the plurality of paralleling transaction is corresponding is 1, if the mode bit of correspondence is all 1, then these affairs are run and are all completed.
The embodiment of the present invention additionally provides a kind of data processing equipment.This device can realize its function by computer equipment.It should be noted that, the data processing equipment of the embodiment of the present invention may be used for performing the data processing method that the embodiment of the present invention provides, and the data processing equipment that the data processing method of the embodiment of the present invention also can be provided by the embodiment of the present invention performs.
Fig. 5 is the schematic diagram of the data processing equipment according to the embodiment of the present invention.As shown in Figure 5, this data processing equipment comprises: the first acquiring unit 10, processing unit 20, judging unit 30 and running unit 40.
First acquiring unit 10 is for obtaining pending data.
Pending data can be need processed data, such as, and dimension data (as time data) and/or factual data (as production marketing data).
Processing unit 20 is for running multiple affairs respectively to process pending data, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs.
Wherein, affairs are program execution unit in database, and can be a SQL statement in relational database (as SQL server), also can be a program.When processing data, affairs being divided into multiple subtransactions of functional independence, and running these subtransactions, effectively can improve data processing performance.Multiple affairs can be: the affairs of write dimension data and the affairs of write factual data.
Default affairs can be the standalone transactions corresponding to pending data, these default affairs are the affairs for the treatment of pending data, such as, in the data that pending data are for being written to data warehouse, so, default affairs are then the affairs pending data being write data warehouse corresponding with it.Particularly, default affairs can be write in data warehouse by SSIS (SQL Server Integration Services) engineering by raw data, for storing the database of multi-dimensional data in data warehouse and Conceptual Modeling, be usually divided into dimension table and fact table.Dimension table stores the dimensional information of all kinds of factual data, and fact table stores achievement data, and is associated with dimension table.If dimension table is timetable, fact table is production marketing table, then have achievement data in production marketing table, and join with time correlation, then dimension table when being associated with.
Default affairs can comprise multiple subtransaction, can there is parallel subtransaction in the plurality of subtransaction.Multiple affairs of the embodiment of the present invention are according to multiple affairs that the function of multiple subtransaction splits out from these default affairs, that is to say, in multiple affairs, each affairs have identical function with the subtransaction of in default affairs, such as, default affairs comprise subtransaction A ', subtransaction B ' and subtransaction C ', the multiple affairs so split into comprise: affairs A, affairs B and affairs C, wherein, affairs A has identical function with subtransaction A ', affairs B has identical function with subtransaction B ', and affairs C has identical function with subtransaction C '.Affairs A, affairs B and affairs C are independently affairs, and each affairs all have atomicity.Like this, utilize multiple affairs to process pending data, a part for the pending data of each issued transaction, because affairs each in multiple affairs all have independence, in the pending data procedures of process, when certain affairs occurs abnormal, such as, when affairs perform unsuccessfully, then only can re-execute the affairs of this exception.
Judging unit 30 is for judging the affairs that whether there is operation exception in multiple affairs.
If running unit 40 for judging the affairs that there is operation exception in multiple affairs, then reruns the affairs of operation exception.
Judge the affairs that whether there is operation exception in multiple affairs, if existed, then rerun the affairs of this exception, due to separate between multiple affairs, other affairs in multiple affairs are then without the need to reruning; If there is no abnormal transaction, then pending ED.Particularly, the affairs judging whether to exist in multiple affairs operation exception can be the marks by detection record affairs running status, judge that the mode whether this mark shows affairs operation exception judges.
According to the embodiment of the present invention, pending data are processed by running multiple affairs respectively, wherein, multiple affairs are the independently multiple affairs each other split out in advance from default affairs, default affairs are the affairs for the treatment of pending data, default affairs comprise multiple parallel subtransaction, a subtransaction in the corresponding multiple subtransaction of each affairs in multiple affairs, when judging the affairs that there is operation exception in multiple affairs, then only need rerun the affairs of this exception, without the need to running other affairs.And adopt in prior art affairs as default affairs process pending data time, when wherein certain subtransaction occurs abnormal, because affairs have atomicity, need to rerun all subtransactions, in embodiments of the present invention, only need rerun and occur abnormal affairs, substantially increase the efficiency of data processing like this, solve the problem that data-handling efficiency in prior art is low, reach the effect of the efficiency improving data processing.
Preferably, data processing equipment also comprises: second acquisition unit, for running multiple affairs respectively to before processing pending data, obtains the multiple subtransactions preset in affairs; And extraction unit, for multiple subtransaction is extracted as multiple independently affairs, obtain multiple affairs.
Here default affairs comprise multiple subtransaction, namely in affairs, part separate for function are divided into multiple subtransaction.For ensureing program parallelization and not destroying complete function, adopt the method for parallel subtransaction to carry out the parallel processing of fulfillment database program, the write efficiency of data warehouse can be improved like this.Such as, in the data warehouse ablation process of Conceptual Modeling engineering, after the dimension data table data stuffing of data warehouse, can walk abreast and fill the data of fact table, between each fact table, data are separate, but all rely on the data in dimension table.Using the process in whole padding data warehouse as complete affairs, so the process of the process of dimension data and each fact table data can be regarded as subtransaction, and each fact table data can be written in parallel to, and are namely multiple parallel subtransactions.But, because affairs have atomicity, could unify to submit to after namely needing to wait all operations to complete.In the meantime any step occur abnormal all can cause data rewind start to affairs before state.In parallel subtransaction, although subtransaction function is separate, if occur in any one subtransaction that process is abnormal, then can affect other all parallel subtransactions.When again processing, need again all processes in processing transactions, and be not only occur abnormal branch.In the present invention, parallel subtransaction is extracted as parallel standalone transaction by function, wherein, any one subtransaction occurs abnormal, capital is only occurring reruning this affairs in abnormal subtransaction, and each subtransaction is independent submission to, with this avoid interactional situation between parallel subtransaction (as needs etc. all transaction operation could unify submission after completing).
The embodiment of the present invention, obtain the multiple word subtransactions preset in affairs, multiple subtransaction is extracted as multiple affairs of the embodiment of the present invention, particularly, each subtransaction completed in same affairs is extracted as multiple independently affairs can by a SQL program is split as multiple program or data warehouse write in by the Sequence Container instrument in SSIS engineering, a Container is split as multiple Container by function and completes.Like this, obtain multiple separate affairs by original multiple subtransactions, when making the affairs occurring operation exception in multiple affairs, only need rerun the affairs of this exception.
Preferably, judging unit comprises: logging modle, for recording the mode bit that in multiple affairs, each affairs are corresponding, mode bit is for reflecting the running status of each affairs in multiple affairs, wherein, when mode bit is for presetting mark, the affairs operation exception that mode bit is corresponding; First judge module, for by judging that whether mode bit is preset the affairs that mark judges whether to exist in multiple affairs operation exception.
It should be noted that, mode bit may be used for the running status representing multiple affairs, and wherein, the corresponding mode bit of each affairs in multiple affairs, this mode bit can be for representing the timestamp that affairs are run, and also may be used for the numerical value representing that affairs are run.Such as, when affairs are run successfully, the mode bit of these affairs becomes the first mark, when affairs operation exception (or failure), this mode bit becomes the second mark, like this, just can judge whether these affairs are run successfully or exception by detecting mode bit corresponding to affairs.
By record status bit, the affairs that this mode bit is corresponding judge whether multiple affairs have been run.By the mode of record status bit, the operation conditions of the affairs corresponding to mode bit can be detected fast, thus processed, effectively improve data processing performance.
When mode bit is for presetting mark, then the affairs operation exception that mode bit is corresponding, that is, default mark is that of arranging before affairs are run is used for judging this affairs normal operation whether mark.
According to the embodiment of the present invention, by recording the mode bit that in multiple affairs, each affairs are corresponding, judging whether the mode bit of multiple affairs is preset mark, if the mark of presetting, then determining that the affairs that this mode bit is corresponding occur abnormal, reruning abnormal affairs.The affairs of operation exception are determined in utilization state position, improve the detection speed of abnormal transaction, improve the efficiency of data processing further.
Preferably, data processing equipment also comprises: creating unit, for running multiple affairs respectively to before processing pending data, creates the state table being used for flag state position; Updating block, be operation starting time for the mode bit upgraded in state table, operation starting time is the time that multiple affairs bring into operation, wherein, when in multiple affairs during each affairs end of run, the mode bit of the affairs of end of run is updated to the end of run time of the affairs of end of run by state table, judge module is also for judging whether mode bit is operation starting time, wherein, if judge that mode bit is operation starting time, then determine the affairs operation exception that mode bit is corresponding.
Particularly, timestamp can be used in embodiments of the present invention as the mark of running status.The timestamp that record affairs are run wherein, can be when affairs are run successfully, the end of run time corresponding with these affairs in change state table; If run unsuccessfully, then the mode bit in state table is still operation starting time, like this, and can by judging that whether this mode bit is that operation starting time judges whether this state is for being preset mark, thus determine affairs whether operation exception.
Such as, as shown in Figure 4, data in embodiments of the invention are written with 5 affairs and comprise: affairs A (write dimension data), affairs B (write factual data), affairs C (write factual data), affairs D (write factual data) and affairs E (write factual data), wherein, the parallel branch that 4 (affairs B, affairs C, affairs D and affairs E) write factual data is had.
State table is as shown in table 1, when multiple affairs bring into operation, time more in row state table is operation starting time, such as, first time operation starting time is set to 0:00:00, record paralleling transaction end of run time first time, if the end time of paralleling transaction normal operation first time is 15:00:00, then can judge that the paralleling transaction end of run time whether is equally 15:00:00, if equal, then think the success of this issued transaction, and using time that this end of run time 15:00:00 brings into operation as affairs next time.Before program enters each parallel branch, first judge whether timestamp corresponding to this branch equals the time 15:00:00 of this end of run, if unequal, then this branch's affairs operation exception, re-execute the affairs of this branch, other affairs are without the need to reruning; If equal, then directly jump out branch, and using this end of run time 15:00:00 as running the start time next time.If this step judgement is used for ensureing that a certain parallel branch occurs abnormal before, then only process this branch, and do not need normal branch between process after reruning.The efficiency again processed is improved with this.
After branch's affairs end of run of this operation exception, upgrading corresponding timestamp is end of run time 15:00:00.When whole branches, affairs have been run, and again judge whether the operation starting time of 4 paralleling transaction equals the end of run time, if equal, then these affairs are run and all completed.If operation starting time and end of run time are all 15:00:00 in the present embodiment, then these affairs are run and are all completed.
Alternatively, mode bit is digital state position, wherein, when digital state position is the first numerical value, the affairs end of run of digital state position correspondence, when digital state position is second value, the affairs operation exception of digital state position correspondence, judging unit comprises: the second judge module, for judging that digital state position is the first numerical value or second value, wherein, if when judging that digital state position is the first numerical value, determine the affairs end of run of digital state position correspondence; If when judging that digital state position is second value, determine the affairs operation exception of digital state position correspondence.
First numerical value and second value can be the data representing different running status, and the first numerical value can be 1, and second value can be 0, and such as, when supposing that mode bit is 1, the affairs of mode bit 1 correspondence terminate, and namely judge affairs normal operation; When supposing that mode bit is 0, the affairs operation exception of mode bit 0 correspondence.
Particularly, before multiple paralleling transaction runs first, the mode bit of the plurality of affairs is set to 0, when end of run first, judge the mode bit that multiple affairs are corresponding respectively, if mode bit becomes 1, the then whole normal operation of multiple affairs, directly runs affairs next time; If the mode bit having at least 1 affairs corresponding between multiple affairs is 0, then the mode bit of this correspondence be 0 affairs rerun, the affairs of other normal operations are not by the impact of the affairs of this operation exception, and when the affairs of this operation exception complete, upgrading corresponding mode bit is 1.When whole affairs have been run, again judge whether the mode bit that the plurality of paralleling transaction is corresponding is 1, if the mode bit of correspondence is all 1, then these affairs are run and are all completed.
It should be noted that, for aforesaid each embodiment of the method, in order to simple description, therefore it is all expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not by the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in instructions all belongs to preferred embodiment, and involved action and module might not be that the present invention is necessary.
In the above-described embodiments, the description of each embodiment is all emphasized particularly on different fields, in certain embodiment, there is no the part described in detail, can see the associated description of other embodiments.
In several embodiments that the application provides, should be understood that, disclosed device, the mode by other realizes.Such as, device embodiment described above is only schematic, the such as division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, such as multiple unit or assembly can in conjunction with or another system can be integrated into, or some features can be ignored, or do not perform.Another point, shown or discussed coupling each other or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of device or unit or communication connection can be electrical or other form.
The described unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location, namely can be positioned at a place, or also can be distributed in multiple network element.Some or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, also can be that the independent physics of unit exists, also can two or more unit in a unit integrated.Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form of SFU software functional unit also can be adopted to realize.
If described integrated unit using the form of SFU software functional unit realize and as independently production marketing or use time, can be stored in a computer read/write memory medium.Based on such understanding, the part that technical scheme of the present invention contributes to prior art in essence in other words or all or part of of this technical scheme can embody with the form of software product, this computer software product is stored in a storage medium, comprises all or part of step of some instructions in order to make a computer equipment (can be personal computer, mobile terminal, server or the network equipment etc.) perform method described in each embodiment of the present invention.And aforesaid storage medium comprises: USB flash disk, ROM (read-only memory) (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), portable hard drive, magnetic disc or CD etc. various can be program code stored medium.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for a person skilled in the art, the present invention can have various modifications and variations.Within the spirit and principles in the present invention all, any amendment done, equivalent replacement, improvement etc., all should be included within protection scope of the present invention.
Claims (10)
1. a data processing method, is characterized in that, comprising:
Obtain pending data;
Run multiple affairs respectively to process described pending data, wherein, described multiple affairs are the independently multiple affairs each other split out in advance from default affairs, described default affairs are the affairs for the treatment of described pending data, described default affairs comprise multiple subtransaction, a subtransaction in the corresponding described multiple subtransaction of each affairs in described multiple affairs;
Judge the affairs that whether there is operation exception in described multiple affairs; And
If judge the affairs that there is operation exception in described multiple affairs, then rerun the affairs of described operation exception.
2. data processing method according to claim 1, is characterized in that, running multiple affairs respectively to before processing described pending data, described data processing method also comprises:
Obtain the multiple subtransactions in described default affairs; And
Described multiple subtransaction is extracted as multiple independently affairs, obtains described multiple affairs.
3. data processing method according to claim 1, is characterized in that, judges that the affairs that whether there is operation exception in described multiple affairs comprise:
Record the mode bit that in described multiple affairs, each affairs are corresponding, described mode bit for reflecting the running status of each affairs in described multiple affairs, wherein, when described mode bit for preset mark time, the affairs operation exception that described mode bit is corresponding;
By judging whether described mode bit is the affairs that described default mark judges whether to exist in described multiple affairs operation exception.
4. data processing method according to claim 3, is characterized in that,
Running multiple affairs respectively to before processing described pending data, described data processing method also comprises: create the state table for marking described mode bit; The mode bit upgraded in described state table is operation starting time, described operation starting time is the time that described multiple affairs bring into operation, wherein, when in described multiple affairs during each affairs end of run, the mode bit of the affairs of end of run is updated to the end of run time of the affairs of described end of run by described state table
Judge whether described mode bit is that described default mark comprises: judge whether described mode bit is described operation starting time, wherein, if judge that described mode bit is described operation starting time, then determine the affairs operation exception that described mode bit is corresponding.
5. data processing method according to claim 3, it is characterized in that, described mode bit is digital state position, wherein, when described digital state position is the first numerical value, the affairs end of run of described digital state position correspondence, when described digital state position is second value, the affairs operation exception of described digital state position correspondence
Judge that the affairs that whether there is operation exception in described multiple affairs comprise: judge that described digital state position is described first numerical value or described second value, wherein, if when judging that described digital state position is described first numerical value, determine the affairs end of run of described digital state position correspondence; If when judging that described digital state position is described second value, determine the affairs operation exception of described digital state position correspondence.
6. a data processing equipment, is characterized in that, comprising:
First acquiring unit, for obtaining pending data;
Processing unit, for running multiple affairs respectively to process described pending data, wherein, described multiple affairs are the independently multiple affairs each other split out in advance from default affairs, described default affairs are the affairs for the treatment of described pending data, described default affairs comprise multiple subtransaction, a subtransaction in the corresponding described multiple subtransaction of each affairs in described multiple affairs;
Judging unit, for judging the affairs that whether there is operation exception in described multiple affairs; And
Running unit, if for judging the affairs that there is operation exception in described multiple affairs, then rerun the affairs of described operation exception.
7. data processing equipment according to claim 6, is characterized in that, described data processing equipment also comprises:
Second acquisition unit, for running multiple affairs respectively to before processing described pending data, obtains the multiple subtransactions in described default affairs; And
Extraction unit, for described multiple subtransaction is extracted as multiple independently affairs, obtains described multiple affairs.
8. data processing equipment according to claim 6, is characterized in that, described judging unit comprises:
Logging modle, for recording the mode bit that in described multiple affairs, each affairs are corresponding, described mode bit for reflecting the running status of each affairs in described multiple affairs, wherein, when described mode bit is for presetting mark, the affairs operation exception that described mode bit is corresponding;
First judge module, for by judging whether described mode bit is the affairs that described default mark judges whether to exist in described multiple affairs operation exception.
9. data processing equipment according to claim 8, is characterized in that,
Described data processing equipment also comprises: creating unit, for running multiple affairs respectively to before processing described pending data, creates the state table for marking described mode bit; Updating block, be operation starting time for the mode bit upgraded in described state table, described operation starting time is the time that described multiple affairs bring into operation, wherein, when in described multiple affairs during each affairs end of run, the mode bit of the affairs of end of run is updated to the end of run time of the affairs of described end of run by described state table
Described judge module, also for judging whether described mode bit is described operation starting time, wherein, if judge that described mode bit is described operation starting time, then determines the affairs operation exception that described mode bit is corresponding.
10. data processing equipment according to claim 8, it is characterized in that, described mode bit is digital state position, wherein, when described digital state position is the first numerical value, the affairs end of run of described digital state position correspondence, when described digital state position is second value, the affairs operation exception of described digital state position correspondence
Described judging unit comprises: the second judge module, for judging that described digital state position is described first numerical value or described second value, wherein, if when judging that described digital state position is described first numerical value, the affairs end of run of described digital state position correspondence is determined; If when judging that described digital state position is described second value, determine the affairs operation exception of described digital state position correspondence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410542598.7A CN104317850B (en) | 2014-10-14 | 2014-10-14 | Data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410542598.7A CN104317850B (en) | 2014-10-14 | 2014-10-14 | Data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104317850A true CN104317850A (en) | 2015-01-28 |
| CN104317850B CN104317850B (en) | 2017-11-14 |
Family
ID=52373082
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410542598.7A Active CN104317850B (en) | 2014-10-14 | 2014-10-14 | Data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104317850B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183791A (en) * | 2015-08-21 | 2015-12-23 | 中国人民解放军装备学院 | Transaction-based data integration method |
| CN106445687A (en) * | 2016-09-27 | 2017-02-22 | 金蝶软件（中国）有限公司 | Large transaction execution method and system |
| WO2018113534A1 (en) * | 2016-12-20 | 2018-06-28 | 阿里巴巴集团控股有限公司 | Database deadlock processing method and apparatus, and database system |
| CN109033301A (en) * | 2018-07-16 | 2018-12-18 | 中国科学技术大学 | A kind of db transaction execution method based on graphics processor |
| CN110990182A (en) * | 2019-12-03 | 2020-04-10 | 腾讯科技（深圳）有限公司 | Transaction processing method, device, equipment and storage medium |
| CN112883045A (en) * | 2021-03-31 | 2021-06-01 | 中国工商银行股份有限公司 | Database transaction splitting execution method and device |
| US11544245B2 (en) | 2019-12-03 | 2023-01-03 | Tencent Technology (Shenzhen) Company Limited | Transaction processing method, apparatus, and device and computer storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101089857A (en) * | 2007-07-24 | 2007-12-19 | 中兴通讯股份有限公司 | Internal store data base transaction method and system |
| US20080120298A1 (en) * | 2006-11-17 | 2008-05-22 | Microsoft Corporation | Parallelizing sequential frameworks using transactions |
| CN102073540A (en) * | 2010-12-15 | 2011-05-25 | 北京新媒传信科技有限公司 | Distributed affair submitting method and device thereof |
| CN102782644A (en) * | 2010-03-01 | 2012-11-14 | 国际商业机器公司 | Performing aggressive code optimization with an ability to rollback changes made by the aggressive optimizations |
| CN103077006A (en) * | 2012-12-27 | 2013-05-01 | 浙江工业大学 | Multithreading-based parallel executing method for long transaction |
-
2014
- 2014-10-14 CN CN201410542598.7A patent/CN104317850B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080120298A1 (en) * | 2006-11-17 | 2008-05-22 | Microsoft Corporation | Parallelizing sequential frameworks using transactions |
| CN101089857A (en) * | 2007-07-24 | 2007-12-19 | 中兴通讯股份有限公司 | Internal store data base transaction method and system |
| CN102782644A (en) * | 2010-03-01 | 2012-11-14 | 国际商业机器公司 | Performing aggressive code optimization with an ability to rollback changes made by the aggressive optimizations |
| CN102073540A (en) * | 2010-12-15 | 2011-05-25 | 北京新媒传信科技有限公司 | Distributed affair submitting method and device thereof |
| CN103077006A (en) * | 2012-12-27 | 2013-05-01 | 浙江工业大学 | Multithreading-based parallel executing method for long transaction |
Non-Patent Citations (2)
| Title |
|---|
| "廖正新": ""事务管理器软件构架及调度优化方法研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 李盛恩 等: ""PARAWARE中事务管理的研究和设计"", 《计算机科学》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105183791A (en) * | 2015-08-21 | 2015-12-23 | 中国人民解放军装备学院 | Transaction-based data integration method |
| CN106445687A (en) * | 2016-09-27 | 2017-02-22 | 金蝶软件（中国）有限公司 | Large transaction execution method and system |
| WO2018113534A1 (en) * | 2016-12-20 | 2018-06-28 | 阿里巴巴集团控股有限公司 | Database deadlock processing method and apparatus, and database system |
| CN109033301A (en) * | 2018-07-16 | 2018-12-18 | 中国科学技术大学 | A kind of db transaction execution method based on graphics processor |
| CN109033301B (en) * | 2018-07-16 | 2021-07-06 | 中国科学技术大学 | Database transaction execution method based on graphic processor |
| CN110990182A (en) * | 2019-12-03 | 2020-04-10 | 腾讯科技（深圳）有限公司 | Transaction processing method, device, equipment and storage medium |
| CN110990182B (en) * | 2019-12-03 | 2021-06-11 | 腾讯科技（深圳）有限公司 | Transaction processing method, device, equipment and storage medium |
| US11544245B2 (en) | 2019-12-03 | 2023-01-03 | Tencent Technology (Shenzhen) Company Limited | Transaction processing method, apparatus, and device and computer storage medium |
| CN112883045A (en) * | 2021-03-31 | 2021-06-01 | 中国工商银行股份有限公司 | Database transaction splitting execution method and device |
| CN112883045B (en) * | 2021-03-31 | 2024-05-17 | 中国工商银行股份有限公司 | Database transaction splitting execution method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104317850B (en) | 2017-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104317850A (en) | Data processing method and device | |
| CN107704539B (en) | Method and device for large-scale text information batch structuring | |
| CN107807982B (en) | Consistency checking method and device for heterogeneous database | |
| CN110781231A (en) | Batch import method, device, equipment and storage medium based on database | |
| CN103714086A (en) | Method and device used for generating non-relational data base module | |
| US10120768B2 (en) | Data management system and method for backup, recovery, and mount of time-series data | |
| US20230205755A1 (en) | Methods and systems for improved search for data loss prevention | |
| CN104778179A (en) | Data migration test method and system | |
| CN105630656A (en) | Log model based system robustness analysis method and apparatus | |
| CN103136244A (en) | Parallel data mining method and system based on cloud computing platform | |
| CN103500224A (en) | Data writing method and device and data reading method and device | |
| CN107103035A (en) | This earth's surface data-updating method and device | |
| CN104603779A (en) | Text mining device, text mining method, and computer-readable recording medium | |
| CN104794130A (en) | Inter-table correlation query method and device | |
| CN112948473A (en) | Data processing method, device and system of data warehouse and storage medium | |
| CN104298570A (en) | Data processing method and device | |
| CN104915435A (en) | Data query method and device | |
| CN104506636A (en) | Method and device for synchronizing data | |
| CN104408097A (en) | Hybrid indexing method and system based on character field hot update | |
| CN111858581A (en) | Page query method and device, storage medium and electronic equipment | |
| CN105760373A (en) | Abnormal data processing method and abnormal data processing device | |
| CN104463627A (en) | Data processing method and device | |
| CN114116699A (en) | Data processing method and device, electronic equipment and computer readable storage medium | |
| CN104881395A (en) | Method and system for obtaining similarity of vectors in matrix | |
| CN112347723A (en) | ROM code extraction verification method and device based on layout |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: Parallel processed data prcessing method and apparatus thereof Effective date of registration: 20190531 Granted publication date: 20171114 Pledgee: Shenzhen Black Horse World Investment Consulting Co., Ltd. Pledgor: Beijing Guoshuang Technology Co.,Ltd. Registration number: 2019990000503 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right | ||
| CP02 | Change in the address of a patent holder |
Address after: 100083 No. 401, 4th Floor, Haitai Building, 229 North Fourth Ring Road, Haidian District, Beijing Patentee after: Beijing Guoshuang Technology Co.,Ltd. Address before: 100086 Beijing city Haidian District Shuangyushu Area No. 76 Zhichun Road cuigongfandian 8 layer A Patentee before: Beijing Guoshuang Technology Co.,Ltd. |
|
| CP02 | Change in the address of a patent holder |