CN110222027A - The quantity method of calibration and computer readable storage medium of Data Migration - Google Patents
The quantity method of calibration and computer readable storage medium of Data Migration Download PDFInfo
- Publication number
- CN110222027A CN110222027A CN201910333181.2A CN201910333181A CN110222027A CN 110222027 A CN110222027 A CN 110222027A CN 201910333181 A CN201910333181 A CN 201910333181A CN 110222027 A CN110222027 A CN 110222027A
- Authority
- CN
- China
- Prior art keywords
- data
- tables
- major key
- missing
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses the quantity method of calibration and computer readable storage medium of a kind of Data Migration, method includes: the major key ID for obtaining migrating data in old database, and the first set into Redis database is written after the major key ID is ranked up；According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；According to the first major key ID and the last one major key ID in the first set, the major key ID in corresponding range is inquired in each tables of data respectively, and the second set that each tables of data is corresponded into Redis database is written；According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain the corresponding missing set of each tables of data；If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.The efficiency of verification can be improved in the present invention.
Description
Technical field
The present invention relates to technical field of data check more particularly to the quantity methods of calibration and computer of a kind of Data Migration
Readable storage medium storing program for executing.
Background technique
In the prior art, all there are a corresponding server-sides for many systems, and in each system also there are
One corresponding database, because of the mode of internet, user data is increased significantly, so also storing in database a large amount of
Data.It is applied and is updated frequently due to internet system, it may appear that while the case where use new and old edition, in this scenario,
New version system connects new database and uses, and old version system connects old database and uses.It, may in order to be compatible with new legacy data
It needs to carry out Data Migration, migrates old database information into new database.
The transition process of data, mainly one in old database or multiple tables move to new number by migrator
It is the data of lot lot to carry out Data Migration, without pipe transfer under normal circumstances according to one or multiple tables in library
How is the result of data, finally requires the verifying for carrying out data bulk.For example, the data in certain of old database table
(a corresponding major key ID) is moved in new database, can generate 3 datas in corresponding 3 tables according to business demand,
Middle major key ID is consistent.At this time, it may be necessary to carry out the quantity validation of Data Migration.
Currently, carry out Data Migration quantity validation mode have it is following several:
1, corresponding library table record sum is inquired by count (*)；But this mode can only know a total quantity, nothing
Which clear ID of method or record lack, and need to carry out one by one the contrast operation of data.
2, the information of batch query old database table inquires the record information in new database, such as one by one or in bulk
Fruit, which exists, then illustrates that record migrates successfully, fails if there is no then illustrating to migrate.But by the way of one by one, there can be efficiency
Low problem, and batch mode is limited to the inquiry quantity limitation of database support.For example, (for inquiring by the way of in
Data within the scope of some) inquiry of Lai Jinhang SQL compares, i.e., first inquires batch of data in old database, then use
Which data is the mode of in, which inquire, is present in new database, and the then explanation being not present is the data of migration failure.But it uses
, then there is quantitative limitation in the mode of in, the parameter that in is followed by oracle no more than 1000, and mysql or
It substantially can not be more than thousands of, in this way, can only inquire every time the problem of limitation there is also quantity in other databases of person
1000 or so data can not promote verification efficiency, if data volume is very big, need time-consuming for a long time.
Summary of the invention
The technical problems to be solved by the present invention are: providing the quantity method of calibration of a kind of Data Migration and computer-readable
The efficiency of verification can be improved in storage medium.
In order to solve the above-mentioned technical problem, a kind of the technical solution adopted by the present invention are as follows: quantity verification side of Data Migration
Method, comprising:
The major key ID of migrating data is obtained in old database, and is written after the major key ID is ranked up to Redis
First set in database；
According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；
According to the first major key ID and the last one major key ID in the first set, respectively in each tables of data
The middle major key ID inquired in corresponding range, and the second set that each tables of data is corresponded into Redis database is written；
According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain each data
The corresponding missing set of table；
If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.
The invention further relates to a kind of computer readable storage mediums, are stored thereon with computer program, and described program is located
Reason device realizes following steps when executing:
The major key ID of migrating data is obtained in old database, and is written after the major key ID is ranked up to Redis
First set in database；
According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；
According to the first major key ID and the last one major key ID in the first set, respectively in each tables of data
The middle major key ID inquired in corresponding range, and the second set that each tables of data is corresponded into Redis database is written；
According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain each data
The corresponding missing set of table；
If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.
The beneficial effects of the present invention are: by the way that major key ID corresponding in new old database is respectively written into Redis data
In the different sets in library, then in the way of the set operation in Redis, missing set is calculated, passes through judgement missing set
It whether is that sky can judge whether Data Migration migrates completely；Success is not migrated simultaneously as storing in missing set
Major key ID, therefore can also quickly determine specific missing data, be migrated again convenient for subsequent.The present invention can be quick
It determines missing total amount and specific missing data, substantially increases the verification efficiency of Data Migration.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the quantity method of calibration of Data Migration of the invention；
Fig. 2 is the method flow diagram of the embodiment of the present invention one.
Specific embodiment
To explain the technical content, the achieved purpose and the effect of the present invention in detail, below in conjunction with embodiment and cooperate attached
Figure is explained in detail.
The most critical design of the present invention is: Redis data will be respectively written into corresponding major key ID in new old database
Different sets in library quickly calculate then in the way of the set operation in Redis and do not migrate successful data.
Referring to Fig. 1, a kind of quantity method of calibration of Data Migration, comprising:
The major key ID of migrating data is obtained in old database, and is written after the major key ID is ranked up to Redis
First set in database；
According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；
According to the first major key ID and the last one major key ID in the first set, respectively in each tables of data
The middle major key ID inquired in corresponding range, and the second set that each tables of data is corresponded into Redis database is written；
According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain each data
The corresponding missing set of table；
If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.
As can be seen from the above description, the beneficial effects of the present invention are: it can quickly determine missing total amount and specific missing number
According to substantially increasing the verification efficiency of Data Migration.
Further, the first major key ID and the last one major key ID according in the first set, respectively
The major key ID in corresponding range is inquired in each tables of data, and is written and is corresponded to the of each tables of data into Redis database
Two set specifically:
Using first major key ID in the first set as ID is started, by the last one master in the first set
Key ID as terminate ID, in the corresponding tables of data of the migrating data inquiry be greater than or equal to the beginning ID and be less than or
Equal to the major key ID for terminating ID, and is written after the major key ID inquired is ranked up and corresponds to institute into Redis database
State the second set of a tables of data.
Seen from the above description, since the major key ID in first set is arranged in order, by obtaining first
A major key ID and the last one major key ID can determine the range of the major key ID in first set, by the range in new data
It is inquired in library, it is ensured that it is successfully main that all come from old database migration and migrations are got in new database
Key ID.
Further, described according to the first set and the second set of each tables of data of the correspondence, it calculates separately
Obtain the corresponding missing set of each tables of data specifically:
The first set is subjected to intersection calculating with the second set of corresponding each tables of data respectively, is obtained corresponding each
The intersection set of tables of data；
The first set is subjected to difference set calculating with the intersection set of corresponding each tables of data respectively, is obtained described each
The corresponding missing set of tables of data.
Seen from the above description, since the major key ID increased newly in new database may be got when obtaining second set,
Therefore it first passes through calculating intersection and screens out these newly-increased major key ID, obtain migrating coming from old database in new database and move
Successful major key ID is moved, then cuts intersection with the first set obtained from old database again, i.e., in all migrating datas
The successful major key ID of migration is screened out in major key ID, remaining is the major key ID of migration failure.
Further, described according to the first set and the second set of each tables of data of the correspondence, it calculates separately
After obtaining the corresponding missing set of each tables of data, further comprise:
If the corresponding missing set of each tables of data is not sky, respectively according to the corresponding missing collection of each tables of data
It closes, the major key ID lacked in each tables of data is migrated again.
Seen from the above description, it is migrated again by the major key ID to missing, guarantees the integrality of Data Migration.
The present invention also proposes a kind of computer readable storage medium, is stored thereon with computer program, and described program is located
Reason device realizes step as described above when executing.
Embodiment one
Referring to figure 2., the embodiment of the present invention one are as follows: a kind of quantity method of calibration of Data Migration, it can be to new legacy data
The migration integrality of Data Migration between library is verified, and is included the following steps:
S1: in old database obtain migrating data major key ID, and be written after the major key ID is ranked up to
First set in Redis database.
Specifically, it in a manner of paging query major key ID, and with the sortord of ID ascending order, inquires and moves in old database
Move data major key ID, every batch of inquire 10000 ID, and in a manner of pipeline in Redis (pipeline) batch (batch)
These ID are written in the first set of Redis (data structure is set set in Redis), and 1,000,000 major keys are written when amounting to
ID then suspends write-in into first set.
S2: according to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained.Its
In, mapping ruler is depending on different business scenario and business demand.
For example, it is assumed that only organized relevant data, major key ID are organization id in old database, these Data Migrations are arrived
In new database, in addition to organizing relevant data, the relevant data of generating mechanism and it can also will record between tissue and mechanism
Corresponding relationship, that is to say, that the tissue Data Migration in old database can be mapped into new database tissue table, institution table with
And in node table (corresponding relationship for record organization and mechanism) this three tables of data, all there is tissue in this three tables of data
This field of ID, it is subsequent to be inquired in this three tables of data.
S3: according to the first major key ID and the last one major key ID in the first set, respectively in each number
According to the major key ID inquired in corresponding range in table, and the second set that each tables of data is corresponded into Redis database is written.
Specifically, using first major key ID in first set as ID is started, by the last one master in first set
Key ID, then using the beginning ID and end ID as data base querying parameter, passes through paging query major key ID as ID is terminated
Mode, and with the sortord of ID ascending order, inquiry is greater than the beginning in each tables of data in new database respectively
ID and the major key ID for being less than the end ID, every batch of inquire 10000 ID, and in a manner of pipeline in Redis (pipeline)
The ID that (batch) inquires these in batches is written in the second set for corresponding to each tables of data in Redis database.
Wherein, if step S1 uses the sortord of descending, using first major key ID in first set as terminating
ID, using the last one major key ID in first set as beginning ID.
For example, inquiry is greater than beginning ID and is less than the major key ID for terminating ID, the major key that then will be inquired in tissue table
Write-in corresponds to the second set of the tissue table into Redis database after ID is ranked up；And so on, obtain corresponding institution table
Second set and corresponding node table second set.
S4: it according to the first set and the second set of each tables of data of the correspondence, calculates separately to obtain described each
The corresponding missing set of tables of data.
Specifically, the first set is subjected to intersection calculating with the second set of corresponding each tables of data respectively, obtained
To the intersection set of each tables of data of correspondence；It is poor that the first set is carried out with the intersection set of corresponding each tables of data respectively
Collection calculates, and obtains the corresponding missing set of each tables of data.
For example, it is assumed that first set is denoted as A, the second set of corresponding tissue table is denoted as B, by the of corresponding institution table
Two set are denoted as C, and the second set of corresponding node table is denoted as D.Since A, B, C, D are the set in Redis database, because
This can carry out the operation for taking intersection union and difference set.Therefore, the intersection operation of Redis, obtained intersection are first carried out to A and B
Set is denoted as B1；The intersection operation of Redis is carried out to A and C, obtained intersection set is denoted as C1；The friendship of Redis is carried out to A and D
Collection operation, obtained intersection set are denoted as D1.Then the difference operation of Redis is carried out to A and B1, obtained difference set set is denoted as
B2, B2 are the corresponding missing set of tissue table；The difference operation of Redis is carried out to A and C1, obtained difference set set is denoted as
C2, C2 are the corresponding missing set of institution table；The difference operation of Redis is carried out to A and D1, obtained difference set set is denoted as
D2, D2 are the corresponding missing set of node table.
S5: judge whether the corresponding missing set of each tables of data is sky, if so, S6 is thened follow the steps, if it is not, then holding
Row step S7.
S6: determine that the quantity validation of Data Migration passes through, i.e., migrating data is without missing.
S7: gathering according to the corresponding missing of each tables of data respectively, to the major key ID lacked in each tables of data into
Row migrates again.Specifically, if the corresponding missing set of a tables of data is not sky, then it represents that some migrating datas move to new number
It is not mapped to the table when according to library, then mends the major key ID of missing in the table again from being mapped in the table in old database
Fill the major key ID of missing.
Further, step S1, S3 and S4 can be executed by multiple asynchronous tasks.
Further, after step S6 and step S7, then it represents that the major key ID of present lot has located in first set
Reason finishes, and can start the operation for carrying out next batch, that is, re-execute the steps S1.Preferably, re-execute the steps S1 it
Before, it can first empty first set.Therefore, the present embodiment can carry out data check to the data volume of million ranks, compared to existing
There is mode to substantially increase verification efficiency.
The present embodiment loads the correspondence ID of new old database using the set operation mode in single point R edis in batch
Into single point R edis, in a manner of set operation in Redis, the intersection in two set is calculated, later, by legacy data set button
Except intersection, remaining data are without migrating successful ID.It by this way can be clearly without migrating successful data number
Amount and specific data information, can be used for it is subsequent migrated again or other operations, and each set operation can be with hundred
Ten thousand number of levelss carry out operation, and the fast hundred times of the calculating that the mode than in front of carries out substantially increase the effect of verification
Rate.
Embodiment two
The present embodiment is a kind of computer readable storage medium of corresponding above-described embodiment, is stored thereon with computer journey
Sequence realizes following steps when described program is executed by processor:
The major key ID of migrating data is obtained in old database, and is written after the major key ID is ranked up to Redis
First set in database；
According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；
According to the first major key ID and the last one major key ID in the first set, respectively in each tables of data
The middle major key ID inquired in corresponding range, and the second set that each tables of data is corresponded into Redis database is written；
According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain each data
The corresponding missing set of table；
If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.
Further, the first major key ID and the last one major key ID according in the first set, respectively
The major key ID in corresponding range is inquired in each tables of data, and is written and is corresponded to the of each tables of data into Redis database
Two set specifically:
Using first major key ID in the first set as ID is started, by the last one master in the first set
Key ID as terminate ID, in the corresponding tables of data of the migrating data inquiry be greater than or equal to the beginning ID and be less than or
Equal to the major key ID for terminating ID, and is written after the major key ID inquired is ranked up and corresponds to institute into Redis database
State the second set of a tables of data.
Further, described according to the first set and the second set of each tables of data of the correspondence, it calculates separately
Obtain the corresponding missing set of each tables of data specifically:
The first set is subjected to intersection calculating with the second set of corresponding each tables of data respectively, is obtained corresponding each
The intersection set of tables of data；
The first set is subjected to difference set calculating with the intersection set of corresponding each tables of data respectively, is obtained described each
The corresponding missing set of tables of data.
Further, described according to the first set and the second set of each tables of data of the correspondence, it calculates separately
After obtaining the corresponding missing set of each tables of data, further comprise:
If the corresponding missing set of each tables of data is not sky, respectively according to the corresponding missing collection of each tables of data
It closes, the major key ID lacked in each tables of data is migrated again.
In conclusion the quantity method of calibration and computer readable storage medium of a kind of Data Migration provided by the invention,
By the way that major key ID corresponding in new old database to be respectively written into the different sets of Redis database, then using in Redis
Set operation mode, calculate missing set, by judge missing gather whether be whether sky can judge Data Migration
Migration is complete；Successful major key ID is not migrated simultaneously as storing in missing set, therefore can also quickly determine and provide
The missing data of body is migrated again convenient for subsequent；It is migrated again by the major key ID to missing, guarantees Data Migration
Integrality.The present invention can quickly determine missing total amount and specific missing data, substantially increase the verification effect of Data Migration
Rate.
The above description is only an embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalents made by bright specification and accompanying drawing content are applied directly or indirectly in relevant technical field, similarly include
In scope of patent protection of the invention.
Claims (8)
1. a kind of quantity method of calibration of Data Migration characterized by comprising
The major key ID of migrating data is obtained in old database, and is written after the major key ID is ranked up to Redis data
First set in library；
According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；
According to the first major key ID and the last one major key ID in the first set, looked into each tables of data respectively
The major key ID in corresponding range is ask, and the second set for corresponding to each tables of data into Redis database is written；
According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain each tables of data pair
The missing set answered；
If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.
2. the quantity method of calibration of Data Migration according to claim 1, which is characterized in that described according to first collection
First major key ID and the last one major key ID in conjunction inquire the major key in corresponding range in each tables of data respectively
ID, and the second set that each tables of data is corresponded into Redis database is written specifically:
Using first major key ID in the first set as ID is started, by the last one major key ID in the first set
As ID is terminated, inquiry is greater than or equal to the beginning ID and is less than or equal in the corresponding tables of data of the migrating data
The major key ID for terminating ID, and be written after the major key ID inquired is ranked up and correspond to described one into Redis database
The second set of tables of data.
3. the quantity method of calibration of Data Migration according to claim 1, which is characterized in that described according to first collection
The second set of conjunction and each tables of data of the correspondence calculates separately to obtain the corresponding missing set of each tables of data specifically
Are as follows:
The first set is subjected to intersection calculating with the second set of corresponding each tables of data respectively, obtains corresponding to each data
The intersection set of table；
The first set is subjected to difference set calculating with the intersection set of corresponding each tables of data respectively, obtains each data
The corresponding missing set of table.
4. the quantity method of calibration of Data Migration according to claim 1, which is characterized in that described according to first collection
The second set of conjunction and each tables of data of the correspondence calculates separately after obtaining the corresponding missing set of each tables of data,
Further comprise:
If the corresponding missing set of each tables of data is not sky, respectively according to the corresponding missing set of each tables of data,
The major key ID lacked in each tables of data is migrated again.
5. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that described program is by processor
Following steps are realized when execution:
The major key ID of migrating data is obtained in old database, and is written after the major key ID is ranked up to Redis data
First set in library；
According to preset mapping ruler, the migrating data corresponding each tables of data in new database is obtained；
According to the first major key ID and the last one major key ID in the first set, looked into each tables of data respectively
The major key ID in corresponding range is ask, and the second set for corresponding to each tables of data into Redis database is written；
According to the first set and the second set of each tables of data of the correspondence, calculate separately to obtain each tables of data pair
The missing set answered；
If the corresponding missing set of each tables of data is sky, determine that the quantity validation of Data Migration passes through.
6. computer readable storage medium according to claim 5, which is characterized in that described according in the first set
First major key ID and the last one major key ID, the major key ID in corresponding range is inquired in each tables of data respectively,
And the second set that each tables of data is corresponded into Redis database is written specifically:
Using first major key ID in the first set as ID is started, by the last one major key ID in the first set
As ID is terminated, inquiry is greater than or equal to the beginning ID and is less than or equal in the corresponding tables of data of the migrating data
The major key ID for terminating ID, and be written after the major key ID inquired is ranked up and correspond to described one into Redis database
The second set of tables of data.
7. computer readable storage medium according to claim 5, which is characterized in that it is described according to the first set with
And the second set of each tables of data of correspondence, it calculates separately to obtain the corresponding missing set of each tables of data specifically:
The first set is subjected to intersection calculating with the second set of corresponding each tables of data respectively, obtains corresponding to each data
The intersection set of table；
The first set is subjected to difference set calculating with the intersection set of corresponding each tables of data respectively, obtains each data
The corresponding missing set of table.
8. computer readable storage medium according to claim 5, which is characterized in that it is described according to the first set with
And the second set of each tables of data of correspondence, it calculates separately after obtaining the corresponding missing set of each tables of data, into one
Step includes:
If the corresponding missing set of each tables of data is not sky, respectively according to the corresponding missing set of each tables of data,
The major key ID lacked in each tables of data is migrated again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910333181.2A CN110222027A (en) | 2019-04-24 | 2019-04-24 | The quantity method of calibration and computer readable storage medium of Data Migration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910333181.2A CN110222027A (en) | 2019-04-24 | 2019-04-24 | The quantity method of calibration and computer readable storage medium of Data Migration |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110222027A true CN110222027A (en) | 2019-09-10 |
Family
ID=67819966
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910333181.2A Pending CN110222027A (en) | 2019-04-24 | 2019-04-24 | The quantity method of calibration and computer readable storage medium of Data Migration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110222027A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111190884A (en) * | 2019-12-17 | 2020-05-22 | 腾讯科技（深圳）有限公司 | Data verification method, device and computer readable storage medium |
| CN111611253A (en) * | 2020-04-01 | 2020-09-01 | 石化盈科信息技术有限责任公司 | Data verification method, device and storage medium |
| CN112579591A (en) * | 2019-09-30 | 2021-03-30 | 重庆小雨点小额贷款有限公司 | Data verification method and device, electronic equipment and computer readable storage medium |
| CN112835869A (en) * | 2021-01-15 | 2021-05-25 | 中国船舶重工集团公司七五0试验场 | Fuzzy data cleaning method based on reverse data irrigation |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103793424A (en) * | 2012-10-31 | 2014-05-14 | 阿里巴巴集团控股有限公司 | Database data migration method and database data migration system |
| CN104252481A (en) * | 2013-06-27 | 2014-12-31 | 阿里巴巴集团控股有限公司 | Dynamic check method and device for consistency of main and salve databases |
| CN104778179A (en) * | 2014-01-14 | 2015-07-15 | 阿里巴巴集团控股有限公司 | Data migration test method and system |
| US20150378855A1 (en) * | 2013-03-22 | 2015-12-31 | Hitachi, Ltd. | Storage subsystem, and method for verifying storage area |
| CN106815326A (en) * | 2016-12-28 | 2017-06-09 | 中国民航信息网络股份有限公司 | A kind of system and method for detecting dereliction key data table uniformity |
-
2019
- 2019-04-24 CN CN201910333181.2A patent/CN110222027A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103793424A (en) * | 2012-10-31 | 2014-05-14 | 阿里巴巴集团控股有限公司 | Database data migration method and database data migration system |
| US20150378855A1 (en) * | 2013-03-22 | 2015-12-31 | Hitachi, Ltd. | Storage subsystem, and method for verifying storage area |
| CN104252481A (en) * | 2013-06-27 | 2014-12-31 | 阿里巴巴集团控股有限公司 | Dynamic check method and device for consistency of main and salve databases |
| CN104778179A (en) * | 2014-01-14 | 2015-07-15 | 阿里巴巴集团控股有限公司 | Data migration test method and system |
| CN106815326A (en) * | 2016-12-28 | 2017-06-09 | 中国民航信息网络股份有限公司 | A kind of system and method for detecting dereliction key data table uniformity |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112579591A (en) * | 2019-09-30 | 2021-03-30 | 重庆小雨点小额贷款有限公司 | Data verification method and device, electronic equipment and computer readable storage medium |
| CN111190884A (en) * | 2019-12-17 | 2020-05-22 | 腾讯科技（深圳）有限公司 | Data verification method, device and computer readable storage medium |
| CN111611253A (en) * | 2020-04-01 | 2020-09-01 | 石化盈科信息技术有限责任公司 | Data verification method, device and storage medium |
| CN111611253B (en) * | 2020-04-01 | 2023-08-08 | 石化盈科信息技术有限责任公司 | Data verification method, device and storage medium |
| CN112835869A (en) * | 2021-01-15 | 2021-05-25 | 中国船舶重工集团公司七五0试验场 | Fuzzy data cleaning method based on reverse data irrigation |
| CN112835869B (en) * | 2021-01-15 | 2023-05-02 | 中国船舶重工集团公司七五0试验场 | Fuzzy data cleaning method based on reverse data irrigation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110222027A (en) | The quantity method of calibration and computer readable storage medium of Data Migration | |
| US9830372B2 (en) | Scalable coordination aware static partitioning for database replication | |
| CN105373599B (en) | Data mover system based on various data storing platforms | |
| CN109189852B (en) | Data synchronization method and device for data synchronization | |
| US9064031B2 (en) | Advancements in data distribution methods and referential integrity | |
| US9589041B2 (en) | Client and server integration for replicating data | |
| US10031935B1 (en) | Customer-requested partitioning of journal-based storage systems | |
| US20150269215A1 (en) | Dependency-aware transaction batching for data replication | |
| CN111767303A (en) | Data query method and device, server and readable storage medium | |
| US20160132542A1 (en) | Online index rebuilding method and apparatus | |
| EP2713555B1 (en) | Data configuration method and device, and rollback method and device for data configuration | |
| Bermbach et al. | Informed schema design for column store-based database services | |
| CN111143470A (en) | Cross-platform database data synchronization comparison method and device | |
| CN107798111B (en) | Method for exporting data in large batch in distributed environment | |
| CN109828966A (en) | Gradual heavy hash method, device, computer equipment and storage medium | |
| CN111767266A (en) | Entity contact model design method and device, computer equipment and storage medium | |
| US10235100B2 (en) | Optimizing column based database table compression | |
| US20140108367A1 (en) | Client apparatus and database server for resumable transaction and method thereof | |
| CN107766519B (en) | Method for visually configuring data structure | |
| US10521426B2 (en) | Query plan generation for split table query operations | |
| CN116955341A (en) | Database integrity evaluation method, system and application thereof | |
| CN104750743A (en) | System and method for ticking and rechecking transaction files | |
| US11556532B2 (en) | Hash trie based optimization of database operations | |
| RU2650032C1 (en) | Electronic database and method of its formation | |
| WO2014009999A1 (en) | Database system and database management method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |