CN107103077A - Integrality determines method and system before and after a kind of Data Migration - Google Patents
Integrality determines method and system before and after a kind of Data Migration Download PDFInfo
- Publication number
- CN107103077A CN107103077A CN201710277797.3A CN201710277797A CN107103077A CN 107103077 A CN107103077 A CN 107103077A CN 201710277797 A CN201710277797 A CN 201710277797A CN 107103077 A CN107103077 A CN 107103077A
- Authority
- CN
- China
- Prior art keywords
- data
- migrated
- target signature
- integrality
- migration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 94
- 230000005012 migration Effects 0.000 title claims abstract description 52
- 238000013508 migration Methods 0.000 title claims abstract description 52
- 230000007704 transition Effects 0.000 claims abstract description 36
- 239000000284 extract Substances 0.000 claims description 3
- 241001269238 Data Species 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Method and system are determined this application discloses integrality before and after a kind of Data Migration, this method includes：The data characteristics of data to be migrated in raw data base is determined, target signature is obtained；When the transition process for data to be migrated has terminated, then judge in target database with the presence or absence of the data that data characteristics is consistent with target signature, if, then judge that this is directed to the transition process of data to be migrated as complete data migration process, if it is not, then judging that this is directed to the transition process of data to be migrated as incomplete data migration process.The application is by determining the data characteristicses of data to be migrated, so as to obtain target signature, in the case where being over for the transition process of data to be migrated, it will judge whether data keep integrality before and after can determining this transition process by above-mentioned judged result with the presence or absence of the data that data characteristics is consistent with above-mentioned target signature in target database.
Description
Technical field
The present invention relates to Data Transference Technology field, integrality determines method and is before and after more particularly to a kind of Data Migration
System.
Background technology
With continuing to develop for Database Systems, original old system replaces from enabling to by new system, in its validity period
Between often have accumulated the historical datas of a large amount of preciousnesses, many of which historical data is all necessary to new system is smoothly enabled.Separately
Outside, these historical datas are also the important evidence for carrying out Analysis of Policy Making.Data Migration, is exactly to carry out these historical datas clearly
Wash, change, and be loaded into the process in new system.Data Migration is primarily adapted for use in a set of old system and is switched to another set of new system
System, or cover when old system is switched to same set of new system, it is necessary to which the historical data in old system is transformed into new system more
Situation.Data Migration at this stage is mainly focused data migration and completes and do not have, and whether data have kept before and after migration
Whole property is then unknown, so that user can not know the reliability of data migration process, have impact on Consumer's Experience.
In summary as can be seen that how to determine whether data keep integrality to be also to be solved at present before and after migration
The problem of.
The content of the invention
In view of this, method and system, energy are determined it is an object of the invention to provide integrality before and after a kind of Data Migration
Enough determine whether data keep integrality before and after migration.Its concrete scheme is as follows：
Integrality determines method before and after a kind of Data Migration, including：
The data characteristics of data to be migrated in raw data base is determined, target signature is obtained；
When the transition process for the data to be migrated has terminated, then judge special with the presence or absence of data in target database
Levy the data consistent with the target signature, if it is, judge this for the data to be migrated transition process as
Complete data migration process, if it is not, then judging that this is directed to the transition process of the data to be migrated as incomplete number
According to transition process.
Optionally, the process for determining the data characteristics of data to be migrated in raw data base, including：
Determine the data type of the data to be migrated；
According to the data type of the data to be migrated, the data characteristics of the data to be migrated is determined, the mesh is obtained
Mark feature.
Optionally, the process of the data characteristics for determining the data to be migrated, including：
If the data type of the data to be migrated is major-key table, the Major key of the major-key table is defined as the mesh
Mark feature.
Optionally, the process of the data characteristics for determining the data to be migrated, including：
If the data type of the data to be migrated is unique key table, merge described on the basis of corresponding major key is handled
Total line number of unique key table, obtains the target signature.
Optionally, the process of the data characteristics for determining the data to be migrated, including：
If the data type of the data to be migrated is common table, row data corresponding with the common table are extracted, and
It is determined that MD5 values corresponding with the row data extracted, obtain the target signature.
Integrality determines system before and after the present invention further correspondingly discloses a kind of Data Migration, including：
Characteristic determination module, the data characteristics for determining data to be migrated in raw data base, obtains target signature；
Integrality judge module, for having terminated when the transition process for the data to be migrated, then judges number of targets
According to whether there is the data characteristics data consistent with the target signature in storehouse, if it is, judging that this is treated for described
The transition process of migrating data is complete data migration process, if it is not, then judging this for the data to be migrated
Transition process is incomplete data migration process.
Optionally, the characteristic determination module, including：
Type determining units, the data type for determining the data to be migrated；
Characteristics determining unit, for the data type according to the data to be migrated, determines the number of the data to be migrated
According to feature, the target signature is obtained.
Optionally, the characteristics determining unit, specifically for being major-key table when the data type of the data to be migrated, then
The Major key of the major-key table is defined as the target signature.
Optionally, the characteristics determining unit, specifically for being unique key table when the data type of the data to be migrated,
Total line number of unique key table is then merged on the basis of corresponding major key is handled, the target signature is obtained.
Optionally, the characteristics determining unit, specifically for being common table when the data type of the data to be migrated, then
Row data corresponding with the common table, and determination MD5 values corresponding with the row data extracted are extracted, the target is obtained
Feature.
In the present invention, integrality determines method before and after Data Migration, including：Determine data to be migrated in raw data base
Data characteristics, obtains target signature；When the transition process for data to be migrated has terminated, then judge in target database whether
There are the data characteristics data consistent with target signature, if it is, judging this transition process for being directed to data to be migrated
For complete data migration process, if it is not, then judging this transition process for data to be migrated as incomplete data
Transition process.
It can be seen that, the present invention is by determining the data characteristics of data to be migrated, so that target signature is obtained, for waiting to move
In the case that the transition process of shifting data is over, it will judge in target database with the presence or absence of data characteristics and above-mentioned mesh
The consistent data of feature are marked, whether data keep complete before and after can determining this transition process by above-mentioned judged result
Property, enable a user to know the reliability of this data migration process, so as to improve Consumer's Experience.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
There is the accompanying drawing used required in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
The embodiment of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
The accompanying drawing of offer obtains other accompanying drawings.
Fig. 1 determines method flow diagram for integrality before and after a kind of Data Migration disclosed in the embodiment of the present invention；
Fig. 2 determines method flow diagram for integrality before and after a kind of specific Data Migration disclosed in the embodiment of the present invention；
Fig. 3 determines system structure diagram for integrality before and after a kind of Data Migration disclosed in the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
Method is determined the embodiment of the invention discloses integrality before and after a kind of Data Migration, shown in Figure 1, this method bag
Include：
Step S11：The data characteristics of data to be migrated in raw data base is determined, target signature is obtained；
Step S12：When the transition process for data to be migrated has terminated, then judge in target database with the presence or absence of number
According to the feature data consistent with target signature, if it is, into step S13, if it is not, then into step S14.
Step S13：Judge that this is directed to the transition process of data to be migrated as complete data migration process.
Step S14：Judge that this is directed to the transition process of data to be migrated as incomplete data migration process.
It can be seen that, the embodiment of the present invention is by determining the data characteristics of data to be migrated, so that target signature is obtained, in pin
Treat migrating data transition process be in the case of, it will judge in target database with the presence or absence of data characteristics with
The consistent data of above-mentioned target signature, whether data protect before and after can determining this transition process by above-mentioned judged result
Integrality is held, enables a user to know the reliability of this data migration process, so as to improve Consumer's Experience.
It is shown in Figure 2, method is determined the embodiment of the invention discloses integrality before and after a kind of specific Data Migration, is wrapped
Include following steps：
Step S21：Determine the data type of data to be migrated.
It should be noted that in Database Systems, the main Types of data include major-key table, unique key table and common
Table, here so-called common table refer to tables of data both without major key or without unique key.
Step S22：According to the data type of data to be migrated, the data characteristics of data to be migrated is determined, target is obtained special
Levy.
In a kind of embodiment, the process of the data characteristics of above-mentioned determination data to be migrated, including：If to be migrated
The data type of data is major-key table, then the Major key of major-key table is defined as into target signature.
In another embodiment, the process of the data characteristics of above-mentioned determination data to be migrated, including：If waiting to move
The data type for moving data is unique key table, then total line number of unique key table is merged on the basis of corresponding major key is handled, is obtained
Target signature.
In another embodiment, the process of the data characteristics of above-mentioned determination data to be migrated, including：If waiting to move
The data type for moving data is common table, then extracts row data corresponding with common table, and determine the row data with extracting
Corresponding MD5 values (MD5, i.e. Message Digest Algorithm5, Message Digest Algorithm 5), obtain target signature.
That is, when the data type of data to be migrated is common table, then entering rower to the corresponding row data of the common table in MD5 modes
Note, obtains corresponding MD5 values.
From the foregoing, it will be observed that the corresponding data characteristics of different types of data can be different in Database Systems.It is appreciated that
If above-mentioned data to be migrated include polytype data, data characteristics corresponding with above-mentioned data to be migrated
Various features will be correspondingly included, if for example, the data type of above-mentioned data to be migrated includes major-key table and common table,
Data characteristics corresponding with above-mentioned data to be migrated includes corresponding Major key and MD5 values.
Step S23：When the transition process for data to be migrated has terminated, then judge in target database with the presence or absence of number
According to the feature data consistent with target signature, if it is, into step S24, if it is not, then into step S25.
Step S24：Judge that this is directed to the transition process of data to be migrated as complete data migration process.
Step S25：Judge that this is directed to the transition process of data to be migrated as incomplete data migration process.
Accordingly, system is determined the embodiment of the invention also discloses integrality before and after a kind of Data Migration, referring to Fig. 3 institutes
Show, the system includes：
Characteristic determination module 11, the data characteristics for determining data to be migrated in raw data base, obtains target signature；
Integrality judge module 12, for having terminated when the transition process for data to be migrated, then judges target data
With the presence or absence of the data that data characteristics is consistent with target signature in storehouse, if it is, judging this for data to be migrated
Transition process is complete data migration process, if it is not, then judging that this is directed to the transition process of data to be migrated to be endless
Whole data migration process.
In the present embodiment, features described above determining module 11 specifically can include type determining units and feature determines list
Member；Wherein,
Type determining units, the data type for determining data to be migrated；
Characteristics determining unit, for the data type according to data to be migrated, determines the data characteristics of data to be migrated, obtains
To target signature.
In a kind of embodiment, features described above determining unit, specifically for when the data type of data to be migrated
For major-key table, then the Major key of major-key table is defined as target signature.
In another embodiment, features described above determining unit, specifically for when the data class of data to be migrated
Type is unique key table, then total line number of unique key table is merged on the basis of corresponding major key is handled, target signature is obtained.
In another embodiment, features described above determining unit, specifically for when the data class of data to be migrated
Type is common table, then extracts row data corresponding with common table, and determines MD5 values corresponding with the row data extracted, is obtained
To target signature.
It can be seen that, the embodiment of the present invention is by determining the data characteristics of data to be migrated, so that target signature is obtained, in pin
Treat migrating data transition process be in the case of, it will judge in target database with the presence or absence of data characteristics with
The consistent data of above-mentioned target signature, whether data protect before and after can determining this transition process by above-mentioned judged result
Integrality is held, enables a user to know the reliability of this data migration process, so as to improve Consumer's Experience.
Finally, in addition it is also necessary to explanation, herein, such as first and second or the like relational terms be used merely to by
One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation
Between there is any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant meaning
Covering including for nonexcludability, so that process, method, article or equipment including a series of key elements not only include that
A little key elements, but also other key elements including being not expressly set out, or also include be this process, method, article or
The intrinsic key element of equipment.In the absence of more restrictions, the key element limited by sentence "including a ...", is not arranged
Except also there is other identical element in the process including the key element, method, article or equipment.
Method and system, which have carried out detailed Jie, to be determined to integrality before and after a kind of Data Migration provided by the present invention above
Continue, specific case used herein is set forth to the principle and embodiment of the present invention, the explanation of above example is only
It is the method and its core concept for being used to help understand the present invention；Simultaneously for those of ordinary skill in the art, according to this hair
Bright thought, be will change in specific embodiments and applications, in summary, and this specification content should not be managed
Solve as limitation of the present invention.
Claims (10)
1. integrality determines method before and after a kind of Data Migration, it is characterised in that including：
The data characteristics of data to be migrated in raw data base is determined, target signature is obtained；
When the transition process for the data to be migrated has terminated, then judge in target database with the presence or absence of data characteristics with
The consistent data of the target signature, if it is, judging that this is directed to the transition process of the data to be migrated to be complete
Data migration process, if it is not, then judging that this is moved for transition processes of the data to be migrated as incomplete data
Move past journey.
2. integrality determines method before and after Data Migration according to claim 1, it is characterised in that the determination original number
According to the process of the data characteristics of data to be migrated in storehouse, including：
Determine the data type of the data to be migrated；
According to the data type of the data to be migrated, the data characteristics of the data to be migrated is determined, the target is obtained special
Levy.
3. integrality determines method before and after Data Migration according to claim 2, it is characterised in that treated described in the determination
The process of the data characteristics of migrating data, including：
If the data type of the data to be migrated is major-key table, the Major key of the major-key table is defined as the target special
Levy.
4. integrality determines method before and after Data Migration according to claim 2, it is characterised in that treated described in the determination
The process of the data characteristics of migrating data, including：
If the data type of the data to be migrated is unique key table, merge described unique on the basis of corresponding major key is handled
Total line number of key table, obtains the target signature.
5. integrality determines method before and after Data Migration according to claim 2, it is characterised in that treated described in the determination
The process of the data characteristics of migrating data, including：
If the data type of the data to be migrated is common table, row data corresponding with the common table are extracted, and determine
MD5 values corresponding with the row data extracted, obtain the target signature.
6. integrality determines system before and after a kind of Data Migration, it is characterised in that including：
Characteristic determination module, the data characteristics for determining data to be migrated in raw data base, obtains target signature；
Integrality judge module, for having terminated when the transition process for the data to be migrated, then judges target database
In with the presence or absence of data characteristics data consistent with the target signature, if it is, it is described to be migrated to judge that this is directed to
The transition process of data is complete data migration process, if it is not, then judging this migration for being directed to the data to be migrated
Process is incomplete data migration process.
7. integrality determines system before and after Data Migration according to claim 6, it is characterised in that the feature determines mould
Block, including：
Type determining units, the data type for determining the data to be migrated；
Characteristics determining unit, for the data type according to the data to be migrated, determines that the data of the data to be migrated are special
Levy, obtain the target signature.
8. integrality determines system before and after Data Migration according to claim 7, it is characterised in that
The characteristics determining unit, is major-key table specifically for the data type when the data to be migrated, then by the major key
The Major key of table is defined as the target signature.
9. integrality determines system before and after Data Migration according to claim 7, it is characterised in that
The characteristics determining unit, specifically for being unique key table when the data type of the data to be migrated, then in processing phase
Total line number that unique key table is merged on the basis of major key is answered, the target signature is obtained.
10. integrality determines system before and after Data Migration according to claim 7, it is characterised in that
The characteristics determining unit, specifically for when the data to be migrated data type be common table, then extract with it is described
The corresponding row data of common table, and MD5 values corresponding with the row data extracted are determined, obtain the target signature.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710277797.3A CN107103077B (en) | 2017-04-25 | 2017-04-25 | Method and system for determining integrity before and after data migration |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710277797.3A CN107103077B (en) | 2017-04-25 | 2017-04-25 | Method and system for determining integrity before and after data migration |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107103077A true CN107103077A (en) | 2017-08-29 |
| CN107103077B CN107103077B (en) | 2021-05-18 |
Family
ID=59656363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710277797.3A Active CN107103077B (en) | 2017-04-25 | 2017-04-25 | Method and system for determining integrity before and after data migration |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107103077B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112835869A (en) * | 2021-01-15 | 2021-05-25 | 中国船舶重工集团公司七五0试验场 | Fuzzy data cleaning method based on reverse data irrigation |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104504122A (en) * | 2014-12-29 | 2015-04-08 | 浪潮(北京)电子信息产业有限公司 | Database migration data verification method and system |
| US20150358323A1 (en) * | 2014-06-05 | 2015-12-10 | Owl Computing Technologies, Inc. | System and method for modular and continuous data assurance |
| CN105487816A (en) * | 2015-11-26 | 2016-04-13 | 布比（北京）网络技术有限公司 | Data transfer method and apparatus |
| CN105989044A (en) * | 2015-02-04 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Database verification method and system |
-
2017
- 2017-04-25 CN CN201710277797.3A patent/CN107103077B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150358323A1 (en) * | 2014-06-05 | 2015-12-10 | Owl Computing Technologies, Inc. | System and method for modular and continuous data assurance |
| CN104504122A (en) * | 2014-12-29 | 2015-04-08 | 浪潮(北京)电子信息产业有限公司 | Database migration data verification method and system |
| CN105989044A (en) * | 2015-02-04 | 2016-10-05 | 阿里巴巴集团控股有限公司 | Database verification method and system |
| CN105487816A (en) * | 2015-11-26 | 2016-04-13 | 布比（北京）网络技术有限公司 | Data transfer method and apparatus |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112835869A (en) * | 2021-01-15 | 2021-05-25 | 中国船舶重工集团公司七五0试验场 | Fuzzy data cleaning method based on reverse data irrigation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107103077B (en) | 2021-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108062202A (en) | A kind of file block storage method and system | |
| CN105488185B (en) | A kind of optimization method and device of knowledge base | |
| CN104050417B (en) | A kind of method and device detected in mobile terminal to application state | |
| WO2002033525A3 (en) | A method and system for detecting rogue software | |
| Moreno et al. | Decomposition-based algorithms for the crew scheduling and routing problem in road restoration | |
| CN110414236A (en) | A kind of detection method and device of malicious process | |
| CN107239468A (en) | Task node management method and device | |
| US20150227587A1 (en) | Method and apparatus for searching node by using tree index | |
| CN107203265A (en) | Information interacting method and device | |
| CN103645905B (en) | A kind of incremental data acquisition method and device | |
| CN112052413B (en) | URL fuzzy matching method, device and system | |
| CN106372977A (en) | Method and device for processing virtual account | |
| CN107103077A (en) | Integrality determines method and system before and after a kind of Data Migration | |
| CN105718793A (en) | Method and system for preventing malicious code from identifying sandbox on the basis of sandbox environment modification | |
| CN106156170A (en) | The analysis of public opinion method and device | |
| CN104700030A (en) | Virus data searching method, device and server | |
| CN107766342A (en) | A kind of recognition methods of application and device | |
| CN103559574B (en) | Method and system for operating workflow | |
| CN109117202A (en) | A kind of method and system that audit type configuration item is set | |
| CN112529543A (en) | Method, device and equipment for verifying mutual exclusion relationship of workflow and storage medium | |
| CN108255950A (en) | Date storage method and terminal device | |
| CN102592108B (en) | Picture label information extracting method and device | |
| CN108024090A (en) | A kind of abnormal localization method and device for video monitoring platform | |
| CN111159718A (en) | Method and device for bug repair and household appliance | |
| CN102339292A (en) | Distributed searching method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |