CN108572994A - A kind of processing method and server of Data Migration - Google Patents

A kind of processing method and server of Data Migration Download PDF

Info

Publication number
CN108572994A
CN108572994A CN201710149806.0A CN201710149806A CN108572994A CN 108572994 A CN108572994 A CN 108572994A CN 201710149806 A CN201710149806 A CN 201710149806A CN 108572994 A CN108572994 A CN 108572994A
Authority
CN
China
Prior art keywords
data
node
migrated
database
data type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710149806.0A
Other languages
Chinese (zh)
Other versions
CN108572994B (en
Inventor
郭远胜
王滔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Group Hunan Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Group Hunan Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Group Hunan Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN201710149806.0A priority Critical patent/CN108572994B/en
Publication of CN108572994A publication Critical patent/CN108572994A/en
Application granted granted Critical
Publication of CN108572994B publication Critical patent/CN108572994B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The embodiment of the present invention provides a kind of processing method and server of Data Migration, the method includes:Extract the data to be migrated in first database;According to pre-set meshed network and the data type of the data to be migrated, matching rule corresponding with the second database datatype, wherein, the meshed network is mapped with the correspondence between the data type of the data to be migrated and the rule;It, will be in the Data Migration to be migrated to second database according to the rule after matching.The server executes the above method.The processing method and server of Data Migration provided in an embodiment of the present invention can reduce the workload of Data Migration personnel, the Autonomic Migration Framework of data between disparate databases be completed, to improve the efficiency of Data Migration.

Description

A kind of processing method and server of Data Migration
Technical field
The present embodiments relate to technical field of data processing, and in particular to a kind of processing method of Data Migration and service Device.
Background technology
With the fast development of informationization technology, explosive growth, the visit capacity of database is presented in the data volume of enterprise Database processing capacity and calculating intensity are also accordingly increased with data volume rapid growth so that data are in different data base sets Migration is particularly important between system.
Alternative solution one of of the MYSQL database as existing ORACLE databases, the prior art is by first using SQL Developer in ORACLE export the data in the tables of data of ORACLE, then will by veteran migration personnel Data type matching in ORACLE tables of data reuses the Work Bench wounds of MYSQL at the corresponding data types of MYSQL It builds tables of data and imports the data after matching, to complete migration of the data from ORACLE database to MYSQL database, but Be disparate databases isomeric data between technical definition it is different so that database cross platform, across structural transfer difficulty are high, work Amount is big, and dependent on the experience and technical merit of migration personnel.
Therefore, the workload of Data Migration personnel how is reduced, the Autonomic Migration Framework of data between disparate databases is completed, from And the efficiency of Data Migration is improved, becoming need solve the problems, such as.
Invention content
In view of the problems of the existing technology, the embodiment of the present invention provides processing method and the service of a kind of Data Migration Device.
On the one hand, the embodiment of the present invention provides a kind of processing method of Data Migration, including:
Extract the data to be migrated in first database;
According to pre-set meshed network and the data type of the data to be migrated, matching and the second database The corresponding rule of data type, wherein the meshed network is mapped with the data type of the data to be migrated and the rule Correspondence between then;
It, will be in the Data Migration to be migrated to second database according to the rule after matching.
On the other hand, the embodiment of the present invention provides a kind of processing server of Data Migration, including:
Extraction module, for extracting the data to be migrated in first database;
Matching module, for the data type according to pre-set meshed network and the data to be migrated, matching Rule corresponding with the second database datatype, wherein the meshed network is mapped with the data of the data to be migrated Correspondence between type and the rule;
Transferring module is used for according to the rule after matching, will be in the Data Migration to be migrated to second database.
The processing method and server of Data Migration provided in an embodiment of the present invention, can reduce the work of Data Migration personnel It measures, the Autonomic Migration Framework of data between disparate databases is completed, to improve the efficiency of Data Migration.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair Some bright embodiments for those of ordinary skill in the art without creative efforts, can be with root Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the flow diagram of the processing method of Data Migration of the embodiment of the present invention;
Fig. 2 is the structural schematic diagram of meshed network of the embodiment of the present invention;
Fig. 3 is the structural schematic diagram of the processing server of Data Migration of the embodiment of the present invention;
Fig. 4 is server entity structural schematic diagram provided in an embodiment of the present invention.
Specific implementation mode
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art The every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Fig. 1 is the flow diagram of the processing method of Data Migration of the embodiment of the present invention, as shown in Figure 1, the present invention is implemented A kind of processing method for Data Migration that example provides, includes the following steps:
S1:Extract the data to be migrated in first database.
Specifically, the data to be migrated in server extraction first database.It should be noted that:First database can be with It is ORACLE databases, data to be migrated can be extracted from the list of meta data in ORACLE databases, metadata can wraps It includes:User information, table name information, literary name segment information, table partition information, index information, annotation information, field type information, word Section annotation information etc..
S2:According to pre-set meshed network and the data type of the data to be migrated, matching and the second data The corresponding rule of library data type, wherein the meshed network be mapped with the data types of the data to be migrated with it is described Correspondence between rule.
Specifically, server is according to pre-set meshed network and the data type of the data to be migrated, matching Rule corresponding with the second database datatype, wherein the meshed network is mapped with the data of the data to be migrated Correspondence between type and the rule.It should be noted that:The data type of data to be migrated can be ORACLE numbers According to the data type in library, data type can specifically include:The character types such as VARCHAR, CHAR, can also be including numeric type etc.. Second database can be MYSQL database, and ORACLE databases have different corresponding rule from the data type of MYSQL database Then, such as:VARCHAR, CHAR are the character type data types in ORACLE databases, and TEXT is MYSQL database Chinese This type data type, the substantially the same data type of the two, substantially identical data type correspond to same rule.And Numeric type data type is then considered in ORACLE databases and the character type datas type essence such as VARCHAR, CHAR are different, real The different multiple data types of matter correspond to multiple rules, it is believed that:The rule matched is ORACLE databases and MYSQL numbers According to the correspondence between the data type of library.
S3:It, will be in the Data Migration to be migrated to second database according to the rule after matching.
Specifically, server is according to the rule after matching, it will be in the Data Migration to be migrated to second database. It should be noted that:With reference to above-described embodiment VARCHAR, CHAR can complete character type data type corresponding to the rule of TEXT The migration of corresponding data similarly can complete all data type corresponding datas such as numeric type data type according to other rules Migration.
The processing method of Data Migration provided in an embodiment of the present invention can reduce the workload of Data Migration personnel, complete At the Autonomic Migration Framework of data between disparate databases, to improve the efficiency of Data Migration.
On the basis of the above embodiments, the meshed network includes class node, regular node and intermediate node, wherein:
Each class node is corresponding with each data type of the data to be migrated, each regular node be corresponding with it is each with The corresponding rule of second database datatype, the intermediate node between the class node and the regular node, The intermediate node binding has the attribute information for the data type for meeting same rule data to be migrated.
Each regular node is connected one by one with each intermediate node, the identical class node point of multiple attribute informations It is not connected in intermediate node corresponding with the same regular node.
Specifically, Fig. 2 is the structural schematic diagram of meshed network of the embodiment of the present invention, as shown in Fig. 2, the node in server Network may include multiple class nodes, multiple regular nodes and multiple intermediate nodes, wherein:
Each class node is corresponding with each data type of the data to be migrated, each regular node be corresponding with it is each with The corresponding rule of second database datatype, due to first database, the difference of the second database, the number of class node can Be more than, be less than or equal to regular node number, the intermediate node be located at the class node and the regular node it Between, the number of regular node can be equal to the number of intermediate node, and the intermediate node binding have that meet same rule to be migrated The attribute information of the data type of data, attribute information are referred to above-described embodiment, character or numerical value etc. are interpreted as, such as Fig. 2 Shown in first three class node may be considered the attribute information of data type having the same, they are connected to same rule Intermediate node on then, then it is connected to via the intermediate node regular node of same rule.
Each regular node is connected one by one with each intermediate node, the identical class node point of multiple attribute informations It is not connected in intermediate node corresponding with the same regular node.
The processing method of Data Migration provided in an embodiment of the present invention passes through the class node in setting meshed network, rule Node and intermediate node have advanced optimized matching rule used in the Autonomic Migration Framework of data, to improve Data Migration Efficiency.
On the basis of the above embodiments, the meshed network further includes:
Not via the intermediate node, each class node being connected one by one with each regular node.
Specifically, the meshed network in server further includes:Not via the intermediate node, with each regular node Connected each class node one by one.As shown in Fig. 2, the latter class node may be considered without identical with other class nodes The attribute information of data type, therefore it can individually, one by one with regular node be connected directly.
The processing method of Data Migration provided in an embodiment of the present invention, further by being directly connected in meshed network setting The class node of regular node, more optimizes matching rule used in the Autonomic Migration Framework of data, to improve Data Migration Efficiency.
On the basis of the above embodiments, described according to pre-set meshed network and the data to be migrated Data type matches rule corresponding with the second database datatype, including:
If judging to know the attribute information that the data type of the data to be migrated contains the intermediate node binding, by The intermediate node matches rule corresponding with the second database datatype.
Specifically, if server judges to know that the data type of the data to be migrated contains the intermediate node binding Attribute information then matches rule corresponding with the second database datatype by the intermediate node.It is illustrated below:It is false If the data type of data to be migrated is VARCHAR and CHAR, attribute information is character type, server matches to data type For VARCHAR and CHAR, and attribute information is the corresponding intermediate node of character type, is matched to by an intermediate node TEXT data types in MYSQL database.The correspondence mapped between them is exactly the data type of ORACLE databases Rule corresponding with the data type of MYSQL database.
Or,
If judging to know the attribute information that the data type of the data to be migrated does not contain intermediate node binding, Directly by the corresponding class node matching of the data type rule corresponding with the second database datatype of the data to be migrated Then.
Specifically, if server judges to know that the data type of the data to be migrated is bound without containing the intermediate node Attribute information, then directly by the corresponding class node matching of data type of the data to be migrated and the second database data class The corresponding rule of type.It is illustrated below:If the data type of data to be migrated is X, attribute information A, node net All intermediate nodes of network all have an A attribute informations without binding, are the corresponding data class of X with data type in MYSQL database Type is Y, then directly by the corresponding class node matchings of X rule corresponding with MYSQL database data type Y.
The processing method of Data Migration provided in an embodiment of the present invention, by by intermediate node indirect matching or by class node The corresponding rule of the second database datatype is directly matched, is further able to reduce the workload of Data Migration personnel, it is complete At the Autonomic Migration Framework of data between disparate databases, to improve the efficiency of Data Migration.
On the basis of the above embodiments, the method further includes:
According to the variation of the data type of data to be migrated in the first database, the meshed network is updated.
Specifically, variation of the server according to the data type of data to be migrated in the first database, described in update Meshed network.It should be noted that:The variation of the data type of data to be migrated is by first database under normal conditions The edition upgrading of one database and generate, therefore meshed network is also made into corresponding synchronized update.
The processing method of Data Migration provided in an embodiment of the present invention optimizes number by being continuously updated meshed network According to Autonomic Migration Framework used in matching rule, to improve the efficiency of Data Migration.
On the basis of the above embodiments, the change according to the data type of data to be migrated in the first database Change, updates the meshed network, including:
The data to be migrated in the first database after all changes are traversed, for newly-increased data type, if institute The attribute information for stating newly-increased data type is associated with the attribute information that the intermediate node is bound, then increases newly for described new The class node of the data type of increasing, and newly-increased class node is connected one by one with associated intermediate node.
Specifically, the data to be migrated in the first database after server traversal all changes, for newly-increased Data type, if judging to know the attribute information phase that the attribute information of the newly-increased data type is bound with the intermediate node Association, then increase the class node for the newly-increased data type newly, and by newly-increased class node and associated intermediate node It is connected one by one.It should be noted that:Server traverses the data to be migrated after all ORACLE database versions upgradings, for The data type increased newly in data to be migrated judges the category whether attribute information of newly-increased data type has intermediate node to bind Property information it is associated, with continued reference to the illustration of above-described embodiment:One of before the upgrading of ORACLE database versions Data type is VARCHAR, is changed to VARCHAR3 after upgrading, the data information VARCHAR bound in intermediate node Attribute information be character type, and VARCHAR3 is also character type, it may be considered that VARCHAR is associated with VARCHAR3, i.e.,: Attribute information belongs to character type.Increase the corresponding class nodes of the VARCHAR3, and by the newly-increased class node with bound The intermediate node that it is VARCHAR to have data type, attribute information is character type is connected.
Test the newly-increased class node, the intermediate node and corresponding regular node whether successful connection.
Specifically, whether server tests the newly-increased class node, the intermediate node and corresponding regular node Successful connection.It should be noted that:Test method can be by newly-increased class node, intermediate node and corresponding rule Then node is inserted into the data of simulation, and then tests out whether connection succeeds.
If successful connection, the newly-increased class node, the intermediate node and corresponding regular node are activated.
If specifically, server judgement know successful connection, activate the newly-increased class node, the intermediate node, And corresponding regular node.It should be noted that:Newly-increased class node, intermediate node after activation and corresponding rule The corresponding updated meshed network of node can be used for ORACLE database versions and upgrade later Data Migration.
Or,
If the attribute information of the newly-increased data type is unrelated to the attribute information that the intermediate node is bound, The newly-increased class node for the newly-increased data type, and reset it is matching with the newly-increased data type, with The corresponding new rule of second database datatype, and by newly-increased class node and new regular corresponding newly-increased regular node one One is connected.
Specifically, if server judges to know that the attribute information of the newly-increased data type is bound with the intermediate node Attribute information it is unrelated, then increase the class node for the newly-increased data type newly, and reset with it is described newly-increased Data type is matching, corresponding with the second database datatype new rule, and by newly-increased class node and new rule Then corresponding newly-increased regular node is connected one by one.It should be noted that:Server traverses all ORACLE database version liters Data to be migrated after grade judge the attribute information of newly-increased data type for the data type increased newly in data to be migrated There is no the attribute information that intermediate node is bound associated, it may be considered that ORACLE database versions increase origin node after upgrading The no new data type of network is then not only needed to increase corresponding class node newly for the new data type, also to be set again New rule that newly-increased data type matches, corresponding with the second database datatype is set, new rule is reset It can be written and be stored in meshed network by related personnel, and by newly-increased class node and new regular corresponding newly-increased rule Node is connected one by one.
Test the newly-increased class node and accordingly newly-increased regular node whether successful connection.
Specifically, server test the newly-increased class node and accordingly newly-increased regular node whether successful connection. Above-described embodiment is can refer to, is repeated no more.
If successful connection, activates the newly-increased class node and increase regular node newly accordingly.
Specifically, if successful connection is known in server judgement, activates the newly-increased class node and increase newly accordingly Regular node.Above-described embodiment is can refer to, is repeated no more.
The processing method of Data Migration provided in an embodiment of the present invention optimizes number specifically to newly-increased data type According to Autonomic Migration Framework used in matching rule, to improve the efficiency of Data Migration.
On the basis of the above embodiments, it is described according to the data type of data to be migrated in the first database Variation, updates the meshed network, including:
The data to be migrated in the first database after all changes are traversed, for the data type being deleted, If the attribute information of the data type being deleted belongs to the attribute information of the former intermediate node binding, freeze described The corresponding class node of data type being deleted.
Specifically, server traversal all changes after the first database in data to be migrated, for being deleted The data type removed, if judging to know that the attribute information of the data type being deleted belongs to the former intermediate node binding Attribute information, then freeze the corresponding class node of data type being deleted.It should be noted that:Server traverses institute Data to be migrated after some ORACLE database versions upgradings, ORACLE numbers are not being found if existed in meshed network According to the corresponding class node of the corresponding data type of data to be migrated after the edition upgrading of library, data class corresponding for such node Type, it may be considered that being deleted, if the attribute information for the data type being deleted belongs to the former intermediate node binding Attribute information, i.e.,:The data type being deleted is connected with intermediate node originally, then freezes the data class being deleted The corresponding class node of type but retain the intermediate node.
Or,
If the attribute information of the data type being deleted is not belonging to the attribute information of the former intermediate node binding, Then freeze the corresponding class node of data type being deleted and the corresponding regular node.
If specifically, server judge to know the attribute information of the data type being deleted be not belonging to original it is described in The attribute information of intermediate node binding, then freeze the corresponding class node of data type being deleted and the corresponding rule Node.It should be noted that:If the attribute information for the data type being deleted is not belonging to the attribute of former intermediate node binding Information, i.e.,:The original of the data type being deleted is not connected with intermediate node, but has been directly connected to corresponding rule section Point, therefore freeze such node and corresponding regular node.
The processing method of Data Migration provided in an embodiment of the present invention optimizes specifically to the data type being deleted Matching rule used in the Autonomic Migration Framework of data, to improving the efficiency of Data Migration.
On the basis of the above embodiments, before the step of extracting the data to be migrated in first database, the method Further include:
It obtains the address information of meta data block in first database, identifier and exports agreement used in data.
Specifically, server obtains the address information of meta data block in first database, identifier and export data Used agreement.It should be noted that:Address information may include the IP address of device where ORACLE databases and shared Port numbers, identifier can be SID (secure identifier Security Identifiers, hereinafter referred to as " SID "), export Agreement used in data can be:OCI (ORACLE calling interface Oracle Call Interface) or ORACLE thin.
According to described address information, identifier and export data used in agreement, establish the first database with Link between second database.
Specifically, server establishes institute according to agreement used in described address information, identifier and export data State linking between first database and second database.It should be noted that:Illustrated by above-described embodiment, is established Linking between ORACLE databases and MYSQL database.
The processing method of Data Migration provided in an embodiment of the present invention, by establishing first database and the second data at first Link between library ensure that being normally carried out for the Autonomic Migration Framework of data.
Fig. 3 is the structural schematic diagram of the processing server of Data Migration of the embodiment of the present invention, as shown in figure 3, the present invention is real It applies example and provides a kind of processing server of Data Migration, including extraction module 1, matching module 2 and transferring module 3, wherein:
Extraction module 1 is used to extract the data to be migrated in first database, and matching module 2 is used for according to pre-set The data type of meshed network and the data to be migrated matches rule corresponding with the second database datatype, In, the meshed network is mapped with the correspondence between the data type of the data to be migrated and the rule, migrates mould Block 3 is used for according to the rule after matching, will be in the Data Migration to be migrated to second database.
Specifically, extraction module 1 is used to extract data to be migrated in first database, extraction module 1 is by number to be migrated According to matching module 2 is sent to, matching module 2 is used for the number according to pre-set meshed network and the data to be migrated According to type, rule corresponding with the second database datatype is matched, wherein the meshed network is mapped with described to be migrated Rule after matching is sent to transferring module by the correspondence between the data type of data and the rule, matching module 2 3, transferring module 3 is used for according to the rule after matching, will be in the Data Migration to be migrated to second database.
The processing server of Data Migration provided in an embodiment of the present invention can reduce the workload of Data Migration personnel, The Autonomic Migration Framework of data between completion disparate databases, to improve the efficiency of Data Migration.
On the basis of the above embodiments, the matching module 2 is specifically used for:
If judging to know the attribute information that the data type of the data to be migrated contains the intermediate node binding, by The intermediate node matches rule corresponding with the second database datatype;If or, judging to know the data to be migrated Data type do not contain the intermediate node binding attribute information, then directly by the data type pair of the data to be migrated The class node matching rule corresponding with the second database datatype answered.
Specifically, the matching module 2 is specifically used for:If judging the data type for knowing the data to be migrated containing The attribute information of intermediate node binding is stated, then rule corresponding with the second database datatype are matched by the intermediate node Then;If or, judging to know the attribute information that the data type of the data to be migrated does not contain intermediate node binding, directly Connect the corresponding class node matching of the data type rule corresponding with the second database datatype by the data to be migrated.
The processing server of Data Migration provided in an embodiment of the present invention, by by intermediate node indirect matching or by class section Point directly matches the corresponding rule of the second database datatype, is further able to reduce the workload of Data Migration personnel, The Autonomic Migration Framework of data between completion disparate databases, to improve the efficiency of Data Migration.
The processing server of Data Migration provided in an embodiment of the present invention, which specifically can be used for executing above-mentioned each method, to be implemented The process flow of example, details are not described herein for function, is referred to the detailed description of above method embodiment.
Fig. 4 is server entity structural schematic diagram provided in an embodiment of the present invention, as shown in figure 4, the server includes: Processor (processor) 401, memory (memory) 402 and bus 403;
Wherein, the processor 401, memory 402 complete mutual communication by bus 403;
The processor 401 is used to call the program instruction in the memory 402, to execute above-mentioned each method embodiment The method provided, such as including:Extract the data to be migrated in first database;According to pre-set meshed network, with And the data type of the data to be migrated, match rule corresponding with the second database datatype, wherein the node Network mapping has the correspondence between the data type of the data to be migrated and the rule;According to the rule after matching, It will be in the Data Migration to be migrated to second database.
The present embodiment discloses a kind of computer program product, and the computer program product includes being stored in non-transient calculating Computer program on machine readable storage medium storing program for executing, the computer program include program instruction, when described program instruction is calculated When machine executes, computer is able to carry out the method that above-mentioned each method embodiment is provided, such as including:It extracts in first database Data to be migrated;According to pre-set meshed network and the data type of the data to be migrated, matching and the second number According to the corresponding rule of library data type, wherein the meshed network is mapped with data type and the institute of the data to be migrated State the correspondence between rule;It, will be in the Data Migration to be migrated to second database according to the rule after matching.
The present embodiment provides a kind of non-transient computer readable storage medium, the non-transient computer readable storage medium Computer instruction is stored, the computer instruction makes the computer execute the method that above-mentioned each method embodiment is provided, example Such as include:Extract the data to be migrated in first database;According to pre-set meshed network and the data to be migrated Data type, match corresponding with the second database datatype rule, wherein the meshed network be mapped with described in wait for Correspondence between the data type of migrating data and the rule;According to the rule after matching, by the data to be migrated It migrates into second database.
One of ordinary skill in the art will appreciate that:Realize that all or part of step of above method embodiment can pass through The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned includes:ROM, RAM, magnetic disc or light The various media that can store program code such as disk.
The embodiments such as server described above are only schematical, wherein the list illustrated as separating component Member may or may not be physically separated, and the component shown as unit may or may not be physics Unit, you can be located at a place, or may be distributed over multiple network units.It can select according to the actual needs Some or all of module therein achieves the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creation In the case of the labour of property, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can It is realized by the mode of software plus required general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on Stating technical solution, substantially the part that contributes to existing technology can be expressed in the form of software products in other words, should Computer software product can store in a computer-readable storage medium, such as ROM/RAM, magnetic disc, CD, including several fingers It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation Method described in certain parts of example or embodiment.
Finally it should be noted that:The above various embodiments is only to illustrate the technical solution of the embodiment of the present invention rather than right It is limited;Although the embodiment of the present invention is described in detail with reference to foregoing embodiments, the ordinary skill of this field Personnel should understand that:It still can be with technical scheme described in the above embodiments is modified, or to which part Or all technical features carries out equivalent replacement;And these modifications or replacements, it does not separate the essence of the corresponding technical solution The range of each embodiment technical solution of the embodiment of the present invention.

Claims (10)

1. a kind of processing method of Data Migration, which is characterized in that including:
Extract the data to be migrated in first database;
According to pre-set meshed network and the data type of the data to be migrated, matching and the second database data The corresponding rule of type, wherein the meshed network is mapped with the data type of the data to be migrated and the rule Between correspondence;
It, will be in the Data Migration to be migrated to second database according to the rule after matching.
2. according to the method described in claim 1, it is characterized in that, the meshed network include class node, regular node and in Intermediate node, wherein:
Each class node is corresponding with each data type of the data to be migrated, and each regular node is corresponding with each with second The corresponding rule of database datatype, the intermediate node are described between the class node and the regular node Intermediate node binds the attribute information for having the data type for meeting same rule data to be migrated;
Each regular node is connected one by one with each intermediate node, and the identical class node of multiple attribute informations distinguishes phase It is connected in intermediate node corresponding with the same regular node.
3. according to the method described in claim 2, it is characterized in that, the meshed network further includes:
Not via the intermediate node, each class node being connected one by one with each regular node.
4. method according to claim 1 or 2 or 3, which is characterized in that it is described according to pre-set meshed network, with And the data type of the data to be migrated, rule corresponding with the second database datatype is matched, including:
If judging to know the attribute information that the data type of the data to be migrated contains the intermediate node binding, by described Intermediate node matches rule corresponding with the second database datatype;
Or,
If judging to know the attribute information that the data type of the data to be migrated does not contain intermediate node binding, directly By the corresponding class node matching of the data type of the data to be migrated rule corresponding with the second database datatype.
5. according to the method described in claim 1, it is characterized in that, the method further includes:
According to the variation of the data type of data to be migrated in the first database, the meshed network is updated.
6. according to the method described in claim 5, it is characterized in that, described according to data to be migrated in the first database The variation of data type updates the meshed network, including:
The data to be migrated in the first database after all changes are traversed, for newly-increased data type, if described new The attribute information of the data type of increasing is associated with the attribute information that the intermediate node is bound, then increases newly for described newly-increased The class node of data type, and newly-increased class node is connected one by one with associated intermediate node;
Test the newly-increased class node, the intermediate node and corresponding regular node whether successful connection;
If successful connection, the newly-increased class node, the intermediate node and corresponding regular node are activated;
Or,
If the attribute information of the newly-increased data type is unrelated to the attribute information that the intermediate node is bound, increase newly For the class node of the newly-increased data type, and reset it is matching with the newly-increased data type, with second The corresponding new rule of database datatype, and by newly-increased class node and new regular corresponding newly-increased regular node phase one by one Even;
Test the newly-increased class node and accordingly newly-increased regular node whether successful connection;
If successful connection, activates the newly-increased class node and increase regular node newly accordingly.
7. method according to claim 5 or 6, which is characterized in that described according to number to be migrated in the first database According to data type variation, update the meshed network, including:
The data to be migrated in the first database after all changes are traversed, for the data type being deleted, if institute The attribute information for stating the data type being deleted belongs to the attribute information of the former intermediate node binding, then freeze it is described by The corresponding class node of data type of deletion;
Or,
If the attribute information of the data type being deleted is not belonging to the attribute information of the former intermediate node binding, freeze The corresponding class node of data type and the corresponding regular node being deleted described in knot.
8. according to the method described in claim 1, it is characterized in that, extraction first database in data to be migrated the step of with Before, the method further includes:
It obtains the address information of meta data block in first database, identifier and exports agreement used in data;
According to described address information, identifier and export data used in agreement, establish the first database with it is described Link between second database.
9. a kind of processing server of Data Migration, which is characterized in that including:
Extraction module, for extracting the data to be migrated in first database;
Matching module, for according to the data type of pre-set meshed network and the data to be migrated, matching and the The corresponding rule of two database datatypes, wherein the meshed network is mapped with the data type of the data to be migrated With the correspondence between the rule;
Transferring module is used for according to the rule after matching, will be in the Data Migration to be migrated to second database.
10. server according to claim 9, which is characterized in that the matching module is specifically used for:
If judging to know the attribute information that the data type of the data to be migrated contains the intermediate node binding, by described Intermediate node matches rule corresponding with the second database datatype;
Or,
If judging to know the attribute information that the data type of the data to be migrated does not contain intermediate node binding, directly By the corresponding class node matching of the data type of the data to be migrated rule corresponding with the second database datatype.
CN201710149806.0A 2017-03-14 2017-03-14 Data migration processing method and server Active CN108572994B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710149806.0A CN108572994B (en) 2017-03-14 2017-03-14 Data migration processing method and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710149806.0A CN108572994B (en) 2017-03-14 2017-03-14 Data migration processing method and server

Publications (2)

Publication Number Publication Date
CN108572994A true CN108572994A (en) 2018-09-25
CN108572994B CN108572994B (en) 2021-05-25

Family

ID=63577234

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710149806.0A Active CN108572994B (en) 2017-03-14 2017-03-14 Data migration processing method and server

Country Status (1)

Country Link
CN (1) CN108572994B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111538772A (en) * 2020-04-14 2020-08-14 北京宝兰德软件股份有限公司 Data exchange processing method and device, electronic equipment and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102521387A (en) * 2011-12-21 2012-06-27 北京人大金仓信息技术股份有限公司 Plug-in-based data migration method
US9361326B2 (en) * 2008-12-17 2016-06-07 Sap Se Selectable data migration
CN106202111A (en) * 2015-05-06 2016-12-07 阿里巴巴集团控股有限公司 The method of calibration of database data and device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9361326B2 (en) * 2008-12-17 2016-06-07 Sap Se Selectable data migration
CN102521387A (en) * 2011-12-21 2012-06-27 北京人大金仓信息技术股份有限公司 Plug-in-based data migration method
CN106202111A (en) * 2015-05-06 2016-12-07 阿里巴巴集团控股有限公司 The method of calibration of database data and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
梁吉胜: "数据映射技术在ETL过程中的应用", 《计算机***应用》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111538772A (en) * 2020-04-14 2020-08-14 北京宝兰德软件股份有限公司 Data exchange processing method and device, electronic equipment and storage medium
CN111538772B (en) * 2020-04-14 2023-07-04 北京宝兰德软件股份有限公司 Data exchange processing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN108572994B (en) 2021-05-25

Similar Documents

Publication Publication Date Title
CN108536761A (en) Report data querying method and server
CN109977110A (en) Data cleaning method, device and equipment
DE112012005037B4 (en) Manage redundant immutable files using deduplications in storage clouds
US9977798B2 (en) Data migration and table manipulation in a database management system
JP2020525906A (en) Database tenant migration system and method
US20170277556A1 (en) Distribution system, computer, and arrangement method for virtual machine
CN107122360A (en) Data mover system and method
CN109344153A (en) The processing method and terminal device of business datum
CN109508355A (en) A kind of data pick-up method, system and terminal device
CN113297182B (en) Data migration method, device, storage medium and program product
CN107122361A (en) Data mover system and method
CN103761189A (en) Test case management method and system
US11669504B2 (en) Database schema branching workflow, with support for data, keyspaces and VSchemas
CN107463610A (en) A kind of data storage method and device
CN106802928B (en) Power grid historical data management method and system
CN107193688A (en) Data list structure amending method and device
CN109857806A (en) The synchronization verification method and device of database table
WO2023197904A1 (en) Data processing method and apparatus, computer device and storage medium
US20160125026A1 (en) Proactive query migration to prevent failures
CN108572994A (en) A kind of processing method and server of Data Migration
US10747438B1 (en) Reporting using archived data
CN105447012B (en) A kind of write-in mutual exclusion method and device for database
CN110222105B (en) Data summarization processing method and device
CN111881110B (en) Data migration method and device
US10970176B2 (en) Managing data with restoring from purging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant