CN117667894A - Data migration method, device, electronic equipment and storage medium - Google Patents
Data migration method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117667894A CN117667894A CN202311666828.6A CN202311666828A CN117667894A CN 117667894 A CN117667894 A CN 117667894A CN 202311666828 A CN202311666828 A CN 202311666828A CN 117667894 A CN117667894 A CN 117667894A
- Authority
- CN
- China
- Prior art keywords
- data
- migration
- migrated
- database
- payment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013508 migration Methods 0.000 title claims abstract description 156
- 230000005012 migration Effects 0.000 title claims abstract description 156
- 238000000034 method Methods 0.000 title claims abstract description 64
- 238000004590 computer program Methods 0.000 claims description 17
- 238000012795 verification Methods 0.000 claims description 12
- 238000007726 management method Methods 0.000 claims description 8
- 230000003068 static effect Effects 0.000 claims description 6
- 238000013524 data verification Methods 0.000 claims description 3
- 238000007689 inspection Methods 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000013479 data entry Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 235000014510 cooky Nutrition 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data migration method, a data migration device, electronic equipment and a storage medium. The method comprises the following steps: acquiring payment application to be migrated and payment data to be migrated, which are positioned in a source end database; transferring the payment application to be transferred and the payment data to be transferred which are positioned in the source end database to a cloud end database in batches; and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check. According to the technical scheme, batch cloud migration of payment application and payment data is achieved, stability of data migration is guaranteed, and in addition, accuracy and integrity of migrated data are guaranteed by verifying data migrated to a cloud database.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data migration method, a data migration device, an electronic device, and a storage medium.
Background
With the continuous increase of business functions of enterprises, the data storage capacity is larger and larger, the old system database is difficult to support business development, and transformation is needed.
In the process of implementing the present invention, the inventor finds that at least the following technical problems exist in the prior art: the existing technical scheme for modifying the old system has the problems of poor data migration stability, inaccurate and incomplete migration data.
Disclosure of Invention
The invention provides a data migration method, a data migration device, electronic equipment and a storage medium, which are used for improving the stability of data migration and realizing verification of migration data, so that the accuracy and the integrity of the migration data are improved.
According to an aspect of the present invention, there is provided a data migration method, including:
acquiring payment application to be migrated and payment data to be migrated, which are positioned in a source end database;
transferring the payment application to be transferred and the payment data to be transferred which are positioned in the source end database to a cloud end database in batches;
and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check.
According to another aspect of the present invention, there is provided a data migration apparatus including:
the information to be migrated acquisition module is used for acquiring the payment application to be migrated and the payment data to be migrated, which are positioned in the source end database;
the information batch migration module is used for batch migrating the payment application to be migrated and the payment data to be migrated which are positioned in the source end database to the cloud end database;
the data verification module is used for verifying the data transferred to the cloud database, wherein the verification method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum verification and migration table md5 value 10 system sum verification.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor;
and a memory communicatively coupled to the at least one processor;
wherein the memory stores a computer program executable by the at least one processor, the computer program being executable by the at least one processor to enable the at least one processor to perform the data migration method according to any one of the embodiments of the present invention.
According to another aspect of the present invention, there is provided a computer readable storage medium storing computer instructions for causing a processor to execute a data migration method according to any one of the embodiments of the present invention.
According to the technical scheme, the application to be migrated and the payment data to be migrated which are located in the source end database are obtained, and then the application to be migrated and the payment data to be migrated which are located in the source end database are migrated to the cloud end database in batches; and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check. According to the technical scheme, batch cloud migration of payment application and payment data is achieved, stability of data migration is guaranteed, and in addition, integrity and accuracy of migration data are guaranteed by verifying data migrated to a cloud database.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the invention or to delineate the scope of the invention. Other features of the present invention will become apparent from the description that follows.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a data migration method according to a first embodiment of the present invention;
FIG. 2 is a flow chart of a data migration method according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a data migration apparatus according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device implementing a data migration method according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. The data acquisition, storage, use, processing and the like in the technical scheme meet the relevant regulations of national laws and regulations.
Example 1
Fig. 1 is a flowchart of a data migration method provided in an embodiment of the present invention, where the method may be applied to a payment system data migration situation, and the method may be performed by a data migration device, where the data migration device may be implemented in a form of hardware and/or software, and the data migration device may be configured in a terminal and/or a server. As shown in fig. 1, the method includes:
s110, acquiring payment application to be migrated and payment data to be migrated, which are positioned in the source database.
In the embodiment of the present disclosure, the source database refers to a database in which data and applications before migration are stored, for example, the source database may be a database such as Oracle. The payment application to be migrated refers to an application related to payment in banking business, and can include, but is not limited to, personal internet banking, personal palm banking, enterprise internet banking, enterprise palm banking, and the like. The payment data to be migrated refers to data related to payment in banking business, and can include, but is not limited to, payment contract, payment bill, payment order and the like.
Specifically, the application to be migrated and the payment data to be migrated can be retrieved from the source database.
S120, transferring the payment application to be transferred and the payment data to be transferred, which are positioned in the source end database, to a cloud end database in batches.
In the embodiment of the present disclosure, the cloud database refers to a database located in the cloud, for example, may be a TDSQL database or the like.
Specifically, the payment application to be migrated and the payment data to be migrated in the source database can be migrated to the cloud database in batches through a preset batch migration rule, so that the stability of the data migration process is ensured. The batch migration rule may be a rule formulated according to information such as a transaction channel and a transaction classification, and is not specifically limited herein.
S130, checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table number checking, migration table data sum check and migration table md5 value 10 system sum check.
In the embodiment of the disclosure, the integrity and the accuracy of the data in the cloud database can be ensured by checking the data migrated to the cloud database.
Specifically, the Chinese random spot check includes: acquiring Chinese fields in data migrated to a cloud database; if the character codes corresponding to the Chinese fields in the data migrated to the cloud database are the same as the preset character codes, checking is passed.
Specifically, the field cut-off spot check includes: comparing the fields in the data migrated to the cloud database with the fields in the data of the source database, and if the comparison result is that the field lengths are consistent, checking to pass.
Specifically, the migration table number inspection includes: acquiring the total number of migration tables in data migrated to a cloud database; acquiring the total number of migration tables in the data of a source database; and if the total number of the migration tables in the data migrated to the cloud database is the same as the total number of the migration tables in the data of the source database, checking to pass.
Specifically, the migration table data sum check includes: acquiring the sum of migration table data in the data migrated to the cloud database; obtaining the sum of migration table data in the data of the source database; if the sum of the migration table data in the data migrated to the cloud database is the same as the sum of the migration table data in the data of the source database, the verification is passed.
Specifically, the migration table md5 value 10-ary sum check includes: determining the md5 value of each migration table data in the data migrated to the cloud database; converting the md5 value of each migration table data in the data migrated to the cloud database into 10 system, and determining the sum of the md5 values of each migration table data converted into 10 system; if the sum of the md5 values of the migration table data converted into 10 system is the same as the preset sum value, checking is passed.
In some alternative embodiments, the present embodiment may also perform multi-channel session management. Specifically, when each online channel jumps to the payment center H5, the session unique identifier can be transmitted to the payment center in a cookie or parameter mode, and then the payment center server obtains the user information of the login of the channel end according to the session user information obtaining interface provided by each channel, and stores the user information in the session frame of the payment server for session management.
In some alternative embodiments, cookieName, cookiePath, cookieDomain may be set to be the same in order to ensure that transactions of the new and old frames are parallel during data migration, enabling session sharing.
In some alternative embodiments, the war package and jar package in the database may also be integrated in engineering. Specifically, the method can be divided into a channel war package, a merchant war package, a management war package and a public service jar package according to the dimension of the product, so that the code multiplexing capability of the public module is improved, and the operation and maintenance complexity of the system is reduced.
According to the technical scheme, the application to be migrated and the payment data to be migrated in the source end database are obtained; transferring the payment application to be transferred and the payment data to be transferred which are positioned in the source end database to a cloud end database in batches; and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check. According to the technical scheme, batch cloud migration of payment application and payment data is achieved, stability of data migration is guaranteed, and in addition, integrity and accuracy of migration data are guaranteed by verifying data migrated to a cloud database.
Example two
Fig. 2 is a flowchart of a data migration method according to a second embodiment of the present invention, where the method according to the present embodiment may be combined with each of the alternatives in the data migration method provided in the foregoing embodiment. The data migration method provided by the embodiment is further optimized. Optionally, the payment application to be migrated includes a channel payment service application, a merchant service application, a shipping management service application and a batch service application; the payment data to be migrated includes static parameters, non-customer information and customer information.
As shown in fig. 2, the method includes:
s210, acquiring payment applications to be migrated and payment data to be migrated, which are positioned in a source end database, wherein the payment applications to be migrated comprise channel payment service applications, merchant service applications, transportation management service applications and batch service applications; the payment data to be migrated includes static parameters, non-customer information and customer information.
For example, for the channel side, migration of channel payment business applications may be accomplished in batches by transaction channel and transaction classification. For merchants and shipping ends, migration of merchant business applications and shipping business applications may be accomplished in batches according to transaction classifications. For the batch end, the batch business application can be migrated to the TDSQL database at regular time.
In the disclosed embodiment, the static parameters refer to a static data table that is unchanged. Non-customer information refers to a dynamic change list that does not involve customer data and may include, but is not limited to, a payment items list, etc. Customer information refers to a dynamic change table for customer data, and may include, but is not limited to, customer contracts, bills, orders, and the like.
S220, transferring the payment application to be transferred and the payment data to be transferred, which are positioned in the source end database, to a cloud end database in batches.
S230, checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table number checking, migration table data sum check and migration table md5 value 10 system sum check.
Illustratively, the step of migrating the payment data to be migrated includes, but is not limited to: 1. and (3) exporting payment data to be migrated: exporting migration payment data in Oracle data in a CSV format; 2. and (3) data entry: importing the CSV format into a TDSQL database through a data entry tool; 3. and performing data check and data management, wherein the data check method comprises Chinese messy code spot check, field cut spot check, migration table number checking, migration table data sum check and migration table md5 value 10 system sum check.
In some optional embodiments, in the data migration process, if data is abnormal, emergency rollback may be performed, that is, data migrated into the cloud database is written back to the source database one by one.
According to the technical scheme, batch cloud migration of payment application and payment data is achieved, stability of data migration is guaranteed, and in addition, integrity and accuracy of migration data are guaranteed by checking data migrated to a cloud database.
Example III
Fig. 3 is a schematic structural diagram of a data migration apparatus according to a third embodiment of the present invention. As shown in fig. 3, the apparatus includes:
the information to be migrated acquisition module 310 is configured to acquire a payment application to be migrated and payment data to be migrated, which are located in the source database;
the information batch migration module 320 is configured to batch migrate the payment application to be migrated and the payment data to be migrated, which are located in the source database, to the cloud database;
the data verification module 330 is configured to verify data migrated to the cloud database, where the verification method includes a chinese random number spot check, a field cut spot check, a migration table row number verification, a migration table data sum verification, and a migration table md5 value 10 system sum verification.
According to the technical scheme, the application to be migrated and the payment data to be migrated in the source end database are obtained; transferring the payment application to be transferred and the payment data to be transferred which are positioned in the source end database to a cloud end database in batches; and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check. According to the technical scheme, batch cloud migration of payment application and payment data is achieved, stability of data migration is guaranteed, and in addition, integrity and accuracy of migration data are guaranteed by verifying data migrated to a cloud database.
In some optional embodiments, the payment to be migrated application includes a channel payment service application, a merchant service application, a shipping management service application, and a bulk service application; the payment data to be migrated includes static parameters, non-customer information and customer information.
In some optional embodiments, the data migration device includes a chinese random spot check unit, which may be configured to:
acquiring Chinese fields in data migrated to a cloud database;
and if the character codes corresponding to the Chinese fields in the data migrated to the cloud database are the same as the preset character codes, checking.
In some alternative embodiments, the field truncates the spot check, including:
comparing the fields in the data migrated to the cloud database with the fields in the data of the source database, and if the comparison result is that the field lengths are consistent, checking to pass.
In some optional embodiments, the data migration apparatus includes a migration table number checking unit, and the migration table number checking unit may be configured to:
acquiring the total number of migration tables in data migrated to a cloud database;
acquiring the total number of migration tables in the data of a source database;
and if the total number of the migration tables in the data migrated to the cloud database is the same as the total number of the migration tables in the data of the source database, checking to pass.
In some alternative embodiments, the data migration apparatus includes a migration table data sum check unit, which may be configured to:
acquiring the sum of migration table data in the data migrated to the cloud database;
obtaining the sum of migration table data in the data of the source database;
and if the sum of the migration table data in the data migrated to the cloud database is the same as the sum of the migration table data in the data of the source database, checking to pass.
In some alternative embodiments, the data migration apparatus includes a migration table md5 value 10 binary sum check unit, and the migration table md5 value 10 binary sum check may be used to:
determining the md5 value of each migration table data in the data migrated to the cloud database;
converting the md5 value of each migration table data in the data migrated to the cloud database into 10 system, and determining the sum of the md5 values of each migration table data converted into 10 system;
if the sum of the md5 values of the migration table data converted into 10 system is the same as the preset sum value, checking is passed.
The data migration device provided by the embodiment of the invention can execute the data migration method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.
Example IV
Fig. 4 shows a schematic diagram of the structure of an electronic device 10 that may be used to implement an embodiment of the invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. Electronic equipment may also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smartphones, wearable devices (e.g., helmets, eyeglasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, etc., communicatively connected to the at least one processor 11, in which the memory stores a computer program executable by the at least one processor, and the processor 11 may perform various appropriate actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from the storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 may also be stored. The processor 11, the ROM 12 and the RAM 13 are connected to each other via a bus 14. An I/O interface 15 is also connected to bus 14.
Various components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, etc.; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The processor 11 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 11 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various processors running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a data migration method, which includes:
acquiring payment application to be migrated and payment data to be migrated, which are positioned in a source end database;
transferring the payment application to be transferred and the payment data to be transferred which are positioned in the source end database to a cloud end database in batches;
and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check.
In some embodiments, the data migration method may be implemented as a computer program tangibly embodied on a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the data migration method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the data migration method in any other suitable way (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system-on-chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
A computer program for carrying out methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be implemented. The computer program may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) through which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the internet.
The computing system may include clients and servers. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical hosts and VPS service are overcome.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps described in the present invention may be performed in parallel, sequentially, or in a different order, so long as the desired results of the technical solution of the present invention are achieved, and the present invention is not limited herein.
The above embodiments do not limit the scope of the present invention. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the scope of the present invention.
Claims (10)
1. A method of data migration, comprising:
acquiring payment application to be migrated and payment data to be migrated, which are positioned in a source end database;
transferring the payment application to be transferred and the payment data to be transferred which are positioned in the source end database to a cloud end database in batches;
and checking the data transferred to the cloud database, wherein the checking method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum check and migration table md5 value 10 system sum check.
2. The method of claim 1, wherein the payment to migrate application comprises a channel payment service application, a merchant service application, a shipping management service application, and a bulk service application; the payment data to be migrated includes static parameters, non-customer information and customer information.
3. The method of claim 1, wherein the chinese character spot check comprises:
acquiring Chinese fields in data migrated to a cloud database;
and if the character codes corresponding to the Chinese fields in the data migrated to the cloud database are the same as the preset character codes, checking.
4. The method of claim 1, wherein the field truncation spot check comprises:
comparing the fields in the data migrated to the cloud database with the fields in the data of the source database, and if the comparison result is that the field lengths are consistent, checking to pass.
5. The method of claim 1, wherein the migration table number inspection comprises:
acquiring the total number of migration tables in data migrated to a cloud database;
acquiring the total number of migration tables in the data of a source database;
and if the total number of the migration tables in the data migrated to the cloud database is the same as the total number of the migration tables in the data of the source database, checking to pass.
6. The method of claim 1, wherein the migration table data sum check comprises:
acquiring the sum of migration table data in the data migrated to the cloud database;
obtaining the sum of migration table data in the data of the source database;
and if the sum of the migration table data in the data migrated to the cloud database is the same as the sum of the migration table data in the data of the source database, checking to pass.
7. The method of claim 1, wherein the migration table md5 value 10-ary sum check comprises:
determining the md5 value of each migration table data in the data migrated to the cloud database;
converting the md5 value of each migration table data in the data migrated to the cloud database into 10 system, and determining the sum of the md5 values of each migration table data converted into 10 system;
if the sum of the md5 values of the migration table data converted into 10 system is the same as the preset sum value, checking is passed.
8. A data migration apparatus, comprising:
the information to be migrated acquisition module is used for acquiring the payment application to be migrated and the payment data to be migrated, which are positioned in the source end database;
the information batch migration module is used for batch migrating the payment application to be migrated and the payment data to be migrated which are positioned in the source end database to the cloud end database;
the data verification module is used for verifying the data transferred to the cloud database, wherein the verification method comprises Chinese messy code spot check, field cut spot check, migration table line number checking, migration table data sum verification and migration table md5 value 10 system sum verification.
9. An electronic device, the electronic device comprising:
at least one processor;
and a memory communicatively coupled to the at least one processor;
wherein the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the data migration method of any one of claims 1-7.
10. A computer readable storage medium storing computer instructions for causing a processor to perform the data migration method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311666828.6A CN117667894A (en) | 2023-12-06 | 2023-12-06 | Data migration method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311666828.6A CN117667894A (en) | 2023-12-06 | 2023-12-06 | Data migration method, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117667894A true CN117667894A (en) | 2024-03-08 |
Family
ID=90067776
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311666828.6A Pending CN117667894A (en) | 2023-12-06 | 2023-12-06 | Data migration method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117667894A (en) |
-
2023
- 2023-12-06 CN CN202311666828.6A patent/CN117667894A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116611411A (en) | Business system report generation method, device, equipment and storage medium | |
| CN116151718A (en) | Overseas warehouse management system, method, equipment and storage medium | |
| CN117667894A (en) | Data migration method, device, electronic equipment and storage medium | |
| CN114693116A (en) | Method and device for detecting code review validity and electronic equipment | |
| CN115563310A (en) | Method, device, equipment and medium for determining key service node | |
| CN115309730A (en) | Data auditing method and device, electronic equipment and storage medium | |
| CN115659347A (en) | Safety testing method and device, electronic equipment and storage medium | |
| CN113360672A (en) | Methods, apparatus, devices, media and products for generating a knowledge graph | |
| CN112559547A (en) | Method and device for determining consistency among multiple storage object copies | |
| CN117370213A (en) | Test data generation method and device, electronic equipment and storage medium | |
| CN115526711A (en) | Data processing method, device, equipment, medium and product | |
| CN115600819A (en) | Risk assessment method and device, electronic equipment and storage medium | |
| CN115437955A (en) | Project testing method, device, equipment and storage medium | |
| CN115713446A (en) | Business license handling method and device, electronic equipment and readable medium | |
| CN116188107A (en) | Test order generation method, device, equipment and storage medium | |
| CN115983222A (en) | EasyExcel-based file data reading method, device, equipment and medium | |
| CN115455060A (en) | Data processing method, device, equipment and medium | |
| CN117081939A (en) | Traffic data processing method, device, equipment and storage medium | |
| CN115567624A (en) | Message processing method and device, electronic equipment and medium | |
| CN116450659A (en) | Transaction information accounting method, device, equipment and medium based on distributed system | |
| CN115545341A (en) | Event prediction method and device, electronic equipment and storage medium | |
| CN118172020A (en) | Data restoration method, device, equipment, storage medium and program product | |
| CN118132533A (en) | Data processing method, device, equipment and storage medium | |
| CN117009356A (en) | Method, device and equipment for determining application success of public data | |
| CN113779098A (en) | Data processing method, data processing device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |