CN110245125A - Data migration method, device, computer equipment and storage medium - Google Patents
Data migration method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN110245125A CN110245125A CN201910418940.5A CN201910418940A CN110245125A CN 110245125 A CN110245125 A CN 110245125A CN 201910418940 A CN201910418940 A CN 201910418940A CN 110245125 A CN110245125 A CN 110245125A
- Authority
- CN
- China
- Prior art keywords
- data
- task
- migration
- sheet
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013508 migration Methods 0.000 title claims abstract description 231
- 230000005012 migration Effects 0.000 title claims abstract description 231
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000012545 processing Methods 0.000 claims abstract description 141
- 230000008569 process Effects 0.000 claims abstract description 27
- 230000007704 transition Effects 0.000 claims abstract description 24
- 238000004590 computer program Methods 0.000 claims description 22
- 239000000284 extract Substances 0.000 claims description 7
- 238000012216 screening Methods 0.000 claims description 6
- 238000012790 confirmation Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 9
- 239000000203 mixture Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application involves a kind of data migration method, device, computer equipment and storage mediums.The described method includes: the data processing task that scanning is in operating status；Inquire the task data sheet that the data processing task is relied on；Create temporary data table corresponding with the task data sheet inquired；Data access address in the data processing task is directed toward the temporary data table；Data Migration is carried out to the task data sheet；When task data sheet migration finishes, the data access address in the data processing task is directed toward the task data sheet after migration.Can be in task data sheet transition process using this method, data processing task does not interrupt execution, improves the data-handling efficiency of data processing task.
Description
Technical field
This application involves technical field of data processing, more particularly to a kind of data migration method, device, computer equipment
And storage medium.
Background technique
With the development of computer technology and Internet technology, various businesses are all by computer disposal, and interconnection
What net was transmitted, it needs to store a large amount of data, and the quantity of the database of storing data also increases and decreases therewith, in number
According to, sometimes according to business demand, needing to migrate the data in database between library, there is the correlation of big data migration
Technology.
However, traditional big data migrating technology, requires to stop the access to data in transition process, just be able to achieve
Data in database are migrated, until in database Data Migration completion can just continue data access, can be right
It is had an impact in the data processing task of line service, reduces the data-handling efficiency of data processing task.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of data processing that can be improved data processing task
Data migration method, device, computer equipment and the storage medium of efficiency.
A kind of data migration method, which comprises
Scan data processing task in operating status；
Inquire the task data sheet that the data processing task is relied on；
Create temporary data table corresponding with the task data sheet inquired；
Data access address in the data processing task is directed toward the temporary data table；
Data Migration is carried out to the task data sheet；
When task data sheet migration finishes, the data access address in the data processing task is directed toward migration
Task data sheet afterwards.
A kind of data migration device, described device include:
Task scan module, for scanning data processing task in operating status；
Tables of data enquiry module, the task data sheet relied on for inquiring the data processing task；
Tables of data creation module, the corresponding temporary data table of task data sheet for creating with inquiring；
It is directed toward adjustment module, for the data access address in the data processing task to be directed toward the ephemeral data
Table；
Data Migration module, for carrying out Data Migration to the task data sheet；
Migration monitor module, for when the task data sheet migration finish when, by the number in the data processing task
The task data sheet after migration is directed toward according to access address.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing
Device performs the steps of when executing the computer program
Scan data processing task in operating status；
Inquire the task data sheet that the data processing task is relied on；
Create temporary data table corresponding with the task data sheet inquired；
Data access address in the data processing task is directed toward the temporary data table；
Data Migration is carried out to the task data sheet；
When task data sheet migration finishes, the data access address in the data processing task is directed toward migration
Task data sheet afterwards.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
It is performed the steps of when row
Scan data processing task in operating status；
Inquire the task data sheet that the data processing task is relied on；
Create temporary data table corresponding with the task data sheet inquired；
Data access address in the data processing task is directed toward the temporary data table；
Data Migration is carried out to the task data sheet；
When task data sheet migration finishes, the data access address in the data processing task is directed toward migration
Task data sheet afterwards.
Above-mentioned data migration method, device, computer equipment and storage medium inquire data processing in operating status
The task data sheet that task is relied on, the corresponding temporary data table of creation task data sheet, at data in operating status
Data access address in reason task is directed toward temporary data table, guarantees when migrating to task data sheet, at data
Reason task can operate normally.When task data sheet migration finishes, the data access address direction in data processing task is moved
Task data sheet after shifting, while ensure that when task data sheet migration finishes, after data processing task can rely on migration
Task data sheet continue to run, so that data processing task does not interrupt execution in task data sheet transition process, improve
The data-handling efficiency of data processing task.
Detailed description of the invention
Fig. 1 is the application scenario diagram of data migration method in one embodiment；
Fig. 2 is the flow diagram of data migration method in one embodiment；
Fig. 3 is flow diagram the step of confirming memory space in one embodiment；
Fig. 4 is the flow diagram for the step of garbled data handles task in one embodiment；
Fig. 5 is flow diagram the step of migrating task data sheet in one embodiment；
Fig. 6 is flow diagram the step of generating Data Migration report in one embodiment；
The flow diagram for the step of Fig. 7 is configuration access permission in one embodiment；
Fig. 8 is the structural block diagram of data migration device in one embodiment；
Fig. 9 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Data migration method provided by the present application can be applied in application environment as shown in Figure 1.Wherein, terminal 102
It is communicated with server 104 by network by network, server 104 is communicated by network with server 106, serviced
Device 106 is communicated with server 108 by network, server 108 is communicated with server 104 by network.Wherein, eventually
End 102 can be, but not limited to be various personal computers, laptop, smart phone, tablet computer and portable wearable
Equipment, server 104, server 106 and server 108 can use the clothes of the either multiple server compositions of independent server
Device cluster be engaged in realize.Server 104, server 106 and server 108 can integrate in same server.
In one embodiment, as shown in Fig. 2, providing a kind of data migration method, it is applied in Fig. 1 in this way
It is illustrated for server, comprising the following steps:
S202 scans data processing task in operating status.
Specifically, server receives Data Migration request, requests in response to Data Migration, carries out to data processing task
Scanning determines data processing task in operating status by scanning.Data processing task in operating status is
Carry out the task of data processing.
In one embodiment, the Data Migration page is shown in terminal, is detected in the Data Migration page for request
When the clicking operation of trigger button, input data transfer parameter in the Data Migration page is obtained, is generated according to Data Migration parameter
Data Migration request is sent to server by Data Migration request.The Data Migration request that server receiving terminal is sent.
S204, the task data sheet that inquiry data processing task is relied on.
Specifically, server extracts the task identification of data processing task, inquires the corresponding data processing of each task identification
Information extracts tables of data mark from data processing of information, and the corresponding task data sheet of the tables of data mark extracted is number
The task data sheet relied on according to processing task.The task data sheet that data processing task is relied on is to execute data processing task
The task data sheet of required access.
S206 creates temporary data table corresponding with the task data sheet inquired.
Specifically, server is in the task data sheet for inquiring data processing task and being relied on, for each data processing
The task data sheet that task is relied on is replicated, to replicate obtained tables of data as the corresponding ephemeral data of task data sheet
Table, to obtain the corresponding temporary data table of each task data sheet.
In one embodiment, server reads each data processing and appoints after inquiring data processing task tables of data
The data being engaged in table, the data read are added in the tables of data being pre-created, and it is corresponding interim to generate task data sheet
Tables of data.
Data access address in data processing task is directed toward temporary data table by S208.
Specifically, when server creation temporary data table, the access address of temporary data table is recorded.Server to data at
Reason task is parsed, by parsing the data access address determined in data processing task, by determining data access address
The access address for replacing with temporary data table is modified the data access address in data processing task, makes data processing
Data access address after changing in task is directed toward temporary data table.
In one embodiment, server creation temporary data table when, by the access address of temporary data table with it is corresponding
The corresponding storage of the data access address of task data sheet.Server after determining the data access address in data processing task,
The access address for inquiring temporary data table corresponding with the data access address determined, by the data access in data processing task
Access address corresponding to the temporary data table inquired after the modification of address.
S210 carries out Data Migration to task data sheet.
Specifically, database address is moved into server acquisition, is connected according to moving into database address and moving into Database
It connects, task data sheet is sent to by the connection of foundation and moves into database.
In one embodiment, server obtains the tables of data mark of task data sheet and moves into database address, according to
The tables of data got identifies and moves into database address creation migration task, constructs migration task according to the migration task of creation
Queue.Server reads migration task from migration task queue, according to the tables of data mark in the migration task queue read
Know query task tables of data, the task data sheet read is moved into and moves into that database address is corresponding to move into migration task
Database.
S212, when task data sheet migration finishes, after the data access address in data processing task is directed toward migration
Task data sheet.
Specifically, server monitors the migration of task data sheet, works as prison when migrating to task data sheet
When hearing that task data sheet migration finishes, migration access address corresponding to the task data sheet after obtaining migration, at data
Data access address in reason task is revised as migration access address, is directed toward the data access address in data processing task and moves
Task data sheet after shifting.
In one embodiment, server monitors migration task queue, migrates in task queue when listening to
Migration task is read when finishing, that is, is listened to task data sheet migration and finished.
In the present embodiment, the task data sheet that data processing task in operating status is relied on is inquired, creates task
Data access address in data processing task in operating status is directed toward nonce by the corresponding temporary data table of tables of data
According to table, guarantee when being migrated to task data sheet, data processing task can operate normally.When task data sheet migrates
When finishing, the data access address in data processing task is directed toward the task data sheet after migration, while ensure that in task
When tables of data migration finishes, the task data sheet that data processing task can rely on after migration is continued to run, thus in number of tasks
According in table transition process, data processing task does not interrupt execution, improves the data-handling efficiency of data processing task.
As shown in figure 3, in one embodiment, specifically further including the steps that confirming memory space, the step before S202
Specifically include the following contents:
S302 obtains Data Migration instruction.
Specifically, terminal obtains moving out for setting and database address and moves into database address, to the number of moving out got
It according to library address and moves into database address and is packaged, Data Migration instruction is generated by encapsulation, Data Migration is instructed and is sent
Server 104 into big data platform.Big data platform is at least made of server 104, server 106 and server 106.
S304 extracts moving out in Data Migration instruction and database address and moves into database address.
Specifically, after server 104 receives Data Migration instruction, Data Migration instruction is parsed, by parsing,
It is extracted from Data Migration instruction and moves out database address and move into database address.Database address of moving out is task data sheet
The address for the database of moving out being currently located, database of moving out can be set in server 106.Moving into database address is to appoint
The business address for moving into database to be moved into of tables of data, moving into database can be set in server 108.
S306 counts the storage space volume in database address of moving out.
Specifically, server 104 has been requested with capacity query according to database address generation of moving out, and will use capacity query
Request is sent to server 106.Server 106 has used capacity by parsing to extract to being parsed with capacity query request
Database address of moving out in inquiry request, statistics, which is moved out, moves out in database that memory space holds corresponding to database address
Amount, is back to server 104 for storage space volume.Server 104 receives the storage space volume that server 106 returns.
S308, determination move into whether the corresponding remaining space capacity of database address is greater than storage space volume.
Specifically, server 104 generates residual capacity inquiry request according to database address of moving out, and residual capacity is inquired
Request is sent to server 108.Server 108 parses residual capacity inquiry request, extracts residual capacity by parsing
Database address is moved into inquiry request, statistics, which is moved into, moves into remaining space appearance in database corresponding to database address
Amount, is back to server 104 for remaining space capacity.Server 104 receives the remaining space capacity that server 106 returns.Clothes
The remaining space capacity for moving into database is compared by business device 104 with the storage space volume for database of moving out, with determination
Whether remaining space capacity is greater than storage space volume.
S310 scans data processing in operating status and appoints when remaining space capacity is greater than storage space volume
Business.
Specifically, when remaining space capacity is greater than storage space volume, expression, which is moved into database, enough deposit
Space is stored up to store the task data sheet moved out in database of moving out；When remaining space capacity is less than or equal to storage space volume
When, expression, which is moved into database, does not have enough memory spaces to store the task data sheet moved out in database of moving out.When surplus
When complementary space capacity is greater than storage space volume, data processing task in operating status is scanned.
In the present embodiment, after getting Data Migration instruction, statistics move out storage space volume in database and
The corresponding remaining space capacity of database is moved into, when remaining space capacity is greater than storage space volume, scanning is in operation
The processing task of state, ensure that has enough remaining space capacity in moving into database, restarts Data Migration, avoids
The Data Migration as caused by memory space inadequate is abnormal in data migration process.
As shown in figure 4, in one embodiment, S202 specifically includes the step of garbled data handles task, step tool
Body includes the following contents:
S402, scan data handle the corresponding task identification of task.
Specifically, server 104 is scanned data processing task, determines that data processing task is corresponding by scanning
Task identification.Mark of the task identification for unique identification data processing task.
S404 determines the corresponding working condition of task identification.
Specifically, the scanning of server 104 is to after the corresponding task identification of data processing task, for each task identification,
The corresponding status indicator of each task identification is extracted, work corresponding to the corresponding status indicator of each task identification is recognized
Make state.
S406, screening operation state are data processing task corresponding to the task identification of operating status.
Specifically, server 104 identifies that working condition is the task identification of operating status, determines the state mark of operating status
Know corresponding task identification, screening and data processing task corresponding to the task identification determined.
In the present embodiment, according to the corresponding working condition of task identification, determine that task identification in operating status is corresponding
Data processing task, need to migrate and data processing task in operating status to determine, guarantee the number to operating status
It is accurately migrated according to processing task.
As shown in figure 5, in one embodiment, S210 specifically includes the step of migrating task data sheet, and the step is specific
Including the following contents:
S502 creates data migration task according to task data sheet.
Specifically, server obtains the tables of data mark of task data sheet, is appointed according to the tables of data mark creation got
The corresponding data migration task of tables of data of being engaged in, obtains the corresponding data migration task of each task data sheet.Data migration task is
Task for being migrated to task data sheet.
The data migration task of creation is added in each migration task queue of preset quantity by S504.
Specifically, the migration task queue of preset quantity is provided in server.Server is by each task data of creation
The corresponding data migration task of table is added in each migration task queue, obtain include data migration task each migration task
Queue.
S506 reads the data migration task in each migration task queue parallel.
Specifically, server carries out parallel processing to the data migration task in each migration task queue.Server is parallel
Read the data migration task in each migration task queue.
S508 carries out Data Migration to the corresponding task data sheet of the data migration task read.
Specifically, server parses each data migration task read, extracts Data Migration by parsing
Task list mark in task, inquires task data sheet corresponding with task list mark, and acquisition is moved into database address, will be inquired
To task data sheet store to moving into the corresponding database of database address.
In the present embodiment, data migration task is created according to task data sheet, the data migration task of creation is added to
Each migration task queue of preset quantity moves data by reading the data migration task in each migration task queue parallel
Shifting task carries out parallel processing, avoids excessively leading to network congestion due to data migration task, to reduce task data sheet
Transport efficiency.
As shown in fig. 6, in one embodiment, specifically further include the steps that generating Data Migration report after S210, it should
Step specifically includes the following contents:
S602, the transition process data of logger task tables of data.
Specifically, server is when migrating task data sheet, to the transition process data of each task data sheet
It is recorded.Transition process data include transition state, migration time started, migration end time and the migration of task data sheet
At least one of spent duration.
S604 generates Data Migration report according to the transition process data of record.
Specifically, the tables of data of task data sheet is identified and was migrated after the transition process data of record by server
Number of passes is stored according to corresponding, generates Data Migration report.
Data Migration report is sent to the terminal logged in administrator's account by S606.
Specifically, server obtains administrator's account after generating Data Migration report, inquires corresponding with administrator's account
Terminal address, by Data Migration report be sent to the corresponding terminal of terminal address inquired.
In the present embodiment, in the transition process of task data sheet, the transition process data of task data sheet are remembered
Record generates Data Migration report according to transition process data, is reported in record data migration process by Data Migration and migrate shape
Data Migration report is sent to the terminal logged in administrator's account, it is ensured that administrator can report by Data Migration by state
It can exercise supervision to data.
As shown in fig. 7, in one embodiment, specifically further including the steps that configuration access permission after S212, the step
Specifically include the following contents:
S702 obtains the corresponding access authority information of task data sheet.
Specifically, the quiet tables of data mark for obtaining each task data sheet of server, generates tables of data and identifies corresponding access
Access authority acquisition request is sent to the corresponding database of database address of moving out, obtains data of moving out by authority acquiring request
The access authority information corresponding with tables of data mark that library is inquired according to access authority acquisition request.
S704, the task data sheet after determining the corresponding migration of task data sheet.
Specifically, server is after migrating task data sheet, the data table addresses of the task data sheet after obtaining migration,
By the storage corresponding with the tables of data of task data sheet mark of the data table addresses after migration.Server inquiry and tables of data mark pair
The data table addresses answered, the data table addresses inquired are the data table addresses after the corresponding migration of task data sheet.
S706, according to access authority information to the data table addresses configuration access permission after migration.
Specifically, server is migrating task data sheet to after moving into that database address is corresponding and move into database, really
Task data sheet after fixed migration, according to access authority information to the data table addresses configuration access permission after migration.
In the present embodiment, after task data sheet is carried out Data Migration, according to the access authority information of task data sheet,
The access authority of tables of data after migration is configured, thus guarantee the control that accesses to the task data sheet after migration,
The safety of task data sheet after guaranteeing migration.
It should be understood that although each step in the flow chart of Fig. 2-7 is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 2-7
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately
It executes.
In one embodiment, as shown in figure 8, providing a kind of data migration device 800, comprising: task scan module
802, tables of data enquiry module 804, tables of data creation module 806, direction adjustment module 808, Data Migration module 810 and migration
Monitor module 812, in which:
Task scan module 802, for scanning data processing task in operating status.
Tables of data enquiry module 804, the task data sheet relied on for inquiring data processing task.
Tables of data creation module 806, the corresponding temporary data table of task data sheet for creating with inquiring.
It is directed toward adjustment module 808, for the data access address in data processing task to be directed toward temporary data table.
Data Migration module 810, for carrying out Data Migration to task data sheet.
Migration monitor module 812, for when task data sheet migration finish when, by the data access in data processing task
It is directed toward the task data sheet after migration in address.
In one embodiment, data migration device 800 is specific further include: capacity confirmation module.
Capacity confirmation module, for obtaining Data Migration instruction；Extract the database address of moving out in Data Migration instruction
With move into database address；Statistics is moved out corresponding to database address storage space volume；Database address is moved into determination
Whether corresponding remaining space capacity is greater than storage space volume；
Task scan module 802 is also used to when remaining space capacity is greater than storage space volume, and scanning is in operation
The data processing task of state.
In one embodiment, task scan module 802 is also used to scan multiple data processing tasks corresponding
Business mark；Determine the corresponding working condition of task identification；Screening operation state is number corresponding to the task identification of operating status
According to processing task.
In one embodiment, Data Migration module 810 is also used to create data migration task according to task data sheet；It will
The data migration task of creation is added in each migration task queue of preset quantity；It is read in each migration task queue parallel
Data migration task；Data Migration is carried out to the corresponding task data sheet of the data migration task read.
In one embodiment, Data Migration module 810 is also used to the transition process data of logger task tables of data；According to
The transition process data of record generate Data Migration report；Data Migration report is sent to the end logged in administrator's account
End.
In one embodiment, Data Migration module 810 is also used to obtain the corresponding access authority information of task data sheet；
Data table addresses after determining the corresponding migration of task data sheet；The data table addresses after migration are matched according to access authority information
Set access authority.
In the present embodiment, the task data sheet that data processing task in operating status is relied on is inquired, creates task
Data access address in data processing task in operating status is directed toward nonce by the corresponding temporary data table of tables of data
According to table, guarantee when being migrated to task data sheet, data processing task can operate normally.When task data sheet migrates
When finishing, the data access address in data processing task is directed toward the task data sheet after migration, while ensure that in task
When tables of data migration finishes, the task data sheet that data processing task can rely on after migration is continued to run, thus in number of tasks
According in table transition process, data processing task does not interrupt execution, improves the data-handling efficiency of data processing task.
Specific about data migration device limits the restriction that may refer to above for data migration method, herein not
It repeats again.Modules in above-mentioned data migration device can be realized fully or partially through software, hardware and combinations thereof.On
Stating each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also store in a software form
In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction
Composition can be as shown in Figure 9.The computer equipment include by system bus connect processor, memory, network interface and
Database.Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory packet of the computer equipment
Include non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and data
Library.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating
The database of machine equipment table for storing data.The network interface of the computer equipment is used to connect with external terminal by network
Connect letter.To realize a kind of data migration method when the computer program is executed by processor.
It will be understood by those skilled in the art that structure shown in Fig. 9, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, which is stored with
Computer program, which performs the steps of when executing computer program scans data processing in operating status times
Business；The task data sheet that inquiry data processing task is relied on；Create ephemeral data corresponding with the task data sheet inquired
Table；Data access address in data processing task is directed toward temporary data table；Data Migration is carried out to task data sheet；When appoint
When business tables of data migration finishes, the data access address in data processing task is directed toward the task data sheet after migration.
In one embodiment, before scanning data processing task in operating status, processor executes computer journey
It is also performed the steps of when sequence and obtains Data Migration instruction；Moving out in Data Migration instruction is extracted database address and to move into
Database address；Statistics is moved out corresponding to database address storage space volume；It is corresponding that database address is moved into determination
Whether remaining space capacity is greater than storage space volume；When remaining space capacity is greater than storage space volume, at scanning
In the data processing task of operating status.
In one embodiment, scanning data processing task in operating status includes: that the multiple data processings of scanning are appointed
It is engaged in corresponding task identification；Determine the corresponding working condition of task identification；Screening operation state is the task of operating status
The corresponding data processing task of mark.
In one embodiment, carrying out Data Migration to task data sheet includes: to create data according to task data sheet to move
Shifting task；The data migration task of creation is added in each migration task queue of preset quantity；Each migration is read parallel to appoint
The data migration task being engaged in queue；Data Migration is carried out to the corresponding task data sheet of the data migration task read.
In one embodiment, after carrying out Data Migration to task data sheet, processor is gone back when executing computer program
Perform the steps of the transition process data of logger task tables of data；Data Migration is generated according to the transition process data of record
Report；Data Migration report is sent to the terminal logged in administrator's account.
In one embodiment, when task data sheet migration finishes, by the data access address in data processing task
After task data sheet after being directed toward migration, processor also performs the steps of acquisition task data when executing computer program
The corresponding access authority information of table；Data table addresses after determining the corresponding migration of task data sheet；According to access authority information
To the data table addresses configuration access permission after migration.
In the present embodiment, the task data sheet that data processing task in operating status is relied on is inquired, creates task
Data access address in data processing task in operating status is directed toward nonce by the corresponding temporary data table of tables of data
According to table, guarantee when being migrated to task data sheet, data processing task can operate normally.When task data sheet migrates
When finishing, the data access address in data processing task is directed toward the task data sheet after migration, while ensure that in task
When tables of data migration finishes, the task data sheet that data processing task can rely on after migration is continued to run, thus in number of tasks
According in table transition process, data processing task does not interrupt execution, improves the data-handling efficiency of data processing task.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor scans data processing task in operating status；Inquire data processing
The task data sheet that task is relied on；Create temporary data table corresponding with the task data sheet inquired；Data processing is appointed
Data access address in business is directed toward temporary data table；Data Migration is carried out to task data sheet；When task data sheet has migrated
Data access address in data processing task is directed toward the task data sheet after migration by Bi Shi.
In one embodiment, before scanning data processing task in operating status, computer program is by processor
It is also performed the steps of when execution and obtains Data Migration instruction；Moving out in Data Migration instruction is extracted database address and to move
Enter database address；Statistics is moved out corresponding to database address storage space volume；Determine that moving into database address corresponds to
Remaining space capacity whether be greater than storage space volume；When remaining space capacity is greater than storage space volume, scanning
Data processing task in operating status.
In one embodiment, scanning data processing task in operating status includes: that the multiple data processings of scanning are appointed
It is engaged in corresponding task identification；Determine the corresponding working condition of task identification；Screening operation state is the task of operating status
The corresponding data processing task of mark.
In one embodiment, carrying out Data Migration to task data sheet includes: to create data according to task data sheet to move
Shifting task；The data migration task of creation is added in each migration task queue of preset quantity；Each migration is read parallel to appoint
The data migration task being engaged in queue；Data Migration is carried out to the corresponding task data sheet of the data migration task read.
In one embodiment, after carrying out Data Migration to task data sheet, when computer program is executed by processor
Also perform the steps of the transition process data of logger task tables of data；Data are generated according to the transition process data of record to move
Move report；Data Migration report is sent to the terminal logged in administrator's account.
In one embodiment, when task data sheet migration finishes, by the data access address in data processing task
After task data sheet after being directed toward migration, acquisition number of tasks is also performed the steps of when computer program is executed by processor
According to the corresponding access authority information of table；Data table addresses after determining the corresponding migration of task data sheet；Believed according to access authority
Breath is to the data table addresses configuration access permission after migration.
In the present embodiment, the task data sheet that data processing task in operating status is relied on is inquired, creates task
Data access address in data processing task in operating status is directed toward nonce by the corresponding temporary data table of tables of data
According to table, guarantee when being migrated to task data sheet, data processing task can operate normally.When task data sheet migrates
When finishing, the data access address in data processing task is directed toward the task data sheet after migration, while ensure that in task
When tables of data migration finishes, the task data sheet that data processing task can rely on after migration is continued to run, thus in number of tasks
According in table transition process, data processing task does not interrupt execution, improves the data-handling efficiency of data processing task.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of data migration method, which comprises
Scan data processing task in operating status；
Inquire the task data sheet that the data processing task is relied on；
Create temporary data table corresponding with the task data sheet inquired；
Data access address in the data processing task is directed toward the temporary data table；
Data Migration is carried out to the task data sheet；
When task data sheet migration finishes, after the data access address in the data processing task is directed toward migration
Task data sheet.
2. the method according to claim 1, wherein scanning data processing task in operating status it
Before, further includes:
Obtain Data Migration instruction；
It extracts moving out in Data Migration instruction and database address and moves into database address；
It moves out corresponding to database address described in statistics storage space volume；
Move into whether the corresponding remaining space capacity of database address is greater than storage space volume described in determination；
When the remaining space capacity is greater than storage space volume, scanning data processing in operating status is executed
The step of task.
3. the method according to claim 1, wherein the data processing task packet that the scanning is in operating status
It includes:
Scan the corresponding task identification of multiple data processing tasks；
Determine the corresponding working condition of the task identification；
Screening operation state is data processing task corresponding to the task identification of operating status.
4. the method according to claim 1, wherein described carry out Data Migration packet to the task data sheet
It includes:
Data migration task is created according to the task data sheet；
The data migration task of creation is added in each migration task queue of preset quantity；
The data migration task in each migration task queue is read parallel；
Data Migration is carried out to the corresponding task data sheet of the data migration task read.
5. the method according to claim 1, wherein it is described to the task data sheet carry out Data Migration it
Afterwards, further includes:
Record the transition process data of the task data sheet；
Data Migration report is generated according to the transition process data of record；
Data Migration report is sent to the terminal logged in administrator's account.
6. method according to any one of claims 1-5, which is characterized in that described when the task data sheet has migrated
Data access address in the data processing task is directed toward after the task data sheet after migration by Bi Shi, further includes:
Obtain the corresponding access authority information of the task data sheet；
Data table addresses after determining the corresponding migration of the task data sheet；
According to the access authority information to the data table addresses configuration access permission after the migration.
7. a kind of data migration device, which is characterized in that described device includes:
Task scan module, for scanning data processing task in operating status；
Tables of data enquiry module, the task data sheet relied on for inquiring the data processing task；
Tables of data creation module, the corresponding temporary data table of task data sheet for creating with inquiring；
It is directed toward adjustment module, for the data access address in the data processing task to be directed toward the temporary data table；
Data Migration module, for carrying out Data Migration to the task data sheet；
Module is monitored in migration, for when task data sheet migration finishes, the data in the data processing task to be visited
Ask the task data sheet that address is directed toward after migration.
8. device according to claim 7, which is characterized in that described device further include:
Capacity confirmation module, for obtaining Data Migration instruction；Moving out in Data Migration instruction is extracted database address and to move
Enter database address；The storage space volume moved out in database address described in statistics；Database address is moved into described in determination
Whether corresponding remaining space capacity is greater than storage space volume；
The task scan module is also used to when the remaining space capacity is greater than storage space volume, and scanning is in operation
The data processing task of state.
9. a kind of computer equipment, including memory and processor, the memory are stored with computer program, feature exists
In the step of processor realizes any one of claims 1 to 6 the method when executing the computer program.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 6 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910418940.5A CN110245125A (en) | 2019-05-20 | 2019-05-20 | Data migration method, device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910418940.5A CN110245125A (en) | 2019-05-20 | 2019-05-20 | Data migration method, device, computer equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110245125A true CN110245125A (en) | 2019-09-17 |
Family
ID=67884488
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910418940.5A Pending CN110245125A (en) | 2019-05-20 | 2019-05-20 | Data migration method, device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110245125A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111694517A (en) * | 2020-05-28 | 2020-09-22 | 新浪网技术(中国)有限公司 | Distributed data migration method and system and electronic equipment |
| CN111930715A (en) * | 2020-07-16 | 2020-11-13 | 北京金山云网络技术有限公司 | Data migration method and device, computer equipment and storage medium |
| CN112328573A (en) * | 2020-11-03 | 2021-02-05 | 杭州朗澈科技有限公司 | Database migration method and system in kubernets cluster |
| CN113297145A (en) * | 2020-02-24 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Migration report generation method and device, electronic equipment and computer storage medium |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534226A (en) * | 2015-09-09 | 2017-03-22 | 阿里巴巴集团控股有限公司 | Processing method and apparatus for data migration |
| CN108268501A (en) * | 2016-12-30 | 2018-07-10 | ***通信集团北京有限公司 | Method for processing business and device in a kind of online data transition process |
| CN108509556A (en) * | 2018-03-22 | 2018-09-07 | 上海达梦数据库有限公司 | Data migration method and device, server, storage medium |
-
2019
- 2019-05-20 CN CN201910418940.5A patent/CN110245125A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534226A (en) * | 2015-09-09 | 2017-03-22 | 阿里巴巴集团控股有限公司 | Processing method and apparatus for data migration |
| CN108268501A (en) * | 2016-12-30 | 2018-07-10 | ***通信集团北京有限公司 | Method for processing business and device in a kind of online data transition process |
| CN108509556A (en) * | 2018-03-22 | 2018-09-07 | 上海达梦数据库有限公司 | Data migration method and device, server, storage medium |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113297145A (en) * | 2020-02-24 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Migration report generation method and device, electronic equipment and computer storage medium |
| CN113297145B (en) * | 2020-02-24 | 2023-12-22 | 阿里巴巴集团控股有限公司 | Migration report generation method and device, electronic equipment and computer storage medium |
| CN111694517A (en) * | 2020-05-28 | 2020-09-22 | 新浪网技术(中国)有限公司 | Distributed data migration method and system and electronic equipment |
| CN111694517B (en) * | 2020-05-28 | 2024-02-13 | 新浪技术（中国）有限公司 | Distributed data migration method, system and electronic equipment |
| CN111930715A (en) * | 2020-07-16 | 2020-11-13 | 北京金山云网络技术有限公司 | Data migration method and device, computer equipment and storage medium |
| CN112328573A (en) * | 2020-11-03 | 2021-02-05 | 杭州朗澈科技有限公司 | Database migration method and system in kubernets cluster |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110245125A (en) | Data migration method, device, computer equipment and storage medium | |
| CN108573371B (en) | Data approval method, device, computer equipment and storage medium | |
| CN110727499B (en) | Method, device, computer equipment and storage medium for acquiring resource data | |
| CN109447411A (en) | Business Process Control method, apparatus, computer equipment and storage medium | |
| CN110209652B (en) | Data table migration method, device, computer equipment and storage medium | |
| CN110290212B (en) | Service call recording method, device, computer equipment and storage medium | |
| CN108874926A (en) | Mass data inquiry method, device, computer equipment and storage medium | |
| CN109815013A (en) | Business data processing method, device, computer equipment and storage medium | |
| CN110224996A (en) | Network Access Method, device, computer equipment and the storage medium of application program | |
| CN110245505A (en) | Tables of data access method, device, computer equipment and storage medium | |
| CN110109712A (en) | Service Component loading method, device, computer equipment and storage medium | |
| CN110765001B (en) | Modularized automatic test method and device for application system | |
| CN109726134B (en) | Interface test method and system | |
| CN110795171B (en) | Service data processing method, device, computer equipment and storage medium | |
| CN109788031A (en) | Business datum acquisition methods, device, computer equipment and storage medium | |
| CN109816331A (en) | Audit task processing method, device, computer equipment and storage medium | |
| CN109726983A (en) | Examine method for allocating tasks, device, computer equipment and storage medium | |
| CN110321284B (en) | Test data entry method, device, computer equipment and storage medium | |
| CN113507475B (en) | Cross-domain access method and device | |
| CN109408320A (en) | Abnormality eliminating method, device, computer equipment and storage medium are developed in front end | |
| CN109361628A (en) | Message assemble method, device, computer equipment and storage medium | |
| CN110099414A (en) | Network resource transmission method, apparatus, computer equipment and storage medium | |
| CN110750443A (en) | Webpage testing method and device, computer equipment and storage medium | |
| CN109358874A (en) | Business rule update method, device, computer equipment and storage medium | |
| CN108389124B (en) | Data processing method, data processing device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |