CN106603665A - Cloud platform continuous data synchronization method and cloud platform continuous data synchronization device - Google Patents
Cloud platform continuous data synchronization method and cloud platform continuous data synchronization device Download PDFInfo
- Publication number
- CN106603665A CN106603665A CN201611167491.4A CN201611167491A CN106603665A CN 106603665 A CN106603665 A CN 106603665A CN 201611167491 A CN201611167491 A CN 201611167491A CN 106603665 A CN106603665 A CN 106603665A
- Authority
- CN
- China
- Prior art keywords
- data
- storage device
- strange land
- cloud platform
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a cloud platform continuous data synchronization method and a cloud platform continuous data synchronization device. The cloud platform continuous data synchronization method comprises the steps of receiving a request which is transmitted from a data generation device by a client, and parallelly transmitting the request to a local storage device and a remote storage device; and avoiding data persistence of data which are related with the request by the client in the local storage device and/or the remote storage device, and waiting response of the local storage device or the local storage device which does not perform response, thereby finishing the task. The cloud platform continuous data synchronization method and the cloud platform continuous data synchronization device have advantages of ensuring no data loss, giving consideration to data throughput capabilities of the local storage device and the remote storage device, preventing computing capability reduction of the cloud platform, improving user experience and reducing background computing expenditure.
Description
Technical field
The present invention relates to field of cloud computer technology, more particularly to a kind of cloud platform continuous data synchronous method and its device.
Background technology
In field of cloud calculation, when performing data protection to magnetic disk of virtual machine snapping technique is typically adopted.User can select
Periodically or aperiodically to system disk and data disks do snapshot (snapshot).Snapping technique accident can be occurred after number
It is reduced in certain limit according to loss, such as, it is allowed to the snapshot number that user creates.But, snapping technique can only be extensive by data
The multiple state to a nearest snapshot point, the data produced after this snapshot point just cannot be recovered.Although snapping technique can
To return to past certain snapshot point, but when local data center breaks down, it is stored in the fast of local data center
According to also using, so as to cause magnetic disk of virtual machine data to ensure concordance.
Additionally, magnetic disk of virtual machine data are protected be in field of cloud calculation can also be using the technical side of remote backup
Case.The implementation of remote backup has two kinds, and one kind is strange land snapshot, i.e., periodically or aperiodically by local data
The snapshot of the heart, when local data center breaks down, can be incited somebody to action to another data center in strange land data center
Data recovery is to a nearest snapshot point；Another is by way of mirror image, in another data center's storage phase
Same data.The former shortcoming is that data can only be recovered to a nearest strange land snapshot point；And the shortcoming of the latter is once source
Data center is written with the data of mistake, and strange land data center can also deposit the data of mistake.
As enterprise is incremented by data processing degree of dependence, the loss of low volume data can cause substantial amounts of economic loss.
Traditional data backup and resume has been used up periodically backup and snapshot to realize.Traditional backup mode and snapshot can only
The data recovery of set time point is accomplished to, the data between backing up twice update and cannot protect.With the increase of data volume, pass
The backup mode of system and the RPO (Recovery Point Objective, data recovery point target) of snapshot and RTO
(Recovery Time Objective, recovery time target) just seems long, and this is very high to data dependency for some
Information system is unacceptable.This kind of system usually requires that 24 hours one day and runs incessantly, the interruption service of short time
Or a small amount of loss of data may all bring huge traffic lost.
In the practical application based on cloud storage technology, Clustering is generally used, by two or multiple stage computers section
Point constitutes a kind of loosely-coupled calculate node set, has provided the user more efficient fault-tolerant and failover capability, increases
Processing capability in real time to magnanimity task, so as to providing more preferable dependable with function.
For continuous data protection is generally realized using asynchronous system or the method for synchronization in cloud platform.
In asynchronous system, after request of data is sended over from client, local cluster and interior is first write data into
In the middle of depositing, one response of client is then returned to, represents that the request of data has been completed, client can send follow-up reading
Write request, when the data of region of memory reach certain threshold value, such as internal storage data reaches size set in advance or reaches
The threshold value of certain hour, system can start that extra thread is asynchronous to work as the data cluster that internal storage data copies to distal end
In, it is ensured that the concordance of this part local cluster and distant clusters data, the program also has some simple changes, but essential
Or asynchronous replication of data reaches the purpose of data protection to distant clusters.There is local collection in the continuous data protection of asynchronous scheme
Group and distant clusters data out of step conditions, local cluster because certain reason need by distant clusters recover data when
Wait, it is understood that there may be newest data can not be returned to, had been written in local cluster and internal memory in data, but data also do not have
In asynchronous replication distant clusters, if this when of client place physical node is because certain reason causes internal storage data to be lost
Lose, this when, data just may be recovered less than newest version.
Synchronization scenario is for asynchronous scheme nonsynchronous, the synchronization side that there are problems that local cluster and distant clusters have a data
Case takes request of data while issuing local cluster and distant clusters, and only local cluster and distant clusters ensure request of data
Data have been persisted to local cluster and distant clusters, and client only receives the response just meeting of local cluster and distant clusters
Think that this secondary data request has been completed, client can send subsequent request.
The content of the invention
It is an object of the invention to disclose a kind of cloud platform continuous data synchronous method and its a kind of cloud based on the method
Platform continuous data synchronizer, overcomes asynchronous continuous data protection mode between local cluster and distant clusters due to difference
The defect of the loss of data caused by step；Meanwhile, to overcome needed in synchronous continuous data protection mode and wait pending data locally collecting
Group and the problem of distant clusters persistence, it is to avoid the decline of the calculating performance of cloud platform in the method for synchronization.
For achieving the above object, the invention provides a kind of cloud platform continuous data synchronous method, client reception
From the request that data generating device sends, by request transmitted in parallel to local storage and strange land storage device；Client is not
Wait the data associated by the request to complete data persistence in local storage and/or strange land storage device, and wait
The local storage or strange land storage device not responded responds, and task terminates.
As a further improvement on the present invention, client is not to wait for the data associated by the request in local storage
And/or data persistence is completed in the storage device of strange land, and wait the local storage not responded or strange land storage
Device responds, and allows to differ between local storage and strange land storage device described at least one from client reception
Request corresponding to the delay operation cycle.
As a further improvement on the present invention, the local storage and/or strange land storage device are deposited including volatibility
The storage of reservoir, nonvolatile memory, data base, calculate node, cluster server or software definition；
The client is configured to Qemu or KVM；
The data generating device is configured to virtual machine, application program, the computer installation of operation UI.
As a further improvement on the present invention, the Qemu or KVM is driven by Librbd and sends out data generating device
The request transmitted in parallel for sending is to local storage and strange land storage device.
As a further improvement on the present invention, the request includes read operation, write operation, deletion action, Data Migration behaviour
Make or replicate operation.
As a further improvement on the present invention, also include：Performance is carried out to local storage or strange land storage device
Judge, to determine the operation cycle is postponed.
Meanwhile, the invention also discloses a kind of cloud platform continuous data synchronizer, including：
Client, local storage, strange land storage device；
Client is received from the request of data generating device transmission, by request transmitted in parallel to local storage and strange land
Storage device；Client is not to wait for the data associated by the request and completes in local storage and/or strange land storage device
Data persistence, and wait the local storage not responded or strange land storage device to respond, task terminates.
As a further improvement on the present invention, the cache module communicated with client is also included, the cache module is used
In the data corresponding to the request that interim storage local storage and strange land storage device send to data generating device；And
Performance judgment module, the performance judgment module is used to carry out performance judgment to local storage or strange land storage device,
To determine the data difference that local storage is tolerated with strange land storage device a delay operation cycle.
As a further improvement on the present invention, also include homogeneous with client, local storage and strange land storage device
The update module and acquisition module of mutual communication, time threshold T of the acquisition module according to set by setting update module, to this
The performance data of body storage device and strange land storage device is acquired, and sends to update module；The update module is included
A kind of logic, the logic can determine the delay operation cycle according to the performance data that acquisition module sends.
As a further improvement on the present invention, the local storage and/or strange land storage device are deposited including volatibility
The storage of reservoir, nonvolatile memory, data base, calculate node, cluster server or software definition；
The client is configured to Qemu or KVM；
The data generating device is configured to virtual machine, application program, the computer installation of operation UI.
As a further improvement on the present invention, the nonvolatile memory is filled by the solid-state storage for supporting random access
Put, flash memory, phase transition storage, strong dielectric body memorizer, magnetic recording formula write at any time reading memorizer, two-way unification and deposit
One of reservoir, resistance RAM, NVDIMM or RAMDISK are constituted.
As a further improvement on the present invention, the time threshold T set by the update module is less than 10 seconds.
Compared with prior art, the invention has the beneficial effects as follows：By the present invention, before ensureing that data do not occur to lose
Put, local storage and handling capacity of the strange land storage device to data can be taken into account again, it is to avoid the calculating of cloud platform
The decline of performance, improves Consumer's Experience, reduces the computing cost on backstage.
Description of the drawings
Fig. 1 is based on a kind of cloud platform continuous data synchronous method of the invention and its cloud platform continuous data synchronizer institute
The topological diagram being related to；
Fig. 2 is the sequence chart that local cluster promises prior to distant clusters response in embodiment one；
Fig. 3 is the sequence chart that distant clusters promise prior to local cluster response in embodiment two；
Fig. 4 is a kind of topological diagram of the cloud platform continuous data synchronizer in variation；
Fig. 5 is topological diagram of the cloud platform continuous data synchronizer in another kind of variation；
Fig. 6 is the topological diagram of local storage.
Specific embodiment
Below in conjunction with the accompanying drawings the present invention is described in detail for shown each embodiment, but it should explanation, these
Embodiment not limitation of the present invention, those of ordinary skill in the art according to these embodiment institute work energy, method,
Or the equivalent transformation or replacement in structure, belong within protection scope of the present invention.
KVM (Kernel-based Virtual Machine) is built in linux kernel, is a kind of hardware based complete
Virtualization system.KVM basic structures are made up of KVM Driver and Qemu.Wherein, KVM Driver are had become in Linux
One module of core, and be responsible for creating virtual machine, the distribution of virtual memory, the read/write of virtual cpu depositor and operation etc.；
Qemu is used to simulate the user's space of PC hardware and sets up, there is provided the device model such as hard disk, network and access approach.
Qemu is to operate in an application program in HOST OS (host operating system), and with the shape of host file
Formula storage virtual machine hard disc data, and provide raw and qcow2 two kinds of conventional file formats.Qcow2 provides cow and (writes recurrence of disease at the same time next year
System) technology, data block is only allocated when updating, and there is provided snapshot (snapshot functions)
Overview
Fig. 1 is involved by a kind of cloud platform continuous data synchronous method of the invention and its cloud platform continuous data synchronizer
Topological diagram.In various application scenarios shown by the present invention, client 20 receives the request of the transmission of data generating device 10,
The request can be read operation request, alternatively write operation requests, deletion action request, data migration operation request or duplication
Operation requests, and other are based on cloud platform, computer cluster, cluster server or open and run on the void in physical machine
Plan machine being created, run or closing process in involved all data actions.
Client 20 by above-mentioned request transmitted in parallel to local storage 30 and strange land storage device 40, client 20
It is not to wait for the data associated by the request and completes data persistence in local storage 30 and/or strange land storage device 40,
And waiting the local storage 30 not responded or strange land storage device 40 to respond, task terminates；Then start
Perform next operation.Client 20 is run in HOST OS.
It by the data model translation in internal memory is storage model that data persistence is exactly, and in storage model is converted to
The general designation of the data model in depositing. data model can be any data structure or object model, and storage model can be relation
Model, XML, binary stream etc..
Local storage 30 and/or strange land storage device 40 include volatile memory (for example, DRAM), non-volatile
Memorizer (for example, support the solid-state storage device of random access, flash memory, phase transition storage, strong dielectric body memorizer,
Magnetic recording formula write at any time reading memorizer, two-way Unified Memory, resistance RAM, NVDIMM or RAMDISK), data base,
The storage of calculate node, cluster server or software definition.Client 20 be configured to Qemu either KVM or other based on void
Planization technology configures the client of formation and drives 20a.Data generating device 10 is configured to virtual machine, application program, operation
The computer installation of UI.In this manual, data generating device 10 is elaborated from application program 101.Application program
101 can independent operating in the PC of user (guest), also can independent operating in based on user's Telnet the void positioned at strange land
In plan machine, and with client 20a can be driven to carry out data transmit-receive by api interface or system bus.In this manual, should
Client drives 20a to be configured to Qemu or KVM, and drives the request for sending data generating device 10 simultaneously by Librbd
Row is sent to local storage 30 and strange land storage device 40.In this manual, local cluster 30a is local storage
A kind of 30 concrete application example, distant clusters 40a are a kind of instantiations of strange land storage device 40.
Embodiment one：
Present embodiment illustrates the response of local cluster 30a prior to distant clusters 40a reach client drive 20a when reality
Example scene.
Coordinate with reference to shown in Fig. 2, in the present embodiment, the cloud platform continuous data synchronous method is comprised the following steps：Should
20a is driven to send write request to client as data generating device with program 101；Client drives 20a that write request is parallel
(i.e. in the same time) is respectively sent to local cluster 30a and distant clusters 40a.Due to local cluster 30a and the meter of distant clusters 40a
The difference of calculation machine performance and network environment, so as to cause both disposal ability to the data corresponding to same write request to exist
Certain difference.Therefore, local cluster 30a can cause write request institute right with distant clusters 40a after above-mentioned write request is received
To there is the regular hour in the data answered poor when local cluster 30a is write with distant clusters 40a.
In this implement scene, the response of local cluster 30a reaches client and drives prior to the response of distant clusters 40a
20a.Now, client drives the response of slower distant clusters 40a of 20a meeting wait-for-responses, until it makes to client 20a
Response.Finally, 20a is driven to the response of application program 101 from client, and completes this write operation requests.
In the present embodiment, client driving 20a is not to wait for the data associated by the request in local cluster 30a and distal end
Data persistence is completed in cluster 40a, and waits distant clusters 40a not responded to respond, and allow local cluster
The delay corresponding to the request of 20a receptions is driven to operate from client described in difference at least one between 30a and distant clusters 40a
Cycle.The delay operation cycle depends on every parameter of local cluster 30a and distant clusters 40a, such as CPU floating-points fortune
Calculate speed, network environment etc..
Specifically, Qemu or KVM is configured to when data generating device 10 is configured to VM virtual machines, client 20,
Local cluster 30a is configured to local Ceph, when distant clusters 40a are configured to distal end Ceph, the execution of above-mentioned write request
Journey can be described in detail below.
Application program in VM virtual machines sends write request to QEMU/KVM virtualization layers.QEMU/KVM is by Librbd's
Drive and send write request to the Ceph clusters being located locally.Simultaneously QEMU/KVM sends parallel sending out also by the driving of Librbd
Write request is sent to the Ceph clusters positioned at distal end.Local Ceph clusters send out the write request response after the write request has been processed
Give QEMU/KVM.QEMU/KVM judges the response that the response is local Ceph clusters, sends responses to QEMU/KVM's
The driving of librbd.The driving of QEMU/KVM is sent to VM virtual machines, represents this write operation requests writing in Ceph clusters
The corresponding data write of operation is completed.Then, the response for waiting distal end Ceph clusters reaches QEMU/KVM.Finally, this is completed
Data corresponding to secondary write operation requests are in local Ceph clusters (a kind of instantiation of local storage 30) and distal end
Write while Ceph clusters (a kind of instantiation of strange land storage device 40), so as to ensure that local Ceph clusters and distal end
Data in Ceph clusters keep synchronous.
Embodiment two：
Present embodiment illustrates the response of distant clusters 40a prior to local cluster 30a reach client drive 20a when reality
Example scene.The present embodiment is distinguishing as follows with the application scenarios of embodiment one.
Coordinate with reference to shown in Fig. 3, in the present embodiment, the cloud platform continuous data synchronous method is comprised the following steps：Should
20a is driven to send write request to client as data generating device with program 101；Client drives 20a that write request is parallel
(i.e. in the same time) is respectively sent to local cluster 30a and distant clusters 40a.Due to local cluster 30a and the meter of distant clusters 40a
The difference of calculation machine performance and network environment, so as to cause both disposal ability to the data corresponding to same write request to exist
Certain difference.Therefore, local cluster 30a can cause write request institute right with distant clusters 40a after above-mentioned write request is received
To there is the regular hour in the data answered poor when local cluster 30a is write with distant clusters 40a.
In this implement scene, the response of distant clusters 40a reaches client and drives prior to the response of local cluster 30a
20a.Now, client drives the response of slower local cluster 30a of 20a meeting wait-for-responses, until it makes to client 20a
Response.Finally, 20a is driven to the response of application program 101 from client, and completes this write operation requests.
Embodiment three：
Deposit to optimize local storage 30 (that is, local cluster 30a in embodiment one and embodiment two), strange land
In storage device 40 (that is, the strange land cluster 40a in embodiment one and embodiment two) to client 20 (that is, embodiment one with it is real
Apply client in example two and drive 20a) accuracy that responds and data reliability.Shown in ginseng Fig. 4 and Fig. 5, in this enforcement
In example, also include in the cloud platform continuous data synchronizer：The cache module 21 communicated with client 20.Cache module 21
Corresponding to the request sent to data generating device 10 for interim storage local storage 30 and strange land storage device 40
Data；And performance judgment module 22.Performance judgment module 22 by api interface and client 20, local storage 30 and
Strange land storage device 40 communicates.Performance judgment module 22 is used to carry out local storage 30 or strange land storage device 40
Performance judgment, to determine the data difference that local storage 30 is tolerated with strange land storage device 40 a delay operation cycle
It is different.
After some comparatively fast responds in local storage 30 and strange land storage device 40, can be connect by client 20
The next request of receipts, and issue next asking to the local storage 30 or strange land storage device 40 for comparatively fast completing to respond
Ask, and start to perform the request；When the local storage 30 or strange land storage device 40 compared with the previous request of slow-response it is complete
Into after response, the response of next request can be got started.
Because local storage 30 can be converted at any time with the performance of strange land storage device 40 with network environment, therefore
Both sequencing is not fixed, so as to can according to the calculating performance of local storage 30 and strange land storage device 40 and/
Or network environment and flexibly switch and convert sequencing so that whole technical scheme can either reach current asynchronous data
The efficient advantage of backup, is avoided that the undue computing resource for consuming backstage or cloud platform again, therefore this programme can show
The raising Consumer's Experience of work, it is to avoid the request that user sends produces the delayed of response and postpones.
Shown in ginseng Fig. 5, as a further improvement on the present invention, the cloud platform continuous data synchronizer also includes and client
End 20, local storage 30 and the update module 24 and acquisition module 23 of the homogeneous mutual communication of strange land storage device 40.The collection
Time threshold T of the module 23 according to set by setting update module 24, to body storage device 30 and strange land storage device 40
Performance data is acquired, and sends to update module 24.The update module 24 includes a kind of logic, and the logic being capable of basis
The performance data that acquisition module 23 sends determines the delay operation cycle.By this Technical Architecture, can be slow with easier determination
The capacity arranged required for storing module 21, so as to provide accurate foundation to the setting of the capacity of cache module 21.The locally stored dress
Put 30 and/or strange land storage device 40 include volatile memory, nonvolatile memory, data base, calculate node, cluster clothes
Business device or software definition storage.
Because traditional DRAM has that power down cannot keep self-refresh and lose data.In the present embodiment, should
Local storage 30 and strange land storage device 40 are more preferably nonvolatile memory, and more preferably
NVDIMM.NVDIMM is a kind of memory bar specification for being integrated with DRAM and Nonvolatile memory chip.
Shown in ginseng Fig. 6, the present embodiment further discloses a kind of NVDIMM.The local storage 30 and strange land storage device 40
In include at least a memory element 100.
The memory element 100, including：
Memorizer 20b and Memory Controller 10a that some matchings arranged side by side are arranged, specifically, memorizer 20b and storage
The quantity of device controller 10a is equal.The memory element 100 also includes control circuit 30.Control circuit 30 includes：It is arranged on described
First selector 301 in cascade structure, second selector 302, bypass between memorizer 20b and Memory Controller 10a is cut
The mold changing moderator 304 of block 303 and.
Memory Controller 10a receives data access request 101a, 101b of each memorizer 20b and sends to moderator
304.Moderator 304 receives each data access request 101a, 101b and judges the order of priority.First selector 301
According to the order of priority, multiple interface channel 102a, 102b are set up with Memory Controller 10a successively, and select by second
The normal data passage 312 that device 302 is set up with multiple memorizeies 20 being set up in parallel carries out the write/reading of data.
In the present embodiment, prioritization adopts following ordering strategy：
First priority：The management data of memorizer 20；
Second priority：System state data；
Third priority：Need the general data for writing memorizer 20b or reading from memorizer 20b.
Specifically, in the present embodiment, moderator 304 includes data according to data access request 101a, 101b
Importance, judges the order of priority.That is in Fig. 6, data access request 101a, 101b is which Memory Controller 10a meeting
Data cube computation passage 102a, 102b are preferentially set up with first selector 301.
When Memory Controller 10a monitors the abnormal conditions of data write/reading in memorizer 20b, by bypass
Handover module 303 to moderator 304 sends interruptive command 3041, to interrupt first selector 301 with second selector 302
Connection, then connection, i.e. interface channel 313 in Fig. 6 are set up between bypass changeover module 303 and second selector 302.
Specifically, the Memory Controller 10a is connected by interface bus 305 with system bus 40.The interface is total
Line 305 includes I2C or SMBUS, and preferably SMBUS.SMBUS (System Management Bus) is a kind of two-wire system
Universal serial bus.It has abandoned the form of controlling bus and data/address bus in traditional central processing unit, therefore by interface bus
305 can transmission data signal, clock signal, address signal.
Memorizer 20b is nonvolatile memory or volatile memory, and preferably nonvolatile memory.It is described
Nonvolatile memory is by flash memory (Flash memory), phase transition storage (FCM), strong dielectric body memorizer
(FeRAM), magnetic recording formula write at any time reading memorizer (MRAM), two-way Unified Memory (OUM), resistance RAM (RRAM) it
One is constituted.Flash memory (Flash memory) is made up of one of nand flash memory, NOR flash memory；The volatile memory by
One of static RAM (SRAM), dynamic random access memory (DRAM) are constituted, and preferably dynamic random is deposited
Access to memory (DRAM).Memorizer 20b is nand flash memory, and Memory Controller 10a is NAND controller.Because NAND dodges
It is highly developed prior art to deposit with NAND controller, and here is not repeated.Due to the inherent character of nand flash memory, each
Nand flash memory all has the write/read cycle of its setting, therefore can be set up in parallel multiple nand flash memories, and with multiple NAND
Controller matches side by side setting.
The a series of detailed description of those listed above is only for the feasibility embodiment of the present invention specifically
Bright, they simultaneously are not used to limit the scope of the invention, all equivalent implementations made without departing from skill spirit of the present invention
Or change should be included within the scope of the present invention.
It is obvious to a person skilled in the art that the invention is not restricted to the details of above-mentioned one exemplary embodiment, Er Qie
In the case of spirit or essential attributes without departing substantially from the present invention, the present invention can be in other specific forms realized.Therefore, no matter
From the point of view of which point, embodiment all should be regarded as exemplary, and be nonrestrictive, the scope of the present invention is by appended power
Profit is required rather than described above is limited, it is intended that all in the implication and scope of the equivalency of claim by falling
Change is included in the present invention.Any reference in claim should not be considered as and limit involved claim.
Moreover, it will be appreciated that although this specification is been described by according to embodiment, not each embodiment is only wrapped
Containing an independent technical scheme, this narrating mode of description is only that for clarity those skilled in the art should
Using description as an entirety, the technical scheme in each embodiment can also Jing it is appropriately combined, form those skilled in the art
Understandable other embodiment.
Claims (12)
1. a kind of cloud platform continuous data synchronous method, it is characterised in that：Client is received from asking for data generating device transmission
Ask, and transmitted in parallel will be asked to local storage and strange land storage device；Client is not to wait for the number associated by the request
According to completing data persistence in local storage and/or strange land storage device, and wait do not respond locally stored
Device or strange land storage device respond, and task terminates.
2. cloud platform continuous data synchronous method according to claim 1, it is characterised in that client is not to wait for the request
Associated data complete data persistence in local storage and/or strange land storage device, and wait and not responding
Local storage or strange land storage device respond, and allow phase between local storage and strange land storage device
Differ from the delay operation cycle corresponding to the request described at least one from client reception.
3. cloud platform continuous data synchronous method according to claim 1, it is characterised in that
The local storage and/or strange land storage device include volatile memory, nonvolatile memory, data base,
The storage of calculate node, cluster server or software definition；
The client is configured to Qemu or KVM；
The data generating device is configured to virtual machine, application program, the computer installation of operation UI.
4. cloud platform continuous data synchronous method according to claim 3, it is characterised in that the Qemu or KVM leads to
Cross Librbd and drive the request transmitted in parallel for sending data generating device to local storage and strange land storage device.
5. cloud platform continuous data synchronous method as claimed in any of claims 1 to 4, it is characterised in that described
Request includes read operation, write operation, deletion action, data migration operation or replicates operation.
6. cloud platform continuous data synchronous method according to claim 5, it is characterised in that also include：To locally stored
Device or strange land storage device carry out performance judgment, and to determine the operation cycle is postponed.
7. a kind of cloud platform continuous data synchronizer, it is characterised in that include：
Client, local storage, strange land storage device；
Client is received from the request of data generating device transmission, and request transmitted in parallel is deposited to local storage with strange land
Storage device；Client is not to wait for the data associated by the request and number is completed in local storage and/or strange land storage device
According to persistence, and the local storage not responded or strange land storage device is waited to respond, task terminates.
8. cloud platform continuous data synchronizer according to claim 7, it is characterised in that also include being communicated with client
The cache module of letter, the cache module is used for interim storage local storage with strange land storage device to data generating device
Data corresponding to the request of transmission；And performance judgment module, the performance judgment module be used for local storage or
Person strange land storage device carries out performance judgment, to determine that local storage postpones the operation cycle with strange land storage device at one
The data difference tolerated.
9. cloud platform continuous data synchronizer according to claim 8, it is characterised in that also include and client, sheet
Ground storage device and the homogeneous mutual communication of strange land storage device update module and acquisition module, the acquisition module according to setting more
Time threshold T set by new module, is acquired to the performance data of body storage device and strange land storage device, and sends
To update module；The update module includes a kind of logic, and the logic can be true according to the performance data of acquisition module transmission
Surely the operation cycle is postponed.
10. cloud platform continuous data synchronizer according to claim 9, it is characterised in that
The local storage and/or strange land storage device include volatile memory, nonvolatile memory, data base,
The storage of calculate node, cluster server or software definition；
The client is configured to Qemu or KVM；
The data generating device is configured to virtual machine, application program, the computer installation of operation UI.
11. cloud platform continuous data synchronizers according to claim 10, it is characterised in that the non-volatile memories
Device is by solid-state storage device, flash memory, phase transition storage, strong dielectric body memorizer, the magnetic recording formula for supporting random access
Write at any time reads one of memorizer, two-way Unified Memory, resistance RAM, NVDIMM or RAMDISK and constitutes.
12. cloud platform continuous data synchronizers according to claim 1, it is characterised in that set by the update module
Fixed time threshold T is less than 10 seconds.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611167491.4A CN106603665B (en) | 2016-12-16 | 2016-12-16 | Cloud platform continuous data synchronous method and its device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611167491.4A CN106603665B (en) | 2016-12-16 | 2016-12-16 | Cloud platform continuous data synchronous method and its device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106603665A true CN106603665A (en) | 2017-04-26 |
| CN106603665B CN106603665B (en) | 2018-04-13 |
Family
ID=58599456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611167491.4A Active CN106603665B (en) | 2016-12-16 | 2016-12-16 | Cloud platform continuous data synchronous method and its device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106603665B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107547160A (en) * | 2017-06-28 | 2018-01-05 | 新华三技术有限公司 | A kind of method for synchronizing time and device |
| CN109710699A (en) * | 2019-01-02 | 2019-05-03 | 神州数码融信软件有限公司 | The back method of the method for recording of transaction data, transaction data |
| CN109819048A (en) * | 2019-02-27 | 2019-05-28 | 北京字节跳动网络技术有限公司 | Method of data synchronization, device, terminal and storage medium |
| CN110158430A (en) * | 2019-05-08 | 2019-08-23 | 中铁北京工程局集团有限公司 | A kind of automatic plucking laminating machine in bridge concrete face |
| CN114041112A (en) * | 2019-07-18 | 2022-02-11 | 净睿存储股份有限公司 | Virtual storage system architecture |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751415A (en) * | 2008-12-09 | 2010-06-23 | ***通信集团公司 | Metadata service system metadata synchronized method and writing server updating method |
| CN102412985A (en) * | 2011-10-31 | 2012-04-11 | 烽火通信科技股份有限公司 | Method for managing object of network management system based on operation separation |
| CN103078945A (en) * | 2013-01-07 | 2013-05-01 | 北京奇虎科技有限公司 | Method and system for processing browser crash data |
| CN104239476A (en) * | 2014-09-04 | 2014-12-24 | 上海天脉聚源文化传媒有限公司 | Method, device and system for synchronizing databases |
| CN105045531A (en) * | 2015-07-01 | 2015-11-11 | 山东超越数控电子有限公司 | Buffer synchronization mechanism between double storage controllers |
-
2016
- 2016-12-16 CN CN201611167491.4A patent/CN106603665B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751415A (en) * | 2008-12-09 | 2010-06-23 | ***通信集团公司 | Metadata service system metadata synchronized method and writing server updating method |
| CN102412985A (en) * | 2011-10-31 | 2012-04-11 | 烽火通信科技股份有限公司 | Method for managing object of network management system based on operation separation |
| CN103078945A (en) * | 2013-01-07 | 2013-05-01 | 北京奇虎科技有限公司 | Method and system for processing browser crash data |
| CN104239476A (en) * | 2014-09-04 | 2014-12-24 | 上海天脉聚源文化传媒有限公司 | Method, device and system for synchronizing databases |
| CN105045531A (en) * | 2015-07-01 | 2015-11-11 | 山东超越数控电子有限公司 | Buffer synchronization mechanism between double storage controllers |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107547160A (en) * | 2017-06-28 | 2018-01-05 | 新华三技术有限公司 | A kind of method for synchronizing time and device |
| CN109710699A (en) * | 2019-01-02 | 2019-05-03 | 神州数码融信软件有限公司 | The back method of the method for recording of transaction data, transaction data |
| CN109710699B (en) * | 2019-01-02 | 2021-01-22 | 神州数码融信软件有限公司 | Recording method and playback method of transaction data |
| CN109819048A (en) * | 2019-02-27 | 2019-05-28 | 北京字节跳动网络技术有限公司 | Method of data synchronization, device, terminal and storage medium |
| CN110158430A (en) * | 2019-05-08 | 2019-08-23 | 中铁北京工程局集团有限公司 | A kind of automatic plucking laminating machine in bridge concrete face |
| CN114041112A (en) * | 2019-07-18 | 2022-02-11 | 净睿存储股份有限公司 | Virtual storage system architecture |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106603665B (en) | 2018-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106603665B (en) | Cloud platform continuous data synchronous method and its device | |
| US10838648B2 (en) | Distributed host copy migration in a cluster environment using changed block tracking | |
| US11397648B2 (en) | Virtual machine recovery method and virtual machine management device | |
| CN102467408B (en) | Method and device for accessing data of virtual machine | |
| US7594137B2 (en) | Storage system and data restoration method thereof | |
| CN101609419B (en) | Continuous on-line transferring data backup method of virtual machine and device thereof | |
| US11500739B2 (en) | Creating remote backup copies in asynchronous replication arrangements involving relatively long cycle times | |
| CN102981931B (en) | Backup method and device for virtual machine | |
| US9336132B1 (en) | Method and system for implementing a distributed operations log | |
| CN109857445A (en) | Storage system and control software layout method | |
| CN100383749C (en) | Remote copy method and remote copy system | |
| CN106030500B (en) | The data migration method of storage system | |
| CN108235751A (en) | Identify the method, apparatus and data-storage system of object storage device inferior health | |
| CN100561447C (en) | Storage volume is rendered as device, the system and method for virtual volume | |
| US20090031097A1 (en) | Creating Backups in Storage Systems | |
| CN103814360A (en) | Data replication method and storage system | |
| CN102123176B (en) | Space distribution and management method and device for network storage system | |
| CN101815986B (en) | Splitting writes between a storage controller and replication engine | |
| CN111026510A (en) | Cross-storage thermal migration method for virtual machine in cloud environment | |
| CN106855834B (en) | Data backup method, device and system | |
| CN105940386A (en) | Migrating data between memories | |
| CN103793291A (en) | Distributed data copying method and device | |
| CN101945131A (en) | Storage virtualization-based data migration method | |
| CN104272242A (en) | Creating encrypted storage volumes | |
| CN100530069C (en) | Virtualizing system and method for non-homogeny storage device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | ||
| CP03 | Change of name, title or address |
Address after: 214125 Wuxi science and Technology Park, Jiangsu Binhu District No. 6 Patentee after: Huayun data holding group Co., Ltd Address before: No.6, science and education software park, Binhu District, Wuxi City, Jiangsu Province Patentee before: WUXI CHINAC DATA TECHNICAL SERVICE Co.,Ltd. |