CN103973727B - Method of data synchronization and device - Google Patents

Method of data synchronization and device Download PDF

Info

Publication number
CN103973727B
CN103973727B CN201310032868.5A CN201310032868A CN103973727B CN 103973727 B CN103973727 B CN 103973727B CN 201310032868 A CN201310032868 A CN 201310032868A CN 103973727 B CN103973727 B CN 103973727B
Authority
CN
China
Prior art keywords
data
synchronization
failure
data block
record
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310032868.5A
Other languages
Chinese (zh)
Other versions
CN103973727A (en
Inventor
彭勇
罗皓
郭振宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Tencent Computer Systems Co Ltd
Original Assignee
Shenzhen Tencent Computer Systems Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Tencent Computer Systems Co Ltd filed Critical Shenzhen Tencent Computer Systems Co Ltd
Priority to CN201310032868.5A priority Critical patent/CN103973727B/en
Publication of CN103973727A publication Critical patent/CN103973727A/en
Application granted granted Critical
Publication of CN103973727B publication Critical patent/CN103973727B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Hardware Redundancy (AREA)

Abstract

The invention discloses a kind of method of data synchronization and devices, belong to computer field.The described method includes: the data block in source data is synchronized to copy data;Detect the data block whether synchronization failure;If it is detected that the data block synchronization failure, the corresponding Data Identification of the data block is added into synchronization failure flowing water;Continue next not synchronous data block in the source data being synchronized to the copy data;Re-synchronization is carried out to the data block according to the synchronization failure flowing water in a subsequent predetermined point of time.The present invention passes through in the data block synchronization failure for detecting current sync, the corresponding mark of the data block is added into synchronization failure flowing water, continue to synchronize next not synchronous data block simultaneously, it solves in the prior art, the problem of request bulk deposition is retried caused by when being retried at once after detecting data block synchronization failure, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating.

Description

Method of data synchronization and device
Technical field
The present invention relates to computer field, in particular to a kind of method of data synchronization and device.
Background technique
It, can be by user data in order to solve the problems, such as that user data is surprisingly lost with the continuous development of network application It is synchronized in different equipment or system.When progress high-volume data are synchronous, due to failure or network fluctuation etc., Often have a certain proportion of failure of data synchronization.
Existing method of data synchronization, when being synchronized to a data block, detect the data block whether synchronization failure, when When detecting the data block synchronization failure, the synchronized process of the data block is retried at once, until the data block synchronizes success.
In the implementation of the present invention, the inventor finds that the existing technology has at least the following problems:
Method of data synchronization used by the prior art, in the feelings that failure or network fluctuation problem cannot be resolved in time Under condition, it will cause and retry request bulk deposition, system pressure increases, and is further exacerbated by loss of data risk.
Summary of the invention
When in order to solve failure of data synchronization in the prior art, request bulk deposition is retried, increases system pressure, data are lost It goes wrong dangerous the problem of aggravating, the embodiment of the invention provides a kind of method of data synchronization and devices.The technical solution is as follows:
On the one hand, a kind of method of data synchronization is provided, which comprises
A data block in source data is synchronized to copy data;
Detect the data block whether synchronization failure;
If it is detected that the data block synchronization failure, is added into synchronization failure for the corresponding Data Identification of the data block In flowing water;
Continue next not synchronous data block in the source data being synchronized to the copy data;
Re-synchronization is carried out to the data block according to the synchronization failure flowing water in a subsequent predetermined point of time.
On the other hand, a kind of data synchronization unit is provided, described device includes:
First synchronization module, for the data block in source data to be synchronized to copy data;
Detection module, for detect the data block whether synchronization failure;
Flow Record module, if detecting that the synchronous data block of first synchronization module is synchronous for the detection module The corresponding Data Identification of the data block, then be added into synchronization failure flowing water by failure;
First synchronization module, for after the data block in source data is synchronized to copy data, continue by Next not synchronous data block in the source data is synchronized to the copy data;
Second synchronization module is used in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block Carry out re-synchronization.
Technical solution provided in an embodiment of the present invention has the benefit that
By the way that in the data block synchronization failure for detecting current sync, the corresponding mark of the data block is added into synchronous mistake Flowing water is lost, while continuing to synchronize next not synchronous data block, solves in the prior art, is detecting data block synchronization failure The problem of request bulk deposition is retried caused by when being retried at once afterwards, has reached mitigation system pressure, has avoided loss of data The purpose of risk aggravation;Also by being carried out again according to the synchronization failure flowing water to the data block in a subsequent predetermined point of time It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure Final accurate synchronization all data, the purpose for being consistent copy data and source data.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is the method flow diagram for the method for data synchronization that the embodiment of the present invention one provides;
Fig. 2 is the method flow diagram of method of data synchronization provided by Embodiment 2 of the present invention;
Fig. 3 is the process flow diagram of method of data synchronization provided by Embodiment 2 of the present invention;
Fig. 4 is the apparatus structure schematic diagram for the data synchronization unit that the embodiment of the present invention three provides;
Fig. 5 is the apparatus structure schematic diagram for the data synchronization unit that the embodiment of the present invention four provides.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Embodiment one
Referring to FIG. 1, the method flow diagram of the method for data synchronization provided it illustrates the embodiment of the present invention one.The data Synchronous method may include:
Step 102, the data block in source data is synchronized to copy data;
Step 104, detect the data block whether synchronization failure;
Step 106, if it is detected that the data block synchronization failure, is added into synchronization for the corresponding Data Identification of the data block In failure flowing water;
Step 108, continue next not synchronous data block in the source data being synchronized to the copy data;
Step 110, re-synchronization is carried out to the data block according to the synchronization failure flowing water in a subsequent predetermined point of time.
In conclusion the method for data synchronization that the embodiment of the present invention one provides, by the data for detecting current sync When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating;The embodiment of the present invention one provides Method of data synchronization, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block carry out again It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure Final accurate synchronization all data, the purpose for being consistent copy data and source data.
Embodiment two
Referring to FIG. 2, it illustrates the method flow diagrams of method of data synchronization provided by Embodiment 2 of the present invention.As base In the particularly preferred embodiment that embodiment one provides, which may include:
Step 202, the data block in source data is synchronized to copy data by data synchronization unit;
Specifically, the copy of the data block in the available source data of data synchronization unit, and the data block that will acquire Replica updating copy data in corresponding data block.
Step 204, data synchronization unit detect the data block whether synchronization failure;
Specifically, data synchronization unit after a data block is synchronized to copy data, can wait the number of copies to be received The synchronization success response or synchronization failure response corresponding to the data block returned according to place device;If receiving correspondence It is responded in the synchronization failure of the data block, or is not received by synchronizes success corresponding to the data block within a predetermined period of time Any one of response or synchronization failure response, then confirmation detects the data block synchronization failure.
Step 206, if it is detected that the data block synchronization failure, data synchronization unit is by the corresponding data mark of the data block Knowledge is added into synchronization failure flowing water;
Specifically, the synchronization failure flowing water is made of a series of failure record.Failure record, which includes at least, the failure The Data Identification of the data block of the record time and synchronization failure of record, such as the data ID(Identity of the data block, sequence Number), in addition, can also include in user information corresponding with the data block, action type and data in the failure record The information such as appearance.
If it is detected that the data block synchronization failure, data synchronization unit is generated according to the corresponding Data Identification of the data block One failure record, and the failure record of generation is added in synchronization failure flowing water.
Step 208, data synchronization unit continues next not synchronous data block in the source data being synchronized to the copy Data;
Data synchronization unit the data block to synchronization failure will not carry out at once when being tested with data block synchronization failure It retries, but first by the data identity record of the data block of the synchronization failure to synchronization failure flowing water, and continue to synchronize next Not synchronous data block.
Step 210, data synchronization unit in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block Carry out re-synchronization.
Specifically, retried caused by order to avoid cannot be resolved in time because of failure or network fluctuation problem process after The problem of continuous failure, data synchronization unit after this is subsynchronous, do not need to extract at once synchronization failure flowing water carry out it is again same Step, but the synchronization failure flowing water is extracted in a subsequent predetermined point of time, and according to the number in the synchronization failure flowing water of extraction According to mark, re-synchronization is carried out to the data block of synchronization failure.
Wherein, the predetermined point of time be preset specific time point, according to predetermined period determine time point or The time point determined according to network condition;Specifically, data synchronization unit can extract synchronous mistake according to scheduled time point Flowing water is lost, for example, it is again same to be predefined in the data block progress that 0 point of daily morning extraction synchronization failure flowing water comes to synchronization failure Step;Alternatively, data synchronization unit can be every certain synchronization failure flowing water of periodicity extraction, for example, extracting every 4 hours Synchronization failure flowing water to carry out re-synchronization to the data block of synchronization failure;Also or, data synchronization unit can also be It detects and synchronization failure flowing water is extracted to carry out re-synchronization to the data block of synchronization failure when present network conditions are preferable.
In addition, data synchronization unit before the data block to synchronization failure carries out re-synchronization, can also lose to synchronous It loses the identical failure record of Data Identification in flowing water to merge, carries out multiple re-synchronization to avoid to same data block.Its In, can have much to the method that the identical failure record of Data Identification merges in synchronization failure flowing water, it is specific for example, number It can be extracted in the identical failure record of Data Identification according to synchronizing device, record time and the immediate failure of current time Record, and the Data Identification in the failure record of extraction is added into miss data identification list;Data synchronization unit is according to this Data Identification in miss data identification list carries out re-synchronization to the data block of the synchronization failure.
Specifically, data synchronization unit is according to the Data Identification in the miss data identification list, to the synchronization failure The specific steps that data block carries out re-synchronization can be such that
Data synchronization unit judges the data block of synchronization failure in source according to the Data Identification in miss data identification list It whether there is in data.If judging, the data block of synchronization failure exists in source data, and data synchronization unit is by the source number The data block re-synchronization of the synchronization failure present in is to copy data, and by the number of synchronization failure present in the source data Write-in copy data is covered according to block.If judging, the data block of synchronization failure is not present in source data, data synchronization unit The data block of synchronization failure in copy data is deleted.
As the preferred of above-mentioned steps, Data Identification of the data synchronization unit in the synchronization failure flowing water according to extraction, After carrying out re-synchronization to the data block of synchronization failure, this synchronization failure flowing water extracted can be emptied or be deleted, with When avoiding extracting synchronization failure flowing water next time, the synchronization failure flowing water of extracted mistake is carried out to repeat extraction.
In addition, it is necessary to explanation, generally requires to carry out between different devices since data synchronize, this hair Equipment where the data synchronization unit that bright embodiment two provides is not fixed.Data synchronization unit can be deployed in source number According to place equipment, it can also be deployed in equipment where copy data, alternatively, data synchronization unit, which has, can also be deployed in third party Relay device, even, the disparate modules in the data synchronization unit can be respectively deployed in different equipment, in this regard, this hair Bright embodiment two is not especially limited.
Further, the purposes of the copy data synchronized with source data can be divided into two kinds: one is as source number According to backup, source data lose when, can be restored according to copy data;Another kind is as the number being equal with source data According to source, to improve the speed for reading or loading in reading data or load.But regardless of which kind of purposes, require copy Data and source data are completely the same just available, and therefore, data synchronization unit can be arranged one uniquely for each copy data Status indication, when the status indication of a copy data is arranged to available, which just can be used as source data Backup or the data source same with source data.
In order to be described further to above-mentioned method of data synchronization, referring to FIG. 3, it illustrates above-mentioned method of data synchronization Process flow diagram in practical applications.At the moment 1, the data block 1-5 in source data is synchronized to copy by data synchronization unit Data, wherein data block 1,3,5 synchronizes success, and the synchronization failure of data block 2 and 4;Data synchronization unit is according to synchronization failure The Data Identification of data block 2 and 4 generates synchronization failure flowing water.At the subsequent a certain moment 2, data synchronization unit extracts synchronous lose Flowing water is lost, and re-synchronization is carried out according to data block 2 and 4 of the synchronization failure flowing water to synchronization failure, if this moment data block 2 Exist in source data, then by 2 re-synchronization of data block in source data to copy data, if this moment data block 4 is in source Data are not present, then delete the data block 4 in copy data.In addition, if in re-synchronization process, and synchronization failure occurs Situation then continues to generate synchronization failure flowing water.
When data synchronization unit starts to synchronize a copy data, first by the status indication of the copy data Be set as unavailable, when synchronously completing, and detect in source data all data blocks all it is synchronous with the copy data successfully when, then Set available for the status indication of the copy data.
In conclusion method of data synchronization provided by Embodiment 2 of the present invention, by the data for detecting current sync When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating;Second embodiment of the present invention provides Method of data synchronization, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block carry out again It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure Final accurate synchronization all data, the purpose for being consistent copy data and source data;In addition, the embodiment of the present invention two mentions The method of data synchronization of confession, also by the Data Identification in the synchronization failure flowing water according to extraction, to the data of synchronization failure Before block carries out re-synchronization, the identical failure record of Data Identification in synchronization failure flowing water is merged, is solved same There are in the case where the identical failure record of a plurality of Data Identification in step failure flowing water, same data block is carried out repeatedly again same The problem of step, has achieved the purpose that reduce the read-write step in synchronizing process.
Embodiment three
Referring to FIG. 4, the structure drawing of device of the data synchronization unit provided it illustrates the embodiment of the present invention three, the device May include:
First synchronization module 301, for the data block in source data to be synchronized to copy data;
Detection module 302, for detect the synchronous data block of the first synchronization module 301 whether synchronization failure;
Flow Record module 303, if the data block synchronization failure is detected for detection module 302, by the data block Corresponding Data Identification is added into synchronization failure flowing water;
First synchronization module 301, for continuing source after the data block in source data is synchronized to copy data Next not synchronous data block in data is synchronized to copy data;
Second synchronization module 304 is used in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block Carry out re-synchronization.
In conclusion the data synchronization unit that the embodiment of the present invention three provides, by the data for detecting current sync When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating;In addition, the embodiment of the present invention Three provide data synchronization units, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block into Row re-synchronization is solved and is asked because data are inconsistent caused by not retrying at once to the data block of synchronization failure Topic, has reached all data of final accurate synchronization, the purpose for being consistent copy data and source data.
Example IV
Referring to FIG. 5, the structure drawing of device of the data synchronization unit provided it illustrates the embodiment of the present invention four.As base In embodiment three provide particularly preferred embodiment, the apparatus may include:
First synchronization module 301, for the data block in source data to be synchronized to copy data;
Detection module 302, for detect the synchronous data block of the first synchronization module 301 whether synchronization failure;
Flow Record module 303, it is if detecting data block synchronization failure for detection module 302, data block is corresponding Data Identification be added into synchronization failure flowing water;
First synchronization module 301, for continuing source after the data block in source data is synchronized to copy data Next not synchronous data block in data is synchronized to copy data;
Second synchronization module 304 is used in a subsequent predetermined point of time according to the synchronization failure flowing water to the data block Carry out re-synchronization.
In addition, the second synchronization module 304 includes:
Day-to-day drawing unit 3041, for extracting the same of the record of Flow Record module 303 in a subsequent predetermined point of time Step failure flowing water, the predetermined point of time are preset specific time point, according to predetermined period determining time point or root The time point determined according to network condition;
Synchronization unit 3042, the Data Identification in synchronization failure flowing water for being extracted according to day-to-day drawing unit 3041, Re-synchronization is carried out to the data block of synchronization failure.
Wherein, synchronization unit 3042 includes:
Judgment sub-unit 3042a, the data mark in synchronization failure flowing water for being extracted according to day-to-day drawing unit 3041 Knowledge judges that the data block of synchronization failure whether there is in source data;
Synchronous subelement 3042b, if judging the data block of synchronization failure in source data for judgment sub-unit 3042a In the presence of then by the data block re-synchronization of synchronization failure present in source data to copy data;
Subelement 3042c is deleted, if judging the data block of synchronization failure in source data for judgment sub-unit 3042a It is not present, then deletes the data block of the synchronization failure in copy data.
Wherein, Flow Record module 303, comprising:
Record generation unit 3031, for generating a failure record according to the corresponding Data Identification of data block;
Adding unit 3032 is recorded, the failure record for generating record generation unit 3031 is added to synchronization failure stream Water.
It also include the record time in the failure record;Second synchronization module 304 further include:
Record extraction unit 3043, the synchronization for extracting in judgment sub-unit 3042a according to day-to-day drawing unit 3041 Before Data Identification in failure flowing water judges that the data block of synchronization failure whether there is in source data, Data Identification phase is extracted In same failure record, record time and the immediate failure record of current time;
Wherein, data synchronization unit records extraction unit before the data block to synchronization failure carries out re-synchronization 3043 can merge the identical failure record of Data Identification in synchronization failure flowing water, carry out to avoid to same data block Multiple re-synchronization.
List adding unit 3044, for the addition of the Data Identification in the failure record that extraction unit 3043 extracts will to be recorded Enter miss data identification list;
Judgment sub-unit 3042a, for judging the number of synchronization failure according to the Data Identification in miss data identification list It whether there is in source data according to block.
It should be noted that the data synchronization unit that the embodiment of the present invention four provides, can be deployed in where source data Equipment can also be deployed in equipment where copy data, alternatively, the data synchronization unit, which has, can also be deployed in third party's transfer Equipment, in this regard, the embodiment of the present invention three is not especially limited.
In conclusion the data synchronization unit that the embodiment of the present invention four provides, by the data for detecting current sync When block synchronization failure, the corresponding mark of the data block is added into synchronization failure flowing water, while continuing to synchronize next not synchronous number According to block, solve in the prior art, when being retried at once after detecting data block synchronization failure caused by retry request big The problem of amount accumulation, mitigation system pressure is reached, the purpose for avoiding loss of data risk from aggravating;The embodiment of the present invention four provides Data synchronization unit, also by a subsequent predetermined point of time according to the synchronization failure flowing water to the data block carry out again It is synchronous, it solves the problems, such as to reach because data are inconsistent caused by once not retrying the data block of synchronization failure Final accurate synchronization all data, the purpose for being consistent copy data and source data;In addition, the embodiment of the present invention four mentions The data synchronization unit of confession, also by the Data Identification in the synchronization failure flowing water according to extraction, to the data of synchronization failure Before block carries out re-synchronization, the identical failure record of Data Identification in synchronization failure flowing water is merged, is solved same There are in the case where the identical failure record of a plurality of Data Identification in step failure flowing water, same data block is carried out repeatedly again same The problem of step, has achieved the purpose that reduce the read-write step in synchronizing process.
It should be understood that data synchronization unit provided by the above embodiment carry out data it is synchronous when, only with above-mentioned each The division progress of functional module can according to need and for example, in practical application by above-mentioned function distribution by different function Energy module is completed, i.e., the internal structure of device is divided into different functional modules, to complete whole described above or portion Divide function.In addition, data synchronization unit provided by the above embodiment and method of data synchronization embodiment belong to same design, have Body realizes that process is detailed in embodiment of the method, and which is not described herein again.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware It completes, relevant hardware can also be instructed to complete by program, the program can store in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only memory, disk or CD etc..
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (3)

1. a kind of method of data synchronization, which is characterized in that the described method includes:
A data block in source data is synchronized to copy data;Detect the data block whether synchronization failure;
If it is detected that the data block synchronization failure, generates one according to the corresponding Data Identification of the data block and unsuccessfully remembers Record;The failure record of generation is added to synchronization failure flowing water;Continue next not synchronous number in the source data The copy data is synchronized to according to block;
It include the record time in the failure record;Before the data block to synchronization failure carries out re-synchronization, number is extracted According to identifying in identical failure record, the record time and the immediate failure record of current time;
Data Identification in the failure record of extraction is added into miss data identification list;In a subsequent predetermined time Point extracts the miss data identification list, and the predetermined point of time is preset specific time point, according to predetermined period Determining time point or the time point determined according to network condition;
Judge the data block of the synchronization failure in the source data according to the Data Identification in the miss data identification list In whether there is;
If judging, the data block of the synchronization failure exists in the source data, will be described present in the source data The data block re-synchronization of synchronization failure is to the copy data;If judging the data block of the synchronization failure in the source number It is not present, then deletes the data block of the synchronization failure in the copy data in;
After by the data block re-synchronization to the copy data of the synchronization failure present in the source data, institute is deleted State synchronization failure flowing water;
The method also includes:
When starting to synchronize the data block, down state is set by the status indication of the copy data;
When synchronously completing, and detect in the source data all data blocks all it is synchronous with the copy data successfully when, by institute The status indication for stating copy data is set as available mode.
2. a kind of data synchronization unit, which is characterized in that described device includes:
First synchronization module, for the data block in source data to be synchronized to copy data;
Detection module, for detect the synchronous data block of first synchronization module whether synchronization failure;
Flow Record module, comprising:
Record generation unit, for generating a failure record according to the corresponding Data Identification of the data block;
Adding unit is recorded, the failure record for generating the record generation unit is added to synchronization failure flowing water;
First synchronization module, for after the data block in source data is synchronized to copy data, continuing will be described Next not synchronous data block in source data is synchronized to the copy data;
For to synchronization failure data block carry out re-synchronization before, it is identical to Data Identification in the synchronization failure flowing water Failure record merge, obtain the module of miss data identification list;
Second synchronization module is used in a subsequent predetermined point of time according to the miss data identification list to the data block Carry out re-synchronization;
It also include the record time in the failure record;It is described for synchronization failure data block carry out re-synchronization it Before, the identical failure record of Data Identification in the synchronization failure flowing water is merged, miss data identification list is obtained Module, comprising:
Extraction unit is recorded, for extracting in the identical failure record of Data Identification, the record time most connects with current time A close failure record;
List adding unit, the Data Identification in the failure record for extracting the record extraction unit are added into institute State miss data identification list;
Second synchronization module includes:
Day-to-day drawing unit, for extracting the miss data identification list, the pre- timing in a subsequent predetermined point of time Between point be preset specific time point, according to predetermined period determine time point or according to network condition determine time Point;
Synchronization unit, for according to the Data Identification in the miss data identification list, to the data block of the synchronization failure Carry out re-synchronization;
The synchronization unit includes:
Judgment sub-unit, for judging the data of the synchronization failure according to the Data Identification in the miss data identification list Block whether there is in the source data;
Synchronous subelement, if judging that the data block of the synchronization failure is deposited in the source data for the judgment sub-unit Then by the data block re-synchronization of the synchronization failure present in the source data to the copy data;
Subelement is deleted, if judging the data block of the synchronization failure in the source data not for the judgment sub-unit In the presence of then by the data block deletion of the synchronization failure in the copy data;
The synchronization unit further includes for by the data block re-synchronization of the synchronization failure present in the source data After to the copy data, the subelement of the synchronization failure flowing water is deleted;
Described device further includes module for performing the following operations:
When starting to synchronize the data block, down state is set by the status indication of the copy data;
When synchronously completing, and detect in the source data all data blocks all it is synchronous with the copy data successfully when, by institute The status indication for stating copy data is set as available mode.
3. a kind of computer readable storage medium, which is characterized in that be stored with program, institute in the computer readable storage medium Program is stated for realizing method of data synchronization as described in claim 1.
CN201310032868.5A 2013-01-28 2013-01-28 Method of data synchronization and device Active CN103973727B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310032868.5A CN103973727B (en) 2013-01-28 2013-01-28 Method of data synchronization and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310032868.5A CN103973727B (en) 2013-01-28 2013-01-28 Method of data synchronization and device

Publications (2)

Publication Number Publication Date
CN103973727A CN103973727A (en) 2014-08-06
CN103973727B true CN103973727B (en) 2019-03-19

Family

ID=51242772

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310032868.5A Active CN103973727B (en) 2013-01-28 2013-01-28 Method of data synchronization and device

Country Status (1)

Country Link
CN (1) CN103973727B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105450682B (en) * 2014-08-08 2019-12-06 阿里巴巴集团控股有限公司 Method, device and system for synchronously storing data and synchronizing data to client
CN105282253A (en) * 2015-11-04 2016-01-27 湖南御家科技有限公司 Data document synchronization method and system
CN105760415A (en) * 2015-12-30 2016-07-13 深圳市鼎芯无限科技有限公司 Data processing method and device
CN109561126B (en) * 2017-09-27 2022-01-28 北京国双科技有限公司 Data synchronization method and device, storage medium and processor
CN107948318B (en) * 2017-12-27 2021-02-19 世纪龙信息网络有限责任公司 Method and system for synchronizing cache among multiple nodes
CN109561151B (en) * 2018-12-12 2021-09-17 北京达佳互联信息技术有限公司 Data storage method, device, server and storage medium
CN113886497A (en) * 2021-10-09 2022-01-04 北京房江湖科技有限公司 Bidirectional real-time data monitoring method and device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101018113A (en) * 2007-01-24 2007-08-15 华为技术有限公司 The method for synchronizing data and obtaining the data synchronization result and its system and HLR
CN101216832A (en) * 2007-12-28 2008-07-09 腾讯科技(深圳)有限公司 Data synchronization process and device
US7804838B2 (en) * 2004-01-09 2010-09-28 Thomson Licensing Time synchronizing device and process and associated products
CN102447742A (en) * 2011-11-24 2012-05-09 中兴通讯股份有限公司 Dynamic data active and standby synchronization method and system as well as metadata server
CN102594874A (en) * 2008-06-20 2012-07-18 华为技术有限公司 Synchronization processing method and device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719149B (en) * 2009-12-03 2012-02-08 联动优势科技有限公司 Data synchronization method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7804838B2 (en) * 2004-01-09 2010-09-28 Thomson Licensing Time synchronizing device and process and associated products
CN101018113A (en) * 2007-01-24 2007-08-15 华为技术有限公司 The method for synchronizing data and obtaining the data synchronization result and its system and HLR
CN101216832A (en) * 2007-12-28 2008-07-09 腾讯科技(深圳)有限公司 Data synchronization process and device
CN102594874A (en) * 2008-06-20 2012-07-18 华为技术有限公司 Synchronization processing method and device
CN102447742A (en) * 2011-11-24 2012-05-09 中兴通讯股份有限公司 Dynamic data active and standby synchronization method and system as well as metadata server

Also Published As

Publication number Publication date
CN103973727A (en) 2014-08-06

Similar Documents

Publication Publication Date Title
CN103973727B (en) Method of data synchronization and device
CN109165229B (en) Method, device, equipment and storage medium for checking local block synchronization
CN105376277B (en) A kind of method of data synchronization and device
CN104504062B (en) Master/slave data storehouse method of data synchronization and device
CN106354583B (en) A kind of heat backup method and system of MySQL database
CN105843702B (en) A kind of method and device for data backup
KR101662212B1 (en) Database Management System providing partial synchronization and method for partial synchronization thereof
CN106445414B (en) Method and system for expanding available storage space of terminal equipment
CN106302806A (en) A kind of method of data synchronization, system, synchronous obtaining method and relevant apparatus
CN103475716B (en) The method and system of data sharing is realized by shared storage
CN109933632B (en) Data migration method, device and equipment for database
RU2004105884A (en) METHOD FOR MANAGING FILE REPLICATION IN APPLICATIONS
CN111651523B (en) MySQL data synchronization method and system of Kubernetes container platform
US20160041886A1 (en) Data storage upon database failure
CN105824846B (en) Data migration method and device
CN106202365A (en) Method, system and the data-base cluster that database update synchronizes
CN106802895A (en) For repair data storehouse for database data method and apparatus
CN105550230B (en) The method for detecting and device of distributed memory system node failure
CN104636218B (en) Data reconstruction method and device
CN108762982A (en) A kind of database restoring method, apparatus and system
CN103581262B (en) A kind of master/slave data synchronous method, device and system
CN110825758B (en) Transaction processing method and device
CN108460163A (en) K-DB method for synchronizing data of database, device, equipment and storage medium
CN109947592A (en) A kind of method of data synchronization, device and relevant device
CN114756410B (en) Data recovery method, device and medium for dual-computer hot standby system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant