CN110377664A - Method of data synchronization, device, server and storage medium - Google Patents

Method of data synchronization, device, server and storage medium Download PDF

Info

Publication number
CN110377664A
CN110377664A CN201910662737.2A CN201910662737A CN110377664A CN 110377664 A CN110377664 A CN 110377664A CN 201910662737 A CN201910662737 A CN 201910662737A CN 110377664 A CN110377664 A CN 110377664A
Authority
CN
China
Prior art keywords
database
consuming
time
standby
primary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910662737.2A
Other languages
Chinese (zh)
Other versions
CN110377664B (en
Inventor
刘永松
朱翀
潘安群
雷海林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Tencent Cloud Computing Beijing Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201910662737.2A priority Critical patent/CN110377664B/en
Publication of CN110377664A publication Critical patent/CN110377664A/en
Application granted granted Critical
Publication of CN110377664B publication Critical patent/CN110377664B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G06F11/1402—Saving, restoring, recovering or retrying
    • G06F11/1446—Point-in-time backing up or restoration of persistent data
    • G06F11/1458—Management of the backup or restore process
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/273—Asynchronous replication or reconciliation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2201/00—Indexing scheme relating to error detection, to error correction, and to monitoring
    • G06F2201/80—Database-specific techniques

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Quality & Reliability (AREA)
  • Computing Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present invention provides a kind of method of data synchronization, device, server and storage mediums, belong to database technical field.The described method includes: by primary database in acquisition Database Systems at least one for the synchronous time-consuming of database, this synchronize it is time-consuming for indicate primary database and any one for carried out between database data it is synchronous when each stage needed for time-consuming, when this, which synchronizes time-consuming, is greater than first object duration, current systematic synchronisation pattern is switched into goal systems synchronous mode, under the goal systems synchronous mode, when primary database receives database instruction, under the premise of being not necessarily to sync response of any standby database to database instruction, it will be in the disk of the implementing result write-in primary database of database instruction.Primary database no longer needs to wait when receiving database instruction the response of standby database, and implementing result write-in disk is directly improved the process performance of Database Systems so that primary database can execute database instruction faster.

Description

Method of data synchronization, device, server and storage medium
Technical field
The present invention relates to database technical field, in particular to a kind of method of data synchronization, device, server and storage are situated between Matter.
Background technique
With the fast development of Internet technology, enterprise is higher and higher to the dependence of information system, and database is as letter The core of breath system takes on important role.In the exigent industry of some data reliabilities, such as bank, security, electricity The industries such as letter, electric business can cause serious loss, therefore if unexpected delay machine or loss of data occur for database to enterprise Enterprise needs to formulate detailed DB Backup and disaster recovery strategy according to its type of service.When DB Backup, need The database instruction executed in primary database is synchronized in standby database, to guarantee the data in standby database and primary database Unanimously.
Currently, guaranteeing master data usually using a kind of paxos (Parker's Suo Si algorithm, distributed consensus algorithm) agreement Library is consistent with data in standby database.The principle of paxos agreement is to add paxos layers in database layer, and primary database will execute Database instruction be stored in binlog (binary log file) log, the paxos layers of binlog log by primary database Other are distributed to for database.Each standby database is executed and is stored in the binlog log after receiving the binlog log Database instruction, after being finished to primary database send response, when primary database receives most of standby databases After response, primary database is by the implementing result write-in disk of database instruction in the binlog log and feedback database instruction is held It goes successfully, so that primary database and standby database execute identical database instruction, guarantees that data are consistent.
Above-mentioned technical proposal the problem is that, when paxos layers of failure or network fluctuate, primary database may Can not receive the response that standby database returns, the database instruction for causing primary database to execute can not execute or execute compared with Slowly, to influence the process performance of Database Systems.
Summary of the invention
The embodiment of the invention provides a kind of method of data synchronization, device, server and storage mediums, for solving at present Primary database may can not receive the response that standby database returns, the data for causing primary database to execute when database synchronization Library instruction can not be executed or be executed relatively slowly, thus the problem of influencing the process performance of Database Systems.The technical solution is such as Under:
On the one hand, a kind of method of data synchronization is provided, comprising:
Obtaining primary database in Database Systems, at least one for the synchronous time-consuming of database, the time-consuming that synchronizes is used for Indicate the primary database and any one for carried out between database data it is synchronous when each stage needed for time-consuming；
When it is described synchronize it is time-consuming be greater than first object duration when, it is same that current systematic synchronisation pattern is switched into goal systems Step mode；
Under the goal systems synchronous mode, when the primary database receives database instruction, without any Standby database is under the premise of the sync response of the database instruction, described in the implementing result write-in by the database instruction In the disk of primary database.
On the other hand, a kind of data synchronization unit is provided, comprising:
First obtains module, for obtaining synchronous consumption of the primary database at least one for database in Database Systems When, it is described synchronize it is time-consuming for indicate the primary database and any one for carried out between database data it is synchronous when each stage Required time-consuming；
First switching module, for when it is described synchronize it is time-consuming be greater than first object duration when, by the synchronous mould of current system Formula switches to goal systems synchronous mode；
Writing module is used under the goal systems synchronous mode, when the primary database receives database instruction When, under the premise of being not necessarily to sync response of any standby database to the database instruction, by holding for the database instruction Row result is written in the disk of the primary database.
In an optional implementation manner, described first module is obtained, be also used in the Database Systems, obtained It is time-consuming that first stage property needed for each stage when data synchronize is carried out between the primary database and a standby database, it will be described The summation of first stage property time-consuming synchronizes time-consuming as the single of the Database Systems；By multiple lists of the Database Systems The average value of subsynchronous time-consuming synchronizes time-consuming as described.
In another optional implementation, described first obtains module, is also used to obtain the primary database and executes The waiting time-consuming and the first write-in that database instruction is spent are time-consuming, and the time-consuming waiting is that the primary database waits a standby number Time-consuming needed for returning to sync response according to library, time-consuming first write-in is the primary database holding the database instruction Time-consuming needed for the disk of the primary database is written in row result；The time-consuming and described first write-in consumption of the waiting is determined respectively When weight；Wait the time-consuming weight time-consuming with first write-in synchronous with the single as the Database Systems for described It is time-consuming.
In another optional implementation, described device further include:
Second obtains module, for for it is described at least one for database each standby in database, obtain the standby number According to the time-consuming that executes in library, the execution is time-consuming for indicating time-consuming needed for the standby database completes the database instruction；
Second switching module is used for when the execution time-consuming is greater than the second target duration, and the standby database is current Per-unit synchronous pattern switching to target per-unit synchronous mode；Under the target per-unit synchronous mode, the primary database without Need to wait for the sync response of the standby database.
In another optional implementation, described second obtains module, is also used to obtain the standby database and completes Second stage needed for each stage is time-consuming when the database instruction, using the summation of the second stage time-consuming as described in The single of the completion database instruction of standby database executes time-consuming；Multiple singles of the standby database are executed into time-consuming Average value executes time-consuming as described.
In another optional implementation, described second obtains module, is also used to obtain the standby database and completes The communication time-consuming spent when the database instruction and the second write-in are time-consuming, the communication it is time-consuming for the standby database with it is described Primary database carries out communicating required time-consuming, and time-consuming second write-in is standby database the holding the database instruction Time-consuming needed for the disk of the standby database is written in row result；The time-consuming and described second write-in consumption of the communication is determined respectively When weight；The time-consuming weight of time-consuming and described second write-in of the communication and the single as the standby database are executed into consumption When.
In another optional implementation, described device further include:
Third switching module, for described in the Database Systems at least one all switch to for database it is described When target per-unit synchronous mode, current systematic synchronisation pattern is switched into the goal systems synchronous mode.
In another optional implementation, described device further include:
4th switching module, for when it is described synchronize it is time-consuming be less than the first object duration when, current system is same Step mode switches to default system synchronous mode；
Under the default system synchronous mode, when the primary database receives database instruction, the master data Library executes the database instruction, by the database instruction be sent to it is described at least one for database, when the master data When library receives the sync response of any standby database, the primary database is written into the implementing result of the database instruction In disk.
In another optional implementation, described device further include:
Third obtains module, for the resource occupation information of database server where obtaining the Database Systems, institute Stating includes at least two Database Systems in database server；
Distribution module, for being that the Database Systems distribute available hardware resource, institute according to the resource occupation information It is related to the load condition of Database Systems to state available hardware resource size.
In another optional implementation, the distribution module is also used to obtain in the database server every The resource distribution file of a Database Systems, the resource distribution file are used to indicate each Database Systems and can be used Hardware resource size；When the hardware resource of the database server is not otherwise fully engaged, according to each data The load condition of library system is that the Database Systems distribute available hardware resource, and the size of the available hardware resource can surpass Cross the size of the hardware resource of the resource distribution file instruction of the Database Systems；When the hardware of the database server provides It is that the Database Systems distribute available hardware resource according to the resource distribution file when source has been fully used.
In another optional implementation, the distribution module is also used to determine in the database server every The priority of a Database Systems；When the resource occupation total amount for determining the database server according to the resource occupation information It is when occupying threshold value more than target, the system of the Database Systems of at least one low priority in the database server is synchronous Pattern switching is to the goal systems synchronous mode.
In another optional implementation, described device further include:
4th obtain module, for obtain primary database described in the Database Systems and it is described at least one for data The running state information in library, the running state information be used to indicate the primary database and it is described at least one for database be No normal operation；
Determining module, for determining and the primary database being caused to run not just when primary database operation is abnormal Normal failure cause；
5th switching module will be described for according to the failure cause, the primary database to be switched to standby database At least one is switched to new primary database for the standby database in database.
In another optional implementation, the 5th switching module is also used to determine that the failure cause is corresponding Fault type；When the fault type is not target faults type, the primary database is switched to standby database, by institute It states at least one and is switched to new primary database for the standby database in database, the target faults type is that general is described at least Standby database in one standby database is switched to the fault type that can solve after new primary database；When the fault type is When target faults type, handover mechanism is exempted from starting, described to exempt from handover mechanism and be used to indicate to exempt to cut in the time in target to detect institute When stating the fault error reason of target faults type, keep the primary database constant.
On the other hand, a kind of server is provided, the server includes processor and memory, and the memory is used for Program code is stored, said program code is loaded by the processor and executed to realize that the data in the embodiment of the present invention are synchronous Performed operation in method.
On the other hand, a kind of storage medium is provided, program code, said program code are stored in the storage medium For executing the method for data synchronization in the embodiment of the present invention.
Technical solution provided in an embodiment of the present invention has the benefit that
In embodiments of the present invention, by obtain Database Systems in primary database at least one for the synchronous of database Time-consuming, this synchronize it is time-consuming for indicate primary database and any one for carried out between database data it is synchronous when each stage needed for Time-consuming, when this synchronize it is time-consuming be greater than first object duration when, it is synchronous that current systematic synchronisation pattern is switched into goal systems Mode, when primary database receives database instruction, is being not necessarily to any standby database pair under the goal systems synchronous mode It, will be in the disk of the implementing result write-in primary database of database instruction under the premise of the sync response of database instruction.Pass through Obtain in Database Systems primary database and at least one for the synchronous time-consuming of database, when this is synchronized time-consuming and first object Length compares, and when this synchronizes time-consuming and is greater than the first object duration, current systematic synchronisation pattern is switched to goal systems Synchronous mode will directly execute so that primary database no longer needs to wait when receiving database instruction the response of standby database As a result write-in disk improves the treatability of Database Systems so that primary database can execute database instruction faster Energy.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is a kind of implementation environment figure of method of data synchronization provided in an embodiment of the present invention；
Fig. 2 is a kind of flow chart of the method for data synchronization provided according to an exemplary embodiment；
Fig. 3 is the flow chart of another method of data synchronization provided according to an exemplary embodiment；
Fig. 4 is the flow chart of another method of data synchronization provided according to an exemplary embodiment；
Fig. 5 is a kind of block diagram of the data synchronization unit provided according to embodiments of the present invention；
Fig. 6 is a kind of structural schematic diagram of server provided in an embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with attached drawing to embodiment party of the present invention Formula is described in further detail.
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all embodiments consistented with the present invention.On the contrary, they be only with it is such as appended The example of device and method being described in detail in claims, some aspects of the invention are consistent.
The embodiment of the present invention relates generally to carry out the synchronous scene of data in Database Systems.In order to guarantee the peace of data Entirely, in Database Systems, it will usually a primary database be set at least one for database.Wherein, primary database is external Service is provided, at least one is synchronous with the data in primary database for database, when primary database breaks down, at least one A standby database in standby database can become new primary database and the primary database of failure is replaced externally to provide service.
It should be noted that the operation in any data can be realized by database instruction in Database Systems, For example, the operations such as increase, deletion, modification can be based on corresponding SQL (Structured Query in MYSQL system Language, structured query language) sentence realization.
In embodiments of the present invention, it is related to two kinds of systematic synchronisation patterns, one is strong synchronous modes, refer to primary database After receiving database instruction, when receiving sync response of any standby database to the database instruction, by the database In the implementing result write-in disk of instruction.Another kind is asynchronous mode, is referred to when primary database receives database instruction, nothing Need any standby database to the sync response of the database instruction, it will be in the implementing result write-in disk of the database instruction.
The process that Database Systems carry out database synchronization using strong synchronous mode is described below: primary database is connecing After receiving database instruction, the database instruction is executed, in memory by the implementing result caching of the database instruction.Master data Also the database instruction can be written in corresponding binlog log after receiving the database instruction for library, by the binlog days Will is sent to the standby database in Database Systems, this respectively parses the binlog log for database, obtains and holds The row database instruction, and implementing result is written in respective disk.Standby database after implementing result to be written to disk to Primary database sends sync response, indicates that data are synchronized and finishes, primary database is in the synchronization for receiving any standby database It, will be in the disk of the implementing result write-in primary database of caching in memory when response.At this point, the Database Systems complete one It is synchronous to be properly termed as data of completion for database instruction.Wherein, for the SQL statement for inquiry, since inquiry can't The data in database are modified, therefore the SQL statement that primary database will can't be used to inquire is stored in binlog log.
Database inevitably breaks down, and is described below when primary database breaks down how to carry out primary database With the switching of standby database.When primary database, which breaks down, to provide service, mentioned by standby database to replace primary database For service, primary database is just switched to standby database at this time, and Database Systems select one from least one in database Standby database is switched to primary database and externally provides server.
Fig. 1 is a kind of implementation environment figure of method of data synchronization provided in an embodiment of the present invention, referring to Fig. 1, including it is multiple Database server 101 and dispatch server 102,
Database server 101 can be connected by wireless network or cable network with dispatch server 102.Data Library server 101 may include at least one of a server, multiple servers or cloud computing server cluster.Data Library server 101 is for disposing an at least database.Each database, which can correspond to, is deployed with agent (agency) mould Block, the relevant information of database server of the agent module for acquisition database and where database, as heartbeat message, Communication is time-consuming, the time-consuming and resource occupation information of database server is written etc., is referred to as data acquisition module.Scheduling Server 102 is used to receive the information of agent module transmission.
Fig. 2 is a kind of flow chart of the method for data synchronization provided according to an exemplary embodiment, as shown in Figure 2.The party Method the following steps are included:
201, dispatch server obtains in Database Systems primary database at least one for the synchronous time-consuming of database, should Synchronize it is time-consuming for identify the primary database and any one for carried out between database data it is synchronous when each stage needed for consumption When.
In embodiments of the present invention, this synchronize time-consuming can for primary database and any one for the last between database Carry out data it is synchronous when each stage needed for time-consuming, this synchronize time-consuming can also for primary database and any one for database it Between repeatedly carry out data it is synchronous when each stage needed for time-consuming average value.Primary database and any one between database into It may include four-stage that row data, which synchronize: the first stage, primary database and each standby database communication；Second stage, it is each Standby database executes database instruction and disk is written in implementing result；Phase III, primary database receive standby database synchronization and ring It answers；Fourth stage, primary database will be in the disks of the implementing result write-in primary database of database instruction.
In an optional implementation manner, dispatch server can in Database Systems, obtain in primary database and It is time-consuming that first stage property needed for each stage when data synchronize is carried out between one standby database, by first stage property time-consuming Summation synchronizes time-consuming as the single of the Database Systems, and multiple singles of the Database Systems are synchronized time-consuming average value and are made Time-consuming is synchronized for this.Wherein, the summation of first stage property time-consuming can be the above-mentioned first stage to time-consuming total of fourth stage With.By the way that multiple singles are synchronized time-consuming average value as time-consuming is synchronized, can be synchronized to avoid single caused by network jitter It takes long time, so that this synchronizes and time-consuming can correctly reflect time-consuming needed for data synchronize each stage.
In an optional implementation manner, which synchronizes time-consuming can execute database instruction cost for primary database Waiting is time-consuming and weight that the first write-in is time-consuming and.Correspondingly, dispatch server is obtained in primary database and a standby data It is time-consuming that first stage property needed for each stage when data synchronization is carried out between library, using the summation of first stage property time-consuming as this It is permissible that the single of Database Systems synchronizes time-consuming step are as follows: the available primary database of dispatch server executes database instruction The waiting time-consuming of cost and the first write-in are time-consuming, the weight of the waiting time-consuming and the first write-in time-consuming are determined respectively, by this etc. To time-consuming weight with single as the Database Systems synchronous time-consuming time-consuming with first write-in.It is time-consuming and the by that will wait The time-consuming weight time-consuming synchronous with the single as Database Systems of one write-in, can intuitively reflect that data synchronize each rank The time-consuming and Database Systems of section carry out total time-consuming when data synchronize.
Wherein, which is time-consuming needed for primary database waits a standby database to return to sync response, e.g., main Database is to all for database transmission binlog journal file to the time-consuming for receiving any standby database return sync response. Time-consuming first write-in is that time-consuming needed for the disk of primary database is written in the implementing result of database instruction by primary database. The weight of waiting time-consuming can be any value between 1 to 2, and the time-consuming weight of first write-in can be between 1.5 to 2 Any value.In one implementation, when primary database uses ordinary magnetic disc, can be time-consuming by the first write-in It is time-consuming that weight is set greater than waiting；When primary database uses SSD (Solid State Drive, solid state drive) magnetic When disk, time-consuming weight can will be waited to be set greater than the first write-in time-consuming.This is because the writing speed of SSD is far longer than The writing speed of ordinary magnetic disc, namely wait time-consuming more time-consuming than write-in longer.
It should be noted that when Database Systems are deployed on a database server, dispatch server can be with The database server is same server, i.e., is deployed with Database Systems in the database server, and be deployed with reality The scheduler module of existing dispatch server function.
202, when this, which synchronizes time-consuming, is greater than first object duration, dispatch server switches current systematic synchronisation pattern To goal systems synchronous mode.
In embodiments of the present invention, synchronizing time-consuming is the delay time that Database Systems handle data library instruction. The first object duration can be the maximum value for allowing to postpone.Such as, which can be 1 second, 2 seconds, 3 seconds, 5 seconds Deng.The goal systems synchronous mode can be asynchronous mode.
In an optional implementation manner, the synchronous mould of the current system of the available Database Systems of dispatch server Formula can switch when the current systematic synchronisation pattern is not goal systems synchronous mode to Database Systems sending mode Instruction, Database Systems instruct according to the pattern switching the current systematic synchronisation pattern being switched to the synchronous mould of goal systems Formula.When the current systematic synchronisation pattern is goal systems synchronous mode, dispatch server does not send pattern switching instruction, The systematic synchronisation pattern that Database Systems can keep this current is constant.
In an optional implementation manner, dispatch server can also be according to the standby number of execution time-consuming switching of standby database According to the current per-unit synchronous mode in library.For at least one for standby database each in database, dispatch server is available This executes time-consuming for database, the execution time-consuming for indicate this for database complete database instruction needed for time-consuming, when When the execution time-consuming is greater than the second target duration, dispatch server can be by the per-unit synchronous pattern switching current for database To target per-unit synchronous mode, under the target per-unit synchronous mode, primary database synchronizes sound without waiting for this for database It answers.Wherein, when target per-unit synchronous mode is all switched to for database when at least one for including in Database Systems, scheduling The current systematic synchronisation pattern of the Database Systems can be switched to goal systems synchronous mode by server.The target single machine is same Step mode can be single machine asynchronous mode.By switching the standby number when the execution time-consuming of standby database is greater than the second target duration According to the current per-unit synchronous mode in library, carried out by force between time-consuming lesser standby database so that primary database can be executed with other It is synchronous.It is by when whole standby databases switches to target per-unit synchronous mode, the current system of Database Systems is same The caused Database Systems of the problems such as step mode switches to goal systems synchronous mode, can solve network delay or slow write magnetic disk The problem of process performance declines.
In an optional implementation manner, dispatch server obtains permissible for the time-consuming step of the execution of database are as follows: It is time-consuming that the available standby database of dispatch server completes second stage needed for each stage when database instruction, by this second Interim time-consuming summation executes time-consuming as the single of the completions database instruction for database, and dispatch server can general Multiple singles for database execute time-consuming average value and execute time-consuming as this.By the way that multiple singles are executed time-consuming put down Mean value can cause certain execution of standby database time-consuming higher as time-consuming is executed to avoid network jitter, lead to standby database frequency The problem of numerous switching per-unit synchronous mode.
For example, it is T that the single of a certain standby database, which executes time-consuming, dispatch server is stored with the N nearest for database A single executes time-consuming, and N is positive integer.Then executing time-consuming is Tavg=(T1+T2+…+TN)/N。
In an optional implementation manner, dispatch server takes standby database to complete when database instruction needed for each stage Second stage it is time-consuming, the summation of second stage time-consuming is used as the step of the single execution time-consuming of standby database permissible Are as follows: the communication time-consuming that spends and the second write-in are time-consuming when available this of dispatch server completes database instruction for database, Determine the communication time-consuming and the time-consuming weight of second write-in respectively, by the time-consuming weight of the communication time-consuming and second write-in and Time-consuming is executed as this for the single of database.By the way that time-consuming and write-in disk the second write-in time-consuming weight and work will be communicated Single for standby database executes time-consuming, can accurately reflect that standby database executes what a database instruction was spent Time.
Wherein, the weight of communication time-consuming can be any value between 1 to 2, and the time-consuming weight of second write-in can Think any value between 1.5 to 2.It, can be by the power of the second write-in time-consuming when the disk of standby database is ordinary magnetic disc It is set greater than the time-consuming weight of communication again；When the disk of standby database is SSD, it can will communicate time-consuming weight and be set as big In the time-consuming weight of the second write-in.
For example, a certain standby database is T with the communication time-consuming that primary database is once communicatednet, the second of disk is written Time-consuming write-in is Tdisk, communicating time-consuming weight is Wnet, the time-consuming weight of the second write-in is Wdisk.Due to the magnetic for database Disk is SSD then Wnet>Wdisk, W is set by the time-consuming weight of communicationnet=2, W is set by the time-consuming weight of the second write-indisk =1.5, then the single for database executes time-consuming T=2*Tnet*Wnet+Tdisk*Wdisk。
203, it is synchronous to carry out data under the goal systems synchronous mode for Database Systems.
In embodiments of the present invention, under the goal systems synchronous mode, when primary database receives database instruction, It, can be by the execution knot of the database instruction under the premise of being not necessarily to sync response of any standby database to the database instruction Fruit is written in the disk of the primary database.
For example, executing the SQL statement when primary database receives the SQL statement of modification data and obtaining implementing result, simultaneously The SQL statement is written in binlog log and is sent to all standby databases, but without waiting for the sync response of standby database, i.e., Implementing result can be written to the disk of primary database, then feedback runs succeeded.
It should be noted that dispatch server can continue to obtain this and synchronize time-consuming, when this synchronizes time-consuming less than the first mesh When marking duration, step 204 and step 205 can be executed by current systematic synchronisation pattern and switch to strong synchronous mode.Certainly this It is only a kind of trigger condition that current systematic synchronisation pattern is switched to strong synchronous mode, dispatch server can also be according to number Current systematic synchronisation pattern is switched to according to the occupation condition of library server and load condition of Database Systems etc. Strong synchronous mode.To carry out data using strong synchronous mode and synchronize when Database Systems meet the condition of strong synchronous mode, To keep strong consistency of the primary database at least one for data in database.
204, when this, which synchronizes time-consuming, is less than the first object duration, dispatch server can be by the synchronous mould of current system Formula switches to default system synchronous mode.
Wherein, which can be strong synchronous mode.
205, it is synchronous to carry out data under the default system synchronous mode for Database Systems.
Under the default system synchronous mode, when primary database receives database instruction, which executes should The database instruction is sent at least one that all standby database namely the Database Systems include by database instruction Standby database, when the primary database receives the sync response of any standby database, primary database is by the database instruction Implementing result is written in the disk of the primary database.By the way that Database Systems are worked as when synchronizing time-consuming and being less than first object duration Preceding systematic synchronisation pattern switches to strong synchronous mode, can guarantee primary database and each standby data when network condition is preferable The strong consistency of data in library.
It should be noted that it is the scheduling illustratively shown that above-mentioned steps 202, which are only the embodiment of the present invention to step 205, Server is according to time-consuming is synchronized, when this synchronizes time-consuming and is greater than first object duration, by the systematic synchronisation pattern of Database Systems Asynchronous mode is switched to by strong synchronous mode, after switching, when this synchronizes time-consuming and is less than first object duration, by Database Systems Systematic synchronisation pattern the process of strong synchronous mode is switched to by asynchronous mode.Above-mentioned steps label is merely for convenience of describing, Be not offered as it is actual execute sequence, for example, can be executed according to 201 to 205 sequence, can also according to 201,204,205, 202,203 sequence executes.
In embodiments of the present invention, by obtain Database Systems in primary database at least one for the synchronous of database This is synchronized time-consuming and compared with first object duration by time-consuming, will be current when this synchronizes time-consuming and is greater than the first object duration Systematic synchronisation pattern be switched to goal systems synchronous mode, so that primary database is no longer needed to when receiving database instruction To the response of standby database, disk directly is written into implementing result, so that primary database can execute database faster Instruction, improves the process performance of Database Systems.
Fig. 3 is the flow chart of another method of data synchronization provided according to an exemplary embodiment, as shown in Figure 3.It should Method the following steps are included:
301, the resource occupation information of database server where dispatch server obtains Database Systems.
In embodiments of the present invention, dispatch server can obtain the resource occupation information of database server in real time, The resource occupation information of database server can be periodically obtained, such as obtained one every 1 minute, 3 minutes or 5 minutes It is secondary.The Database Systems may include a primary database and at least one for database, the corresponding data of each database Library server.The resource occupation information is the occupied information of hardware resource in the database server, which can be CPU (Central Processing Unit, central processing unit) resource, memory source, hard disk resources etc..Dispatch server can To obtain the resource occupation information of each database server, the hardware of each database distribution is adjusted according to the resource occupation information Resource.
For example, Database Systems A includes primary database A1, standby database A2With standby database A3.Primary database A1It is deployed in Database server D1Upper, standby database A2It is deployed in database server D2On, standby database A3It is deployed in database server D3On.
It in an optional implementation manner, may include at least two in a database server for save the cost A Database Systems, the resource occupation information of each Database Systems in the available database server of dispatch server.Its In, the database number that at least two Database Systems for including in the database server include can be identical, can also not Together, the embodiment of the present invention is to this without concrete restriction.
302, dispatch server is that Database Systems distribute available hardware resource according to the resource occupation information, this is available hard Part resource is related to the load condition of the Database Systems.
In embodiments of the present invention, it is said for including at least two Database Systems in a database server It is bright.The load of Database Systems is higher in database server, and the hardware resource for indicating that the Database Systems need is more, scheduling Server can distribute biggish available hardware resource for the high Database Systems of the load.Certain dispatch server is each number According to library system distribution available hardware resource total size no more than the hardware resource that database server includes size.
In an optional implementation manner, the size of the available hardware resource of Database Systems is dynamically changeable, should The size of available hardware resource and the occupation condition of database server, the resource distribution file of the Database Systems and The loading condition of the database is related.
Correspondingly, dispatch server is that the step of Database Systems distribute available hardware resource can according to resource occupation information With are as follows: the resource distribution file of each Database Systems in database server is obtained, which is used to indicate often The size for the hardware resource that a Database Systems can be used.When the hardware resource of the database server is not otherwise fully engaged When, it is that Database Systems distribute available hardware resource according to the load condition of each Database Systems, the available hardware resource Size can be more than the size for the hardware resource that the resource distribution file of the Database Systems indicates.When the database server It is that the Database Systems distribute available hardware resource according to resource distribution file when hardware resource has been fully used.Pass through root The available hardware resource that each Database Systems are adjusted according to the load condition dynamic of each Database Systems, can be to avoid database The hardware resource waste of server, while improving the treatment effeciency for loading higher Database Systems.
For example, dispatch server obtains the resource distribution file a and data base set of Database Systems A in database server The resource distribution file b of system B.The hardware resource that resource distribution file a referred database system A can be used is database service The 50% of device, the hardware resource that resource distribution file b referred database system B can be used are 50%.Database Systems A's is negative It carries lower, only used 25% hardware resource of database server, the load of Database Systems B is higher, is used for 50% hardware resource of database server.But there are hardware resource deficiencies, and processing capacity to be caused to decline by Database Systems B The problem of, it is also necessary to 20% hardware resource of database server, dispatch server are indicated the 20% of database server Idle hardware resource allocation give Database Systems B, so that Database Systems B can normally handle database instruction.Work as data When the load of library system A is promoted, when Database Systems A uses 30% hardware resource of database server, database clothes The hardware resource of business device has been fully used, according to resource distribution file, by the available of Database Systems A and Database Systems B Hardware resource is respectively set to 50%.If the load of Database Systems A no longer rises, dispatch server can be by database The idle hardware resource allocation of server gives Database Systems B, if the load continuous of Database Systems A rises, until reaching 50%, Database Systems A and Database Systems B will use the hardware resource of distribution to carry out data processing.
In an optional implementation manner, each Database Systems have priority, and dispatch server can be in database When the resource occupation total amount of server is higher, the resource occupation amount of each Database Systems, database can be adjusted according to priority The priority of system is higher, and the hardware resource of distribution is more.
In an optional implementation manner, each Database Systems have priority, and dispatch server can be in database When the resource occupation total amount of server is higher, switching priority it is lower at least one Database Systems the synchronous mould of system Formula.
Correspondingly, dispatch server is that the step of Database Systems distribute available hardware resource can according to resource occupation information With are as follows: dispatch server can determine the priority of each Database Systems in database server, believe when according to resource occupation When ceasing the resource occupation total amount for determining the database server more than target occupancy threshold value, by priority in the database server At least one the lower systematic synchronisation pattern of Database Systems switches to goal systems synchronous mode.When according to resource occupation When information determines the resource occupation total amount of the database server lower than default occupancy threshold value, by the number of goal systems synchronous mode Strong synchronous mode is reverted to according to library system.Wherein, it can be 85%, 90%, 95% etc. which, which occupies threshold value,.The goal systems Synchronous mode can be asynchronous mode.The default threshold value that occupies can be 70%, 75%, 80% etc..By in database service When the resource occupation total amount of device is larger, the lower Database Systems of priority are switched to asynchronous mode, database can be discharged The fractional hardware resource of server, so that the higher Database Systems of priority are able to use more hardware resource and carry out data Processing.
In an optional implementation manner, dispatch server can be more than in the resource occupation total amount of database server When target occupies threshold value, the systematic synchronisation pattern of the minimum Database Systems of priority is switched into goal systems synchronous mode, If after switching, the resource occupation total amount of database server is still more than that target occupies threshold value, and dispatch server can will work as The systematic synchronisation pattern of the minimum Database Systems of preceding priority switches to goal systems synchronous mode, until database server Resource occupation total amount be less than target occupy threshold value.When the resource occupation for determining the database server according to resource occupation information When total amount is lower than default occupancy threshold value, the Database Systems of goal systems synchronous mode are reverted into strong synchronous mode.
For example, having Database Systems A, Database Systems B, Database Systems C and Database Systems in database server D, wherein priority ranking is Database Systems A > Database Systems B > Database Systems C > Database Systems D.When database takes When the hardware resource occupancy total value of business device is more than 95%, the systematic synchronisation pattern of Database Systems D is cut in dispatch server instruction It is changed to asynchronous mode, to save hardware resource.When the hardware resource of database server, which occupies total value, is lower than 80%, by data The systematic synchronisation pattern of library system D is switched to strong synchronous mode.
In embodiments of the present invention, by obtaining the resource occupation information of database server, believed according to the resource occupation Breath is that Database Systems distribute available hardware resource, can utilize the hardware resource of database server to greatest extent, avoid counting According to the hardware resource waste of library server, while improving the treatment effeciency for loading higher Database Systems.
Fig. 4 is the flow chart of another method of data synchronization provided according to an exemplary embodiment, as shown in Figure 4.It should Method the following steps are included:
401, dispatch server obtain Database Systems in primary database and at least one for database operating status believe Breath, the running state information be used to indicate the primary database and this at least one for database whether normal operation.
In embodiments of the present invention, which may include the input and output thread state of database, memory State, network state, heartbeat message etc..Dispatch server can obtain the running state information in real time, can also periodically obtain Take the running state information.
In an optional implementation manner, when dispatch server judges that primary database is abnormal according to running state information When, dispatch server can send connection request to the primary database, establish connection with the primary database, which is used for Whether detection changes database normal.When dispatch server, which is based on the connection request, judges that the primary database is abnormal, determining should Primary database is abnormal；When dispatch server, which is based on the connection request, judges that the primary database is normal, the operating status is determined Information errors.Judge whether primary database is normal by the way that dispatch server is secondary, it can be to avoid because of agent module exception or net Network fluctuation causes primary database caused by running state information mistake to miss switching problem, improves the stability of system.
402, when primary database operation is abnormal, dispatch server, which determines, causes primary database to run abnormal failure Reason.
Dispatch server can determine that primary database runs abnormal failure cause according to running state information, such as negative Carrying excessive leads to that thread queue is crowded, disk write-in is slow, CPU occupies exception, memory corruption etc..
403, primary database is switched to standby database, by least one for data according to failure cause by dispatch server Standby database in library is switched to new primary database.
Dispatch server directly can carry out primary database and standby database when determining that primary database operation is abnormal Switching can also carry out the switching of primary database and standby database according to the type of failure cause.The process is properly termed as disaster tolerance Switching.
In an optional implementation manner, primary database is switched to standby data according to failure cause by dispatch server Library, the step of at least one is switched to new primary database for the standby database in database, can be with are as follows: dispatch server is true Primary database is switched to standby by the fixed corresponding fault type of the failure cause when the fault type is not target faults type At least one is switched to new primary database for the standby database in database by database.Wherein, which is At least one is switched to the fault type that can solve after new primary database for the standby database in database.When the failure classes When type is target faults type, handover mechanism is exempted from starting, this exempts from handover mechanism and be used to indicate to exempt to cut in the time in target to detect When the fault error reason of target faults type, keep primary database constant.By according to the corresponding fault type of failure cause To determine whether to switch primary database and for database, it can just switch over, avoid when switch data library can solve problem Due to the problems such as amount of access is excessive frequent switching database, cause database that can not normally provide server.
Wherein, target faults type can be excessive instantaneous amount of access, load too high, network congestion, hardware damage etc..Mesh The length that mark exempts to cut the time can carry out dynamic modification, such as 1 minute, 10 minutes, 30 minutes according to actual needs, and the present invention is real Example is applied to this without concrete restriction.
In an optional implementation manner, dispatch server can trigger warning information after the switching of each disaster tolerance, will The warning information is used to indicate the reason of currently leading to primary database and standby database switching.By the warning information, work people Member can be repaired and be adjusted to Database Systems based on the warning information, and the performance of Database Systems is improved.
In an optional implementation manner, when hardware fault occurs for the database server where Database Systems, Dispatch server can be cancelled after the hardware fault reparation and exempt from the mechanism of cutting, this is exempted from database that the mechanism of cutting is related to from exempting from cut distribution It sets in file and deletes.Exempt from the mechanism of cutting by cancelling after hardware fault is repaired, so as to avoid other databases from breaking down When lead to not carry out disaster tolerance switching the case where.
It in embodiments of the present invention, can be in database event by obtaining the operating status of database in Database Systems Disaster tolerance switching is carried out when barrier, to guarantee that Database Systems can normally provide server, while the failure for passing through failure cause The problem of type is exempted to cut rule to be arranged, and can solve Database Systems frequent switching to provide service.
Fig. 5 is a kind of block diagram of the data synchronization unit provided according to embodiments of the present invention.The device is above-mentioned for executing The step of when method of data synchronization executes, referring to Fig. 5, device includes: the first acquisition module 501, the first switching module 502 and writes Enter module 503.
First obtains module 501, for obtaining in Database Systems primary database at least one for the synchronous of database Time-consuming, synchronize it is time-consuming for indicate primary database and any one for carried out between database data it is synchronous when each stage needed for It is time-consuming；
First switching module 502, for when synchronize it is time-consuming be greater than first object duration when, by current systematic synchronisation pattern Switch to goal systems synchronous mode；
Writing module 503 is used under goal systems synchronous mode, when primary database receives database instruction, Without any standby database under the premise of the sync response of database instruction, main number is written into the implementing result of database instruction According in the disk in library.
In an optional implementation manner, first module 501 is obtained, is also used in Database Systems, obtains main number According to first stage property time-consuming needed for each stage when data synchronize is carried out between library and a standby database, which is consumed When summation synchronize time-consuming as the single of the Database Systems；Multiple singles of the Database Systems are synchronized into time-consuming be averaged Value is used as and synchronizes time-consuming.
In another optional implementation, first obtains module 501, is also used to obtain primary database and executes database Instruct the waiting time-consuming spent and the first write-in time-consuming, waiting time-consuming is that primary database waits a standby database return to synchronize sound Required time-consuming is answered, time-consuming the first write-in is that primary database the implementing result of database instruction is written in the disk of primary database Required time-consuming；It determines respectively and waits weight time-consuming and that the first write-in is time-consuming；Power time-consuming and that the first write-in is time-consuming will be waited Weight time-consuming synchronous with the single as Database Systems.
In another optional implementation, device further include:
Second obtains module, for, for standby database each in database, obtaining holding for standby database at least one Row is time-consuming, executes time-consuming for indicating time-consuming needed for standby database completes database instruction；
Second switching module is used for when executing time-consuming greater than the second target duration, will be same for the current single machine of database Step mode switches to target per-unit synchronous mode；Under the target per-unit synchronous mode, primary database is without waiting for standby database Sync response.
In another optional implementation, second obtains module, is also used to obtain standby database completion database and refers to Second stage needed for each stage is time-consuming when enabling, using the summation of second stage time-consuming as the completion database of standby database The single of instruction executes time-consuming；Multiple singles of standby database are executed into time-consuming average value as executing time-consuming.
In another optional implementation, second obtains module, is also used to obtain standby database completion database and refers to The communication time-consuming spent when enabling and the second write-in are time-consuming, and communication is time-consuming to be carried out communicating required consumption with primary database for standby database When, the time-consuming implementing result of database instruction is written for standby database of the second write-in is consumed needed for the disk of standby database When；The weight that communication is time-consuming and the second write-in is time-consuming is determined respectively；By the weight and conduct that communication is time-consuming and the second write-in is time-consuming The single of standby database executes time-consuming.
In another optional implementation, described device further include:
Third switching module, for all switching to target per-unit synchronous for database when at least one in Database Systems When mode, current systematic synchronisation pattern is switched into goal systems synchronous mode.
In another optional implementation, device further include:
4th switching module, for when synchronizing time-consuming less than first object duration, current systematic synchronisation pattern to be cut Shift to default system synchronous mode；
Under default system synchronous mode, when primary database receives database instruction, primary database executes database Database instruction is sent at least one for database by instruction, when what primary database received any standby database synchronizes sound It at once, will be in the disk of the implementing result write-in primary database of database instruction.
In another optional implementation, device further include:
Third obtains module, for the resource occupation information of database server where obtaining Database Systems, database It include at least two Database Systems in server；
Distribution module can be provided for being that Database Systems distribute available hardware resource according to resource occupation information with hardware Source size is related to the load condition of Database Systems.
In another optional implementation, distribution module is also used to obtain each database in database server The resource distribution file of system, resource distribution file are used to indicate the big of the hardware resource that each Database Systems can be used It is small；It is data according to the load condition of each Database Systems when the hardware resource of database server is not otherwise fully engaged Library system distributes available hardware resource, and the size of available hardware resource can be more than that the resource distribution file of Database Systems indicates Hardware resource size；It is number according to resource distribution file when the hardware resource of database server has been fully used Available hardware resource is distributed according to library system.
In another optional implementation, distribution module is also used to determine each database in database server The priority of system；When the resource occupation total amount for determining database server according to resource occupation information is more than that target occupies threshold value When, it is same that the systematic synchronisation pattern of the Database Systems of at least one low priority in database server is switched into goal systems Step mode.
In another optional implementation, device further include:
4th obtains module, for obtaining operating status of the primary database at least one for database in Database Systems Information, running state information be used to indicate primary database and at least one for database whether normal operation；
Determining module, for determining and primary database being caused to run abnormal failure when primary database operation is abnormal Reason；
5th switching module, for according to failure cause, primary database to be switched to standby database, by least one standby number New primary database is switched to according to the standby database in library.
In another optional implementation, the 5th switching module is also used to determine the corresponding failure classes of failure cause Type；When fault type is not target faults type, primary database is switched to standby database, by least one in database Standby database be switched to new primary database, target faults type is by least one for the standby database switching in database For the fault type that can solve after new primary database；When fault type is target faults type, handover mechanism is exempted from starting, is exempted from Handover mechanism is used to indicate when target exempts to cut the fault error reason for detecting target faults type in the time, keeps master data Library is constant.
In embodiments of the present invention, by obtain Database Systems in primary database at least one for the synchronous of database This is synchronized time-consuming and compared with first object duration by time-consuming, will be current when this synchronizes time-consuming and is greater than the first object duration Systematic synchronisation pattern be switched to goal systems synchronous mode, so that primary database is no longer needed to when receiving database instruction To the response of standby database, disk directly is written into implementing result, so that primary database can execute database faster Instruction, improves the process performance of Database Systems.
It should be understood that device provided by the above embodiment is when running application program, only with above-mentioned each functional module Division progress for example, in practical application, can according to need and above-mentioned function distribution is complete by different functional modules At the internal structure of device being divided into different functional modules, to complete all or part of the functions described above.Separately Outside, apparatus and method embodiment provided by the above embodiment belongs to same design, and specific implementation process is detailed in embodiment of the method, Which is not described herein again.
Fig. 6 is a kind of structural schematic diagram of server provided in an embodiment of the present invention, which can be because of configuration or property Energy is different and generates bigger difference, may include one or more processors (central processing Units, CPU) 601 and one or more memory 602, wherein at least one instruction is stored in memory 602, The method that at least one instruction is loaded by processor 601 and executed to realize above-mentioned each embodiment of the method offer.Certainly, the clothes Business device can also have the components such as wired or wireless network interface, keyboard and input/output interface, to carry out input and output, The server can also include other for realizing the component of functions of the equipments, and this will not be repeated here.
The embodiment of the invention also provides a kind of storage mediums, and the storage medium application is in server, the storage medium It is stored with program code, which is used to execute the method for data synchronization in the embodiment of the present invention.
Those of ordinary skill in the art will appreciate that realizing that all or part of the steps of above-described embodiment can pass through hardware Complete, relevant hardware can also be instructed to complete by program, program can store in a kind of storage medium, it is above-mentioned The storage medium mentioned can be read-only memory, disk or CD etc..
The foregoing is merely a prefered embodiment of the invention, is not intended to limit the invention, all in the spirit and principles in the present invention Within, any modification, equivalent replacement, improvement and so on should all be included in the protection scope of the present invention.

Claims (16)

1. a kind of method of data synchronization, which is characterized in that the described method includes:
Obtaining primary database in Database Systems, at least one for the synchronous time-consuming of database, the time-consuming that synchronizes is used to indicate The primary database and any one for carried out between database data it is synchronous when each stage needed for time-consuming；
When it is described synchronize it is time-consuming be greater than first object duration when, current systematic synchronisation pattern is switched into the synchronous mould of goal systems Formula；
Under the goal systems synchronous mode, when the primary database receives database instruction, without any standby number According to library under the premise of the sync response of the database instruction, the main number is written into the implementing result of the database instruction According in the disk in library.
2. the method according to claim 1, wherein primary database and at least one in the acquisition Database Systems A standby database synchronizes time-consuming, comprising:
In the Database Systems, obtains and carry out each rank when data synchronize between the primary database and a standby database The first stage property of Duan Suoxu is time-consuming, synchronous using the summation of the first stage property time-consuming as the single of the Database Systems It is time-consuming；
Multiple singles of the Database Systems are synchronized into time-consuming average value and synchronize time-consuming as described.
3. according to the method described in claim 2, it is characterized in that, described obtain in the primary database and a standby database Between carry out data it is synchronous when each stage needed for first stage property it is time-consuming, using the summation of the first stage property time-consuming as institute The single for stating Database Systems synchronizes time-consuming, comprising:
It obtains the waiting time-consuming and first that the primary database execution database instruction is spent and time-consuming is written, the waiting time-consuming is Time-consuming needed for the primary database waits a standby database to return to sync response, time-consuming first write-in is the main number Time-consuming needed for the disk of the primary database is written into the implementing result of the database instruction according to library；
The weight for waiting time-consuming and described first write-in time-consuming is determined respectively；
Time-consuming weight with single as the Database Systems synchronous time-consuming time-consuming with first write-in is waited by described.
4. the method according to claim 1, wherein primary database and at least one in the acquisition Database Systems A standby database synchronize time-consuming after, the method also includes:
For it is described at least one for database each standby in database, obtain the time-consuming that executes of the standby database, it is described to hold Row is time-consuming for indicating time-consuming needed for the standby database completes the database instruction；
When the execution is time-consuming is greater than the second target duration, by the current per-unit synchronous pattern switching of the standby database to mesh Mark per-unit synchronous mode；
Under the target per-unit synchronous mode, sync response of the primary database without waiting for the standby database.
5. according to the method described in claim 4, it is characterized in that, the acquisition standby database executes time-consuming, comprising:
It obtains the standby database and completes the time-consuming of second stage needed for each stage when the database instruction, by described second Interim time-consuming summation executes time-consuming as the single of the completion database instruction of the standby database；
Multiple singles of the standby database are executed into time-consuming average value and execute time-consuming as described.
6. according to the method described in claim 5, it is characterized in that, the standby database completion database that obtains refers to Second stage needed for each stage is time-consuming when enabling, using the summation of the second stage time-consuming as the list of the standby database It is secondary to execute time-consuming, comprising:
It obtains the standby database and completes the communication time-consuming spent when the database instruction and the second write-in time-consuming, the communication Time-consuming is that the standby database carries out communicating required time-consuming with the primary database, and time-consuming second write-in is the standby number Time-consuming needed for the disk of the standby database is written into the implementing result of the database instruction according to library；
The time-consuming weight of time-consuming and described second write-in of the communication is determined respectively；
The time-consuming weight of time-consuming and described second write-in of the communication and the single as the standby database are executed into time-consuming.
7. according to the method described in claim 4, it is characterized in that, the per-unit synchronous mode that the standby database is current It switches to after target per-unit synchronous mode, the method also includes:
It, will when at least one all switches to the target per-unit synchronous mode for database described in the Database Systems Current systematic synchronisation pattern switches to the goal systems synchronous mode.
8. the method according to claim 1, wherein primary database and at least one in the acquisition Database Systems A standby database synchronize time-consuming after, the method also includes:
When it is described synchronize it is time-consuming be less than the first object duration when, it is same that current systematic synchronisation pattern is switched into default system Step mode；
Under the default system synchronous mode, when the primary database receives database instruction, the primary database is held The row database instruction, by the database instruction be sent to it is described at least one for database, when the primary database connects When receiving the sync response of any standby database, the implementing result of the database instruction is written to the disk of the primary database In.
9. the method according to claim 1, wherein primary database and at least one in the acquisition Database Systems A standby database synchronize time-consuming before, the method also includes:
The resource occupation information of Database Systems place database server is obtained, includes extremely in the database server Few two Database Systems；
It is that the Database Systems distribute available hardware resource, the available hardware resource size according to the resource occupation information It is related to the load condition of Database Systems.
10. according to the method described in claim 9, it is characterized in that, it is described according to the resource occupation information be the data Library system distributes available hardware resource, comprising:
The resource distribution file of each Database Systems in the database server is obtained, the resource distribution file is for referring to Show the size for the hardware resource that each Database Systems can be used；
When the hardware resource of the database server is not otherwise fully engaged, according to the load shape of each Database Systems State is that the Database Systems distribute available hardware resource, and the size of the available hardware resource can be more than the data base set The size of the hardware resource of the resource distribution file instruction of system；
It is the data according to the resource distribution file when the hardware resource of the database server has been fully used Library system distributes available hardware resource.
11. according to the method described in claim 9, it is characterized in that, it is described according to the resource occupation information be the data Library system distributes available hardware resource, comprising:
Determine the priority of each Database Systems in the database server；
When the resource occupation total amount for determining the database server according to the resource occupation information is more than that target occupies threshold value When, the systematic synchronisation pattern of the Database Systems of at least one low priority in the database server is switched into the mesh Mark system synchronous mode.
12. the method according to claim 1, wherein primary database and at least in the acquisition Database Systems One standby database synchronize time-consuming after, the method also includes:
Obtain primary database described in the Database Systems and it is described at least one for database running state information, it is described Running state information be used to indicate the primary database and it is described at least one for database whether normal operation；
When primary database operation is abnormal, determines and the primary database is caused to run abnormal failure cause；
According to the failure cause, the primary database is switched to standby database, by it is described at least one in database Standby database is switched to new primary database.
13. according to the method for claim 12, which is characterized in that it is described according to the failure cause, by the master data Library is switched to standby database, by it is described at least one for the standby database in database be switched to new primary database, comprising:
Determine the corresponding fault type of the failure cause；
When the fault type is not target faults type, the primary database is switched to standby database, by described at least Standby database in one standby database is switched to new primary database, and the target faults type is that at least one is standby by described in Standby database in database is switched to the fault type that can solve after new primary database；
When the fault type is target faults type, handover mechanism is exempted from starting, and the handover mechanism of exempting from is used to indicate in mesh When mark exempts to cut the fault error reason for detecting the target faults type in the time, keep the primary database constant.
14. a kind of data synchronization unit, which is characterized in that described device includes:
First obtains module, for obtaining synchronous time-consuming of the primary database at least one for database, institute in Database Systems State synchronize it is time-consuming for indicate the primary database and any one for carried out between database data it is synchronous when each stage needed for Time-consuming；
First switching module, for when it is described synchronize it is time-consuming be greater than first object duration when, current systematic synchronisation pattern is cut Shift to goal systems synchronous mode；
Writing module is used under the goal systems synchronous mode, when the primary database receives database instruction, Without any standby database under the premise of the sync response of the database instruction, by the implementing result of the database instruction It is written in the disk of the primary database.
15. a kind of server, which is characterized in that the server includes processor and memory, and the memory is for storing Program code, said program code is as processor load and perform claim requires number described in 1 to 13 any claim According to synchronous method.
16. a kind of storage medium, which is characterized in that for storing program code, said program code is used for the storage medium Perform claim requires method of data synchronization described in 1 to 13 any claim.
CN201910662737.2A 2019-07-22 2019-07-22 Data synchronization method, device, server and storage medium Active CN110377664B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910662737.2A CN110377664B (en) 2019-07-22 2019-07-22 Data synchronization method, device, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910662737.2A CN110377664B (en) 2019-07-22 2019-07-22 Data synchronization method, device, server and storage medium

Publications (2)

Publication Number Publication Date
CN110377664A true CN110377664A (en) 2019-10-25
CN110377664B CN110377664B (en) 2022-10-21

Family

ID=68254859

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910662737.2A Active CN110377664B (en) 2019-07-22 2019-07-22 Data synchronization method, device, server and storage medium

Country Status (1)

Country Link
CN (1) CN110377664B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021147197A1 (en) * 2020-01-20 2021-07-29 深圳壹账通智能科技有限公司 Data synchronization method and apparatus, computer device, and storage medium
CN115544147A (en) * 2022-10-18 2022-12-30 山东水发紫光大数据有限责任公司 Machine room data reading method, device, equipment and storage medium
WO2023173870A1 (en) * 2022-03-15 2023-09-21 苏州浪潮智能科技有限公司 Control method and apparatus for storage device, electronic device and non-volatile readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955851A (en) * 2012-10-30 2013-03-06 北京奇虎科技有限公司 Database switching method and device
CN105159795A (en) * 2015-08-21 2015-12-16 小米科技有限责任公司 Data synchronization method, apparatus and system
CN105279210A (en) * 2014-06-26 2016-01-27 赛贝斯股份有限公司 Automatic mode switching in a synchronous replication environment
CN108897658A (en) * 2018-05-31 2018-11-27 康键信息技术（深圳）有限公司 Primary database monitoring method, device, computer equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102955851A (en) * 2012-10-30 2013-03-06 北京奇虎科技有限公司 Database switching method and device
CN105279210A (en) * 2014-06-26 2016-01-27 赛贝斯股份有限公司 Automatic mode switching in a synchronous replication environment
CN105159795A (en) * 2015-08-21 2015-12-16 小米科技有限责任公司 Data synchronization method, apparatus and system
CN108897658A (en) * 2018-05-31 2018-11-27 康键信息技术（深圳）有限公司 Primary database monitoring method, device, computer equipment and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021147197A1 (en) * 2020-01-20 2021-07-29 深圳壹账通智能科技有限公司 Data synchronization method and apparatus, computer device, and storage medium
WO2023173870A1 (en) * 2022-03-15 2023-09-21 苏州浪潮智能科技有限公司 Control method and apparatus for storage device, electronic device and non-volatile readable storage medium
CN115544147A (en) * 2022-10-18 2022-12-30 山东水发紫光大数据有限责任公司 Machine room data reading method, device, equipment and storage medium
CN115544147B (en) * 2022-10-18 2023-12-08 山东水发紫光大数据有限责任公司 Machine room data reading method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN110377664B (en) 2022-10-21

Similar Documents

Publication Publication Date Title
US7779298B2 (en) Distributed job manager recovery
US7321992B1 (en) Reducing application downtime in a cluster using user-defined rules for proactive failover
EP2710461B1 (en) Cross-cloud computing for capacity management and disaster recovery
US7523344B2 (en) Method and apparatus for facilitating process migration
EP2715539B1 (en) Distributed computing framework
CA3168286A1 (en) Data flow processing method and system
CN113641511B (en) Message communication method and device
CN110377664A (en) Method of data synchronization, device, server and storage medium
Hedlund Understanding Hadoop clusters and the network
US20080288812A1 (en) Cluster system and an error recovery method thereof
CN103139302A (en) Real-time copy scheduling method considering load balancing
CN111338773A (en) Distributed timed task scheduling method, scheduling system and server cluster
US10445295B1 (en) Task-based framework for synchronization of event handling between nodes in an active/active data storage system
CN101137984A (en) Systems, methods, and software for distributed loading of databases
EP2224341A1 (en) Node system, server switching method, server device, and data transfer method
WO2021139174A1 (en) Faas distributed computing method and apparatus
CN105827678A (en) High-availability framework based communication method and node
CN115357395A (en) Fault equipment task transfer method and system, electronic equipment and storage medium
CN113986450A (en) Virtual machine backup method and device
CN105323271B (en) Cloud computing system and processing method and device thereof
JP5154843B2 (en) Cluster system, computer, and failure recovery method
CN117076196A (en) Database disaster recovery management and control method and device
CN114598591A (en) Embedded platform node fault recovery system and method
CN109408581A (en) A kind of method for interchanging data, device, equipment and storage medium
US20210357122A1 (en) Synchronizing a stale component of a distributed object using a delta component during maintenance

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230920

Address after: 518057 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 floors

Patentee after: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd.

Patentee after: TENCENT CLOUD COMPUTING (BEIJING) Co.,Ltd.

Address before: 518057 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 floors

Patentee before: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd.