CN111209332A - Database synchronization method based on self-made serialization algorithm - Google Patents
Database synchronization method based on self-made serialization algorithm Download PDFInfo
- Publication number
- CN111209332A CN111209332A CN201911324625.2A CN201911324625A CN111209332A CN 111209332 A CN111209332 A CN 111209332A CN 201911324625 A CN201911324625 A CN 201911324625A CN 111209332 A CN111209332 A CN 111209332A
- Authority
- CN
- China
- Prior art keywords
- data
- processing
- service module
- metadata
- serialization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 23
- 238000012545 processing Methods 0.000 claims abstract description 69
- 238000003860 storage Methods 0.000 claims abstract description 17
- 238000013524 data verification Methods 0.000 claims abstract description 10
- 238000007726 management method Methods 0.000 claims abstract description 9
- 230000008569 process Effects 0.000 claims abstract description 7
- 230000005540 biological transmission Effects 0.000 claims abstract description 5
- 239000000284 extract Substances 0.000 claims abstract description 4
- 230000001360 synchronised effect Effects 0.000 claims description 13
- 230000002159 abnormal effect Effects 0.000 claims description 6
- 238000013500 data storage Methods 0.000 claims description 6
- 230000006835 compression Effects 0.000 claims description 3
- 238000007906 compression Methods 0.000 claims description 3
- 230000009191 jumping Effects 0.000 claims description 3
- 238000012795 verification Methods 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 230000007246 mechanism Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 4
- 230000008520 organization Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000009956 central mechanism Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a database synchronization method based on a self-made serialization algorithm, which comprises a management tool, a publishing service module and a subscribing service module and is characterized in that a self-defined data view primitive data structure is established, a source database generates metadata according to the structure, the publishing service module extracts the data according to the definition of the metadata, a self-made serialization storage algorithm is established, the data are stored in a serialization mode and published, the subscribing service module receives the data published by the publishing service module according to the definition of the metadata, processes the data in a reverse mode, and finally updates the data into target data. The invention realizes the mechanisms of minimized transmission of database synchronization, self-defined identification of data constraint relation and the like, performs self-defined logic processing on the occasions of data updating, data verification, data updating and the like in a plug-in customization mode, ensures the data consistency and realizes the effective synchronization of the data.
Description
Technical Field
The invention relates to the technical field of database synchronization, in particular to a database synchronization method based on a self-made serialization algorithm.
Background
In a production environment with a centralized control mode, data is deployed in a machine room of a central mechanism, and subordinate mechanisms only deploy emergency systems; normally, the business processing of the subordinate organization depends on the system of the central organization, and under the condition that the network and the central database are broken down, the subordinate organization starts the emergency system to perform daily business processing. The service requirement is that service data of the central database needs to be periodically synchronized to subordinate institutions under normal conditions so as to ensure that the service data under emergency conditions can ensure a certain degree of freshness.
The existing data synchronization means is relatively poor in customizability, means for verifying associated data related to business rules are lacking, processing on aspects such as database primary keys is incomplete, conditions of primary key conflict and associated data inconsistency often occur in the synchronization process, and accordingly data synchronization fails, or the synchronized associated data is inconsistent, and finally when an emergency condition occurs, an emergency system cannot be started normally.
Disclosure of Invention
The invention aims to overcome the problems in the prior art and provide a database synchronization method based on a self-made serialization algorithm, so that the data of a source database and the data of a target database are kept consistent in a specified period.
In order to achieve the technical purpose and achieve the technical effect, the invention is realized by the following technical scheme:
a database synchronization method based on a self-made serialization algorithm comprises a management tool, a publishing service module and a subscribing service module, wherein a self-defined data view primitive data structure is established, a source database generates metadata according to the structure, the publishing service module extracts the data according to the definition of the metadata, a self-made serialization storage algorithm is established, the data are stored in a serialization mode and published, the subscribing service module receives the data published by the publishing service module according to the definition of the metadata, processes the data in a reverse mode, and finally updates the data into target data.
Further, the step of generating metadata by the source database according to the customized data view primitive data structure comprises the following steps:
step 1.1) manually generating structure information metadata of a data table, wherein the structure information metadata comprises a data table name, a data table type, a data table batch condition, a field name, a data type and a length;
step 1.2) establishing external data relation metadata of the data table, acquiring other data table lists on which the data table depends, and recording a dependency field;
step 1.3) combines step 1.1) and step 1.2), and establishes a data release configuration model:
step 1.31) configuring a source database connection character string, a data serialization file storage position and data subscriber service address information;
step 1.32) configuring data synchronization opportunity aiming at all data views, wherein the synchronization opportunity is defined as a plurality of numerical values divided by semicolons, the first numerical value represents a synchronization period, the minimum unit of the period is minutes, and the rest numerical values represent time points of forced synchronization;
step 1.4) combining step 1.1) and step 1.2), establishing a data subscription configuration model:
step 1.41) configuring a data verification plug-in, and if the data verification plug-in is not configured, adopting default processing by the system;
step 1.42) configuring the plug-ins before and after updating the data table, and if the plug-ins are not configured, adopting default processing by the system;
step 1.43) configuring the target database connection character strings, data sequence files and FTP server related configuration aiming at all data views.
Further, the homemade serialization storage algorithm comprises the following steps:
step 2.1) aiming at the definition of the data view metadata, sequentially carrying out data acquisition processing on each data item, and carrying out the step 2.2) processing on a single data definition item;
step 2.2) processing each data record in turn according to the number of records for the acquired data item data, and performing the step 2.3) processing for a single data record;
step 2.3), performing binary processing on each data record according to field metadata definition in sequence;
and 2.4) carrying out compression processing on the binary processing structure of the single data definition item, further reducing the size of data storage and final transmission, and carrying out file storage on the compressed data.
Further, the data publishing comprises the following steps:
step 3.1) the publishing service module acquires a data synchronization period from the data view metadata and performs data synchronization operation according to the period requirement, and each period of operation automatically allocates a batch number to the system;
step 3.2) the publishing service module acquires the state of the subscriber, if the state of the subscriber is abnormal, all the complete data is updated at this time to ensure the data consistency of all the data after reaching the target library; if the state of the subscriber terminal is normal, updating the changed data; completely updating the plan data each time;
and 3.3) according to the processing result list in the step 3.2), the system performs the step 2.1) to finish the serialized storage of the data definition items, and after each time the serialized operation of one data definition item is finished, the publishing service module sends a synchronous instruction to the subscribing service module.
Further, the subscription service module receiving and reversely processing the data comprises the following steps:
step 4.1) the subscription service module receives the synchronous instruction issued by the issuing service module, stores the synchronous instruction into an instruction queue according to the batch requirement, and creates an independent thread for instruction processing;
step 4.2) in the instruction processing thread, carrying out FTP downloading on the data definition items appointed in the instruction information in sequence, and aiming at the condition of download failure, repeatedly trying the system for a plurality of times, marking abnormity if a plurality of times fail, and skipping to the step 4.4), otherwise, regarding as downloading success, and waiting for the data file after downloading success;
step 4.3) in the instruction processing thread, after all the data definition items of the current batch are downloaded successfully, sequentially decompressing, deserializing and splicing the data files according to the data constraint relation; after the processing is finished, performing data verification operation, and after the verification is passed, performing plug-in processing before updating, batch updating and storing processing and performing plug-in processing after updating by the system; no abnormity or error occurs in the processing process, the batch state is marked as normal, and the updating is finished; otherwise, jumping to step 4.4);
and 4.4) aiming at the condition of batch processing abnormity, the batch updating fails, all the instruction processing is judged to fail, the batch state is marked to be abnormal, and the batch updating is finished.
Further, in the step 1.43), the FTP server related configuration includes a server address, a port, a login user, a password and a data storage directory.
Further, in the step 3.3), the synchronous instruction information includes a batch number, a data definition item name, a data page number, a data number and an instruction type.
Further, in the step 4.2), for the case of download failure, the system repeats the trial 3 times, and if all the trial 3 times fail, an exception is marked.
The invention has the beneficial effects that:
the invention can compress the size of data transmission to the maximum extent and save the occupation of network bandwidth resources; meanwhile, the system realizes the identification of unchanged data, and reduces the data volume while ensuring the correctness of the data; the system provides a plurality of mechanisms such as increment, safety, fault tolerance, exception handling, customized synchronization rule and the like of data synchronization, more effectively realizes data synchronization service, and is a database synchronization system with excellent performance, good accuracy, stable operation and less resource occupation.
Drawings
FIG. 1 is a schematic diagram of a network topology of the present invention;
FIG. 2 is a diagram of the data distribution processing logic of the present invention;
FIG. 3 is a block diagram of the subscription receiving and reverse processing logic of the present invention;
fig. 4 is a general logical block diagram of the present invention.
Detailed Description
The present invention will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
As shown in fig. 1, a database synchronization method based on a self-made serialization algorithm includes a management tool, a publishing service module and a subscribing service module, where the system establishes a self-defined data view primitive data structure for a database to be subjected to data synchronization through the management tool, generates metadata from a source database according to the structure, and provides a monitoring entry for daily synchronization service, the publishing service module extracts data according to the definition of the metadata, specifically, periodically obtains data from the source database in batches according to the definition of the data view metadata, establishes a self-made serialization storage algorithm, performs serialization storage on the data and performs data publishing, and finally publishes the data on an FTP server in a file form, and the subscribing service module receives the data published by the publishing service module according to the definition of the metadata, and the data is reversely processed and finally updated to the target data.
The method for generating the metadata by the source database according to the self-defined data visual primitive data structure comprises the following steps:
step 1.1) manually generating structure information metadata of a data table by using a management tool at a management end, wherein the structure information metadata comprises a data table name, a data table type (a basic table or a schedule table), a data table batch condition, a field name, a data type and a length, and the data type information is set according to a custom rule;
step 1.2) establishing external data relation metadata of the data table, acquiring other data table lists on which the data table depends, and recording a dependency field;
step 1.3) combines step 1.1) and step 1.2), and establishes a data release configuration model:
step 1.31) configuring a source database connection character string, a data serialization file storage position and data subscriber service address information;
step 1.32) configuring data synchronization opportunity aiming at all data views, wherein the synchronization opportunity is defined as a plurality of numerical values divided by semicolons, the first numerical value represents a synchronization period, the minimum unit of the period is minutes, and the rest numerical values represent time points of forced synchronization, and the time points are accurate to minutes, such as 0930, and represent 9: 30;
step 1.4) combining step 1.1) and step 1.2), establishing a data subscription configuration model:
step 1.41) configuring a data verification plug-in, and if the data verification plug-in is not configured, adopting default processing by the system;
step 1.42) configuring the plug-ins before and after updating the data table, and if the plug-ins are not configured, adopting default processing by the system;
step 1.43) configuring the target database connection character strings, data sequence files and FTP server related configuration aiming at all data views.
The self-made serialization storage algorithm comprises the following steps:
step 2.1) aiming at the definition of the data view metadata, sequentially carrying out data acquisition processing on each data item, and carrying out the step 2.2) processing on a single data definition item;
step 2.2) processing each data record in turn according to the number of records for the acquired data item data, and performing the step 2.3) processing for a single data record;
step 2.3), performing binary processing on each data record according to field metadata definition in sequence;
and 2.4) carrying out compression processing on the binary processing structure of the single data definition item, further reducing the size of data storage and final transmission, and carrying out file storage on the compressed data.
The data publishing comprises the following steps:
step 3.1) the publishing service module acquires a data synchronization period from the data view metadata and performs data synchronization operation according to the period requirement, and each period of operation automatically allocates a batch number to the system;
step 3.2) the publishing service module acquires the state of the subscriber, if the state of the subscriber is abnormal, all the complete data is updated at this time, namely the version problem of the basic data is not considered, so as to ensure the data consistency after all the data reach the target library; if the state of the subscriber terminal is normal, updating the changed data (only aiming at the basic class data) at this time; completely updating the plan data each time;
and 3.3) according to the processing result list in the step 3.2), the system performs the step 2.1) to finish the serialized storage of the data definition items, and after each time the serialized operation of one data definition item is finished, the publishing service module sends a synchronous instruction to the subscribing service module.
The subscription service module receiving and reversely processing data comprises the following steps:
step 4.1) the subscription service module receives the synchronous instruction issued by the issuing service module, stores the synchronous instruction into an instruction queue according to the batch requirement, and creates an independent thread for instruction processing;
step 4.2) in the instruction processing thread, carrying out FTP downloading on the data definition items appointed in the instruction information in sequence, and aiming at the condition of download failure, repeatedly trying the system for a plurality of times, marking abnormity if a plurality of times fail, and skipping to the step 4.4), otherwise, regarding as downloading success, and waiting for the data file after downloading success;
step 4.3) in the instruction processing thread, after all the data definition items of the current batch are downloaded successfully, sequentially decompressing, deserializing and splicing the data files according to the data constraint relation; after the processing is finished, performing data verification operation, and after the verification is passed, performing plug-in processing before updating, batch updating and storing processing and performing plug-in processing after updating by the system; no abnormity or error occurs in the processing process, the batch state is marked as normal, and the updating is finished; otherwise, jumping to step 4.4);
and 4.4) aiming at the condition of batch processing abnormity, the batch updating fails, all the instruction processing is judged to fail, the batch state is marked to be abnormal, and the batch updating is finished.
In the step 1.43), the related configuration of the FTP server includes a server address, a port, a login user, a password and a data storage directory.
In the step 3.3), the synchronous instruction information includes a batch number, a data definition item name, a data page number, a data number and an instruction type.
In the step 4.2), aiming at the condition of download failure, the system repeatedly tries for 3 times, and if all the 3 times of download failure, the system marks an exception.
Principle of the invention
In the specific implementation of the invention, the following parameters can be adopted:
the management tool is deployed on a management terminal, and requires Windows7 professional edition or higher, Framework 4.0;
the database Server requires Windows Server 2008R 2, MS SQL Server 2008R 2;
the network requirement is a local area network.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A database synchronization method based on a self-made serialization algorithm comprises a management tool, a publishing service module and a subscribing service module and is characterized in that a self-defined data visual primitive data structure is established, a source database generates metadata according to the structure, the publishing service module extracts the data according to the definition of the metadata, a self-made serialization storage algorithm is established, the data are stored in a serialization mode and published, the subscribing service module receives the data published by the publishing service module according to the definition of the metadata, processes the data in a reverse mode, and finally updates the data into target data.
2. The database synchronization method based on the homemade serialization algorithm as claimed in claim 1, wherein the step of generating metadata from the source database according to the customized data visual primitive data structure comprises the steps of:
step 1.1) manually generating structure information metadata of a data table, wherein the structure information metadata comprises a data table name, a data table type, a data table batch condition, a field name, a data type and a length;
step 1.2) establishing external data relation metadata of the data table, acquiring other data table lists on which the data table depends, and recording a dependency field;
step 1.3) combines step 1.1) and step 1.2), and establishes a data release configuration model:
step 1.31) configuring a source database connection character string, a data serialization file storage position and data subscriber service address information;
step 1.32) configuring data synchronization opportunity aiming at all data views, wherein the synchronization opportunity is defined as a plurality of numerical values divided by semicolons, the first numerical value represents a synchronization period, the minimum unit of the period is minutes, and the rest numerical values represent time points of forced synchronization;
step 1.4) combining step 1.1) and step 1.2), establishing a data subscription configuration model:
step 1.41) configuring a data verification plug-in, and if the data verification plug-in is not configured, adopting default processing by the system;
step 1.42) configuring the plug-ins before and after updating the data table, and if the plug-ins are not configured, adopting default processing by the system;
step 1.43) configuring the target database connection character strings, data sequence files and FTP server related configuration aiming at all data views.
3. The homemade serialization algorithm-based database synchronization method according to claim 2, wherein said homemade serialization storage algorithm comprises the steps of:
step 2.1) aiming at the definition of the data view metadata, sequentially carrying out data acquisition processing on each data item, and carrying out the step 2.2) processing on a single data definition item;
step 2.2) processing each data record in turn according to the number of records for the acquired data item data, and performing the step 2.3) processing for a single data record;
step 2.3), performing binary processing on each data record according to field metadata definition in sequence;
and 2.4) carrying out compression processing on the binary processing structure of the single data definition item, further reducing the size of data storage and final transmission, and carrying out file storage on the compressed data.
4. The database synchronization method based on the homemade serialization algorithm as claimed in claim 3, wherein said data publishing comprises the steps of:
step 3.1) the publishing service module acquires a data synchronization period from the data view metadata and performs data synchronization operation according to the period requirement, and each period of operation automatically allocates a batch number to the system;
step 3.2) the publishing service module acquires the state of the subscriber, if the state of the subscriber is abnormal, all the complete data is updated at this time to ensure the data consistency of all the data after reaching the target library; if the state of the subscriber terminal is normal, updating the changed data; completely updating the plan data each time;
and 3.3) according to the processing result list in the step 3.2), the system performs the step 2.1) to finish the serialized storage of the data definition items, and after each time the serialized operation of one data definition item is finished, the publishing service module sends a synchronous instruction to the subscribing service module.
5. The homemade serialization algorithm-based database synchronization method of claim 4, wherein said subscription service module receiving and reverse processing data comprises the steps of:
step 4.1) the subscription service module receives the synchronous instruction issued by the issuing service module, stores the synchronous instruction into an instruction queue according to the batch requirement, and creates an independent thread for instruction processing;
step 4.2) in the instruction processing thread, carrying out FTP downloading on the data definition items appointed in the instruction information in sequence, and aiming at the condition of download failure, repeatedly trying the system for a plurality of times, marking abnormity if a plurality of times fail, and skipping to the step 4.4), otherwise, regarding as downloading success, and waiting for the data file after downloading success;
step 4.3) in the instruction processing thread, after all the data definition items of the current batch are downloaded successfully, sequentially decompressing, deserializing and splicing the data files according to the data constraint relation; after the processing is finished, performing data verification operation, and after the verification is passed, performing plug-in processing before updating, batch updating and storing processing and performing plug-in processing after updating by the system; no abnormity or error occurs in the processing process, the batch state is marked as normal, and the updating is finished; otherwise, jumping to step 4.4);
and 4.4) aiming at the condition of batch processing abnormity, the batch updating fails, all the instruction processing is judged to fail, the batch state is marked to be abnormal, and the batch updating is finished.
6. The homemade serialization algorithm-based database synchronization method according to claim 2, wherein in said step 1.43), the FTP server-related configuration includes server address, port, login user, password, and data storage directory.
7. The database synchronization method based on the homemade serialization algorithm as claimed in claim 4, wherein in said step 3.3), the synchronization command information includes batch number, data definition item name, data page number, data number and command type.
8. The database synchronization method based on the homemade serialization algorithm as claimed in claim 5, wherein in step 4.2), for the case of download failure, the system makes 3 repeated attempts, and if all 3 failures, the system marks an exception.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911324625.2A CN111209332B (en) | 2019-12-20 | 2019-12-20 | Database synchronization method based on homemade serialization algorithm |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911324625.2A CN111209332B (en) | 2019-12-20 | 2019-12-20 | Database synchronization method based on homemade serialization algorithm |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111209332A true CN111209332A (en) | 2020-05-29 |
| CN111209332B CN111209332B (en) | 2024-02-09 |
Family
ID=70788173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911324625.2A Active CN111209332B (en) | 2019-12-20 | 2019-12-20 | Database synchronization method based on homemade serialization algorithm |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111209332B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112199441A (en) * | 2020-09-28 | 2021-01-08 | 中国平安人寿保险股份有限公司 | Data synchronization processing method, device, equipment and medium based on big data platform |
| CN113986420A (en) * | 2021-10-13 | 2022-01-28 | 上海视九信息科技有限公司 | Asynchronous rendering method, system and medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040201604A1 (en) * | 2000-06-19 | 2004-10-14 | International Business Machines Corporation | System and method for developing and administering web applications and services from a workflow, enterprise, and mail-enabled web application server and platform |
| US6845383B1 (en) * | 2000-06-19 | 2005-01-18 | International Business Machines Corporation | System and method for managing concurrent scheduled or on-demand replication of subscriptions |
| CN101902473A (en) * | 2010-07-22 | 2010-12-01 | 武汉中地数码科技有限公司 | Method for synchronously updating data based on grid GIS (Geographic Information System) |
| CN104317843A (en) * | 2014-10-11 | 2015-01-28 | 上海瀚之友信息技术服务有限公司 | Data synchronism ETL (Extract Transform Load) system |
| WO2016016539A1 (en) * | 2014-08-01 | 2016-02-04 | Shootshareshow | Method, system and platform for the creation and operation of a multimedia database |
| CN105338086A (en) * | 2015-11-04 | 2016-02-17 | 浪潮软件股份有限公司 | Distributed message forwarding method |
| CN107819824A (en) * | 2017-10-09 | 2018-03-20 | 中国电子科技集团公司第二十八研究所 | A kind of Urban Data opens and information service system and method for servicing |
| CN108536743A (en) * | 2018-03-09 | 2018-09-14 | 中国电子科技集团公司第二十八研究所 | A kind of Combat Command System database in phase system |
-
2019
- 2019-12-20 CN CN201911324625.2A patent/CN111209332B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040201604A1 (en) * | 2000-06-19 | 2004-10-14 | International Business Machines Corporation | System and method for developing and administering web applications and services from a workflow, enterprise, and mail-enabled web application server and platform |
| US6845383B1 (en) * | 2000-06-19 | 2005-01-18 | International Business Machines Corporation | System and method for managing concurrent scheduled or on-demand replication of subscriptions |
| CN101902473A (en) * | 2010-07-22 | 2010-12-01 | 武汉中地数码科技有限公司 | Method for synchronously updating data based on grid GIS (Geographic Information System) |
| WO2016016539A1 (en) * | 2014-08-01 | 2016-02-04 | Shootshareshow | Method, system and platform for the creation and operation of a multimedia database |
| CN104317843A (en) * | 2014-10-11 | 2015-01-28 | 上海瀚之友信息技术服务有限公司 | Data synchronism ETL (Extract Transform Load) system |
| CN105338086A (en) * | 2015-11-04 | 2016-02-17 | 浪潮软件股份有限公司 | Distributed message forwarding method |
| CN107819824A (en) * | 2017-10-09 | 2018-03-20 | 中国电子科技集团公司第二十八研究所 | A kind of Urban Data opens and information service system and method for servicing |
| CN108536743A (en) * | 2018-03-09 | 2018-09-14 | 中国电子科技集团公司第二十八研究所 | A kind of Combat Command System database in phase system |
Non-Patent Citations (2)
| Title |
|---|
| 高卫中,廖华明: "网格数据库中基于发布/订阅的分片复制技术及实现", 计算机应用 * |
| 高梓铭;韦同胜;王鲲;赵文涛;: "疑难电子数据修复方案库数据同步方法比较", 西安邮电大学学报 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112199441A (en) * | 2020-09-28 | 2021-01-08 | 中国平安人寿保险股份有限公司 | Data synchronization processing method, device, equipment and medium based on big data platform |
| CN112199441B (en) * | 2020-09-28 | 2023-11-24 | 中国平安人寿保险股份有限公司 | Data synchronous processing method, device, equipment and medium based on big data platform |
| CN113986420A (en) * | 2021-10-13 | 2022-01-28 | 上海视九信息科技有限公司 | Asynchronous rendering method, system and medium |
| CN113986420B (en) * | 2021-10-13 | 2024-05-17 | 上海视九信息科技有限公司 | Asynchronous rendering method, system and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111209332B (en) | 2024-02-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102162872B1 (en) | Multi-task scheduling method, system, application server and computer-readable storage medium | |
| CN108829409B (en) | Distributed system rapid deployment method and system | |
| CN105763369B (en) | A kind of terminal unit remote software version distribution method and system | |
| CN111400407B (en) | Data synchronization method and device, storage medium and electronic device | |
| CN109981350B (en) | Uninterrupted upgrading method and system for cloud service | |
| CN111209332B (en) | Database synchronization method based on homemade serialization algorithm | |
| CN115048205B (en) | ETL scheduling platform, deployment method thereof and computer-readable storage medium | |
| CN110806907B (en) | Containerized configurable database script execution management system and method | |
| CN104811979A (en) | Pressure testing method and device based on FOTA upgrading | |
| CN114443294B (en) | Big data service component deployment method, system, terminal and storage medium | |
| CN112416957A (en) | Data increment updating method and device based on data model layer and computer equipment | |
| CN111884834A (en) | Zookeeper-based distributed system upgrading method and system and computer equipment | |
| CN108616391A (en) | Method and system for upgrading equipment firmware at server side | |
| EP2808785A1 (en) | Incremental deployment of software across an enterprise system | |
| CN112698622B (en) | Automatic control method, device and machine readable storage medium | |
| CN114546588A (en) | Task deployment method and device, storage medium and electronic device | |
| CN112416936B (en) | DCS background multi-node cooperative configuration mark name verification method | |
| CN110007946B (en) | Method, device, equipment and medium for updating algorithm model | |
| CN111580948A (en) | Task scheduling method and device and computer equipment | |
| US8015270B2 (en) | Redundant appliance configuration repository in standard hierarchical format | |
| CN110377568A (en) | A kind of metadata acquisition method and device | |
| CN113435489B (en) | Method, device, computer readable storage medium and processor for deploying system | |
| CN114020368A (en) | Information processing method and device based on state machine and storage medium | |
| EP2711836A1 (en) | Data distribution system | |
| CN114500268A (en) | Deployment method, device, server and storage medium of chart resource |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |