CN110347746B - 一种异构数据库同步数据一致性校验方法及装置 - Google Patents
一种异构数据库同步数据一致性校验方法及装置 Download PDFInfo
- Publication number
- CN110347746B CN110347746B CN201910510663.0A CN201910510663A CN110347746B CN 110347746 B CN110347746 B CN 110347746B CN 201910510663 A CN201910510663 A CN 201910510663A CN 110347746 B CN110347746 B CN 110347746B
- Authority
- CN
- China
- Prior art keywords
- transaction
- log
- source
- synchronous
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000001360 synchronised effect Effects 0.000 title claims abstract description 129
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000012795 verification Methods 0.000 claims description 13
- 238000004458 analytical method Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 abstract description 12
- 230000008859 change Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2358—Change logging, detection, and notification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910510663.0A CN110347746B (zh) | 2019-06-13 | 2019-06-13 | 一种异构数据库同步数据一致性校验方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910510663.0A CN110347746B (zh) | 2019-06-13 | 2019-06-13 | 一种异构数据库同步数据一致性校验方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110347746A CN110347746A (zh) | 2019-10-18 |
CN110347746B true CN110347746B (zh) | 2020-06-26 |
Family
ID=68181958
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910510663.0A Active CN110347746B (zh) | 2019-06-13 | 2019-06-13 | 一种异构数据库同步数据一致性校验方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110347746B (zh) |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110019502B (zh) * | 2017-08-29 | 2023-03-21 | 阿里巴巴集团控股有限公司 | 在主数据库和备数据库之间的同步方法、数据库***和设备 |
CN110955723A (zh) * | 2019-11-15 | 2020-04-03 | 北京浪潮数据技术有限公司 | 一种主从数据库同步状态监控方法、装置及电子设备 |
CN111198920B (zh) * | 2019-12-30 | 2024-01-23 | 上海英方软件股份有限公司 | 一种基于数据库同步确定对比表快照的方法及装置 |
CN111241193B (zh) * | 2019-12-31 | 2021-04-27 | 武汉达梦数据库股份有限公司 | 一种基于日志解析的数据库添加列同步方法和装置 |
CN111737230B (zh) * | 2020-06-23 | 2024-04-12 | 北京奇艺世纪科技有限公司 | 数据校验方法、装置、电子设备以及可读存储介质 |
CN113760923B (zh) * | 2020-10-27 | 2023-09-05 | 北京京东振世信息技术有限公司 | 一种数据异构方法、装置、***及存储介质 |
CN112783861A (zh) * | 2021-01-22 | 2021-05-11 | 中信银行股份有限公司 | 应用***迁移正确性的验证方法及装置、设备、存储介质 |
CN112966025B (zh) * | 2021-03-17 | 2022-07-19 | 焦点科技股份有限公司 | 一种binlog日志挖掘字典实现方法 |
CN113160918A (zh) * | 2021-05-21 | 2021-07-23 | 山东健康医疗大数据有限公司 | 一种变化数据捕获的统一处理方法及工具 |
CN113282643B (zh) * | 2021-06-04 | 2023-03-21 | 上海英方软件股份有限公司 | 一种oracle数据库同步环境下的表对比方法及*** |
CN115017133B (zh) * | 2022-05-31 | 2024-04-26 | 焦点科技股份有限公司 | 一种基于文件的异构数据库数据一致性校验方法 |
CN115145944B (zh) * | 2022-09-06 | 2022-11-18 | 中国光大银行股份有限公司 | 一种基于令牌表的异构数据库双向同步方法及装置 |
CN116340430A (zh) * | 2023-05-24 | 2023-06-27 | 北京奥星贝斯科技有限公司 | 一种数据同步校验方法及相关设备 |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103970833B (zh) * | 2014-04-02 | 2017-08-15 | 浙江大学 | 一种基于日志的异构数据库同步***中双向同步数据循环的解决方法 |
CN105447046A (zh) * | 2014-09-02 | 2016-03-30 | 阿里巴巴集团控股有限公司 | 一种分布式***数据一致性处理方法、装置和*** |
CN108763358A (zh) * | 2018-05-16 | 2018-11-06 | 阿里巴巴集团控股有限公司 | 一种数据校验方法及装置 |
CN109033186B (zh) * | 2018-06-27 | 2020-11-27 | 东软集团股份有限公司 | 数据一致性检测方法、装置、存储介质及电子设备 |
CN109189852B (zh) * | 2018-08-01 | 2021-05-28 | 武汉达梦数据库有限公司 | 一种数据同步的方法及用于数据同步的装置 |
CN110262929B (zh) * | 2018-08-13 | 2020-01-07 | 武汉达梦数据库有限公司 | 一种保证复制事务一致性的方法以及相应的复制装置 |
CN109271450B (zh) * | 2018-10-10 | 2020-12-04 | 北京百度网讯科技有限公司 | 数据库同步方法、装置、服务器和存储介质 |
CN109271399A (zh) * | 2018-11-19 | 2019-01-25 | 武汉达梦数据库有限公司 | 一种数据库写入日志一致性的校验方法 |
-
2019
- 2019-06-13 CN CN201910510663.0A patent/CN110347746B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
CN110347746A (zh) | 2019-10-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110347746B (zh) | 一种异构数据库同步数据一致性校验方法及装置 | |
US8560502B2 (en) | Method and a system for replaying database workload with transactional consistency | |
CN109460349B (zh) | 一种基于日志的测试用例生成方法和装置 | |
US8078582B2 (en) | Data change ordering in multi-log based replication | |
CN107609188B (zh) | 基于GoldenGate的数据同步校验方法 | |
CN110309161B (zh) | 一种数据同步方法、装置及服务器 | |
CN109933632B (zh) | 一种数据库的数据迁移方法、装置及设备 | |
CN104809202A (zh) | 一种数据库同步的方法和装置 | |
CN111625540A (zh) | 一种关系型数据库数据同步完整性校验方法和装置 | |
CN110427422A (zh) | 数据同步异常时数据一致性校验方法、设备及存储介质 | |
CN113626416A (zh) | 数据校验的方法、装置、计算设备和存储介质 | |
CN112231407A (zh) | PostgreSQL数据库的DDL同步方法、装置、设备和介质 | |
KR101191832B1 (ko) | 네트워크 패킷 분석을 통한 데이터베이스 복제 방법 및 시스템 | |
CN104376088A (zh) | 一种云数据库的分布式同步方法及数据库*** | |
CN110222121A (zh) | 一种基于CDC方式的SQL Server数据库增量同步实现方法及*** | |
CN109669988B (zh) | 一种查询建表事务的拆分同步方法及*** | |
CN115033578A (zh) | 一种业务数据更新的方法、相关装置及存储介质 | |
CN112966025A (zh) | 一种binlog日志挖掘字典实现方法 | |
CN112416944A (zh) | 一种同步业务数据的方法和设备 | |
CN113282643B (zh) | 一种oracle数据库同步环境下的表对比方法及*** | |
CN115827777A (zh) | 一种多数据源的自适应同步与差异识别方法、装置及设备 | |
CN107506436B (zh) | 一种用于物联网数据库存储性能测试的方法以及装置 | |
WO2021047506A1 (zh) | 数据统计分析***、方法及计算机可读存储介质 | |
CN116955369A (zh) | 基于数据库的数据融合方法、装置、电子设备及存储介质 | |
CN117725130A (zh) | 数据同步方法及装置、存储介质和电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP01 | Change in the name or title of a patent holder |
Address after: 430000 16-19 / F, building C3, future technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan, Hubei Province Patentee after: Wuhan dream database Co.,Ltd. Address before: 430000 16-19 / F, building C3, future technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan, Hubei Province Patentee before: WUHAN DAMENG DATABASE Co.,Ltd. |
|
CP01 | Change in the name or title of a patent holder | ||
CB03 | Change of inventor or designer information | ||
CB03 | Change of inventor or designer information |
Inventor after: Sun Feng Inventor after: Yu Yuanlan Inventor after: Zhao Jiawei Inventor before: Fu Quan Inventor before: Sun Feng Inventor before: Yu Yuanlan Inventor before: Zhao Jiawei |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220907 Address after: 430073 16-19 / F, building C3, future science and technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee after: Wuhan dream database Co.,Ltd. Patentee after: HUAZHONG University OF SCIENCE AND TECHNOLOGY Address before: 430000 16-19 / F, building C3, future technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan, Hubei Province Patentee before: Wuhan dream database Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230724 Address after: 16-19/F, Building C3, Future Science and Technology Building, No. 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province, 430206 Patentee after: Wuhan dream database Co.,Ltd. Address before: 430073 16-19 / F, building C3, future science and technology building, 999 Gaoxin Avenue, Donghu New Technology Development Zone, Wuhan City, Hubei Province Patentee before: Wuhan dream database Co.,Ltd. Patentee before: HUAZHONG University OF SCIENCE AND TECHNOLOGY |