CN110402436A - 处理预写日志的方法和装置 - Google Patents
处理预写日志的方法和装置 Download PDFInfo
- Publication number
- CN110402436A CN110402436A CN201780002706.3A CN201780002706A CN110402436A CN 110402436 A CN110402436 A CN 110402436A CN 201780002706 A CN201780002706 A CN 201780002706A CN 110402436 A CN110402436 A CN 110402436A
- Authority
- CN
- China
- Prior art keywords
- key
- value pair
- wal
- state
- collection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2379—Updates performed during online database operations; commit processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2246—Trees, e.g. B+trees
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Debugging And Monitoring (AREA)
Abstract
一种处理预写日志的方法和装置，通过将多个预写日志WAL记录在WAL集键值对中，并基于状态键值对中记录的WAL集键值对的状态，以WAL集键值对为粒度，对WAL集键值对中记录的WAL进行处理，避免了现有技术中，只能逐条对WAL进行处理，有利于简化对存储设备中记录的WAL的进行回放或删除的过程。
Description
PCT国内申请，说明书已公开。
Claims (20)
- PCT国内申请，权利要求书已公开。
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/120118 WO2019127456A1 (zh) | 2017-12-29 | 2017-12-29 | 处理预写日志的方法和装置 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110402436A true CN110402436A (zh) | 2019-11-01 |
| CN110402436B CN110402436B (zh) | 2021-10-08 |
Family
ID=67064425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780002706.3A Active CN110402436B (zh) | 2017-12-29 | 2017-12-29 | 处理预写日志的方法和装置 |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11526495B2 (zh) |
| EP (1) | EP3712783A4 (zh) |
| CN (1) | CN110402436B (zh) |
| WO (1) | WO2019127456A1 (zh) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103502970A (zh) * | 2011-12-21 | 2014-01-08 | 华为技术有限公司 | 一种键值对的操作方法及装置 |
| CN104657500A (zh) * | 2015-03-12 | 2015-05-27 | 浪潮集团有限公司 | 一种基于key-value键值对的分布式存储方法 |
| CN104809178A (zh) * | 2015-04-15 | 2015-07-29 | 北京科电高技术公司 | 一种键值数据库内存日志的写入方法 |
| US20150227573A1 (en) * | 2012-12-03 | 2015-08-13 | Vmware, Inc. | Distributed, Transactional Key-Value Store |
| US20150286671A1 (en) * | 2012-10-29 | 2015-10-08 | Nec Corporation | Transaction system |
| CN106708427A (zh) * | 2016-11-17 | 2017-05-24 | 华中科技大学 | 一种适用于键值对数据的存储方法 |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8396932B2 (en) * | 2010-04-07 | 2013-03-12 | Apple Inc. | Apparatus and method for efficiently managing data in a social networking service |
| US8700670B2 (en) * | 2010-04-12 | 2014-04-15 | Symantec Corporation | Insert optimization for B+ tree data structure scalability |
| US8977898B1 (en) * | 2012-09-24 | 2015-03-10 | Emc Corporation | Concurrent access to data during replay of a transaction log |
| US9613122B2 (en) * | 2014-05-02 | 2017-04-04 | Facebook, Inc. | Providing eventual consistency for multi-shard transactions |
-
2017
- 2017-12-29 WO PCT/CN2017/120118 patent/WO2019127456A1/zh active Application Filing
- 2017-12-29 EP EP17936580.4A patent/EP3712783A4/en active Pending
- 2017-12-29 CN CN201780002706.3A patent/CN110402436B/zh active Active
-
2020
- 2020-06-23 US US16/909,429 patent/US11526495B2/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103502970A (zh) * | 2011-12-21 | 2014-01-08 | 华为技术有限公司 | 一种键值对的操作方法及装置 |
| US20150286671A1 (en) * | 2012-10-29 | 2015-10-08 | Nec Corporation | Transaction system |
| US20150227573A1 (en) * | 2012-12-03 | 2015-08-13 | Vmware, Inc. | Distributed, Transactional Key-Value Store |
| CN104657500A (zh) * | 2015-03-12 | 2015-05-27 | 浪潮集团有限公司 | 一种基于key-value键值对的分布式存储方法 |
| CN104809178A (zh) * | 2015-04-15 | 2015-07-29 | 北京科电高技术公司 | 一种键值数据库内存日志的写入方法 |
| CN106708427A (zh) * | 2016-11-17 | 2017-05-24 | 华中科技大学 | 一种适用于键值对数据的存储方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20200320065A1 (en) | 2020-10-08 |
| EP3712783A4 (en) | 2020-12-30 |
| CN110402436B (zh) | 2021-10-08 |
| US11526495B2 (en) | 2022-12-13 |
| EP3712783A1 (en) | 2020-09-23 |
| WO2019127456A1 (zh) | 2019-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7596658B2 (en) | Method for expanding capacity of replication volume | |
| JP2013509658A (ja) | 将来の使用推量に基づく記憶メモリの割り当て | |
| US8527559B2 (en) | Garbage collector with concurrent flipping without read barrier and without verifying copying | |
| CN109716321B (zh) | N路散列连接 | |
| CN110168532A (zh) | 数据更新方法和存储装置 | |
| US8151079B2 (en) | Computer system, storage area allocation method, and management computer | |
| US11456946B2 (en) | Regular path queries (RPQS) for distributed graphs | |
| US9009435B2 (en) | Methods and systems for data cleanup using physical image of files on storage devices | |
| CN108255576A (zh) | 虚拟机热迁移异常处理方法、装置和存储介质 | |
| CN106775481B (zh) | 数据读取方法及设备 | |
| US7792966B2 (en) | Zone control weights | |
| CN108304142A (zh) | 一种数据管理方法和装置 | |
| WO2017020757A1 (en) | Rebalancing and elastic storage scheme with elastic named distributed circular buffers | |
| CN102341778B (zh) | 用于将数据存储于磁带上的方法和*** | |
| JP2023553220A (ja) | マルチインスタンスプロセスのためのプロセスマイニング | |
| US11243882B2 (en) | In-array linked list identifier pool scheme | |
| JP6158430B2 (ja) | データベースのハッシュ結合処理をストレージ装置が実行するシステム | |
| US10394615B2 (en) | Information processing apparatus and job management method | |
| KR102354343B1 (ko) | 블록체인 기반의 지리공간 데이터를 위한 공간 데이터 인덱싱 방법 및 장치 | |
| CN110402436A (zh) | 处理预写日志的方法和装置 | |
| JP2016018384A (ja) | ストレージ制御装置、ストレージシステム、及びプログラム | |
| CN113051080A (zh) | 一种计算图执行方法、装置及异构平台 | |
| US11163446B1 (en) | Systems and methods of amortizing deletion processing of a log structured storage based volume virtualization | |
| CN103970860A (zh) | 一种数据处理的方法、装置及*** | |
| CN103562918A (zh) | 用于到存储器内数据网格的派遣的数据库查询的拦截 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |