CN110199270A - 存储***中存储设备的管理方法及装置 - Google Patents

存储***中存储设备的管理方法及装置 Download PDF

Info

Publication number
CN110199270A
CN110199270A CN201780002716.7A CN201780002716A CN110199270A CN 110199270 A CN110199270 A CN 110199270A CN 201780002716 A CN201780002716 A CN 201780002716A CN 110199270 A CN110199270 A CN 110199270A
Authority
CN
China
Prior art keywords
memory
memory node
address
management server
mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780002716.7A
Other languages
English (en)
Other versions
CN110199270B (zh
Inventor
罗旦
刘玉
张巍
冒伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Publication of CN110199270A publication Critical patent/CN110199270A/zh
Application granted granted Critical
Publication of CN110199270B publication Critical patent/CN110199270B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G06F3/0679—Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0617—Improving the reliability of storage systems in relation to availability
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0644—Management of space entities, e.g. partitions, extents, pools
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0656—Data buffering arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0688—Non-volatile semiconductor memory arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/0284—Multiple user address space allocation, e.g. using different base addresses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1016—Performance improvement
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/20—Employing a main memory using a specific memory technology
    • G06F2212/202—Non-volatile memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7201—Logical to physical mapping or translation of blocks or pages
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7204—Capacity control, e.g. partitioning, end-of-life degradation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7207—Details relating to flash memory management management of metadata or control data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/72—Details relating to flash memory management
    • G06F2212/7208—Multiple device management, e.g. distributing data over multiple flash devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本方案公开了一种存储***存储设备的管理方法，客户端可以根据获取访问请求指向的NVMe存储设备的队列的起始地址以及访问请求指向的NVMe存储设备的逻辑地址，向NVMe存储设备所在的存储节点发送远程直接内存访问命令，从而充分发挥了NVMe存储设备的性能，提高了存储***的写性能。

Description

PCT国内申请，说明书已公开。

Claims (38)

  1. PCT国内申请，权利要求书已公开。
CN201780002716.7A 2017-12-26 2017-12-26 存储***中存储设备的管理方法及装置 Active CN110199270B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/118642 WO2019127017A1 (zh) 2017-12-26 2017-12-26 存储***中存储设备的管理方法及装置

Publications (2)

Publication Number Publication Date
CN110199270A true CN110199270A (zh) 2019-09-03
CN110199270B CN110199270B (zh) 2022-09-02

Family

ID=67062816

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780002716.7A Active CN110199270B (zh) 2017-12-26 2017-12-26 存储***中存储设备的管理方法及装置

Country Status (4)

Country Link
US (1) US11321021B2 (zh)
EP (1) EP3531266A4 (zh)
CN (1) CN110199270B (zh)
WO (1) WO2019127017A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023143103A1 (zh) * 2022-01-30 2023-08-03 华为技术有限公司 报文处理方法、网关设备及存储***
WO2023207492A1 (zh) * 2022-04-29 2023-11-02 济南浪潮数据技术有限公司 一种数据处理方法、装置、设备及可读存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113568562A (zh) * 2020-04-28 2021-10-29 华为技术有限公司 一种存储***、内存管理方法和管理节点
TWI769080B (zh) * 2021-09-17 2022-06-21 瑞昱半導體股份有限公司 用於同步動態隨機存取記憶體之控制模組及其控制方法

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130198312A1 (en) * 2012-01-17 2013-08-01 Eliezer Tamir Techniques for Remote Client Access to a Storage Medium Coupled with a Server
CN103902230A (zh) * 2012-12-27 2014-07-02 ***通信集团公司 一种数据处理方法、设备和***
CN104111907A (zh) * 2014-06-27 2014-10-22 华为技术有限公司 一种访问NVMe存储设备的方法和NVMe存储设备
US9164702B1 (en) * 2012-09-07 2015-10-20 Google Inc. Single-sided distributed cache system
CN105556930A (zh) * 2013-06-26 2016-05-04 科内克斯实验室公司 针对远程存储器访问的nvm express控制器
CN105653406A (zh) * 2015-12-31 2016-06-08 华为技术有限公司 一种管理分布式存储***的方法及分布式存储***
US20170149920A1 (en) * 2015-07-08 2017-05-25 Samsung Electronics Co., Ltd. Method to implement rdma nvme device
US20170177541A1 (en) * 2015-12-21 2017-06-22 Microsemi Storage Solutions (U.S.), Inc. Apparatus and method for transferring data and commands in a memory management environment
CN107111596A (zh) * 2015-12-14 2017-08-29 华为技术有限公司 一种集群中锁管理的方法、锁服务器及客户端

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6199112B1 (en) * 1998-09-23 2001-03-06 Crossroads Systems, Inc. System and method for resolving fibre channel device addresses on a network using the device's fully qualified domain name
US9658782B2 (en) 2014-07-30 2017-05-23 Excelero Storage Ltd. Scalable data using RDMA and MMIO
US10133668B2 (en) * 2016-09-27 2018-11-20 Intel Corporation Technologies for providing cross data storage device communications
CN110235098B (zh) 2017-12-26 2021-06-22 华为技术有限公司 存储***访问方法及装置

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130198312A1 (en) * 2012-01-17 2013-08-01 Eliezer Tamir Techniques for Remote Client Access to a Storage Medium Coupled with a Server
US9164702B1 (en) * 2012-09-07 2015-10-20 Google Inc. Single-sided distributed cache system
CN103902230A (zh) * 2012-12-27 2014-07-02 ***通信集团公司 一种数据处理方法、设备和***
CN105556930A (zh) * 2013-06-26 2016-05-04 科内克斯实验室公司 针对远程存储器访问的nvm express控制器
CN104111907A (zh) * 2014-06-27 2014-10-22 华为技术有限公司 一种访问NVMe存储设备的方法和NVMe存储设备
US20170149920A1 (en) * 2015-07-08 2017-05-25 Samsung Electronics Co., Ltd. Method to implement rdma nvme device
CN107111596A (zh) * 2015-12-14 2017-08-29 华为技术有限公司 一种集群中锁管理的方法、锁服务器及客户端
US20170177541A1 (en) * 2015-12-21 2017-06-22 Microsemi Storage Solutions (U.S.), Inc. Apparatus and method for transferring data and commands in a memory management environment
CN105653406A (zh) * 2015-12-31 2016-06-08 华为技术有限公司 一种管理分布式存储***的方法及分布式存储***

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
KAM ESHGHI: "强大生态***让NVMe释放出PCIe SSD全部性能", 《中国电子商情(基础电子)》 *
ZVIKA GUZ等: "NVMe-over-fabrics performance characterization and the path to low-overhead flash disaggregation", 《PROCEEDINGS OF THE 10TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE》 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023143103A1 (zh) * 2022-01-30 2023-08-03 华为技术有限公司 报文处理方法、网关设备及存储***
WO2023207492A1 (zh) * 2022-04-29 2023-11-02 济南浪潮数据技术有限公司 一种数据处理方法、装置、设备及可读存储介质

Also Published As

Publication number Publication date
WO2019127017A1 (zh) 2019-07-04
EP3531266A1 (en) 2019-08-28
CN110199270B (zh) 2022-09-02
US20200320014A1 (en) 2020-10-08
EP3531266A4 (en) 2019-08-28
US11321021B2 (en) 2022-05-03

Similar Documents

Publication Publication Date Title
CN110235098A (zh) 存储***访问方法及装置
CN110199512A (zh) 存储***中存储设备的管理方法及装置
CN102971732B (zh) 键/值存储器的集成分级查询处理的***结构
CN110199270A (zh) 存储***中存储设备的管理方法及装置
KR20190117001A (ko) 유지관리 동작들을 위한 병합 트리 수정들
US11003719B2 (en) Method and apparatus for accessing a storage disk
JP5967673B2 (ja) データメンテナンス用の方法
US20120197958A1 (en) Parallel Serialization of Request Processing
CN103701957A (zh) Dns递归方法及其***
US8370943B1 (en) Load balancing of scan requests to all antivirus servers in a cluster
EP3771169A1 (en) Message processing method and related device
CN103312624A (zh) 一种消息队列服务***和方法
WO2020199760A1 (zh) 数据存储方法、存储器和服务器
US8402198B1 (en) Mapping engine for a storage device
CN109302448A (zh) 一种数据处理方法及装置
US20220327102A1 (en) Data index management method and apparatus in storage system
CN107992270B (zh) 一种多控存储***全局共享缓存的方法及装置
JP6378044B2 (ja) データ処理装置、データ処理方法およびプログラム
US20130110904A1 (en) Method and apparatus to forward shared file stored in block storages
WO2019201091A1 (zh) 一种数据处理方法、设备和计算机可读存储介质
JP2017123040A (ja) サーバー装置、分散ファイルシステム、分散ファイルシステム制御方法、および、プログラム
CN116389322B (zh) 流量数据处理方法、装置、计算机设备和存储介质
US9069676B2 (en) Mapping engine for a storage device
CN116303685A (zh) 一种分布式数据查询方法及***

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant