BR112017020736B8 - método de verificação de dados e sistema de armazenamento - Google Patents

método de verificação de dados e sistema de armazenamento

Info

Publication number
BR112017020736B8
BR112017020736B8 BR112017020736A BR112017020736A BR112017020736B8 BR 112017020736 B8 BR112017020736 B8 BR 112017020736B8 BR 112017020736 A BR112017020736 A BR 112017020736A BR 112017020736 A BR112017020736 A BR 112017020736A BR 112017020736 B8 BR112017020736 B8 BR 112017020736B8
Authority
BR
Brazil
Prior art keywords
data
write requests
node
data write
verification
Prior art date
Application number
BR112017020736A
Other languages
English (en)
Other versions
BR112017020736B1 (pt
BR112017020736A2 (pt
Inventor
Wei Mingchang
Original Assignee
Huawei Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Tech Co Ltd filed Critical Huawei Tech Co Ltd
Publication of BR112017020736A2 publication Critical patent/BR112017020736A2/pt
Publication of BR112017020736B1 publication Critical patent/BR112017020736B1/pt
Publication of BR112017020736B8 publication Critical patent/BR112017020736B8/pt

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/08—Error detection or correction by redundancy in data representation, e.g. by using checking codes
    • G06F11/10—Adding special bits or symbols to the coded information, e.g. parity check, casting out 9's or 11's
    • G06F11/1076—Parity data used in redundant arrays of independent storages, e.g. in RAID systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14—Error detection or correction of the data by redundancy in operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
    • G06F12/023—Free address space management
    • G06F12/0253—Garbage collection, i.e. reclamation of unreferenced memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
    • G06F3/0659—Command handling arrangements, e.g. command buffers, queues, command scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0688—Non-volatile semiconductor memory arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0683—Plurality of storage devices
    • G06F3/0689—Disk arrays, e.g. RAID, JBOD
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1016—Performance improvement
    • G06F2212/1024—Latency reduction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/10—Providing a specific technical effect
    • G06F2212/1032—Reliability improvement, data loss prevention, degraded operation etc
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/15—Use in a specific computing environment
    • G06F2212/154—Networked environment
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/25—Using a specific main memory architecture
    • G06F2212/254—Distributed memory
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2213/00—Indexing scheme relating to interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F2213/38—Universal adapter
    • G06F2213/3854—Control is performed at the peripheral side

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Quality & Reliability (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Memory System (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Techniques For Improving Reliability Of Storages (AREA)
  • Detection And Correction Of Errors (AREA)

Abstract

método de verificação de dados e sistema de armazenamento. um sistema de armazenamento inclui um hospedeiro (11), um nó de verificação, e múltiplos nós de dados. 0 hospedeiro é configurado para: agrupar (s102) múltiplas solicitações de escrita de dados em múltiplos conjuntos de solicitações de escrita de dados de acordo com os identificadores de nó de dados incluídos nas solicitações de escrita de dados, onde cada conjunto de solicitações de escrita de dados inclui múltiplas solicitações de escrita de dados tendo um mesmo identificador nó de dados; e quando um tamanho de todas as solicitações de escrita de dados em cada de uma quantidade especificada de conjuntos de solicitações de escrita de dados atinge uma quantidade de dados predefinida, calcular (s103) dados de verificação da quantidade especificada de conjuntos de solicitações de escrita de dados. 0 hospedeiro é ainda configurado para: enviar (5104) cada conjunto de solicitações de escrita de dados para um nó de dados indicado por um identificador, e enviar (s105) os dados de verificação para o nó de verificação. portanto, além de assegurar a confiabilidade de dados, dados de um mesmo tipo podem ser armazenados em um mesmo nó de armazenamento e os dados podem ser lidos a partir de apenas um nó de armazenamento, melhorando assim a eficiência de leitura de dados.
BR112017020736A 2016-11-25 2016-11-25 método de verificação de dados e sistema de armazenamento BR112017020736B8 (pt)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/107355 WO2018094704A1 (zh) 2016-11-25 2016-11-25 一种数据校验的方法及存储***

Publications (3)

Publication Number Publication Date
BR112017020736A2 BR112017020736A2 (pt) 2018-07-17
BR112017020736B1 BR112017020736B1 (pt) 2021-01-19
BR112017020736B8 true BR112017020736B8 (pt) 2021-08-17

Family

ID=62188856

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112017020736A BR112017020736B8 (pt) 2016-11-25 2016-11-25 método de verificação de dados e sistema de armazenamento

Country Status (9)

Country Link
US (1) US10303374B2 (pt)
EP (1) EP3352071B1 (pt)
JP (1) JP6526235B2 (pt)
CN (1) CN109074227B (pt)
AU (1) AU2016397189B2 (pt)
BR (1) BR112017020736B8 (pt)
CA (1) CA2978927C (pt)
SG (1) SG11201707304RA (pt)
WO (1) WO2018094704A1 (pt)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111949434B (zh) * 2019-05-17 2022-06-14 华为技术有限公司 磁盘冗余阵列raid管理方法、raid控制器和***
JP7490394B2 (ja) 2020-03-06 2024-05-27 株式会社日立製作所 情報共有支援方法、及び情報共有支援システム
US20210357366A1 (en) * 2020-05-12 2021-11-18 Hewlett Packard Enterprise Development Lp File system metadata
CN112365124A (zh) * 2020-10-16 2021-02-12 重庆恢恢信息技术有限公司 智慧工地中施工材料快速分配工作方法
CN114697349A (zh) * 2020-12-28 2022-07-01 华为技术有限公司 使用中间设备对数据处理的方法、计算机***、及中间设备
CN113419684B (zh) * 2021-07-09 2023-02-24 深圳大普微电子科技有限公司 一种数据处理方法、装置、设备及可读存储介质
CN116166179A (zh) * 2021-11-25 2023-05-26 华为技术有限公司 数据存储***、智能网卡及计算节点
CN115933995B (zh) * 2023-01-09 2023-05-09 苏州浪潮智能科技有限公司 固态硬盘中数据写入方法、装置、电子设备及可读介质

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3713788B2 (ja) * 1996-02-28 2005-11-09 株式会社日立製作所 記憶装置および記憶装置システム
US6742081B2 (en) * 2001-04-30 2004-05-25 Sun Microsystems, Inc. Data storage array employing block checksums and dynamic striping
JP4383321B2 (ja) * 2004-11-09 2009-12-16 富士通株式会社 記憶制御装置および外部記憶装置
US8332608B2 (en) * 2008-09-19 2012-12-11 Mediatek Inc. Method of enhancing command executing performance of disc drive
JP5317827B2 (ja) * 2009-05-19 2013-10-16 日本電信電話株式会社 分散データ管理装置及び方法及びプログラム
CN102546755A (zh) * 2011-12-12 2012-07-04 华中科技大学 云存储***的数据存储方法
CN102968498B (zh) * 2012-12-05 2016-08-10 华为技术有限公司 数据处理方法及装置
JP6005533B2 (ja) * 2013-01-17 2016-10-12 株式会社東芝 記憶装置および記憶方法
JP2014203233A (ja) * 2013-04-04 2014-10-27 株式会社日立製作所 ストレージシステム及びストレージシステムにおいてデータを更新する方法
CN104216664B (zh) * 2013-06-26 2017-06-09 华为技术有限公司 网络卷创建方法、数据存储方法、存储设备和存储***
CN103647797A (zh) * 2013-11-15 2014-03-19 北京邮电大学 一种分布式文件***及其数据访问方法
CN103699494B (zh) 2013-12-06 2017-03-15 北京奇虎科技有限公司 一种数据存储方法、数据存储设备和分布式存储***
JP6106901B2 (ja) * 2013-12-31 2017-04-05 ▲ホア▼▲ウェイ▼技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． 分散ファイルストレージシステムにおけるデータ処理の方法およびデバイス
CN103761058B (zh) * 2014-01-23 2016-08-17 天津中科蓝鲸信息技术有限公司 Raid1和raid4混合结构网络存储***及方法
JP2016184372A (ja) 2015-03-27 2016-10-20 富士通株式会社 ストレージシステム，情報処理装置，パリティ生成プログラム及びパリティ生成方法
CN104932953B (zh) * 2015-06-04 2017-11-21 华为技术有限公司 一种数据分发方法、数据存储方法、相关装置以及***
CN105404469B (zh) * 2015-10-22 2018-11-13 浙江宇视科技有限公司 一种视频数据的存储方法和***
CN105930103B (zh) * 2016-05-10 2019-04-16 南京大学 一种分布式存储ceph的纠删码覆盖写方法

Also Published As

Publication number Publication date
BR112017020736B1 (pt) 2021-01-19
CA2978927A1 (en) 2018-05-25
AU2016397189B2 (en) 2019-07-25
EP3352071A1 (en) 2018-07-25
EP3352071A4 (en) 2018-07-25
BR112017020736A2 (pt) 2018-07-17
WO2018094704A1 (zh) 2018-05-31
AU2016397189A1 (en) 2018-06-14
US10303374B2 (en) 2019-05-28
SG11201707304RA (en) 2018-06-28
CN109074227A (zh) 2018-12-21
EP3352071B1 (en) 2019-08-28
US20180364920A1 (en) 2018-12-20
JP6526235B2 (ja) 2019-06-05
CA2978927C (en) 2019-09-17
CN109074227B (zh) 2020-06-16
JP2019504369A (ja) 2019-02-14

Similar Documents

Publication Publication Date Title
BR112017020736B8 (pt) método de verificação de dados e sistema de armazenamento
BR112015030590A2 (pt) sistema e método para mapear uma topologia de nível de serviço para uma topologia lógica de plano de dados específica quanto ao serviço
BR112015023369A2 (pt) método e sistema
BR112015029848A8 (pt) dispositivos de recepção e de transmissão, métodos para recepção de um dispositivo de recepção e para transmissão de um dispositivo de transmissão, e, meio de armazenamento legível por computador
BR112017006639A2 (pt) método, aparelho e sistema de gravação de dados
MX2019005034A (es) Sistemas y metodos para crear un registro universal.
BR112018000070A2 (pt) fornecimento, organização e gerenciamento de registros de histórico de localização de um dispositivo móvel
BR112015016352A2 (pt) sistema e método para motores de consulta distribuída a bancos de dados
BR112017017424A2 (pt) meio de armazenamento legível por computador não transitório configurado para armazenar instruções e processo implementado por computador
EA201291023A1 (ru) Распределенное хранение данных
BR122018006762B8 (pt) Método de armazenamento de dados, método de recuperação de dados, aparelho relacionado e sistema
BR112019012915A8 (pt) Geração de ontologia automática
BR112015029306A2 (pt) fragmentação de banco de dados com camada de atualização
BR112016007142A2 (pt) recuperação de falha utilizando memória não volátil
BR112015031703A8 (pt) meio de armazenamento legível por computador, método para proporcionar terminais de lançamento de aplicação a partir de múltiplos centros de dados tendo diferentes conjuntos de locação e sistema
BR112015010723A2 (pt) seleção dinâmica de camadas de armazenamento
BR112015023053A2 (pt) sistema para captura de conhecimento e descoberta
BR112013029296A8 (pt) Propagação de contador de referência
BR112016010291A8 (pt) sistema de computação para atender solicitações de uma pluralidade de clientes e método
BR112015028817A2 (pt) acesso de memória programática eficaz através de protocolos de acesso de arquivo de rede
BR112016022329A2 (pt) Método para processamento de defeito, aparelho relacionado, e computador
BR112016016656A2 (pt) Método de manuseio de falha de serviço de rede, sistema de gerenciamento de serviço e módulo de gerenciamento de sistema
BR112017001495A2 (pt) classificação de conteúdos externos em redes sociais online
PH12017500241A1 (en) File access method, device and storage system
BR112015018922A8 (pt) dispositivo, método e um ou mais meios de armazenamento não transitórios legíveis por computador para estimação de rotina

Legal Events

Date Code Title Description
B06F Objections, documents and/or translations needed after an examination request according [chapter 6.6 patent gazette]
B06U Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]
B09A Decision: intention to grant [chapter 9.1 patent gazette]
B16A Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]

Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 25/11/2016, OBSERVADAS AS CONDICOES LEGAIS.

B16C Correction of notification of the grant [chapter 16.3 patent gazette]

Free format text: REF. RPI 2611 DE 19/01/2021 QUANTO AO TITULO.