EP2770446A4 - Datenverarbeitungsverfahren und vorrichtung - Google Patents

Datenverarbeitungsverfahren und vorrichtung

Info

Publication number
EP2770446A4
EP2770446A4 EP12878641.5A EP12878641A EP2770446A4 EP 2770446 A4 EP2770446 A4 EP 2770446A4 EP 12878641 A EP12878641 A EP 12878641A EP 2770446 A4 EP2770446 A4 EP 2770446A4
Authority
EP
European Patent Office
Prior art keywords
data processing
processing method
data
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP12878641.5A
Other languages
English (en)
French (fr)
Other versions
EP2770446A1 (de
Inventor
Yanhui Zhong
Zongquan Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to EP18161386.0A priority Critical patent/EP3425493A1/de
Publication of EP2770446A1 publication Critical patent/EP2770446A1/de
Publication of EP2770446A4 publication Critical patent/EP2770446A4/de
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/064—Management of blocks
    • G06F3/0641—De-duplication techniques
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0866—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches for peripheral storage systems, e.g. disk cache
    • G06F12/0868—Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02—Addressing or allocation; Relocation
    • G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0875—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches with dedicated cache, e.g. instruction or stack
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0608—Saving storage space on storage systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/061—Improving I/O performance
    • G06F3/0611—Improving I/O performance in relation to response time
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614—Improving the reliability of storage systems
    • G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/0671—In-line storage system
    • G06F3/0673—Single storage device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2212/00—Indexing scheme relating to accessing, addressing or allocation within memory systems or architectures
    • G06F2212/45—Caching of specific data in cache memory
    • G06F2212/452—Instruction code

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
EP12878641.5A 2012-12-28 2012-12-28 Datenverarbeitungsverfahren und vorrichtung Ceased EP2770446A4 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18161386.0A EP3425493A1 (de) 2012-12-28 2012-12-28 Datenverarbeitungsverfahren und -vorrichtung

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/087879 WO2014101130A1 (zh) 2012-12-28 2012-12-28 数据处理方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP18161386.0A Division EP3425493A1 (de) 2012-12-28 2012-12-28 Datenverarbeitungsverfahren und -vorrichtung

Publications (2)

Publication Number Publication Date
EP2770446A1 EP2770446A1 (de) 2014-08-27
EP2770446A4 true EP2770446A4 (de) 2015-01-14

Family

ID=49866743

Family Applications (2)

Application Number Title Priority Date Filing Date
EP18161386.0A Ceased EP3425493A1 (de) 2012-12-28 2012-12-28 Datenverarbeitungsverfahren und -vorrichtung
EP12878641.5A Ceased EP2770446A4 (de) 2012-12-28 2012-12-28 Datenverarbeitungsverfahren und vorrichtung

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP18161386.0A Ceased EP3425493A1 (de) 2012-12-28 2012-12-28 Datenverarbeitungsverfahren und -vorrichtung

Country Status (4)

Country Link
US (2) US8760956B1 (de)
EP (2) EP3425493A1 (de)
CN (1) CN103502957B (de)
WO (1) WO2014101130A1 (de)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015107653A1 (ja) * 2014-01-16 2015-07-23 富士通株式会社 通信装置、通信方法、および、通信プログラム
CN104239518B (zh) 2014-09-17 2017-09-29 华为技术有限公司 重复数据删除方法和装置
CN104750432B (zh) * 2015-03-16 2017-11-24 华为技术有限公司 一种数据存储方法及装置
JP7000422B2 (ja) 2016-06-09 2022-01-19 アンフォルマティック・ホリステック・インコーポレーテッド データストレージシステムおよびデータストレージを実行するための方法
CN106293525B (zh) * 2016-08-05 2019-06-28 上海交通大学 一种提高缓存使用效率的方法及***
US10120688B2 (en) * 2016-11-15 2018-11-06 Andes Technology Corporation Data processing system and method for executing block call and block return instructions
CN107817950B (zh) * 2017-10-31 2021-07-23 新华三技术有限公司 一种数据处理方法及装置
CN108427538B (zh) * 2018-03-15 2021-06-04 深信服科技股份有限公司 全闪存阵列的存储数据压缩方法、装置、及可读存储介质
CN108427539B (zh) * 2018-03-15 2021-06-04 深信服科技股份有限公司 缓存设备数据的离线去重压缩方法、装置及可读存储介质
CN110910939B (zh) * 2018-09-18 2022-05-31 北京兆易创新科技股份有限公司 存储单元的阈值调整方法、装置、存储设备和存储介质
US11392547B2 (en) 2020-04-09 2022-07-19 Micron Technology, Inc. Using prefix-delete operations for data containers
CN112506877B (zh) * 2020-12-03 2024-04-19 深圳市木浪云科技有限公司 基于重删域的数据重删方法、装置、***及存储设备
CN112463077B (zh) * 2020-12-16 2021-11-12 北京云宽志业网络技术有限公司 数据块处理方法、装置、设备及存储介质
US11687266B2 (en) * 2021-05-26 2023-06-27 Red Hat, Inc. Managing deduplication operations based on a likelihood of duplicability
CN114884974B (zh) * 2022-04-08 2024-02-23 海南车智易通信息技术有限公司 一种数据复用方法、***及计算设备
CN114841679B (zh) * 2022-06-29 2022-10-18 陕西省君凯电子科技有限公司 车辆行驶数据的智能管理***

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2063351A2 (de) * 2007-11-20 2009-05-27 Hitachi, Ltd. Verfahren und Vorrichtung zur Deduplikation in einem Speichersystem

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6785684B2 (en) * 2001-03-27 2004-08-31 International Business Machines Corporation Apparatus and method for determining clustering factor in a database using block level sampling
AU2003207856A1 (en) * 2002-02-04 2003-09-02 Cataphora, Inc A method and apparatus to visually present discussions for data mining purposes
US7260098B2 (en) 2002-09-26 2007-08-21 Lucent Technologies Inc. Cyclic buffering of a datastream
US7184577B2 (en) * 2003-03-14 2007-02-27 Intelitrac, Inc. Image indexing search system and method
US7647331B2 (en) * 2006-03-28 2010-01-12 Microsoft Corporation Detecting duplicate images using hash code grouping
EP1852786A1 (de) 2006-05-02 2007-11-07 Research In Motion Limited System und Verfahren zur Zerlegung von mobilem Inhalt
CN100451993C (zh) 2006-12-21 2009-01-14 威盛电子股份有限公司 多来源数据处理方法
CN101271429A (zh) 2007-03-23 2008-09-24 华为技术有限公司 一种数据存储方法及装置
US8166012B2 (en) 2007-04-11 2012-04-24 Emc Corporation Cluster storage using subsegmenting
US8321579B2 (en) * 2007-07-26 2012-11-27 International Business Machines Corporation System and method for analyzing streams and counting stream items on multi-core processors
US7962706B2 (en) * 2008-02-14 2011-06-14 Quantum Corporation Methods and systems for improving read performance in data de-duplication storage
US20100153375A1 (en) * 2008-12-16 2010-06-17 Foundation For Research And Technology - Hellas (Institute Of Computer Science --Forth-Ics) System and method for classifying and storing related forms of data
CN101882141A (zh) * 2009-05-08 2010-11-10 北京众志和达信息技术有限公司 一种实现重复数据数据删除的方法和***
US8578120B2 (en) * 2009-05-22 2013-11-05 Commvault Systems, Inc. Block-level single instancing
CN101576932B (zh) * 2009-06-16 2012-07-04 阿里巴巴集团控股有限公司 近重复图片的计算机查找方法和装置
US8407190B2 (en) * 2009-06-30 2013-03-26 Commvault Systems, Inc. Performing data storage operations with a cloud environment, including containerized deduplication, data pruning, and data transfer
US8488883B2 (en) * 2009-12-28 2013-07-16 Picscout (Israel) Ltd. Robust and efficient image identification
US8244992B2 (en) * 2010-05-24 2012-08-14 Spackman Stephen P Policy based data retrieval performance for deduplicated data
US8542869B2 (en) * 2010-06-02 2013-09-24 Dolby Laboratories Licensing Corporation Projection based hashing that balances robustness and sensitivity of media fingerprints
US8392376B2 (en) * 2010-09-03 2013-03-05 Symantec Corporation System and method for scalable reference management in a deduplication based storage system
CN102456059A (zh) * 2010-10-21 2012-05-16 英业达股份有限公司 重复数据删除的处理***
US8495087B2 (en) * 2011-02-22 2013-07-23 International Business Machines Corporation Aggregate contribution of iceberg queries
CN102222085B (zh) * 2011-05-17 2012-08-22 华中科技大学 一种基于相似性与局部性结合的重复数据删除方法
CN102833298A (zh) * 2011-06-17 2012-12-19 英业达集团(天津)电子技术有限公司 分布式的重复数据删除***及其处理方法
US9317481B2 (en) * 2011-12-31 2016-04-19 Institute Of Automation, Chinese Academy Of Sciences Data access method and device for parallel FFT computation
US8745013B2 (en) * 2012-05-19 2014-06-03 International Business Machines Corporation Computer interface system

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2063351A2 (de) * 2007-11-20 2009-05-27 Hitachi, Ltd. Verfahren und Vorrichtung zur Deduplikation in einem Speichersystem

Also Published As

Publication number Publication date
EP2770446A1 (de) 2014-08-27
CN103502957B (zh) 2016-07-06
WO2014101130A1 (zh) 2014-07-03
CN103502957A (zh) 2014-01-08
US10877680B2 (en) 2020-12-29
US20140189237A1 (en) 2014-07-03
US20140258625A1 (en) 2014-09-11
US8760956B1 (en) 2014-06-24
EP3425493A1 (de) 2019-01-09

Similar Documents

Publication Publication Date Title
EP2922227A4 (de) Datenverarbeitungsverfahren und vorrichtung
EP2717476A4 (de) Datenverarbeitungsverfahren und datenverarbeitungsvorrichtung
ZA201500534B (en) Data processing apparatus and data processing method
EP2854099A4 (de) Informationsverarbeitungsvorrichtung und informationsverarbeitungsverfahren
EP2688210A4 (de) Datenverarbeitungsvorrichtung und datenverarbeitungsverfahren
EP2675068A4 (de) Datenverarbeitungsvorrichtung und datenverarbeitungsverfahren
EP3043497A4 (de) Datenverarbeitungsverfahren und -vorrichtung
EP2680446A4 (de) Datenverarbeitungsvorrichtung und datenverarbeitungsverfahren
HUE050160T2 (hu) Adatfeldolgozó berendezés, adatfeldolgozó eljárás és program
EP2731332A4 (de) Informationsverarbeitungsvorrichtung und informationsverarbeitungsverfahren
EP2717186A4 (de) Informationsverarbeitungsvorrichtung und informationsverarbeitungsverfahren
EP2770446A4 (de) Datenverarbeitungsverfahren und vorrichtung
EP2892021A4 (de) Informationsverarbeitungsvorrichtung und informationsverarbeitungsverfahren
EP2881888A4 (de) Informationsverarbeitungsverfahren und -vorrichtung
EP2915328A4 (de) Vorrichtung zur informationsverarbeitung und verfahren zur informationsverarbeitung
EP2821925A4 (de) Verfahren und vorrichtung für verteilte datenverarbeitung
SG11201406379RA (en) Data processing device and data processing method
EP2905706A4 (de) Datenverarbeitungsvorrichtung und datenverarbeitungsverfahren
EP3007494A4 (de) Datenverarbeitungsverfahren und -vorrichtung
SG11201503850PA (en) Information processing device and information processing method
EP3073393A4 (de) Datenverarbeitungsverfahren und -vorrichtung
EP2836914A4 (de) Informationsverarbeitungsvorrichtung und informationsverarbeitungsverfahren
EP2908251A4 (de) Verfahren und vorrichtung zur datenzellenverarbeitung
EP2958240A4 (de) Datenverarbeitungsvorrichtung und datenverarbeitungsverfahren
EP2924587A4 (de) Datenverarbeitungsverfahren und -vorrichtung

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20131217

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

A4 Supplementary search report drawn up and despatched

Effective date: 20141212

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/06 20060101ALI20141208BHEP

Ipc: G06F 17/30 20060101AFI20141208BHEP

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20160525

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20171219