CN104933010B - 一种重复数据删除方法和装置 - Google Patents
一种重复数据删除方法和装置 Download PDFInfo
- Publication number
- CN104933010B CN104933010B CN201410101736.8A CN201410101736A CN104933010B CN 104933010 B CN104933010 B CN 104933010B CN 201410101736 A CN201410101736 A CN 201410101736A CN 104933010 B CN104933010 B CN 104933010B
- Authority
- CN
- China
- Prior art keywords
- data
- data flow
- block
- flow
- duplication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 230000015654 memory Effects 0.000 claims abstract description 51
- 238000006062 fragmentation reaction Methods 0.000 claims description 57
- 238000013467 fragmentation Methods 0.000 claims description 56
- 239000012634 fragment Substances 0.000 claims description 49
- 230000003139 buffering effect Effects 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000012217 deletion Methods 0.000 claims 1
- 230000037430 deletion Effects 0.000 claims 1
- 230000006870 function Effects 0.000 abstract description 16
- 238000003860 storage Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 241001269238 Data Species 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000017260 vegetative to reproductive phase transition of meristem Effects 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (7)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410101736.8A CN104933010B (zh) | 2014-03-18 | 2014-03-18 | 一种重复数据删除方法和装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410101736.8A CN104933010B (zh) | 2014-03-18 | 2014-03-18 | 一种重复数据删除方法和装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN104933010A CN104933010A (zh) | 2015-09-23 |
CN104933010B true CN104933010B (zh) | 2019-02-19 |
Family
ID=54120179
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410101736.8A Active CN104933010B (zh) | 2014-03-18 | 2014-03-18 | 一种重复数据删除方法和装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN104933010B (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107122130B (zh) * | 2017-04-13 | 2020-04-21 | 杭州宏杉科技股份有限公司 | 一种数据重删方法及装置 |
CN113055127B (zh) * | 2021-03-17 | 2022-03-08 | 网宿科技股份有限公司 | 数据报文去重与传输方法、电子设备及存储介质 |
CN113064869B (zh) * | 2021-03-23 | 2023-06-13 | 网易(杭州)网络有限公司 | 日志处理方法、装置、发送端、接收端设备及存储介质 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102722583A (zh) * | 2012-06-07 | 2012-10-10 | 无锡众志和达存储技术有限公司 | 重复数据删除硬件加速装置和方法 |
CN103309975A (zh) * | 2013-06-09 | 2013-09-18 | 华为技术有限公司 | 一种重复数据删除方法和设备 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103514250B (zh) * | 2013-06-20 | 2017-04-26 | 易乐天 | 一种全局重复数据删除的方法和***及存储装置 |
-
2014
- 2014-03-18 CN CN201410101736.8A patent/CN104933010B/zh active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102722583A (zh) * | 2012-06-07 | 2012-10-10 | 无锡众志和达存储技术有限公司 | 重复数据删除硬件加速装置和方法 |
CN103309975A (zh) * | 2013-06-09 | 2013-09-18 | 华为技术有限公司 | 一种重复数据删除方法和设备 |
Also Published As
Publication number | Publication date |
---|---|
CN104933010A (zh) | 2015-09-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104040516B (zh) | 用于数据去重的方法、设备和*** | |
CN108089814B (zh) | 一种数据存储方法及装置 | |
US9250946B2 (en) | Efficient provisioning of cloned virtual machine images using deduplication metadata | |
TWI559706B (zh) | 網路處理器中的封包調度 | |
US10659532B2 (en) | Technologies for reducing latency variation of stored data object requests | |
CN104636286B (zh) | 用于数据访问的方法和设备 | |
CN104933010B (zh) | 一种重复数据删除方法和装置 | |
EP3316150A1 (en) | Method and apparatus for file compaction in key-value storage system | |
WO2020119029A1 (zh) | 分布式任务调度方法、***及存储介质 | |
JP2017538987A5 (zh) | ||
CN104571956A (zh) | 一种数据写入方法及拆分装置 | |
CN105511964B (zh) | I/o请求的处理方法和装置 | |
CN110099112B (zh) | 基于点对点网络的数据存储方法、装置、介质及终端设备 | |
CN113778320A (zh) | 网卡以及网卡处理数据的方法 | |
CN110474845A (zh) | 流表项淘汰方法及相关装置 | |
US20160334996A1 (en) | In-flash immutable object processing | |
CN104571957B (zh) | 一种数据读取方法及组装装置 | |
CN113176992A (zh) | A/b实验分流方法、装置、设备和计算机可读存储介质 | |
CN104503868B (zh) | 数据同步方法、装置以及*** | |
CN108062235A (zh) | 数据处理方法及装置 | |
CN111625180B (zh) | 数据写入方法及装置、存储介质 | |
CN112905542A (zh) | 一种文件处理方法、装置、服务器、设备及存储介质 | |
CN114637574A (zh) | 基于半虚拟化设备的数据处理方法、装置和*** | |
US10120570B2 (en) | Temporary spill area for volume defragmentation | |
CN108563698B (zh) | 一种HBase表的Region合并方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20201102 Address after: 625, room 269, Connaught platinum Plaza, No. 518101, Qianjin Road, Xin'an street, Shenzhen, Guangdong, Baoan District Patentee after: SHENZHEN SHANGGE INTELLECTUAL PROPERTY SERVICE Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
TR01 | Transfer of patent right |
Effective date of registration: 20201201 Address after: 213000 No. 11 Qingyang North Road, Tianning District, Changzhou, Jiangsu Patentee after: Changzhou Hong quantity Electronic Technology Co.,Ltd. Address before: 625, room 269, Connaught platinum Plaza, No. 518101, Qianjin Road, Xin'an street, Shenzhen, Guangdong, Baoan District Patentee before: SHENZHEN SHANGGE INTELLECTUAL PROPERTY SERVICE Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220829 Address after: Tianning District Hehai road 213000 Jiangsu city of Changzhou province No. 9 Patentee after: Changzhou Tianning Communication Technology Industrial Park Co.,Ltd. Address before: 213000 No. 11 Qingyang North Road, Tianning District, Changzhou City, Jiangsu Province Patentee before: Changzhou Hong quantity Electronic Technology Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
TR01 | Transfer of patent right |
Effective date of registration: 20230105 Address after: Tianning District Hehai road 213000 Jiangsu city of Changzhou province No. 9 Patentee after: Changzhou Hengtang Technology Industry Co.,Ltd. Address before: Tianning District Hehai road 213000 Jiangsu city of Changzhou province No. 9 Patentee before: Changzhou Tianning Communication Technology Industrial Park Co.,Ltd. |
|
TR01 | Transfer of patent right |