WO2009005758A3 - System and method for compression processing within a compression engine - Google Patents

System and method for compression processing within a compression engine Download PDF

Info

Publication number
WO2009005758A3
WO2009005758A3 PCT/US2008/008107 US2008008107W WO2009005758A3 WO 2009005758 A3 WO2009005758 A3 WO 2009005758A3 US 2008008107 W US2008008107 W US 2008008107W WO 2009005758 A3 WO2009005758 A3 WO 2009005758A3
Authority
WO
WIPO (PCT)
Prior art keywords
hash
compression
dictionary
distance values
logic
Prior art date
Application number
PCT/US2008/008107
Other languages
French (fr)
Other versions
WO2009005758A2 (en
Inventor
Robert William Laker
David T Hass
Kaushik Kuila
Original Assignee
Rmi Corp
Robert William Laker
David T Hass
Kaushik Kuila
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/824,501 external-priority patent/US7538695B2/en
Priority claimed from US11/849,166 external-priority patent/US7538696B2/en
Priority claimed from US12/031,524 external-priority patent/US9362948B2/en
Application filed by Rmi Corp, Robert William Laker, David T Hass, Kaushik Kuila filed Critical Rmi Corp
Publication of WO2009005758A2 publication Critical patent/WO2009005758A2/en
Publication of WO2009005758A3 publication Critical patent/WO2009005758A3/en

Links

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/3084—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method
    • H03M7/3086—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction using adaptive string matching, e.g. the Lempel-Ziv method employing a sliding window, e.g. LZ77
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
    • H03M7/46—Conversion to or from run-length codes, i.e. by representing the number of consecutive digits, or groups of digits, of the same kind by a code word and a digit indicative of that kind

Abstract

An apparatus to implement a deflate process In a compression engine. An embodiment of the apparatus Includes a hash table, a dictionary, comparison logic, and encoding logic. The hash table is configured to hash a plurality of characters of an input data stream to provide a hash address. The dictionary is configured to provide a plurality of distance values in parallel based on the hash address. The distance values are stored in the dictionary. The comparison logic is configured to identify a corresponding length for each matching distance value from the plurality of distance values. The encoding logic is configured to encode the longest length and the matching distance value as a portion of a LZ77 code stream.
PCT/US2008/008107 2007-06-29 2008-06-26 System and method for compression processing within a compression engine WO2009005758A2 (en)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US11/824,501 2007-06-29
US11/824,501 US7538695B2 (en) 2007-06-29 2007-06-29 System and method for deflate processing within a compression engine
US11/849,166 2007-08-31
US11/849,166 US7538696B2 (en) 2007-08-31 2007-08-31 System and method for Huffman decoding within a compression engine
US12/031,524 US9362948B2 (en) 2008-02-14 2008-02-14 System, method, and computer program product for saving and restoring a compression/decompression state
US12/031,524 2008-02-14

Publications (2)

Publication Number Publication Date
WO2009005758A2 WO2009005758A2 (en) 2009-01-08
WO2009005758A3 true WO2009005758A3 (en) 2009-04-02

Family

ID=40226723

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2008/008107 WO2009005758A2 (en) 2007-06-29 2008-06-26 System and method for compression processing within a compression engine

Country Status (1)

Country Link
WO (1) WO2009005758A2 (en)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8077064B2 (en) 2010-02-26 2011-12-13 Research In Motion Limited Method and device for buffer-based interleaved encoding of an input sequence
EP2362547B1 (en) * 2010-02-26 2017-10-11 BlackBerry Limited Encoding and decoding methods and devices using a secondary codeword indicator
US7990297B1 (en) 2010-02-26 2011-08-02 Research In Motion Limited Encoding and decoding methods and devices employing dual codesets
US8063801B2 (en) 2010-02-26 2011-11-22 Research In Motion Limited Encoding and decoding methods and devices using a secondary codeword indicator
EP2362546B1 (en) 2010-02-26 2017-07-26 BlackBerry Limited Method and device for buffer-based interleaved encoding of an input sequence
WO2012006738A1 (en) 2010-07-13 2012-01-19 Research In Motion Limited Methods and devices for data compression using context-based coding order
CA2798125C (en) 2010-07-28 2016-04-05 Research In Motion Limited Method and device for compression of binary sequences by grouping multiple symbols
US9489199B2 (en) 2012-12-28 2016-11-08 Intel Corporation Vector compare instructions for sliding window encoding
GB2513987B (en) * 2013-03-15 2016-01-06 Intel Corp Parallel apparatus for high-speed, highly compressed LZ77 tokenization and huffman encoding for deflate compression
CN104113344B (en) * 2013-04-16 2017-04-12 晨星半导体股份有限公司 Decompression circuit, correlated compression method, and correlated decompression method
US8947270B2 (en) 2013-06-29 2015-02-03 Intel Corporation Apparatus and method to accelerate compression and decompression operations
US9252807B2 (en) 2013-10-21 2016-02-02 Globalfoundries Inc. Efficient one-pass cache-aware compression
US9059731B2 (en) 2013-10-21 2015-06-16 International Business Machines Corporation Boosting decompression in the presence of reoccurring Huffman trees
US9509337B1 (en) * 2015-05-11 2016-11-29 Via Alliance Semiconductor Co., Ltd. Hardware data compressor using dynamic hash algorithm based on input block type
US10025956B2 (en) * 2015-12-18 2018-07-17 Intel Corporation Techniques to compress cryptographic metadata for memory encryption
CZ2016272A3 (en) * 2016-05-10 2017-07-07 CESNET, zájmové sdružení právnických osob A system for implementation of a dispersion table
CN106603677A (en) * 2016-12-21 2017-04-26 济南浪潮高新科技投资发展有限公司 Physical information system data compression transmission method using multi-core multi-thread parallelism
CN107592117B (en) * 2017-08-15 2019-09-24 深圳前海信息技术有限公司 Compression data block output method and device based on Deflate
US20190377804A1 (en) * 2018-06-06 2019-12-12 Yingquan Wu Data compression algorithm
CN110620637B (en) * 2019-09-26 2023-02-03 上海仪电（集团）有限公司中央研究院 Data decompression device and method based on FPGA
US11791838B2 (en) 2021-01-15 2023-10-17 Samsung Electronics Co., Ltd. Near-storage acceleration of dictionary decoding
US20230057492A1 (en) * 2021-08-19 2023-02-23 Intel Corporation Interleaving of variable bitrate streams for gpu implementations
CN113839679B (en) * 2021-08-31 2023-09-15 山东云海国创云计算装备产业创新中心有限公司 Huffman decoding system, method, equipment and computer readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5970177A (en) * 1995-06-07 1999-10-19 America Online, Inc. Data compression using selective encoding
US20010054131A1 (en) * 1999-01-29 2001-12-20 Alvarez Manuel J. System and method for perfoming scalable embedded parallel data compression
US20020063641A1 (en) * 2000-08-15 2002-05-30 Seagate Technology, Llc Dual mode data compression for operating code

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5970177A (en) * 1995-06-07 1999-10-19 America Online, Inc. Data compression using selective encoding
US20010054131A1 (en) * 1999-01-29 2001-12-20 Alvarez Manuel J. System and method for perfoming scalable embedded parallel data compression
US20020063641A1 (en) * 2000-08-15 2002-05-30 Seagate Technology, Llc Dual mode data compression for operating code

Also Published As

Publication number Publication date
WO2009005758A2 (en) 2009-01-08

Similar Documents

Publication Publication Date Title
WO2009005758A3 (en) System and method for compression processing within a compression engine
PH12019501881A1 (en) Method and apparatus for the efficient compression of genomic sequence reads
WO2007040362A8 (en) Method and apparatus for signal processing and encoding and decoding method, and apparatus therefor
WO2009061814A3 (en) Lossless data compression and real-time decompression
GB2466580A (en) Data processing apparatus and method of processing data
EA201070630A1 (en) DEVICE AND METHOD FOR PROCESSING DATA, AND ALSO CODING DEVICE AND METHOD OF CODING
EP4322161A3 (en) Device and method for execution of huffman coding
WO2010077658A3 (en) Fast parsing of variable-to-fixed-length codes
JP2009542092A5 (en)
TW201614962A (en) VLSI efficient Huffman encoding apparatus and method
IN2013MU02340A (en)
WO2009053940A3 (en) Method, computer program product, apparatus and device providing scalable structured high throughput ldpc decoding
AU2012333936B2 (en) Image coding method, image coding apparatus, image decoding method and image decoding apparatus
KR20160123302A (en) Devices and methods of source-encoding and decoding of data
WO2006073993A3 (en) Fast compact decoder for huffman codes
WO2011007956A3 (en) Data compression method
GB2512533A (en) Generating a code alphabet of symbols to generate codewords for words used with a program
WO2009050609A3 (en) Method, apparatus and computer program product for providing improved gray mapping
WO2011037775A3 (en) Systems and methods for geometric data compression and encryption
WO2006109240A3 (en) Fast fourier transform architecture
ATE429076T1 (en) FAST CODING AND DECODING METHODS AND ASSOCIATED APPARATUS
WO2009057459A1 (en) Data compression method
JP2016538628A5 (en)
MX2019009680A (en) Method and apparatus for the compact representation of bioinformatics data using multiple genomic descriptors.
WO2009013818A1 (en) Character recognition processing method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08779872

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 08779872

Country of ref document: EP

Kind code of ref document: A2