CN106850785A - A kind of physical message system data compression transmitting method of use sliding window caching - Google Patents

A kind of physical message system data compression transmitting method of use sliding window caching Download PDF

Info

Publication number
CN106850785A
CN106850785A CN201710041145.XA CN201710041145A CN106850785A CN 106850785 A CN106850785 A CN 106850785A CN 201710041145 A CN201710041145 A CN 201710041145A CN 106850785 A CN106850785 A CN 106850785A
Authority
CN
China
Prior art keywords
message system
physical message
sliding window
data compression
symbol
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710041145.XA
Other languages
Chinese (zh)
Inventor
王俊杰
戴鸿君
于治楼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jinan Inspur Hi Tech Investment and Development Co Ltd
Original Assignee
Jinan Inspur Hi Tech Investment and Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jinan Inspur Hi Tech Investment and Development Co Ltd filed Critical Jinan Inspur Hi Tech Investment and Development Co Ltd
Priority to CN201710041145.XA priority Critical patent/CN106850785A/en
Publication of CN106850785A publication Critical patent/CN106850785A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/565Conversion or adaptation of application format or content
    • H04L67/5651Reducing the amount or size of exchanged application data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services
    • H04L67/568Storing data temporarily at an intermediate stage, e.g. caching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/04Protocols for data compression, e.g. ROHC

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

The present invention relates to a kind of data transmission method of physical message system, more particularly to a kind of physical message system data compression transmitting method of use sliding window caching.For there is mass data transmission in physical message system, the present invention is proposed a data compression transmission method compressed based on sliding window caching, when transmitting data in physical message system, is likely to duplicate in a stream the present invention.When there is a repetition, the sequence for repeating can be replaced with a short coding.Condensing routine scanning is such to be repeated, while generating coding to replace repetitive sequence.Over time, coding can reuse to capture new sequence.Decompression program can derive current mapping in coding and original data sequence.A kind of physical message system data compression transmitting method of use sliding window caching of the invention, its time that Data Matching compression can be greatly shortened, so as to improve data compression transmission speed.

Description

A kind of physical message system data compression transmitting method of use sliding window caching
Technical field
The present invention relates to a kind of data transmission method of physical message system, more particularly to one kind is cached using sliding window Physical message system data compression transmitting method.
Background technology
Physical message system is integrated calculating, communicates and be controlled in one as calculation procedure and the entity of physics process The intelligence system of future generation of body.Information physical system realizes the interaction with physics process by Man Machine Interface, uses network Change space and manipulate a physical entity in the way of long-range, reliable, real-time, safety, cooperation.Physical message system bag The system engineerings such as environment sensing ubiquitous in the future, embedding assembly, network service and network control are contained, have made physical system With calculating, communication, precise control, remote collaboration and autonomy function.Its emphasis computing resource is combined closely with physical resource With coordination, it is mainly used in some intelligence systems equipment such as and interconnects, Internet of Things sensing, smart home, robot, intelligent navigation etc.. On the basis of environment sensing, the controllable credible expansible networking physics of depth integration calculating, communication and control ability sets Standby system, it realizes depth integration and real-time, interactive to increase by calculation procedure and the interactional feedback cycle of physics process Or new function is extended, a physical entity is detected or controlled in safe, reliable, efficient and real-time mode.
Sliding window compression is virtual by one, and the window that compression procedure is slided can be followed as term dictionary, to press If the character string of contracting occurs in the window, export it and position and length occur.Term is carried out using fixed size window Matching, matches, rather than in all encoded information because the time loss of matching algorithm is often a lot, it is necessary to limit The size of dictionary processed just can guarantee that the efficiency of algorithm;With the process sliding dictionary window of compression, make wherein total comprising volume recently The information that code is crossed, because for most of information, the character string to be encoded often is easier to look in nearest context Gone here and there to matching.
Under prior art, for the mass data transmission in physics letter system system, current data compression transmission method is made Slow, the problem more than error of transmission into transmission speed.
The content of the invention
In order to solve problem of the prior art, the invention provides a kind of physical message system of use sliding window caching Data compression transmission method, its time that Data Matching compression can be greatly shortened, so as to improve data compression transmission speed.
The technical solution adopted in the present invention is as follows:
A kind of physical message system data compression transmitting method of use sliding window caching, comprises the following steps:
A, by the primary unpressed binary data stream in physical message system, according to the size of network bag, or transmission The demand of unit, independent block;
B, the symbol being likely to occur for each block, the symbol for being occurred inside searching, or repetitive sequence symbol, formation Number set;
C, new binary representation is found for each symbol.
The specific method of step C includes:
C1, since current compression position, investigate uncoded data, and attempt to find out matching word most long in sliding window Symbol string, if it is found, then carrying out step C2, otherwise carries out step C3;
C2, output ternary symbol group(Off, len, c), wherein off be window in matched character string opposite windows border it is inclined Move, len is the length that can be matched, and c is character late, window is then slided backward into+1 character of len, continue step C1;
C3, output ternary symbol group(0,0, c), wherein c is character late, and window then is slided backward into len+1 Character, continues step C1.
Block is 1024Byte, 4KByte or 16KByte.
The beneficial effect brought of technical scheme that the present invention is provided is:
For there is mass data transmission in physical message system, the present invention proposes that one is pressed based on sliding window caching The data compression transmission method of contracting, when transmitting data in physical message system, is likely to duplicate in a stream.When When there is a repetition, the sequence for repeating can be replaced with a short coding.Condensing routine scanning is such to be repeated, while Generation encodes to replace repetitive sequence.Over time, coding can reuse to capture new sequence.Decompression program can Current mapping is derived in coding and original data sequence.
The invention provides a kind of physical message system data compression transmitting method of use sliding window caching, it can The time of Data Matching compression is greatly shortened, so as to improve data compression transmission speed.
Brief description of the drawings
Technical scheme in order to illustrate more clearly the embodiments of the present invention, below will be to that will make needed for embodiment description Accompanying drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for For those of ordinary skill in the art, on the premise of not paying creative work, other can also be obtained according to these accompanying drawings Accompanying drawing.
Fig. 1 is a kind of method of the physical message system data compression transmitting method of use sliding window caching of the invention Schematic diagram.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention Formula is described in further detail.
Embodiment one
As shown in Figure 1, the physical message system data compression transmitting method of a kind of use sliding window caching of the present embodiment, Comprise the following steps:
(1)In physical message system, polytype data transfer is had, primary pressure is mainly wherein in digital display circuit The binary data stream of contracting.
(2)To binary data stream, according to the size of network bag, or transmission unit demand, be divided into 1024Byte, 4KByte or 16KByte etc. independent block size.
(3)For each block, the symbol for being occurred inside searching, or repetitive sequence symbol, formation may go out Existing assemble of symbol.
(4)For each symbol finds new binary representation, so that generally symbol uses little position, uncommon symbol Use more position.Detailed process is:
I. since current compression position, uncoded data are investigated, and attempt to find out matching word most long in sliding window Symbol string, if it is found, then carrying out step 2, otherwise carries out step 3.
Ii. output ternary symbol group (off, len, c).Wherein off is matched character string opposite windows side in window The skew on boundary, len is the length that can be matched, and c is character late.Then window is slided backward into+1 character of len, after Continuous step 1.
Iii. output ternary symbol group (0,0, c).Wherein c is character late.Then window is slided backward + 1 character of len, continues step 1.
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all it is of the invention spirit and Within principle, any modification, equivalent substitution and improvements made etc. should be included within the scope of the present invention.

Claims (3)

1. a kind of physical message system data compression transmitting method of use sliding window caching, comprises the following steps:
A, by the primary unpressed binary data stream in physical message system, according to the size of network bag, or transmission The demand of unit, independent block;
B, the symbol being likely to occur for each block, the symbol for being occurred inside searching, or repetitive sequence symbol, formation Number set;
C, new binary representation is found for each symbol.
2. the physical message system data compression transmitting method that a kind of use sliding window according to claim 1 is cached, Characterized in that, the specific method of the step C includes:
C1, since current compression position, investigate uncoded data, and attempt to find out matching word most long in sliding window Symbol string, if it is found, then carrying out step C2, otherwise carries out step C3;
C2, output ternary symbol group(Off, len, c), wherein off be window in matched character string opposite windows border it is inclined Move, len is the length that can be matched, and c is character late, window is then slided backward into+1 character of len, continue step C1;
C3, output ternary symbol group(0,0, c), wherein c is character late, and window then is slided backward into len+1 Character, continues step C1.
3. the physical message system data compression transmitting method that a kind of use sliding window according to claim 1 is cached, Characterized in that, described block is 1024Byte, 4KByte or 16KByte.
CN201710041145.XA 2017-01-20 2017-01-20 A kind of physical message system data compression transmitting method of use sliding window caching Pending CN106850785A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710041145.XA CN106850785A (en) 2017-01-20 2017-01-20 A kind of physical message system data compression transmitting method of use sliding window caching

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710041145.XA CN106850785A (en) 2017-01-20 2017-01-20 A kind of physical message system data compression transmitting method of use sliding window caching

Publications (1)

Publication Number Publication Date
CN106850785A true CN106850785A (en) 2017-06-13

Family

ID=59119402

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710041145.XA Pending CN106850785A (en) 2017-01-20 2017-01-20 A kind of physical message system data compression transmitting method of use sliding window caching

Country Status (1)

Country Link
CN (1) CN106850785A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115225724A (en) * 2021-04-21 2022-10-21 北京特纳飞电子技术有限公司 Data compression techniques using partitioning and irrelevant bit elimination
CN116527775B (en) * 2021-04-21 2024-07-05 北京特纳飞电子技术有限公司 Data compression techniques using partition and don't care bit cancellation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101469989A (en) * 2007-12-29 2009-07-01 厦门雅迅网络股份有限公司 Compression method for navigation data in mobile phone network navigation
CN101523732A (en) * 2006-09-01 2009-09-02 帕克比特软件股份有限公司 Method and system for transmitting a data file over a data network
CN102088604A (en) * 2011-02-10 2011-06-08 深圳创维数字技术股份有限公司 Method and device for compressing film thumbnails
CN103023511A (en) * 2012-12-05 2013-04-03 云之朗科技有限公司 Applied compressed encoding method and device
CN105187071A (en) * 2015-09-29 2015-12-23 东北大学 Pipeline millisecond online data compound compression/decompression method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101523732A (en) * 2006-09-01 2009-09-02 帕克比特软件股份有限公司 Method and system for transmitting a data file over a data network
CN101469989A (en) * 2007-12-29 2009-07-01 厦门雅迅网络股份有限公司 Compression method for navigation data in mobile phone network navigation
CN102088604A (en) * 2011-02-10 2011-06-08 深圳创维数字技术股份有限公司 Method and device for compressing film thumbnails
CN103023511A (en) * 2012-12-05 2013-04-03 云之朗科技有限公司 Applied compressed encoding method and device
CN105187071A (en) * 2015-09-29 2015-12-23 东北大学 Pipeline millisecond online data compound compression/decompression method

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115225724A (en) * 2021-04-21 2022-10-21 北京特纳飞电子技术有限公司 Data compression techniques using partitioning and irrelevant bit elimination
CN115225724B (en) * 2021-04-21 2023-04-07 北京特纳飞电子技术有限公司 Data compression techniques using partitioning and irrelevant bit elimination
CN116527775A (en) * 2021-04-21 2023-08-01 北京特纳飞电子技术有限公司 Data compression techniques using partition and don't care bit cancellation
CN116527775B (en) * 2021-04-21 2024-07-05 北京特纳飞电子技术有限公司 Data compression techniques using partition and don't care bit cancellation

Similar Documents

Publication Publication Date Title
CN115333735B (en) Safe data transmission method
CN110233728B (en) Fountain code-based continuous variable quantum key distribution data coordination method
CN107360443A (en) A kind of cloud desktop picture processing method, cloud desktop server and client
CN106850141A (en) A kind of physical message system data Lossless Compression transmission method of use DEFLATE algorithms
CN105807266A (en) Compression method for early-warning radar track data transmission
CN104081701A (en) Communication method, system and device for optical network system
CN105740196A (en) High-speed serial transmission data preprocessing method and system
CN103402185B (en) A kind of private information transfer method
CN114600398A (en) Apparatus for multilevel encoding
CN106850785A (en) A kind of physical message system data compression transmitting method of use sliding window caching
CN106791267A (en) A kind of physical message system data compression transmitting method based on bits compression
CN107437976A (en) A kind of data processing method and equipment
CN103414663A (en) Morse signal self-adaptive recognition method based on backtracking
CN106788886B (en) A kind of LT code decoding method
CN109672532B (en) Hybrid automatic retransmission method for continuous variable quantum key distribution
CN104052749A (en) Method for identifying link-layer protocol data types
CN115470799B (en) Text transmission and semantic understanding integrated method for network edge equipment
CN107222294A (en) A kind of improved fountain codes degree Distribution Algorithm
CN111885384A (en) Picture processing and transmission method based on generation countermeasure network under bandwidth limitation
CN106603677A (en) Physical information system data compression transmission method using multi-core multi-thread parallelism
Fu et al. Scalable extraction based semantic communication for 6G wireless networks
Kutay et al. Semantic communications: A paradigm whose time has come
CN114863666A (en) Infrared remote control carrier-free coding method
Han et al. A ConvLSTM-based blind receiver for physical layer wireless communication
CN1964200B (en) A method for coding and decoding of linear code expansion and data transmission method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170613