CN117544177A - Radar data lossless compression method, computer equipment and medium - Google Patents
Radar data lossless compression method, computer equipment and medium Download PDFInfo
- Publication number
- CN117544177A CN117544177A CN202311601649.4A CN202311601649A CN117544177A CN 117544177 A CN117544177 A CN 117544177A CN 202311601649 A CN202311601649 A CN 202311601649A CN 117544177 A CN117544177 A CN 117544177A
- Authority
- CN
- China
- Prior art keywords
- data
- matrix
- radar
- radar data
- length
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000007906 compression Methods 0.000 title claims abstract description 33
- 230000006835 compression Effects 0.000 title claims abstract description 32
- 239000011159 matrix material Substances 0.000 claims abstract description 57
- 238000006243 chemical reaction Methods 0.000 claims abstract description 17
- 238000012163 sequencing technique Methods 0.000 claims abstract description 11
- 238000012545 processing Methods 0.000 claims description 12
- 230000001502 supplementing effect Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 abstract description 9
- 238000013500 data storage Methods 0.000 abstract description 4
- 238000004422 calculation algorithm Methods 0.000 description 9
- 238000013144 data compression Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 238000001514 detection method Methods 0.000 description 2
- 238000004451 qualitative analysis Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000002427 irreversible effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/3002—Conversion to or from differential modulation
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/003—Transmission of data between radar, sonar or lidar systems and remote stations
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/40—Conversion to or from variable length codes, e.g. Shannon-Fano code, Huffman code, Morse code
- H03M7/4093—Variable length to variable length coding
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
- H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
- H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction
- H03M7/46—Conversion to or from run-length codes, i.e. by representing the number of consecutive digits, or groups of digits, of the same kind by a code word and a digit indicative of that kind
- H03M7/48—Conversion to or from run-length codes, i.e. by representing the number of consecutive digits, or groups of digits, of the same kind by a code word and a digit indicative of that kind alternating with other codes during the code conversion process, e.g. run-length coding being performed only as long as sufficientlylong runs of digits of the same kind are present
Abstract
The embodiment of the invention discloses a radar data lossless compression method, computer equipment and a medium. In one embodiment, the method comprises: acquiring radar data, and performing bit conversion on the acquired radar data; ordering the radar data after bit conversion according to a preset ordering mode to obtain first matrix data; grouping the first matrix data, and carrying out scanning sequencing on the grouping matrix data of each group according to a preset scanning format; carrying out differential coding and run length coding on each group matrix data after scanning and sequencing in sequence; and entropy coding is carried out on the grouping matrix data after differential coding and run length coding by adopting a table look-up mode so as to finish the compression of radar data. The invention can realize the lossless compression of radar data, and reduces the bandwidth occupied by data transmission and the space for data storage on the premise of ensuring the data precision.
Description
Technical Field
The present invention relates to the field of data processing. And more particularly, to a method, computer device, and medium for lossless compression of radar data.
Background
At present, with the improvement of radar detection capability and detection range, signal processing generates a large amount of loopback data which needs to be transmitted to a system in real time, and the huge data volume brings great challenges to network transmission and storage. Data compression refers to reducing the redundancy of data between given amounts of information, and is classified into lossless compression and lossy compression according to whether there is information loss during reconstruction. The lossy compression algorithm has a higher compression rate than the lossless algorithm, but loses part of the information in the radar data, and the compression process is irreversible.
Data compression algorithms are used to reduce the amount of data transmitted and stored, but common data compression algorithms do not adequately account for the characteristics of radar data. According to the data characteristics of the data sent back by different types of radars, the real-time and efficient data compression algorithm is designed, so that the real-time processing, transmitting and storing capacities of the data can be effectively improved. Data compression algorithms are classified into lossy compression and lossless compression. The use of lossy or lossless compression algorithms requires consideration of different application environments. The qualitative analysis of the radar data has relatively low accuracy requirements on the data, and the quantitative calculation has relatively high accuracy requirements on the data, so that the lossy compression algorithm is suitable for the radar loopback data of the qualitative analysis, but is not suitable for the application requirements of high data fidelity, and the data distortion can influence the secondary statistics and the analysis of the radar loopback data.
Disclosure of Invention
The invention aims to provide a lossless compression method, computer equipment and medium for radar data, which are used for solving at least one of the problems existing in the prior art.
In order to achieve the above purpose, the invention adopts the following technical scheme:
the first aspect of the invention provides a lossless compression method for radar data, comprising the following steps:
acquiring radar data, and performing bit conversion on the acquired radar data;
ordering the radar data after bit conversion according to a preset ordering mode to obtain first matrix data;
grouping the first matrix data, and carrying out scanning sequencing on the grouping matrix data of each group according to a preset scanning format;
carrying out differential coding and run length coding on each group matrix data after scanning and sequencing in sequence;
and entropy coding is carried out on the grouping matrix data after differential coding and run length coding by adopting a table look-up mode so as to finish the compression of radar data.
Optionally, the performing bit conversion on the acquired radar data includes
The radar data bits are converted into data comprising at least one preset bit value.
Optionally, the preset sorting mode includes
The order from low order to high order.
Optionally, the first matrix data is an n×m matrix;
wherein N is the length of radar data, and M is the number of data of the preset bit value of the radar data conversion.
Optionally, the grouping the first matrix data includes
And carrying out grouping processing on the first matrix data according to the preset length, and if the length of the first matrix data is not a multiple of the preset length, supplementing the first matrix data to be a multiple of the preset length.
Optionally, the preset scanning format is W-type scanning, and the scanning is performed according to the shape of the english letter W from the upper left corner of the grouping matrix.
Optionally, the differential encoding is adopted to encode each piece of grouping matrix data after scanning and sorting, namely, each numerical value of each piece of grouping matrix data after scanning and sorting is taken to encode the difference value of the previous numerical value, and the first numerical value is reserved;
the encoding of the differentially encoded data run length includes replacing consecutive characters that repeatedly occur in a string of characters within the differentially encoded data with two bytes.
Optionally, the entropy encoding the differentially encoded and run-length encoded packet matrix data includes entropy encoding the differentially encoded and run-length encoded packet matrix data using Huffman encoding.
A second aspect of the invention provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterised in that the processor implements the method provided by the first aspect of the invention when executing the program.
A third aspect of the present invention provides a computer readable storage medium having stored thereon a computer program, characterized in that the program, when executed by a processor, implements the method provided by the first aspect of the present invention.
The beneficial effects of the invention are as follows:
the invention provides a radar data lossless compression method based on differential coding aiming at the characteristics of radar data, which can realize the lossless compression of the radar data and reduce the bandwidth occupied by data transmission and the space occupied by data storage on the premise of ensuring the data precision; the invention can also be used for transmission and storage of radar data lossless compression under multiple scenes.
Drawings
The following describes the embodiments of the present invention in further detail with reference to the drawings.
FIG. 1 illustrates an exemplary method flow diagram in which an embodiment of the present invention may be applied.
FIG. 2 shows a schematic view of the "W" scan ordering of the present invention.
Fig. 3 is a schematic diagram of inputting first data in an embodiment of the present invention.
Fig. 4 is a schematic diagram of inputting second data in an embodiment of the invention.
Detailed Description
In order to more clearly illustrate the present invention, the present invention will be further described with reference to the following examples and FIGS. 1 to 4. Like parts in the drawings are denoted by the same reference numerals. It is to be understood by persons skilled in the art that the following detailed description is illustrative and not restrictive, and that this invention is not limited to the details given herein.
Example 1
The data compression focuses on removing the correlation between data, and meanwhile, the lossless compression requires no precision loss of the data, therefore, the invention provides a radar data lossless compression method based on differential coding aiming at the characteristics of radar one-dimensional data through innovative research, and referring to fig. 1, the method comprises the following steps:
a method for lossless compression of radar data, comprising:
acquiring radar data, and performing bit conversion on the acquired radar data;
ordering the radar data after bit conversion according to a preset ordering mode to obtain first matrix data;
grouping the first matrix data, and carrying out scanning sequencing on the grouping matrix data of each group according to a preset scanning format;
carrying out differential coding and run length coding on each group matrix data after scanning and sequencing in sequence;
and entropy coding is carried out on the grouping matrix data after differential coding and run length coding by adopting a table look-up mode so as to finish the compression of radar data.
In one embodiment, the bit converting the acquired radar data includes
The radar data bits are converted into data comprising at least one preset bit value. The preset ordering mode comprises ordering from low order to high order. The first matrix data is an N x M matrix; wherein N is the length of radar data, and M is the number of data of the preset bit value of the radar data conversion.
Specifically, dividing a large bit number into M small bit numbers for reading, sequencing according to the sequence from the lowest bit to the next highest bit and the highest bit, and converting radar data with the length of N into a matrix with the length of N by bit reading and conversion;
in one embodiment, the grouping the first matrix data includes
And carrying out grouping processing on the first matrix data according to the preset length, and if the length of the first matrix data is not a multiple of the preset length, supplementing the first matrix data to be a multiple of the preset length.
Specifically, the radar data after bit conversion is processed by taking each L points as a basic unit, so as to better perform subsequent compression processing on the data; if the length of the data is not a multiple of L, the length of the data needs to be first complemented with the multiple of L, and the complemented content is zero, so that the data meets the requirement of packet processing.
In one embodiment, the preset scanning format is a W-type scanning, and the scanning is performed according to the shape of the english letter W from the upper left corner of the grouping matrix.
In one embodiment, the differential encoding is used to encode each piece of matrix data after scanning and sorting, that is, the difference between each value of each piece of matrix data after scanning and sorting and the previous value is taken to encode, and the first value is reserved;
the encoding of the differentially encoded data run length includes replacing consecutive characters that repeatedly occur in a string of characters within the differentially encoded data with two bytes.
Specifically, each time a "character string having a predetermined length" is read (each time 64 bits or 128 bits, etc. are read, settable) in each packet matrix data after completion of scan sorting, two "characters" (J, K) are used instead of consecutive characters (e.g., 22 or 333, etc.) repeatedly appearing in one character string, where J represents the number of consecutive 0 s between two non-zero numbers, and K represents the value of the next non-zero number.
In one embodiment, the entropy encoding of the packet matrix data after differential encoding and run-length encoding includes entropy encoding the packet matrix data after differential encoding and run-length encoding by using Huffman encoding, and implementing by using a table look-up method, outputting a code stream, and completing data compression, and specifically includes the following steps:
(a) Assuming that the probability distribution of the data after the run-length coding is completed is fixed, sorting the data according to the probability from high to low, giving corresponding binary codes, and generating a code table required by Huffman coding, wherein the code table comprises each data and the binary codes corresponding to the data;
(b) And for the first data after DPCM coding, directly searching the binary code corresponding to the data in the code table, wherein the binary code comprises a coding length part and a coding binary part.
(c) And (3) generating (J, K) data after RLE coding, searching binary codes corresponding to the J corresponding group in a code table, and then finding binary codes corresponding to K in the group, wherein the binary codes comprise two parts of coding length and coding binary.
(d) And storing and outputting the generated binary code stream according to the sequence, and supplementing with code element 1 if the number of the final binary code elements does not meet the multiple of 8.
The invention aims at radar data characteristics, combines RLE coding and Huffman coding based on the thought of differential coding, and can realize the lossy compression of the angle radar data.
Example 2
S1: dividing the number of one big bit into the number of M small bits for reading, and sequencing according to the sequence from the lowest order to the next highest order and the highest order, wherein the radar data with the length of N is changed into a matrix with the length of N after bit reading and conversion.
S2: and processing the radar data after bit conversion by taking each L points as a basic unit, and if the length of the data is not a multiple of L, supplementing the multiple of L and filling zero to meet the processing requirement.
S3: starting from the upper left corner of the grouping matrix, the scan is performed in accordance with the shape of the english letter W, as shown in fig. 2.
S4: encoding by differential encoding (Difference Pulse Code Modulation, DPCM) method, namely taking the difference value between each value and the previous value to encode, and reserving the first number;
s5: -run-length encoding (Run Length Encoding, RLE) the differentially encoded data, replacing consecutive characters repeated in a string with two bytes, assuming that in encoding, a pair of RLE encoded data of (J, K) is obtained, where J represents the number of consecutive 0 s between two non-zero numbers and K represents the value of the next non-zero number;
s6: after DPCM coding and RLE coding, adopting Huffman coding to carry out entropy coding on the digital value, adopting a table look-up mode to realize, outputting code stream and finishing data compression.
Step S1 further comprises: the number of one big bit is divided into M small bits for reading, for example, the number of one 32bit is read according to the number of 4 8 bits:
least significant numerical value: data 8bit_1=bitand (data 32bit, 255)
The next lowest digit value: data 8bit_2=bit and (bit shift (data 32bit, -8), 255)
The next highest numerical value: data 8bit_3=bit and (bit shift (data 32bit, -16), 255)
The highest digit value: data 8bit_4=bit and (bit shift (data 32bit, -24), 255)
Wherein, data32bit represents the value of 32bit, data8bit_1, data8bit_2, data8bit_3 and data8bit_4 represent the 8bit value obtained by reading according to the sequence from the lowest order, the next lowest order to the next highest order and the highest order in sequence;
the invention aims at radar data characteristics, combines RLE coding and Huffman coding based on the thought of differential coding, and can realize lossless compression of the angle radar data.
Example 3
Experimental conditions: the radar data is of 32bit type, the length N is 396, the number of one 32bit is divided into 4 data of 8bit size for reading when the bit is converted, and the grouping size L is 64;
simulation parameters: two different sets of radar data are different in size, and are respectively shown in fig. 3 and fig. 4, and are schematic diagrams of inputting first data and second data in the embodiment of the present invention.
As a result of the experiment, the invention is a lossless compression algorithm, the recovery data after data decompression is the same as the original data, the compression ratio of the radar data is 6.7045 and 1.6141 respectively, and the invention reduces the bandwidth occupied by data transmission and the space for data storage on the premise of ensuring the data precision, thereby having important significance for the real-time transmission of the radar data.
In short, the lossless compression method for radar data disclosed by the invention is based on differential coding, and solves the problem that a large amount of radar returned data of a signal processing system brings huge pressure to a limited storage space and transmission bandwidth. The implementation process is as follows: inputting radar data, reading bit conversion of the data, and storing the re-read data according to the sequence from low order to high order; the converted data are grouped, so that the subsequent processing is facilitated; the data of each group is subjected to W-shaped scanning sequencing, and the data is reordered; DPCM coding and RLE coding are carried out on the data after the ordering is completed; and entropy coding is carried out on the coded data by adopting a table look-up mode, and a code stream is output to finish data compression. The invention reduces the bandwidth occupied by data transmission and the space of data storage on the premise of ensuring the data to be lossless, and has important significance for the real-time transmission of radar data.
In the description of the present invention, it should be noted that the azimuth or positional relationship indicated by the terms "upper", "lower", etc. are based on the azimuth or positional relationship shown in the drawings, and are merely for convenience of describing the present invention and simplifying the description, and are not indicative or implying that the apparatus or element in question must have a specific azimuth, be constructed and operated in a specific azimuth, and thus should not be construed as limiting the present invention. Unless specifically stated or limited otherwise, the terms "mounted," "connected," and "coupled" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
It is further noted that in the description of the present invention, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
It should be understood that the foregoing examples of the present invention are provided merely for clearly illustrating the present invention and are not intended to limit the embodiments of the present invention, and that various other changes and modifications may be made therein by one skilled in the art without departing from the spirit and scope of the present invention as defined by the appended claims.
Claims (10)
1. A method for lossless compression of radar data, comprising:
acquiring radar data, and performing bit conversion on the acquired radar data;
ordering the radar data after bit conversion according to a preset ordering mode to obtain first matrix data;
grouping the first matrix data, and carrying out scanning sequencing on the grouping matrix data of each group according to a preset scanning format;
carrying out differential coding and run length coding on each group matrix data after scanning and sequencing in sequence;
and entropy coding is carried out on the grouping matrix data after differential coding and run length coding by adopting a table look-up mode so as to finish the compression of radar data.
2. The method of claim 1, wherein the bit converting the acquired radar data comprises
The radar data bits are converted into data comprising at least one preset bit value.
3. The method according to claim 1, wherein the predetermined ordering means comprises
The order from low order to high order.
4. The method of claim 1, wherein the first matrix data is an N x M matrix;
wherein N is the length of radar data, and M is the number of data of the preset bit value of the radar data conversion.
5. The method of claim 1, wherein grouping the first matrix data comprises
And carrying out grouping processing on the first matrix data according to the preset length, and if the length of the first matrix data is not a multiple of the preset length, supplementing the first matrix data to be a multiple of the preset length.
6. The method of claim 1, wherein the predetermined scan format is a W-type scan, and the scan is performed in accordance with the shape of the english letter W starting from the upper left corner of the grouping matrix.
7. The method according to claim 1, wherein each piece of data of the group matrix after the scan sequence is encoded by differential encoding, that is, a difference value between each value of each piece of data of the group matrix after the scan sequence and a previous value is taken for encoding, and a first value is reserved;
the encoding of the differentially encoded data run length includes replacing consecutive characters that repeatedly occur in a string of characters within the differentially encoded data with two bytes.
8. The method of claim 1, wherein entropy encoding the differentially encoded and run-length encoded packet matrix data comprises entropy encoding the differentially encoded and run-length encoded packet matrix data using Huffman encoding.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 1-8 when the program is executed by the processor.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311601649.4A CN117544177A (en) | 2023-11-28 | 2023-11-28 | Radar data lossless compression method, computer equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311601649.4A CN117544177A (en) | 2023-11-28 | 2023-11-28 | Radar data lossless compression method, computer equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117544177A true CN117544177A (en) | 2024-02-09 |
Family
ID=89789762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311601649.4A Pending CN117544177A (en) | 2023-11-28 | 2023-11-28 | Radar data lossless compression method, computer equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117544177A (en) |
-
2023
- 2023-11-28 CN CN202311601649.4A patent/CN117544177A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Shannon | A mathematical theory of communication | |
| US7365658B2 (en) | Method and apparatus for lossless run-length data encoding | |
| EP0030437A1 (en) | Method and apparatus for compression and decompression of digital image data | |
| US20040202374A1 (en) | Compression system for integrated sensor devices | |
| WO1997034375A1 (en) | Method for reducing storage requirements for digital data | |
| CN116521093B (en) | Smart community face data storage method and system | |
| CN115529357B (en) | Updating abnormity matching method based on MES intercommunication interconnection production data | |
| CN116016606B (en) | Sewage treatment operation and maintenance data efficient management system based on intelligent cloud | |
| CN101534124B (en) | Compression algorithm for short natural language | |
| US4382286A (en) | Method and apparatus for compressing and decompressing strings of electrical digital data bits | |
| CN113312325B (en) | Track data transmission method, device, equipment and storage medium | |
| KR100906041B1 (en) | Font compression and retrieval | |
| CN111711511B (en) | Method for lossy compression of frequency domain data | |
| CN117544177A (en) | Radar data lossless compression method, computer equipment and medium | |
| CN116471337A (en) | Message compression and decompression method and device based on BWT and LZW | |
| US9235610B2 (en) | Short string compression | |
| CN111274950B (en) | Feature vector data encoding and decoding method, server and terminal | |
| US20020001414A1 (en) | System for building a data compression encoder | |
| CN1130615C (en) | Compressing ideographic characters | |
| CN108573069A (en) | A kind of Twins methods accelerating compression flow regular expression matching | |
| CN102891730B (en) | Method and device for encoding satellite short message based on binary coded decimal (BCD) code | |
| CN117544176A (en) | Radar data lossy compression method and system, computer equipment and medium | |
| CN115276664B (en) | Visitor data management method based on visitor registration information | |
| JPH0936749A (en) | Coding decoding device and coding method used for it | |
| CN115250161A (en) | Data transmission method, device, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |