CN114200413A - Doppler weather radar electromagnetic interference data quality control method - Google Patents

Doppler weather radar electromagnetic interference data quality control method Download PDF

Info

Publication number
CN114200413A
CN114200413A CN202111510332.0A CN202111510332A CN114200413A CN 114200413 A CN114200413 A CN 114200413A CN 202111510332 A CN202111510332 A CN 202111510332A CN 114200413 A CN114200413 A CN 114200413A
Authority
CN
China
Prior art keywords
data
radial
distance
electromagnetic interference
weather radar
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111510332.0A
Other languages
Chinese (zh)
Inventor
赵薪童
李菁
柳晶
林棽
刘汉博
于金
沈自强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huafeng Meteorological Media Group Co Ltd
Original Assignee
Huafeng Meteorological Media Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huafeng Meteorological Media Group Co Ltd filed Critical Huafeng Meteorological Media Group Co Ltd
Priority to CN202111510332.0A priority Critical patent/CN114200413A/en
Publication of CN114200413A publication Critical patent/CN114200413A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/36Means for anti-jamming, e.g. ECCM, i.e. electronic counter-counter measures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/88Radar or analogous systems specially adapted for specific applications
    • G01S13/95Radar or analogous systems specially adapted for specific applications for meteorological use
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/02Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
    • G01S7/41Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
    • G01S7/411Identification of targets based on measurements of radar reflectivity
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/215Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10Complex mathematical operations
    • G06F17/18Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A90/00Technologies having an indirect contribution to adaptation to climate change
    • Y02A90/10Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Evolutionary Biology (AREA)
  • Probability & Statistics with Applications (AREA)
  • Operations Research (AREA)
  • Algebra (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Software Systems (AREA)
  • Electromagnetism (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Quality & Reliability (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

The invention provides a Doppler weather radar electromagnetic interference data quality control method, which comprises the following steps: the method comprises the steps of identifying that the radial reflectivity echoes are uniformly distributed along with the distance by dividing multiple sections of radial data, constructing a diagnosis function by using a mathematical statistic method, and jointly judging whether the radial reflectivity echoes are the radial electromagnetic interference echoes or not according to the radial reflectivity distribution condition and the correlation coefficient of the diagnosis function.

Description

Doppler weather radar electromagnetic interference data quality control method
Technical Field
The invention relates to the technical field of meteorological data processing, in particular to a Doppler weather radar electromagnetic interference data quality control method.
Background
Due to the fact that the Doppler weather radar is subjected to scanning wave bands, scanning modes and objective conditions, such as terrain, biology and atmospheric refractive index, non-meteorological echoes, namely reflectivity echo data caused by non-precipitation particles exist in the Doppler weather radar reflectivity data. These data interfere with the determination of precipitation echo range, intensity, structure, etc., and therefore need to be determined and removed by a quality control algorithm.
At present, the quality control of the radial electromagnetic interference echo is carried out by a storm kernel identification method, an isolated point filtering method and a power method, but the problems that more than 5 continuous azimuth radial electromagnetic interferences cannot be identified, manual intervention is needed for parameter adjustment, and the layered cloud precipitation echo is identified by mistake exist.
Disclosure of Invention
In view of the above, the present invention has been made to provide a doppler weather radar electromagnetic interference data quality control method that overcomes or at least partially solves the above problems.
According to an aspect of the invention, there is provided a doppler weather radar electromagnetic interference data quality control method, the control method comprising:
step S1: obtaining Doppler weather radar base data, extracting radial reflectivity data, and recording the radial reflectivity data as ith radial data, wherein the radial data are one-dimensional data and are arranged from near to far according to the distance from a radar station to the farthest detection distance, and the unit is dBz;
step S2: dividing the ith radial data into one section of every P distance databases according to the distance sequence, and calculating a radial continuous distribution index RD;
step S3: extracting the ith radial data as diagnostic data n by using an interception methodi
Step S4: calculating the number of diagnosesAccording to niThe correlation coefficient r with the diagnostic function Y is calculated by the formula:
Figure BDA0003405019820000021
wherein Cov represents covariance and Var represents variance;
step S5: when RD > a is met and r > b is met, determining the ith radial data as electromagnetic interference data, wherein a and b are set artificially, a belongs to [0,1], b belongs to [ 1,1 ];
step S6: and repeating the steps S1 to S5, judging whether each piece of radial data of the Doppler weather radar base data is electromagnetic interference data, and if so, removing the radial data to perform quality control.
Optionally, in step S2, P is 10, and the radar is divided into one segment every 10 distance bins in the distance order.
Optionally, in step S2, the radial continuous distribution index RD is calculated according to equation (1) (2):
Figure BDA0003405019820000022
Figure BDA0003405019820000023
wherein D is the total distance bank number of radar scanning, Q is the number of distance bank segments, pjIs the j-th data, if pjIncluding reflectivity data, then pj1, otherwise pj=0。
Optionally, the intercepting method specifically includes: calculating the position of the distance base where the minimum value of the reflectivity in the distance base from the radar station 200 is located, and taking the position as the position of the minimum distance base;
intercepting data from the minimum distance library position to the farthest distance library.
Optionally, the formula for calculating the diagnostic function Y is formula (3):
Y=logm(X),X=[1,2,3,…,d-1,d] (3)
wherein X is a one-dimensional array and d is diagnostic data niM is the base of the logarithm.
Optionally, in step S5, when a takes a value of 0.8, b takes a value of 0.8, and RD >0.8 is satisfied, and r >0.8, it is determined that the ith radial data is radial electromagnetic interference data.
The invention provides a Doppler weather radar electromagnetic interference data quality control method, which comprises the following steps: the method comprises the steps of identifying that the radial reflectivity echoes are uniformly distributed along with the distance by dividing multiple sections of radial data, constructing a diagnosis function by using a mathematical statistic method, and jointly judging whether the radial reflectivity echoes are the radial electromagnetic interference echoes or not according to the radial reflectivity distribution condition and the correlation coefficient of the diagnosis function.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flow chart of a method for controlling the quality of electromagnetic interference data of a doppler weather radar according to an embodiment of the present invention;
FIG. 2 is a diagram of a 0.48 elevation angle weather echo profile provided by an embodiment of the present invention;
FIG. 3 is a diagram of the post-quality control profile of the meteorological echo at an elevation angle of 0.48 degrees in an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The terms "comprises" and "comprising," and any variations thereof, in the present description and claims and drawings are intended to cover a non-exclusive inclusion, such as a list of steps or elements.
The technical solution of the present invention is further described in detail with reference to the accompanying drawings and embodiments.
As shown in the flowchart of fig. 1, in the method for controlling the quality of the doppler weather radar electromagnetic interference data according to the embodiment of the present invention, the control method includes:
step S1: reading the elevation angle reflectivity data of 0.48 degrees of a certain Doppler weather radar station at 09, 16 days in 2021, extracting certain azimuth angle radial data of the elevation angle reflectivity, and recording the azimuth angle radial data as the ith radial data, wherein the radial data is one-dimensional data and is arranged from near to far away from the radar station, and the unit is dBz.
The scanning mode of the Doppler weather radar is elevation angle-by-elevation angle and azimuth angle-by-azimuth angle scanning, during observation, the elevation angle is fixed, then radial data of about 360 azimuth angles are scanned at the fixed elevation angle, then the elevation angle is raised, and then azimuth angle scanning is carried out, and the elevation angle scanning set by all scanning modes is completed in sequence. The minimum scanning data unit of the doppler weather radar is a range bin, each range bin comprises one data point, for the data used in this embodiment, the scanning radius is 230km, the spatial resolution is 250m, and each piece of radial data comprises 960 range bins.
Step S2: dividing every P distance banks into one segment according to the distance sequence, wherein P is 10, namely dividing every 10 distance banks into one segment according to the distance sequence of the radar, and calculating a radial continuous distribution index RD according to the formula (1) and the formula (2):
Figure BDA0003405019820000051
Figure BDA0003405019820000052
wherein D represents the total distance library number of radar scanning, and each radial data of the case data has 960 distance libraries. Q is the number of distance bank segments, and is divided into 96 distance bank segments, pjIs the j-th data, if pjIncluding reflectivity data, then pj1, otherwise pj=0。
The electromagnetic interference echo is not always valued from the radar station to the farthest distance library, some electromagnetic interference echoes are in discrete intermittent distribution in the radial direction, data are segmented according to the distance library, and electromagnetic interference echo omission caused by intermittent distribution can be effectively avoided.
Step S3: intercepting the diagnostic data by an interception method, calculating the position of a distance bank where the minimum value of the reflectivity is located in the distance bank from the radar station 200 to the base, and intercepting the data from the distance bank to the farthest distance bank as the diagnostic data ni
The non-meteorological echoes in the weather radar reflectivity include clear sky echoes besides electromagnetic interference echoes, and the large-area clear sky echoes cause failure of a diagnosis function, so that the influence of the clear sky echoes on judgment of the electromagnetic interference echoes needs to be reduced by an interception method.
Step S4: calculating diagnostic data niThe correlation coefficient r with the diagnostic function Y is calculated by the formula:
Figure BDA0003405019820000053
cov denotes covariance, Var denotes variance;
the formula for the calculation of the diagnostic function Y is formula (3):
Y=logm(x),x∈[1,d] (3)
wherein x is a real number and d is diagnostic data niM is the base of the logarithm. Taking m ═ e, equation (3) can also be written as:
Y=loge(x)=ln(x)
step S5: when RD >0.8 and r >0.8 are satisfied, the ith radial data is determined to be electromagnetic interference data.
Step S6: and repeating the steps S1 to S4, judging whether each azimuth radial data of each radar elevation is electromagnetic interference data, if so, performing quality control, and removing the corresponding radial data.
The distribution of the 0.48 degree elevation angle reflectivity of the original Doppler radar is shown in figure 2, and the distribution of the 0.48 degree elevation angle reflectivity after the electromagnetic interference quality control is shown in figure 3. The invention has better recognition and quality control effects on the electromagnetic interference distributed in the radial direction, and can eliminate the judgment interference of clear sky echo and ground object echo on the electromagnetic interference echo.
Has the advantages that: the method identifies that the radial reflectivity echoes uniformly distributed along with the distance exist in the radial direction by dividing multiple sections of radial data, constructs a diagnosis function by using a mathematical statistic method, and judges whether the radial reflectivity echoes are radial electromagnetic interference echoes or not according to the radial reflectivity distribution condition and the correlation coefficient of the diagnosis function in a combined manner.
The above embodiments are provided to further explain the objects, technical solutions and advantages of the present invention in detail, it should be understood that the above embodiments are merely exemplary embodiments of the present invention and are not intended to limit the scope of the present invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (6)

1. A Doppler weather radar electromagnetic interference data quality control method is characterized by comprising the following steps:
step S1: obtaining Doppler weather radar base data, extracting radial reflectivity data, and recording the radial reflectivity data as ith radial data, wherein the radial data are one-dimensional data and are arranged from near to far according to the distance from a radar station to the farthest detection distance, and the unit is dBz;
step S2: dividing the ith radial data into one section of every P distance databases according to the distance sequence, and calculating a radial continuous distribution index RD;
step S3: extracting the ith radial data as diagnostic data n by using an interception methodi
Step S4: calculating diagnostic data niThe correlation coefficient r with the diagnostic function Y is calculated by the formula:
Figure FDA0003405019810000011
wherein Cov represents covariance and Var represents variance;
step S5: when RD > a is met and r > b is met, determining the ith radial data as electromagnetic interference data, wherein a and b are set artificially, a belongs to [0,1], b belongs to [ 1,1 ];
step S6: and repeating the steps S1 to S5, judging whether each piece of radial data of the Doppler weather radar base data is electromagnetic interference data, and if so, removing the radial data to perform quality control.
2. The method for controlling the quality of the electromagnetic interference data of the doppler weather radar as claimed in claim 1, wherein in step S2, P is 10, and the radar is divided into one segment for each 10 distance bins in the distance sequence.
3. The method of claim 1, wherein in step S2, the radial continuous distribution index RD is calculated according to equation (1) (2):
Figure FDA0003405019810000012
Figure FDA0003405019810000021
wherein D is the total distance bank number of radar scanning, Q is the number of distance bank segments, pjIs the j-th data, if pjIncluding reflectivity data, then pj1, otherwise pj=0。
4. The method for controlling the quality of the electromagnetic interference data of the doppler weather radar as claimed in claim 1, wherein the intercepting method specifically comprises: calculating the position of the distance base where the minimum value of the reflectivity in the distance base from the radar station 200 is located, and taking the position as the position of the minimum distance base;
intercepting data from the minimum distance library position to the farthest distance library.
5. The method for controlling the quality of the electromagnetic interference data of the doppler weather radar as claimed in claim 1, wherein the formula for calculating the diagnosis function Y is shown as formula (3):
Y=logm(X),X=[1,2,3,…,d-1,d] (3)
wherein X is a one-dimensional array and d is diagnostic data niM is the base of the logarithm.
6. The method of claim 1, wherein in step S5, when a takes a value of 0.8, b takes a value of 0.8, and RD >0.8 is satisfied, and r >0.8, it is determined that the ith radial data is radial electromagnetic interference data.
CN202111510332.0A 2021-12-10 2021-12-10 Doppler weather radar electromagnetic interference data quality control method Pending CN114200413A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111510332.0A CN114200413A (en) 2021-12-10 2021-12-10 Doppler weather radar electromagnetic interference data quality control method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111510332.0A CN114200413A (en) 2021-12-10 2021-12-10 Doppler weather radar electromagnetic interference data quality control method

Publications (1)

Publication Number Publication Date
CN114200413A true CN114200413A (en) 2022-03-18

Family

ID=80652465

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111510332.0A Pending CN114200413A (en) 2021-12-10 2021-12-10 Doppler weather radar electromagnetic interference data quality control method

Country Status (1)

Country Link
CN (1) CN114200413A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115686377A (en) * 2022-11-17 2023-02-03 福建省气象局 Weather radar data format storage and reading method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090066563A1 (en) * 2005-05-19 2009-03-12 Ronald Hannesen Method and Apparatus for Correcting Weather data, and Computer Program Product
US20160274233A1 (en) * 2016-05-31 2016-09-22 Maravelias Digital, LLC Vertical composite technique for interpolating surface-relevant Doppler radar reflectivity from in-progress NEXRAD plan position indicator (PPI) scans.
CN106483512A (en) * 2016-12-08 2017-03-08 南京理工大学 A kind of general multichannel distributed object analogue echoes method and if system
CN109613540A (en) * 2018-12-25 2019-04-12 江苏省气象信息中心(江苏省气象档案馆) A kind of Doppler radar three-dimensional visualization method based on WebGL

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090066563A1 (en) * 2005-05-19 2009-03-12 Ronald Hannesen Method and Apparatus for Correcting Weather data, and Computer Program Product
US20160274233A1 (en) * 2016-05-31 2016-09-22 Maravelias Digital, LLC Vertical composite technique for interpolating surface-relevant Doppler radar reflectivity from in-progress NEXRAD plan position indicator (PPI) scans.
CN106483512A (en) * 2016-12-08 2017-03-08 南京理工大学 A kind of general multichannel distributed object analogue echoes method and if system
CN109613540A (en) * 2018-12-25 2019-04-12 江苏省气象信息中心(江苏省气象档案馆) A kind of Doppler radar three-dimensional visualization method based on WebGL

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
李若楠等: ""气象雷达基数据质量控制及其在回波识别方面的简单应用"", 《现代农业科技》, no. 5, 25 May 2015 (2015-05-25), pages 245 - 247 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115686377A (en) * 2022-11-17 2023-02-03 福建省气象局 Weather radar data format storage and reading method

Similar Documents

Publication Publication Date Title
CN111583214B (en) Sea surface wind speed inversion method based on RBF neural network and based on marine radar image
CN107561509B (en) Airborne millimeter wave radar power line detection method
CN111738278B (en) Underwater multi-source acoustic image feature extraction method and system
CN114200413A (en) Doppler weather radar electromagnetic interference data quality control method
Karvonen et al. Iceberg detection in dual-polarized C-band SAR imagery by segmentation and nonparametric CFAR (SnP-CFAR)
CN113256990A (en) Method and system for collecting road vehicle information by radar based on clustering algorithm
CN114240940B (en) Cloud and cloud shadow detection method and device based on remote sensing image
Zou et al. A method of radar echo extrapolation based on TREC and Barnes filter
CN116295285A (en) Shallow sea water depth remote sensing inversion method based on region self-adaption
Febriawan et al. Support vector machine and decision tree based classification of side-scan sonar mosaics using textural features
Wyatt et al. Factors affecting the accuracy of SHOWEX HF radar wave measurements
CN108509835B (en) PolSAR image ground object classification method based on DFIC super-pixels
CN111540007A (en) Method for estimating storage capacity of oil tank by utilizing SAR (synthetic aperture radar) image
Arivazhagan et al. Optimal Gabor sub-band-based spectral kurtosis and Teager Kaiser energy for maritime target detection in SAR images
CN115453486A (en) Method and system for identifying biological echo by using weather radar
CN114299397A (en) Multi-temporal SAR image change detection method
CN113673355A (en) Method for classifying echo waveforms of wave spectrometer
Sun et al. A new method to retrieve rainfall intensity level from rain-contaminated X-band marine radar image
Karvonen et al. Pulse-coupled neural network for sea ice SAR image segmentation and classification
CN111736157A (en) PPI data-based prediction method and device for nowcasting
CN117975255B (en) Shallow sea bottom type identification method for multispectral remote sensing image
CN113450308B (en) Radar rainfall detection method and device, computer equipment and storage medium
CN116380811B (en) Cloud detection method based on oxygen absorption band
CN116342417B (en) Radiation correction method and system for aerial remote sensing image
CN116381719B (en) Laser radar-based polluted area enhanced identification method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination