CN117113012A - Adjustment data preprocessing system based on level control - Google Patents

Adjustment data preprocessing system based on level control Download PDF

Info

Publication number
CN117113012A
CN117113012A CN202310715243.2A CN202310715243A CN117113012A CN 117113012 A CN117113012 A CN 117113012A CN 202310715243 A CN202310715243 A CN 202310715243A CN 117113012 A CN117113012 A CN 117113012A
Authority
CN
China
Prior art keywords
unit
calculation
data
module
difference
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310715243.2A
Other languages
Chinese (zh)
Inventor
陈方哲
茅健生
郭平
李忠
丛玉凤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sinohydro Bureau 12 Co Ltd
Original Assignee
Sinohydro Bureau 12 Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sinohydro Bureau 12 Co Ltd filed Critical Sinohydro Bureau 12 Co Ltd
Priority to CN202310715243.2A priority Critical patent/CN117113012A/en
Publication of CN117113012A publication Critical patent/CN117113012A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01DMEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
    • G01D21/00Measuring or testing not otherwise provided for
    • G01D21/02Measuring two or more variables by means not covered by a single other subclass
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/10Pre-processing; Data cleansing
    • G06F18/15Statistical pre-processing, e.g. techniques for normalisation or restoring missing data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Probability & Statistics with Applications (AREA)
  • Testing Or Calibration Of Command Recording Devices (AREA)

Abstract

The application discloses a leveling data preprocessing system based on level control, which relates to the technical field of data processing and comprises an input reading module, a parameter setting module, a calculation verification module and a report output module which are sequentially connected; the input reading module inputs the target observation file and reads the observation data of each measuring station in the target observation file; the parameter setting module sets calculation parameters and carries out correction calculation on all observation data based on the calculation parameters; the calculation verification module calculates the difference value between the corrected observation data and the corresponding standard value, and judges whether each difference value meets the limit difference requirement; and the report output module outputs the preprocessing calculation result table when all the differences meet the difference limiting requirement. The application utilizes Python programming software to realize the intelligent reading of the field observation data of the level control, the intelligent preprocessing of the observation data and the intelligent judgment of the quality of the observation data and the report output item, thereby improving the calculation efficiency and reducing the errors caused by human factors.

Description

Adjustment data preprocessing system based on level control
Technical Field
The application relates to the technical field of data processing, in particular to a level control-based adjustment data preprocessing system.
Background
The level control measurement is used as an important ring of engineering measurement, and has the characteristics of large data quantity, high required precision, various inspection contents and the like, and the data preprocessing of up to 20 kinds of correction, calculation, judgment and the like on field observation results is also needed before adjustment, including correction of addition constants, temperature and air pressure (weather), two differences (refraction, spherical air difference) and the like; calculating corrected slant distance, vertical angle radian value, round trip height difference and average distance, measured section elevation mean value, calculated face side length, control network average side length, round trip observation side length relative error and the like; the round trip height difference is determined by the poor side length, the poor permission and the like.
The calculation table designed according to the manual observation equipment has been used for more than 20 years, the observation, recording and design are carried out manually by the observation and recording means, the field data input process and the check workload are quite large, all correction, calculation and discrimination parameters need to be checked, and calculation errors can be caused by any omission.
With the appearance of the measuring robot, the labor intensity of field observation and recording is greatly reduced, but the data preprocessing before adjustment is still in a completely manual input state, and the reasons for the fact include incomplete matching of the output content, format and specification of the measuring robot; programming and writing codes are also needed to be understood by the measurement profession; the digital and batch degree of the measuring part links of the inner industry is not high; therefore, no related products can be purchased in the market at present, the data preprocessing before adjustment of most units adopts a spliced computing mode, the working efficiency is low, and the industrial computing amount is large.
Disclosure of Invention
The application provides a leveling data preprocessing system based on level control, which aims to solve the problems that the method for preprocessing data before leveling mainly depends on manual operation, and has large calculated amount, low working efficiency and easy error occurrence in the prior art.
In order to achieve the above purpose, the present application adopts the following technical scheme:
the application discloses a leveling data preprocessing system based on level control, which comprises an input reading module, a parameter setting module, a calculation verification module and a report output module, wherein the input reading module, the parameter setting module, the calculation verification module and the report output module are sequentially connected;
the input reading module is used for inputting a target observation file and reading the observation data of each measuring station in the target observation file;
the parameter setting module is used for setting calculation parameters and carrying out correction calculation on all observation data based on the calculation parameters;
the calculation verification module is used for calculating the difference values of the corrected observation data and the corresponding standard values respectively and judging whether the difference values meet the limit difference requirement or not;
and the report output module is used for outputting a preprocessing calculation result table when all the differences meet the difference limiting requirement.
Preferably, the observation data comprises a target point, a return-to-zero direction average value, a zenith angle average value, an inclined distance, an instrument height, a mirror height and an average barometric pressure temperature.
Preferably, the input reading module comprises a data importing unit and a data reading unit connected with the data importing unit;
the data importing unit is used for confirming a target observation file and importing the target observation file into the system;
the data reading unit is used for reading the observation data of each measuring station in the target observation file.
Preferably, the input reading module further comprises a data emptying unit, and the data emptying unit is connected with the data importing unit and is used for cleaning the target observation file to read a new target observation file.
Preferably, the parameter setting module comprises a verification unit, a setting unit and a correction unit, wherein the verification unit, the setting unit and the correction unit are sequentially connected;
the verification unit is used for verifying whether the observation data of each measuring station are correct;
the setting unit is used for configuring the value of the calculation parameter when all the observation data are correct;
and the correction unit is used for correcting all the observed data according to the configured calculation parameter values.
Preferably, the calculated parameters include elevation control level, plane control level, starting point elevation, instrument addition constant, instrument multiplication constant, reduction elevation, and average latitude or radius of curvature.
Preferably, the calculation verification module comprises a difference calculation unit, a comparison unit and a marking unit, wherein the difference calculation unit, the comparison unit and the marking unit are sequentially connected;
the difference value calculating unit is used for calculating the difference value between the round trip observation data after the correction calculation of the target point according to a preset calculation formula;
the comparison unit is used for comparing each difference value with the corresponding limit difference and judging whether all the difference values meet the limit difference requirement or not;
the marking unit is used for performing red marking operation on all the difference values which do not meet the difference limiting requirement.
Preferably, the calculation verification module further comprises a prompt unit connected with the marking unit, and the prompt unit is used for prompting a user to check whether the target observation file is wrong or retested when any difference value is marked red.
The application has the following beneficial effects:
1. the intelligent input of the field data is carried out by using Python programming software, so that the time spent for inputting the field data is shortened by more than 90%, a large amount of internal processing time is saved, and the intelligent reading of the grade control field observation data is realized;
2. the Python programming software is utilized to eliminate misjudgment and misjudgment conditions of data input, the correction of multiplication constant, temperature and air pressure and the like is automatically carried out on the observation side length, the side with overrun to the observation side length and the height difference is automatically identified and prompted, and the intelligent preprocessing of the observation data is realized;
3. and the Python programming software is utilized to automatically judge the calculation result of adjustment preprocessing, so that the calculation result meeting the standard requirement is automatically converted into an adjustment input file, and the quality judgment of the observed data and the intellectualization of the report output item are realized.
Drawings
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, it being obvious that the drawings in the description below are only some embodiments of the application, and that other drawings can be obtained according to these drawings without inventive faculty for a person skilled in the art.
FIG. 1 is a schematic diagram of a leveling data preprocessing system based on level control according to the present application;
FIG. 2 is a schematic diagram of file reading of a leveling data preprocessing system based on level control according to the present application;
FIG. 3 is a schematic diagram of a selected configuration average latitude in the calculation of parameter settings in accordance with the present application;
FIG. 4 is a schematic view of a selected configuration of radius of curvature in a calculated parameter setting of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The terms "first," "second," and the like in the claims and the description of the application, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order, and it is to be understood that the terms so used may be interchanged, if appropriate, merely to describe the manner in which objects of the same nature are distinguished in the embodiments of the application by the description, and furthermore, the terms "comprise" and "have" and any variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of elements is not necessarily limited to those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
As shown in fig. 1, the present embodiment provides a leveling data preprocessing system based on level control, where the system includes an input reading module, a parameter setting module, a calculation verification module, and a report output module, where the input reading module, the parameter setting module, the calculation verification module, and the report output module are sequentially connected;
the input reading module is used for inputting a target observation file and reading the observation data of each measuring station in the target observation file;
the parameter setting module is used for setting calculation parameters and carrying out correction calculation on all observation data based on the calculation parameters;
the calculation verification module is used for calculating the difference values of the corrected observation data and the corresponding standard values respectively and judging whether the difference values meet the limit difference requirement or not;
and the report output module is used for outputting a preprocessing calculation result table when all the differences meet the difference limiting requirement.
The leveling data preprocessing system based on the level control, namely the level control leveling data preprocessing software, is written in the Python language, and mainly aims to realize the intellectualization of calculation before the robot measures the download data and the leveling file input so as to reduce the manual input intensity, improve the calculation quality and control the manual input errors; meanwhile, the software is ensured to stably run in different versions of operating systems by utilizing powerful expansion and compatibility of Python language and a modularized function library.
The preprocessing system comprises an input reading module, a parameter setting module, a calculation verification module and a report output module which are sequentially connected, wherein the input reading module is used for importing and reading target observation files and specifically comprises a data importing unit module, a data reading unit and a data emptying unit, wherein the data reading unit and the data emptying unit are respectively connected with the data importing unit, the target observation files are preferably obtained by carrying out format processing on an original record manual of a measuring robot, the original record manual is an Excel-format record table, the input target observation files are also Excel-format record tables, the input reading module can be used for carrying out operation on the Excel tables through an expansion library in a Python to read data in the target observation files in batches and classify the data in the target observation files, and the format processing process of the original record manual comprises the following steps: firstly, filling average air pressure and average temperature of a measuring station and a mirror station in a horizontal distance and height difference column of a column of recorded manual statistics results; and then modifying and sorting file names of the record handbooks filled with data, wherein the modification and sorting follow the following principle: 1. the sorting should be performed according to the order of the wires or the control network, and the file names are modified into 'serial number-station name'; 2. if repeated station setting is carried out, the file name is modified into a sequence number, a station measuring name and a station setting number; finally, putting all files into the same folder; in this embodiment, the observation file import procedure is to open the preprocessing system, create a new project and select a folder for storing the project, then, the data import unit is used to successfully import the target observation file, and after the target observation file is imported, the data reading unit is used to read the observation data of each observation station in the target observation file, where the observation data is the round trip observation data of the observation station, including the target point, the average value of the zeroing direction, the zenith angle average value, the slant distance, the instrument height, the mirror height and the average air temperature, and the progress bar appears when the data is read, as shown in fig. 2, if the imported target observation file is to be modified, the data emptying unit is used to delete the file to reintroduce the observation file.
The parameter setting module is used for setting calculation parameters, which comprises a verification unit, a setting unit and a correction unit which are sequentially connected, wherein the verification unit is used for checking observation information of each measuring station and determining whether the information is wrong, the calculation parameters are configured through the setting unit under the condition that all data are determined to be wrong, the calculation parameters comprise a height control level, a plane control level, a starting point elevation, an instrument addition constant, an instrument multiplication constant, a reduction elevation, an average latitude or a curvature radius and the like, the calculation parameters are selected according to actual needs, the height control level and the plane control level are set to be four and the like, the starting point number (elevation) is set to be II19, the starting point elevation is set to be 100, the geodetic coordinate system is set to be 2000, the instrument addition constant a and the instrument multiplication constant B are set to be-1.17 and-2.73 respectively, then the curvature radius R or the average latitude B is selected according to needs, in FIG. 3, the average latitude is selected, the curvature radius is not required to be configured, the average latitude is required to be 3, the curvature is calculated when the average latitude is set to be 2.00, the curvature radius is not calculated, the average radius is not calculated, the curvature is set to be 35 is not calculated, the average radius is set to be 35', the other parameters are not set to be 35, and the correction parameters are not set to be 35, and the correction parameters are set to be 35.
The calculation verification module is used for calculating the difference value between the corrected observation data and the corresponding standard value, and judging whether each difference value meets the corresponding difference limiting requirement or not, and comprises a difference value calculation unit, a comparison unit and a marking unit which are sequentially connected, wherein the difference value calculation unit calculates the difference value between the round trip observation data after the target point correction calculation according to a preset calculation formula, the preset calculation formula is an existing calculation formula, and only the preset calculation formula is written into a program in advance, so that manual calculation is changed into computer intelligent calculation, calculation time is further saved, and calculation efficiency is improved; then, comparing each difference value with the corresponding limit difference through a comparison unit, wherein the limit difference is required by national standards, and judging whether all difference values meet the limit difference requirement; finally, marking all the differences which do not meet the difference limiting requirement by using a marking unit, wherein the differences can be marked by using a red highlighting background, other colors can be selected, and the calculation verification module also comprises a prompting unit connected with the marking unit, and when any red marking data exists, a prompting unit prompts a user to check whether the read original observation file is wrong or to carry out retest.
The report output module is used for outputting a preprocessing calculation result table when all the differences meet the limit difference requirement, namely no standard red, the derived calculation table is still in an EXCEL format, and the calculation table can be used for writing subsequent adjustment files.
According to the embodiment, the existing data processing EXCEL calculation table before controlling adjustment is used as a template, the computer technology is used for realizing intelligent adjustment data preprocessing, labor force is effectively saved, automatic detection and discrimination capability of the method can be improved, calculation quality is reduced, site retest and reworking probability are reduced, errors possibly caused by purely manual discrimination can be corrected in time, and the method is efficient and quick.
The foregoing is merely illustrative of specific embodiments of the present application, and the scope of the present application is not limited thereto, but any changes or substitutions within the technical scope of the present application should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (8)

1. The adjustment data preprocessing system based on the level control is characterized by comprising an input reading module, a parameter setting module, a calculation verification module and a report output module, wherein the input reading module, the parameter setting module, the calculation verification module and the report output module are connected in sequence;
the input reading module is used for inputting a target observation file and reading the observation data of each measuring station in the target observation file;
the parameter setting module is used for setting calculation parameters and carrying out correction calculation on all observation data based on the calculation parameters;
the calculation verification module is used for calculating the difference values of the corrected observation data and the corresponding standard values respectively and judging whether the difference values meet the limit difference requirement or not;
and the report output module is used for outputting a preprocessing calculation result table when all the differences meet the difference limiting requirement.
2. The level control-based adjustment data preprocessing system according to claim 1, wherein the observed data comprises a target point, a return-to-zero direction average, a zenith angle average, an oblique distance, an instrument height, a mirror height and an average barometric pressure temperature.
3. The adjustment data preprocessing system based on level control according to claim 1, wherein said input reading module comprises a data importing unit and a data reading unit connected to said data importing unit;
the data importing unit is used for confirming a target observation file and importing the target observation file into the system;
the data reading unit is used for reading the observation data of each measuring station in the target observation file.
4. A leveling data preprocessing system based on level control as set forth in claim 3 wherein said input reading module further comprises a data flushing unit connected to said data importing unit for flushing said target observation file to read a new target observation file.
5. The adjustment data preprocessing system based on level control according to claim 1, wherein the parameter setting module comprises a verification unit, a setting unit and a correction unit, and the verification unit, the setting unit and the correction unit are sequentially connected;
the verification unit is used for verifying whether the observation data of each measuring station are correct;
the setting unit is used for configuring the value of the calculation parameter when all the observation data are correct;
and the correction unit is used for correcting all the observed data according to the configured calculation parameter values.
6. The level control-based adjustment data preprocessing system of claim 1, wherein said calculated parameters include elevation control level, plane control level, starting point elevation, instrument addition constant, instrument multiplication constant, reduction elevation, and average latitude or radius of curvature.
7. The adjustment data preprocessing system based on level control according to claim 2, wherein the calculation verification module comprises a difference calculation unit, a comparison unit and a marking unit, and the difference calculation unit, the comparison unit and the marking unit are sequentially connected;
the difference value calculating unit is used for calculating the difference value between the round trip observation data after the correction calculation of the target point according to a preset calculation formula;
the comparison unit is used for comparing each difference value with the corresponding limit difference and judging whether all the difference values meet the limit difference requirement or not;
the marking unit is used for performing red marking operation on all the difference values which do not meet the difference limiting requirement.
8. The adjustment data preprocessing system based on level control of claim 7, wherein the calculation and verification module further comprises a prompt unit connected with the marking unit, and the prompt unit is used for prompting a user to check whether the target observation file is wrong or retested when any difference value is marked red.
CN202310715243.2A 2023-06-15 2023-06-15 Adjustment data preprocessing system based on level control Pending CN117113012A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310715243.2A CN117113012A (en) 2023-06-15 2023-06-15 Adjustment data preprocessing system based on level control

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310715243.2A CN117113012A (en) 2023-06-15 2023-06-15 Adjustment data preprocessing system based on level control

Publications (1)

Publication Number Publication Date
CN117113012A true CN117113012A (en) 2023-11-24

Family

ID=88811724

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310715243.2A Pending CN117113012A (en) 2023-06-15 2023-06-15 Adjustment data preprocessing system based on level control

Country Status (1)

Country Link
CN (1) CN117113012A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103438872A (en) * 2013-08-13 2013-12-11 河海大学 Indoor and field integrated system based on dam three-dimension forward intersection measurement
CN109544660A (en) * 2018-11-28 2019-03-29 丁文利 A kind of field mapping automatic data processing system
CN110736452A (en) * 2019-06-27 2020-01-31 北京城建勘测设计研究院有限责任公司 lead measuring method and system applied to control measuring field
CN112905560A (en) * 2021-02-02 2021-06-04 中国科学院地理科学与资源研究所 Air pollution prediction method based on multi-source time-space big data deep fusion
CN114111706A (en) * 2021-10-29 2022-03-01 广东省国土资源测绘院 Leveling method integrating interior and exterior industry and quality inspection and data acquisition system
CN114564532A (en) * 2022-02-14 2022-05-31 兰州交通大学 Visualization service platform, system and method based on surveying and mapping data
CN115238318A (en) * 2022-07-21 2022-10-25 重庆市勘测院((重庆市地图编制中心)) Interior and exterior integrated adjustment processing method based on multiple acquisition ends

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103438872A (en) * 2013-08-13 2013-12-11 河海大学 Indoor and field integrated system based on dam three-dimension forward intersection measurement
CN109544660A (en) * 2018-11-28 2019-03-29 丁文利 A kind of field mapping automatic data processing system
CN110736452A (en) * 2019-06-27 2020-01-31 北京城建勘测设计研究院有限责任公司 lead measuring method and system applied to control measuring field
CN112905560A (en) * 2021-02-02 2021-06-04 中国科学院地理科学与资源研究所 Air pollution prediction method based on multi-source time-space big data deep fusion
CN114111706A (en) * 2021-10-29 2022-03-01 广东省国土资源测绘院 Leveling method integrating interior and exterior industry and quality inspection and data acquisition system
CN114564532A (en) * 2022-02-14 2022-05-31 兰州交通大学 Visualization service platform, system and method based on surveying and mapping data
CN115238318A (en) * 2022-07-21 2022-10-25 重庆市勘测院((重庆市地图编制中心)) Interior and exterior integrated adjustment processing method based on multiple acquisition ends

Similar Documents

Publication Publication Date Title
CN111627099B (en) Steel structure non-contact actual measurement real quantity method and system based on three-dimensional scanning technology
CN106886659A (en) The virtual pre-splicing and detection method of steel structure bridge based on 3 D laser scanning and cloud platform
CN110827443A (en) Remote measurement post data processing system
CN109740457B (en) Face recognition algorithm evaluation method
CN107797910A (en) A kind of evaluation method of dispatch automated system software quality
CN115600919B (en) Method for real-time unorganized emission location and total amount of campus emissions calculation
CN116612180B (en) Commodity quantity detecting system capable of being maintained in real time
CN108534869B (en) method for automatically comparing and correcting station differences of meter correcting machine
CN105868100A (en) Android system-based automatic test method and device
CN117113012A (en) Adjustment data preprocessing system based on level control
CN117391534A (en) Construction quality monitoring method and device, electronic equipment and storage medium
CN106780435A (en) A kind of object count method and device
CN115049371A (en) Construction drawing pattern-die linkage examination marking method, system, device and storage medium
CN109522595A (en) A kind of functional diagram importing automatic diagnosis method based on nuclear power plant's verification platform
CN106840090A (en) A kind of measurement of higher degree method and system over strait
CN117422427B (en) Online batch analysis method and system for low-strain data
CN117911412B (en) Dimension detection method and system for caterpillar track section for engineering machinery
CN106557393A (en) A kind of automated verification system of IC chip
CN110633204A (en) Program defect detection method and device
CN108507644B (en) Method for searching string table position on assembly line
CN113722339A (en) Verification method and system for data change in map data
CN116010349B (en) Metadata-based data checking method and device, electronic equipment and storage medium
CN109976762B (en) Method and system for improving solid state disk firmware test efficiency
CN114595497B (en) Intelligent detection method and system for hidden karst cave
CN114546845B (en) Authentication method of functional safety software tool chain

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination