CN110991940A - Ocean observation data product quality online inspection method and device and server - Google Patents
Ocean observation data product quality online inspection method and device and server Download PDFInfo
- Publication number
- CN110991940A CN110991940A CN201911350629.8A CN201911350629A CN110991940A CN 110991940 A CN110991940 A CN 110991940A CN 201911350629 A CN201911350629 A CN 201911350629A CN 110991940 A CN110991940 A CN 110991940A
- Authority
- CN
- China
- Prior art keywords
- quality
- marine
- quality inspection
- observation data
- inspection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
- G06Q10/063—Operations research, analysis or management
- G06Q10/0639—Performance analysis of employees; Performance analysis of enterprise or organisation operations
- G06Q10/06395—Quality analysis or management
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Engineering & Computer Science (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Economics (AREA)
- Entrepreneurship & Innovation (AREA)
- Educational Administration (AREA)
- Operations Research (AREA)
- Marketing (AREA)
- Game Theory and Decision Science (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Factory Administration (AREA)
Abstract
The application provides an online inspection method, an online inspection device and a server for marine observation data product quality, wherein the online inspection method for marine observation data product quality comprises the following steps: acquiring an observation form from an operation control system of a marine observation satellite, and analyzing the observation form to extract marine observation data products in the observation form; analyzing the configuration file, and determining an online inspection project of the product quality of the marine observation data; and performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system. The method and the device realize automatic quality inspection of the marine observation satellite data products, improve inspection efficiency and accuracy, and the generated quality inspection result can provide judgment basis for data product abnormity and data product quality for the operation control system and the archiving and distribution system.
Description
Technical Field
The application relates to the technical field of ocean engineering, in particular to an online inspection method and device for ocean observation data product quality and a server.
Background
With the rapid development of a new generation of satellite remote sensing technology and computer technology, the ocean satellite remote sensing technology is in a new stage of updating, rapidly and timely acquiring mass earth observation remote sensing data. With the rapid improvement of the processing capability of the ground system of the marine observation satellite and the new increase of the task demand of marine observation data products, a full-automatic and efficient online inspection method for the quality of the marine observation data products is urgently needed to realize the quality inspection of the marine observation satellite data products, so as to provide a judgment basis for the data product abnormity and the data product quality for the operation control system and the archiving and distribution system.
The newly launched marine observation satellite HY-1C/D, HY-2B/C, CFOSAT has a plurality of L0-L4-level data formats and a very complex structure, and the quality inspection of the marine observation satellite data is an important link in the production and processing process of marine observation satellite data products. The traditional data quality inspection work of marine observation satellites mostly depends on manual intervention, and the processing efficiency is low and the error rate is high.
Disclosure of Invention
The embodiment of the application aims to provide an online inspection method, an online inspection device and a server for the quality of marine observation data products, so that the quality inspection efficiency and accuracy of the marine observation satellite data products are improved, and the technical effects of data product abnormity and data product quality judgment basis are provided for an operation control system and a filing and distribution system.
In order to solve the technical problem, the following technical scheme is adopted in the application:
in a first aspect of the present application, there is provided an online inspection method for marine observation data product quality, comprising the following steps:
acquiring an observation form from a control system of a marine observation satellite, and analyzing the observation form to extract marine observation data products in the observation form;
analyzing the configuration file, and determining an online inspection project of the product quality of the marine observation data;
and performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system.
In one embodiment, the quality inspection items include file format, file size, parameter completeness, temporal and spatial continuity range, parameter threshold, and quality rating of the marine observation data product.
In one embodiment, the step of quality testing and analyzing the marine observation data product according to the quality testing item comprises:
and respectively carrying out quality inspection and analysis on the file format, the file size and the parameter completeness data of the marine observation data product according to the file format, the file size and the parameter number configuration items of the configuration file.
In one embodiment, the step of quality testing and analyzing the marine observation data product according to the quality testing item comprises:
carrying out time continuity check on the time information in the marine observation data product according to the time continuity range in the configuration file;
carrying out spatial continuity check on the position information in the marine observation data product according to the spatial continuity range in the configuration file;
and generating a continuity check pie chart according to the time continuity check result and the space continuity check result.
In one embodiment, the step of quality testing and analyzing the marine observation data product according to the quality testing item comprises:
and checking whether the marine observation data product meets the index requirements of the corresponding parameter threshold value according to the parameter threshold value range of the configuration file.
In an embodiment, after the generating the quality inspection result, the method further includes:
counting the online quality inspection results of the marine observation data products, and outputting the counting results in the form of thematic maps; the statistical content comprises ground type statistics and effective data statistics.
In an embodiment, after the statistics of the online product quality inspection results of the marine observation data, the method further includes:
and marking the statistical result, generating and storing a quality marking file, and performing quality grading according to the quality grading standard of the configuration file to provide marine observation data product distribution marks for the archiving and distribution system.
In one embodiment, the quality inspection results include a quality identification file, a quality inspection report, a quality inspection metadata file, and a thematic map file.
In a second aspect of the present application, there is provided an online inspection device for marine observation data product quality, comprising:
the acquisition module is used for acquiring an observation form from an operation control system of the marine observation satellite, and analyzing the observation form to extract marine observation data products in the observation form;
the analysis module is used for analyzing the configuration file and determining an online inspection project of the quality of the marine observation data product;
and the generation module is used for carrying out quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system.
In a third aspect of the present application, there is also provided a server comprising a memory and a processor, the memory having stored therein computer readable instructions, which when executed by the processor, cause the processor to execute the steps of the marine observational data product quality online inspection method according to any one of the above.
In a fourth aspect of the present application, there is also provided a storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the online inspection method for marine observation data product quality as described in any one of the above.
Compared with the prior art, the technical scheme of the application has the following advantages:
1. according to the method for online inspection of the quality of the marine observation data product, an observation form is obtained from a control system of a marine observation satellite, and the observation form is analyzed to extract the marine observation data product in the observation form; then analyzing the configuration file to determine an online inspection project of the product quality of the marine observation data; and performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system. According to the method and the device, quality inspection and analysis are carried out on the marine observation data products according to the quality inspection items of the configuration files, and quality inspection results are generated, so that automatic quality inspection of the marine observation satellite data products is realized, the inspection efficiency and the accuracy are improved, and the generated quality inspection results can provide judgment basis for data product abnormity and data product quality for the operation control system and the filing and distribution system.
2. According to the method and the device, quality inspection and analysis are respectively carried out on the file format, the file size and the parameter completeness data of the marine observation data product according to the file format, the file size and the parameter number configuration items of the configuration file, so that data standardization processing is carried out on the marine observation data product, and the data integrity and the data uniformity of the marine observation data product are guaranteed.
3. According to the method, time continuity check is carried out on the time information in the marine observation data product according to the time continuity range in the configuration file; carrying out spatial continuity check on the position information in the marine observation data product according to the spatial continuity range in the configuration file; to ensure the data continuity of the marine observation data product in time and space; and a continuity check pie chart is generated according to the time continuity check result and the space continuity check result, so that the quality check result is visually processed, the quality problem of the marine observation data product can be conveniently and rapidly found, and exception handling and feedback can be timely made.
4. The method and the device identify the statistical results, generate and store the quality identification files, and perform quality grading according to the quality grading standard of the configuration files to provide marine observation data product distribution identification for the filing distribution system, so that the marine observation data products under each statistical result can be searched for in a follow-up manner, and the query efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments of the present application will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and that those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
FIG. 1 is a flow chart of a method for online inspection of marine observation data product quality according to an embodiment of the present application;
FIG. 2 is a block diagram of an apparatus for online inspection of marine vessel survey data product quality according to an embodiment of the present application;
fig. 3 is a block diagram of an internal structure of a server according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.
Example one
As shown in fig. 1, the embodiment provides an online quality inspection method for marine observation data products, which is used for automatically, efficiently and extendibly inspecting the quality of marine observation data products, for example, inspecting and analyzing the quality of a marine observation satellite HY-1C/D, HY-2B/C, CFOSAT, so as to ensure that the quality problem of the marine observation data products is quickly found, and exception handling and feedback are timely made. In one embodiment, the online inspection method for the quality of marine observation data products comprises the following steps:
101. acquiring an observation form from a control system of a marine observation satellite, and analyzing the observation form to extract marine observation data products in the observation form;
the method comprises the steps of obtaining an observation form from operation control systems of all real-time marine observation satellites, analyzing the observation form according to a preset format, and obtaining marine observation data products by using the analyzed observation form, wherein the observation form specifically comprises dynamic parameters, a marine satellite data full path, an output result storage path and the like. The observation form is a data form generated by the operation control system according to the marine satellite data inspection task.
Specifically, the observation form in the xml format provided by the operation control system is analyzed, and the dynamic parameters of the observation form, the full-path file name of the input data file (h5, nc, bin and other format files), the full-path file name of the input data jpg file and the marine observation data product with the full-path name stored in the running log can be obtained from the analysis; the dynamic parameters comprise information such as load, data level and the like; the full-path file name of the input data jpg file is picture data corresponding to the marine observation satellite, and the picture data can be processed into a thumbnail corresponding to a marine observation data product for a user to view.
In one embodiment, after the marine observation data product in the observation form is extracted, the marine observation data product in the observation form may be subjected to a completeness check to check whether the marine observation data specified in the monitoring scheme is complete. Specifically, information such as satellites, loads, inspection tasks and the like related to a scheme text is extracted and quantized into a table form; and traversing and contrasting whether the quantified ocean observation data has the conditions of file number, file type and the like which are vacant, and if so, giving a prompt and filling data in the missing position.
102. Analyzing the configuration file, and determining an online inspection project of the product quality of the marine observation data;
in the step, the quality inspection items required for quality inspection of the marine observation data product to be inspected are obtained by analyzing the configuration file. In one embodiment, the quality inspection items include file format, file size, parameter completeness, temporal and spatial continuity range, parameter threshold, and quality rating of the marine observation data product. The configuration file is standard data of each index in ocean observation.
In an embodiment, after the configuration file is parsed, a variable reading operation may be performed on the data file of the marine observation data product to be subjected to the quality inspection according to the parsed configuration file.
103. And performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system.
The marine observation data product can be a data product of grade L0-L4, and the quality inspection and analysis respectively performs quality inspection on each load and each grade of data.
According to the method for online inspection of the quality of the marine observation data product, an observation form is obtained from a control system of a marine observation satellite, and the observation form is analyzed to extract the marine observation data product in the observation form; then analyzing the configuration file to determine an online inspection project of the product quality of the marine observation data; and performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system. According to the method and the device, quality inspection and analysis are carried out on the marine observation data products according to the quality inspection items of the configuration files, and quality inspection results are generated, so that automatic quality inspection of the marine observation satellite data products is realized, the inspection efficiency and the accuracy are improved, and the generated quality inspection results can provide judgment basis for data product abnormity and data product quality for the operation control system and the filing and distribution system.
In addition, in one embodiment, the quality of marine observation data products can be evaluated, specifically including L0-L4-level data of loads such as a water color water temperature scanner, a coastal zone imager, an ultraviolet imager, a microwave scatterometer, a scanning radiometer, a correction radiometer, a radar altimeter, a wave spectrometer and the like, and the product evaluation method is based on related technical rules and evaluation standards.
Further, the quality grade evaluation can be carried out on the marine observation data, and a quality grade summary table shown in the table 1 is generated. The types of rating evaluation that can be performed include: comprehensive evaluation of file format, file size, parameter integrity, temporal continuity, spatial continuity, parameter threshold range, etc.
Quality grade summary table
TABLE 1
Example two
In step S103, the step of performing quality inspection and analysis on the marine observation data product according to the quality inspection item may specifically include:
and respectively carrying out quality inspection and analysis on the file format, the file size and the parameter completeness data of the marine observation data product according to the file format, the file size and the parameter number configuration items of the configuration file.
In this embodiment, the quality inspection and analysis of the file format, the file size, and the parameter completeness data of the marine observation data product may be performed according to the file format, the file size, and the parameter number configuration items of the configuration file, so as to generate a file inspection result summary table shown in table 2. For example, if the L0-level data product is in binary format, only the size and format of the product is subjected to quality inspection, and a doc-format quality inspection report and an xml-format quality inspection metadata file are generated. The method comprises the steps of carrying out size, format, continuity check, parameter validity check and the like on the L1-L4-level data products, and generating a doc-format quality inspection report, a h 5/nc-format quality inspection result data file, an xml-format quality inspection metadata file, a thematic map, a thumbnail and the like. Wherein, the file size check is as follows:
FileSize_DownLim<FileSize<FileSize_UpLim；
the method comprises the steps of obtaining a file size of a marine observation satellite to be subjected to quality inspection, obtaining file size upper limit and file size lower limit, wherein the file size is the size of the marine observation satellite actual data to be subjected to quality inspection, the file size _ DownLim is the file size lower limit obtained from a configuration file, and the file size _ UpLim is the file size upper limit obtained from the configuration file.
According to the method and the device, quality inspection and analysis are respectively carried out on the file format, the file size and the parameter completeness data of the marine observation data product according to the file format, the file size and the parameter number configuration items of the configuration file, so that the data integrity and the correctness of the marine observation data product are guaranteed.
Summary table of file inspection results
| Content of inspection | Whether it is normal or not | Basis of discrimination | Test results |
| File format | |||
| File size | |||
| Parameter integrity |
TABLE 2
EXAMPLE III
In step S103, the step of performing quality inspection and analysis on the marine observation data product according to the quality inspection item may specifically include:
carrying out time continuity check on the time information in the marine observation data product according to the time continuity range in the configuration file;
carrying out spatial continuity check on the position information in the marine observation data product according to the spatial continuity range in the configuration file;
and generating a continuity check pie chart according to the time continuity check result and the space continuity check result.
According to the time and space continuity check threshold range in the configuration file, the time continuity and the space continuity of the data to be checked can be judged and checked according to the time information and the position information parameters in the satellite data of the L1-L4 level, so that the data accuracy of the marine observation data product on time and space can be ensured; and a continuity check result summary table shown in table 3 is generated according to the time continuity check result and the space continuity check result, and a continuity check pie chart is generated, so that the quality check result is visually processed, the quality problem of the marine observation data product can be conveniently and rapidly found, and exception handling and feedback can be timely made.
Continuity test result summary sheet
TABLE 3
Example four
In step S103, the step of performing quality inspection and analysis on the marine observation data product according to the quality inspection item may specifically include:
and checking whether the marine observation data product meets the index requirements of the corresponding parameter threshold value according to the parameter threshold value range of the configuration file.
The embodiment can detect whether the marine observation data product exceeds the set threshold range, and if so, set an identifier representing the marine observation data product exceeding the set threshold range; wherein the threshold range includes: time code threshold range, latitude and longitude data threshold range, observation parameter threshold range, inversion parameter threshold range and the like.
EXAMPLE five
In step S103, after the generating the quality inspection result, the method may further include:
counting the online quality inspection results of the marine observation data products, and outputting the counting results in the form of thematic maps; the statistical content comprises ground type statistics and effective data statistics.
And (3) counting the results of the data quality test of the L1-L4 satellite, preparing for the visual display of the subsequent quality test results, wherein the counted contents mainly comprise ground type statistics and effective data statistics, and outputting the statistical results in a thematic map form. The effective data statistics is to count the percentage of the effective data, and is to count the effective data of the pixels with the ground type being ocean.
EXAMPLE six
After the statistics of the online inspection results of the marine observation data product quality, the method further comprises the following steps:
and marking the statistical result, generating and storing a quality marking file, and performing quality grading according to the quality grading standard of the configuration file to provide marine observation data product distribution marks for the archiving and distribution system.
In this embodiment, the inspection results of the quality inspection components are collected to generate a quality identification file, and the quality identification file is stored in h5, nc and other formats, wherein a quality inspection result data file in the h5 or nc format records the result of each quality inspection by using a 32-bit nonconforming integer, 0 represents success, 1 represents failure, and A, B, C, D, C five quality grades of marine observation data products are divided according to the quality grade division standard of the configuration file to provide marine observation data product distribution identification for the archiving and distribution system. The configuration file stores the quality grade division standard of marine observation data products in advance.
The embodiment identifies the statistical results, generates and stores a quality identification file, and performs quality grading according to the quality grading standard of the configuration file to provide marine observation data product distribution identification for the archiving and distribution system, so that the marine observation data products under each statistical result can be searched for in a subsequent manner, and the query efficiency is improved.
And after the satellite data quality inspection component is finished, returning the backspacing codes in the range of 0-255. During the operation of the component, the component should not crash abnormally or exit directly, and in any case, an exit code should be returned. The exit code is an 8bit unsigned integer, i.e., ranging from 0-255. Wherein 0 represents success; 1-127 are partially successful; 128-255 is failure. The backspacing code is designed to facilitate the follow-up tracking and analysis of the reason of the abnormal condition.
EXAMPLE seven
In one embodiment, the quality inspection results include a quality identification file, a quality inspection report, a quality inspection metadata file, and a thematic map file.
For example, the quality inspection results of the L0-L4 level data are delivered to the archiving and distribution system for archiving, and quality inspection metadata files in the xml format are fed back to the operation control subsystem. The types of thematic maps may include: a time continuity pie chart, a space continuity pie chart, a valid data pie chart, an anomaly parameter histogram.
Example eight
Referring to fig. 2, an embodiment of the present invention further provides an online product quality inspection device for marine observation data, and in one embodiment, the online product quality inspection device includes an obtaining module 201, an analyzing module 202, and a generating module 203. Wherein the content of the first and second substances,
the acquisition module 201 is configured to acquire an observation form from an operation control system of a marine observation satellite, and analyze the observation form to extract a marine observation data product in the observation form;
the module acquires an observation form in real time from an operation control system of a marine observation satellite, analyzes the observation form according to a preset format, and can acquire a marine observation data product by using the analyzed observation form, wherein the observation form specifically comprises dynamic parameters, a marine satellite data full path, an output result storage path and the like. The observation form is a data form generated by the operation control system according to the marine satellite data inspection task.
Specifically, the observation form in the xml format provided by the operation control system is analyzed, and the dynamic parameters of the observation form, the full-path file name of the input data file (h5, nc, bin and other format files), the full-path file name of the input data jpg file and the marine observation data product with the full-path name stored in the running log can be obtained from the analysis; the dynamic parameters comprise information such as load, data level and the like; the full-path file name of the input data jpg file is picture data corresponding to the marine observation satellite, and the picture data can be processed into a thumbnail corresponding to a marine observation data product for a user to view.
In one embodiment, after the marine observation data product in the observation form is extracted, the marine observation data product in the observation form may be subjected to a completeness check to check whether the marine observation data specified in the monitoring scheme is complete. Specifically, information such as satellites, loads, inspection tasks and the like related to a scheme text is extracted and quantized into a table form; and traversing and contrasting whether the quantified ocean observation data has the conditions of vacancy monitoring such as the number of files, the types of files and the like, and if so, giving a prompt and filling data in the vacancy position.
The analysis module 202 is used for analyzing the configuration file and determining an online inspection project of the marine observation data product quality;
the module obtains quality inspection items required for quality inspection of marine observation data products to be inspected by analyzing the configuration files. In one embodiment, the quality inspection items include file format, file size, parameter completeness, temporal and spatial continuity range, parameter threshold, and quality rating of the marine observation data product. The configuration file is standard data of each index in ocean observation.
In an embodiment, after the configuration file is parsed, a variable reading operation may be performed on the data file of the marine observation data product to be subjected to the quality inspection according to the parsed configuration file.
And the generating module 203 is used for performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system.
The marine observation data product can be a data product of grade L0-L4, and the quality inspection and analysis respectively performs quality inspection on each load and each grade of data.
According to the on-line detection device for the quality of the marine observation data product, an observation form is obtained from a running control system of a marine observation satellite, and the observation form is analyzed to extract the marine observation data product in the observation form; then analyzing the configuration file to determine an online inspection project of the product quality of the marine observation data; and performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system. According to the method and the device, quality inspection and analysis are carried out on the marine observation data products according to the quality inspection items of the configuration files, and quality inspection results are generated, so that automatic quality inspection of the marine observation satellite data products is realized, the inspection efficiency and the accuracy are improved, and the generated quality inspection results can provide judgment basis for data product abnormity and data product quality for the operation control system and the filing and distribution system.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Example nine
The application also provides a server, which comprises a memory and a processor, wherein the memory is stored with computer readable instructions, and the computer readable instructions, when executed by the processor, cause the processor to execute the steps of the marine observation data product quality online inspection method.
In one embodiment, the terminal is a computer device, as shown in fig. 3. The computer device described in this embodiment may be a server, a personal computer, a network device, and other devices. The computer apparatus includes a processor 302, a memory 303, an input unit 304, a display unit 305, and the like. Those skilled in the art will appreciate that the device configuration means shown in fig. 3 do not constitute a limitation of all devices and may include more or less components than those shown, or some components in combination. The memory 303 may be used to store the computer program 301 and the functional modules, and the processor 302 executes the computer program 301 stored in the memory 303, thereby performing various functional applications of the device and data processing. The memory may be internal or external memory, or include both internal and external memory. The memory may comprise read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), flash memory, or random access memory. The external memory may include a hard disk, a floppy disk, a ZIP disk, a usb-disk, a magnetic tape, etc. The disclosed memory includes, but is not limited to, these types of memory. The disclosed memory is by way of example only and not by way of limitation.
The input unit 304 is used for receiving input of signals and receiving keywords input by a user. The input unit 304 may include a touch panel and other input devices. The touch panel can collect touch operations of a user on or near the touch panel (for example, operations of the user on or near the touch panel by using any suitable object or accessory such as a finger, a stylus and the like) and drive the corresponding connecting device according to a preset program; other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., play control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like. The display unit 305 may be used to display information input by a user or information provided to a user and various menus of the computer apparatus. The display unit 305 may take the form of a liquid crystal display, an organic light emitting diode, or the like. The processor 302 is a control center of the computer device, connects various parts of the entire computer using various interfaces and lines, and performs various functions and processes data by operating or executing software programs and/or modules stored in the memory 302 and calling data stored in the memory.
As one embodiment, the computer device includes: one or more processors 302, a memory 303, one or more computer programs 301, wherein the one or more computer programs 301 are stored in the memory 303 and configured to be executed by the one or more processors 302, and the one or more computer programs 301 are configured to perform the marine observational data product quality online inspection method according to the above embodiment.
Example ten
In this embodiment, the present invention further provides a storage medium storing computer-readable instructions, which when executed by one or more processors, cause the one or more processors to execute the above-mentioned online ocean observation data product quality inspection method. For example, the storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, functional modules in the embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an example of the present application and is not intended to limit the scope of the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application. It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. An online inspection method for marine observation data product quality is characterized by comprising the following steps:
acquiring an observation form from a control system of a marine observation satellite, and analyzing the observation form to extract marine observation data products in the observation form;
analyzing the configuration file, and determining an online inspection project of the product quality of the marine observation data;
and performing quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system.
2. The on-line inspection method for marine observational data product quality according to claim 1, wherein the quality inspection items comprise file format, file size, parameter completeness, time and space continuity range, parameter threshold and quality grade division of the marine observational data product.
3. The on-line quality inspection method for marine observational data products according to claim 2, wherein the step of performing quality inspection and analysis on the marine observational data products according to the quality inspection items comprises:
and respectively carrying out quality inspection and analysis on the file format, the file size and the parameter completeness data of the marine observation data product according to the file format, the file size and the parameter number configuration items of the configuration file.
4. The on-line quality inspection method for marine observational data products according to claim 2, wherein the step of performing quality inspection and analysis on the marine observational data products according to the quality inspection items comprises:
carrying out time continuity check on the time information in the marine observation data product according to the time continuity range in the configuration file;
carrying out spatial continuity check on the position information in the marine observation data product according to the spatial continuity range in the configuration file;
and generating a continuity check pie chart according to the time continuity check result and the space continuity check result.
5. The on-line quality inspection method for marine observational data products according to claim 2, wherein the step of performing quality inspection and analysis on the marine observational data products according to the quality inspection items comprises:
and checking whether the marine observation data product meets the index requirements of the corresponding parameter threshold value according to the parameter threshold value range of the configuration file.
6. The on-line quality inspection method for marine observation data products according to claim 1, wherein after the quality inspection result is generated, the method further comprises:
counting the online quality inspection results of the marine observation data products, and outputting the counting results in the form of thematic maps; the statistical content comprises ground type statistics and effective data statistics.
7. The method for online inspection of marine observational data product quality as claimed in claim 6, wherein after the statistics of the online inspection results of marine observational data product quality, the method further comprises:
and marking the statistical result, generating and storing a quality marking file, and performing quality grading according to the quality grading standard of the configuration file to provide marine observation data product distribution marks for the archiving and distribution system.
8. The on-line inspection method for marine observational data product quality as claimed in claim 1, wherein the quality inspection result comprises a quality identification file, a quality inspection report, a quality inspection metadata file and a thematic map file.
9. The utility model provides an online verifying attachment of marine observation data product quality which characterized in that includes:
the acquisition module is used for acquiring an observation form from an operation control system of the marine observation satellite, and analyzing the observation form to extract marine observation data products in the observation form;
the analysis module is used for analyzing the configuration file and determining an online inspection project of the quality of the marine observation data product;
and the generation module is used for carrying out quality inspection and analysis on the marine observation data product according to the quality inspection project to generate a quality inspection result so as to provide a monitoring basis for the quality of the marine observation data product for the operation and control system.
10. A server, characterized by comprising a memory and a processor, the memory having stored therein computer readable instructions which, when executed by the processor, cause the processor to perform the steps of the marine observational data product quality online inspection method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911350629.8A CN110991940A (en) | 2019-12-24 | 2019-12-24 | Ocean observation data product quality online inspection method and device and server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911350629.8A CN110991940A (en) | 2019-12-24 | 2019-12-24 | Ocean observation data product quality online inspection method and device and server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110991940A true CN110991940A (en) | 2020-04-10 |
Family
ID=70075005
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911350629.8A Pending CN110991940A (en) | 2019-12-24 | 2019-12-24 | Ocean observation data product quality online inspection method and device and server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110991940A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113111116A (en) * | 2021-05-12 | 2021-07-13 | 国家海洋信息中心 | Ocean water environment data integration method of ocean comprehensive database |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200809676A (en) * | 2006-08-02 | 2008-02-16 | Gao Jia Jun | Marine data quality method |
| US20170004413A1 (en) * | 2015-06-30 | 2017-01-05 | The Boeing Company | Data driven classification and data quality checking system |
| CN109934494A (en) * | 2019-03-13 | 2019-06-25 | 北京航天宏图信息技术股份有限公司 | A kind of water and soil conservation supervision data quality checking method and system |
-
2019
- 2019-12-24 CN CN201911350629.8A patent/CN110991940A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200809676A (en) * | 2006-08-02 | 2008-02-16 | Gao Jia Jun | Marine data quality method |
| US20170004413A1 (en) * | 2015-06-30 | 2017-01-05 | The Boeing Company | Data driven classification and data quality checking system |
| CN109934494A (en) * | 2019-03-13 | 2019-06-25 | 北京航天宏图信息技术股份有限公司 | A kind of water and soil conservation supervision data quality checking method and system |
Non-Patent Citations (2)
| Title |
|---|
| 丁超;周兴华;王朝阳;周东旭;张化疑;单瑞;: "东海区海洋观测站GPS数据质量检核和分析" * |
| 杨仁忠;于钢;张宁;: "遥感卫星原始数据质量检查方法与实现" * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113111116A (en) * | 2021-05-12 | 2021-07-13 | 国家海洋信息中心 | Ocean water environment data integration method of ocean comprehensive database |
| CN113111116B (en) * | 2021-05-12 | 2022-10-18 | 国家海洋信息中心 | Ocean water environment data integration method of ocean comprehensive database |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107122483B (en) | Basic geographic information data quality inspection method, device and system | |
| CN106980573B (en) | Method, device and system for constructing test case request object | |
| CN111027615B (en) | Middleware fault early warning method and system based on machine learning | |
| CN110990393A (en) | Big data identification method for abnormal data behaviors of industry enterprises | |
| CN109934268B (en) | Abnormal transaction detection method and system | |
| CN116450399B (en) | Fault diagnosis and root cause positioning method for micro service system | |
| CN113850244B (en) | Coal conveying quantity monitoring method, device and equipment based on image recognition and storage medium | |
| CN113888480A (en) | MES-based quality tracing method and system | |
| Panter et al. | To clean or not to clean: Cleaning open‐source data improves extinction risk assessments for threatened plant species | |
| CN112346993B (en) | Method, device and equipment for testing information analysis engine | |
| Gitzel | Data Quality in Time Series Data: An Experience Report. | |
| CN114519498A (en) | Quality evaluation method and system based on BIM (building information modeling) | |
| CN108363678A (en) | One kind being used for the fast automatic processing system of fuel cell pile test data | |
| CN113468034A (en) | Data quality evaluation method and device, storage medium and electronic equipment | |
| Meskas et al. | flowCut: an R package for automated removal of outlier events and flagging of files based on time versus fluorescence analysis | |
| CN117574180B (en) | Fuel production and emission system data correlation control management system | |
| CN111090834B (en) | Off-line inspection method, device and server for ocean observation data product quality | |
| CN110991940A (en) | Ocean observation data product quality online inspection method and device and server | |
| CN112882898B (en) | Anomaly detection method, system, device and medium based on big data log analysis | |
| CN113283768A (en) | Food detection item extraction method, device, equipment and storage medium | |
| CN117391534A (en) | Construction quality monitoring method and device, electronic equipment and storage medium | |
| CN116912061A (en) | Soil ecological environment monitoring and management method and system based on big data | |
| CN115795319A (en) | Test item detection method and related device based on CNAS detection laboratory | |
| CN112734211B (en) | Coal consistency evaluation method, device, equipment and readable storage medium | |
| CN113590663A (en) | Environment detection method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |