CN116644031B - Method and system for unified standardization of coal mine water damage data in different formats - Google Patents
Method and system for unified standardization of coal mine water damage data in different formats Download PDFInfo
- Publication number
- CN116644031B CN116644031B CN202310927999.3A CN202310927999A CN116644031B CN 116644031 B CN116644031 B CN 116644031B CN 202310927999 A CN202310927999 A CN 202310927999A CN 116644031 B CN116644031 B CN 116644031B
- Authority
- CN
- China
- Prior art keywords
- data
- coal mine
- mine water
- format
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000003245 coal Substances 0.000 title claims abstract description 389
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 title claims abstract description 389
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000006243 chemical reaction Methods 0.000 claims abstract description 95
- 238000013507 mapping Methods 0.000 claims abstract description 38
- 238000012545 processing Methods 0.000 claims abstract description 31
- 238000004458 analytical method Methods 0.000 claims abstract description 25
- 238000004806 packaging method and process Methods 0.000 claims abstract description 10
- 238000007726 management method Methods 0.000 claims description 36
- 230000000737 periodic effect Effects 0.000 claims description 17
- 230000006978 adaptation Effects 0.000 claims description 9
- 230000011218 segmentation Effects 0.000 claims description 8
- 230000005540 biological transmission Effects 0.000 claims description 7
- 230000001502 supplementing effect Effects 0.000 claims description 7
- 238000000926 separation method Methods 0.000 claims description 5
- 238000013500 data storage Methods 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 3
- 238000012795 verification Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 description 11
- 230000000694 effects Effects 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000009469 supplementation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/11—File system administration, e.g. details of archiving or snapshots
- G06F16/116—Details of conversion of file system types or formats
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
- G06F16/164—File meta data generation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/172—Caching, prefetching or hoarding of files
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Library & Information Science (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a method and a system for unified standardization of coal mine water damage data in different formats, wherein the method comprises the following steps: acquiring original coal mine water disaster data files of different types of file sources based on a server local catalog, and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes; carrying out data formatting processing on coal mine water hazard data based on the configured file analysis rule, and converting the coal mine water hazard data in different original formats after the data formatting processing into a target unified format based on the format mapping rule; classifying and storing the coal mine water disaster data in the target unified format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the unified format. The flexibility and the intelligence of data conversion are improved, meanwhile, the efficiency and the accuracy of data format conversion are also improved, and unified management and analysis of data files with different contents and structures are facilitated.
Description
Technical Field
The invention relates to the technical field of data processing, in particular to a method and a system for unified standardization of coal mine water damage data in different formats.
Background
The coal mine water disaster refers to a flood which affects production, threatens the safety of a mining working face or a mine, increases the cost of ton coal and enables the mine to be partially or completely submerged, and because the coal mine water disaster relates to a plurality of different aspects, the content and the format of the coal mine water disaster data acquired by the corresponding sensors greatly affect the unified management and analysis of the coal mine water disaster data;
at present, human analysis is mostly adopted when unified standard operation is carried out on coal mine water hazard data, the unified standard operation is limited and guided for workers to the coal mine water hazard data according to industry requirements, and the unified standard operation is special for special people, and because the management is carried out manually, the unified errors of the coal mine water hazard data format are easily caused, and the corresponding unified operation of the coal mine water hazard data in various different types and different formats is carried out differently, so that the working efficiency and accuracy are greatly reduced;
therefore, in order to overcome the defects, the invention provides a method and a system for unified standardization of coal mine water damage data in different formats.
Disclosure of Invention
The invention provides a method and a system for unified standardization of coal mine water damage data in different formats.
The invention provides a method for unified standardization of coal mine water damage data in different formats, which is characterized by comprising the following steps:
step 1: acquiring original coal mine water disaster data files of different types of file sources based on a server local catalog, and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes;
step 2: carrying out data formatting processing on coal mine water hazard data based on the configured file analysis rule, and converting the coal mine water hazard data in different original formats after the data formatting processing into a target unified format based on the format mapping rule;
step 3: classifying and storing the coal mine water disaster data in the target unified format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the unified format.
Preferably, in step 1, an original coal mine water disaster data file of different types of file sources is obtained based on a server local directory, including:
acquiring a server local directory, determining a file source to be called based on the server local directory, and generating a file calling request based on the file source to be called;
Acquiring a calling task of a coal mine water damage data file, analyzing the calling task to obtain a calling frequency of the coal mine water damage data file, and configuring a preset clock generator based on the calling frequency;
generating periodic pulses based on configuration results, combining the periodic pulses with file retrieval requests to obtain periodic file retrieval requests, and sending the periodic file retrieval requests to a server based on the retrieval frequency;
and periodically acquiring the original coal mine water damage data files of different types of file sources from the server based on the transmission result.
Preferably, in step 1, the method for unified standardization of coal mine water disaster data in different formats reads coal mine water disaster data in different original coal mine water disaster data files based on file attributes, including:
the method comprises the steps of obtaining an original coal mine water disaster data file, and analyzing the original coal mine water disaster data file based on file attributes to obtain a basic file and a real-time data file in the original coal mine water disaster data file;
analyzing the real-time data file to obtain data structure characteristics, and obtaining target positions of different types of data in the real-time data file based on the data structure characteristics;
And positioning the coal mine water disaster data in the original coal mine water disaster data file based on the target position, and reading the coal mine water disaster data obtained by positioning.
Preferably, a method for unified standardization of coal mine water damage data in different formats reads coal mine water damage data obtained by positioning, and the method comprises the following steps:
acquiring read coal mine water damage data, and analyzing the coal mine water damage data to obtain character labels corresponding to all data in the coal mine water damage data and paragraph labels in the coal mine water damage data;
determining character values of all data based on character labels, determining paragraph values in coal mine water damage data based on paragraph labels, judging that the current data and the current paragraphs are blank characters and blank lines when the character values and the paragraph values are blank, and eliminating the blank characters and the blank lines based on preset eliminating rules;
verifying the coal mine water damage data obtained after blank characters and blank rows are removed based on a preset context logic rule, and determining lost and distorted data in the coal mine water damage data based on a verification result;
analyzing front and rear target data of the lost and distorted data, obtaining a line text logic and a line text field value at the lost and distorted data based on an analysis result, and supplementing and repairing the lost and distorted data based on the line text logic and the line text field value;
And obtaining final coal mine water damage data based on the supplementing and repairing results.
Preferably, in step 2, data formatting processing is performed on the coal mine water damage data based on configured file analysis rules, including:
acquiring the obtained coal mine water disaster data, and analyzing the coal mine water disaster data based on a configured file analysis rule to obtain a target character set in the coal mine water disaster data, wherein the target character set comprises a segmentation character, a file body separator, a line feed separation character and an ending character;
dividing the coal mine water disaster data based on the separator, dividing and line-feeding the first divided coal mine water disaster data based on the line-feeding separator and the ending character to obtain sub-coal mine water disaster data;
reading metadata in the sub-coal mine water disaster data, and performing second division on the sub-coal mine water disaster data based on the file header and the file body separator of the original coal mine water disaster data file to obtain a coal mine water disaster data field;
extracting data characteristics of coal mine water damage data fields, and matching target Chinese field notes, spare fields and default values from a preset database based on the data characteristics;
And associating the target Chinese field remarks, the spare fields and the default values with the coal mine water damage data fields, displaying association results based on a preset display interface, and completing data formatting processing of the coal mine water damage data based on the display results.
Preferably, in step 2, the method for unified standardization of the coal mine water damage data in different formats converts the coal mine water damage data in different original formats after data formatting processing into a target unified format based on a format mapping rule, which comprises the following steps:
acquiring target requirements of a management terminal on coal mine water damage data formats, and determining expected coal mine water damage data unified formats based on the target requirements;
analyzing the expected coal mine water disaster data unified format to obtain format mapping relations between different original coal mine water disaster data formats and the expected coal mine water disaster data unified format, and determining format conversion characteristics based on the format mapping relations;
invoking the target code block on a preset format configuration page based on the format conversion characteristic, and performing flow adaptation on the target code block based on the preset format configuration page to obtain a format mapping rule;
constructing a distributed format conversion thread, deploying a format mapping rule in the distributed format conversion thread, and obtaining a target distributed format conversion thread based on a deployment result;
Determining the number of threads in a target distributed format conversion thread, constructing a data uploading queue based on the number of threads, and averagely uploading the acquired coal mine water damage data of different types of file sources to the data uploading queue according to the number of threads;
and synchronously uploading the coal mine water disaster data in different data uploading queues to a target distributed format conversion thread for format conversion based on uploading results, and completing the conversion of the coal mine water disaster data in different original formats into a target unified format.
Preferably, a method for unified standardization of coal mine water damage data in different formats, for obtaining target requirements of a management terminal on the coal mine water damage data format, includes:
if the management terminal does not have a requirement on the coal mine water damage data format, acquiring a reference format conversion template, and configuring the working condition of the reference format conversion template;
performing interface adaptation on the reference format conversion model based on the configuration result, and associating the interface with the working condition;
when the management terminal has no requirement on the coal mine water disaster data format, the management terminal judges that the working condition is met, and inputs the coal mine water disaster data in different original formats into a reference format conversion template for processing based on the interface, so that the coal mine water disaster data in a target unified format is obtained.
Preferably, in step 3, the method for unified standardization of the coal mine water disaster data in different formats stores the coal mine water disaster data in a target unified format in a classified manner, including:
acquiring coal mine water damage data in a uniform format of the obtained target, and determining classification labels based on different types of file sources;
clustering coal mine water disaster data in a target unified format based on the classification labels to obtain coal mine water disaster data sets in the target unified format, and setting storage space for each coal mine water disaster data set in the target unified format in a preset cache space based on the classification labels;
and determining the data quantity of the coal mine water disaster data sets in each target unified format, adapting the byte storage quantity of the storage space based on the data quantity, and storing the coal mine water disaster data sets in each target unified format in the corresponding storage space based on the adapting result to finish the classified storage of the coal mine water disaster data in the target unified format.
Preferably, in step 3, the method for unified standardization of coal mine water damage data in different formats is to package coal mine water damage data to be called based on a call request, and output the packaged coal mine water damage data in a unified format, and includes:
Acquiring a retrieval request sent by a data acquisition terminal, analyzing the retrieval request, and determining a data identifier to be retrieved;
searching coal mine water damage data in a preset storage space based on the to-be-called data identifier, and determining the to-be-called coal mine water damage data based on the searching;
compressing and packaging the coal mine water damage data to be modulated, and adding the data mark to be modulated as a data packet header into the compressed and packaged data packet to obtain a target output data packet;
and feeding back the target output data packet to the data acquisition terminal based on the data transmission link, and completing the uniform format output of the coal mine water damage data.
The invention provides a system for unified standardization of coal mine water damage data in different formats, which comprises:
the data acquisition module is used for acquiring original coal mine water disaster data files of different types of file sources based on the local catalogue of the server and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes;
the format conversion module is used for carrying out data formatting processing on the coal mine water hazard data based on the configured file analysis rule and converting the coal mine water hazard data with different original formats after the data formatting processing into a target unified format based on the format mapping rule;
The data storage and output module is used for classifying and storing the coal mine water disaster data in the uniform format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the uniform format.
Compared with the prior art, the invention has the following beneficial effects:
1. the data conversion method has the advantages that the format conversion processing is carried out on the coal mine water damage data with different types and different formats, the flexibility and the intelligence of the data conversion are improved, meanwhile, the efficiency and the accuracy of the data format conversion are also improved, the method can adapt to various original data formats, and the data is automatically converted into a unified format, so that the unified management and analysis of the data files with different contents and structures are facilitated, and the management effect of the data with different formats is improved.
2. The method comprises the steps of analyzing target requirements of a management terminal coal mine water damage data format, accurately and effectively determining format mapping relations between different original coal mine water damage data formats and expected coal mine water damage data unified formats, constructing corresponding format mapping rules on a preset format configuration page according to the format mapping relations, deploying the obtained format mapping rules in a constructed distributed format conversion thread, and finally realizing unified format conversion operation on coal mine water damage data of different types and different formats through the obtained target distributed format conversion thread synchronously, so that flexibility and intelligence of data conversion are improved, meanwhile, efficiency and accuracy of data format conversion are improved, various original data formats can be adapted, data are automatically converted into unified formats, and unified management and analysis of data files of different contents and structures are facilitated.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
FIG. 1 is a flow chart of a method for unified standardization of coal mine water damage data in different formats in an embodiment of the invention;
FIG. 2 is a flowchart of step 1 in a method for unified standardization of coal mine water damage data in different formats according to an embodiment of the present invention;
fig. 3 is a block diagram of a system for unified standardization of coal mine water damage data in different formats in an embodiment of the invention.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
Example 1
The embodiment provides a method for unified standardization of coal mine water damage data in different formats, as shown in fig. 1, which comprises the following steps:
step 1: acquiring original coal mine water disaster data files of different types of file sources based on a server local catalog, and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes;
step 2: carrying out data formatting processing on coal mine water hazard data based on the configured file analysis rule, and converting the coal mine water hazard data in different original formats after the data formatting processing into a target unified format based on the format mapping rule;
step 3: classifying and storing the coal mine water disaster data in the target unified format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the unified format.
In this embodiment, the server local directory is set in advance, and is a chart used for recording data sources of different categories in the server, so as to facilitate calling of file sources of corresponding categories according to the server local directory.
In this embodiment, the original coal mine water damage data file refers to a file corresponding to original data detected by different types of sensors called from a server, and the data recorded in the file corresponding to different types of file sources are different.
In this embodiment, the file attributes are used to characterize the type of original coal mine water damage data file, the type of data recorded, the form in which the data exists in the file, and the like.
In this embodiment, the coal mine water damage data refers to specific data related to coal mine water damage extracted from an original coal mine water damage data file, wherein the coal mine water damage refers to a flood disaster in which production, threat to the working face or mine safety and increase of ton coal cost to partially or totally submerge the mine.
In this embodiment, the file parsing rule refers to parsing data contained in a file, so as to perform word segmentation and line feed operations on the data in the file, thereby facilitating unification of the format of the data.
In this embodiment, the data formatting process refers to performing a line segmentation operation and a word segmentation operation on coal mine water damage data, so as to perform format unification.
In this embodiment, the format mapping rule is a rule for representing that the original coal mine water damage data of different categories are subjected to format unification.
In this embodiment, the raw format refers to the most primitive data format acquired by the sensor.
In this embodiment, the target unified format refers to converting coal mine water damage data in different original formats into the same format, so as to facilitate corresponding analysis and management operations.
In this embodiment, the call request is sent by the data acquisition terminal, and is used to call the corresponding data from the data storage space.
In this embodiment, the coal mine water damage data to be called refers to specific coal mine water damage data to be called by the data acquisition terminal.
The beneficial effects of the technical scheme are as follows: the data conversion method has the advantages that the format conversion processing is carried out on the coal mine water damage data with different types and different formats, the flexibility and the intelligence of the data conversion are improved, meanwhile, the efficiency and the accuracy of the data format conversion are also improved, the method can adapt to various original data formats, and the data is automatically converted into a unified format, so that the unified management and analysis of the data files with different contents and structures are facilitated, and the management effect of the data with different formats is improved.
Example 2
On the basis of embodiment 1, this embodiment provides a method for unified standardization of coal mine water damage data in different formats, as shown in fig. 2, in step 1, original coal mine water damage data files of different types of file sources are obtained based on a server local directory, including:
step 101: acquiring a server local directory, determining a file source to be called based on the server local directory, and generating a file calling request based on the file source to be called;
Step 102: acquiring a calling task of a coal mine water damage data file, analyzing the calling task to obtain a calling frequency of the coal mine water damage data file, and configuring a preset clock generator based on the calling frequency;
step 103: generating periodic pulses based on configuration results, combining the periodic pulses with file retrieval requests to obtain periodic file retrieval requests, and sending the periodic file retrieval requests to a server based on the retrieval frequency;
step 104: and periodically acquiring the original coal mine water damage data files of different types of file sources from the server based on the transmission result.
In this embodiment, the file source to be called refers to the file type that needs to be called.
In this embodiment, the file access request is generated according to the file source to be accessed, and is used to access the corresponding original coal mine water damage data file from the server.
In this embodiment, the calling task is used for representing the calling quantity of the coal mine water damage data, the data type needing to be called, and the like.
In this embodiment, the frequency of the call is used to characterize the number of calls to the coal mine water damage data file per unit time.
In this embodiment, the preset always generator is set in advance for generating the corresponding pulse signal.
In this embodiment, the periodic pulse is a periodic signal generated by a preset clock generator according to the retrieval frequency, so as to automatically retrieve the corresponding original coal mine water damage data file from the server.
In this embodiment, the periodic file access request is obtained by combining a periodic pulse with the file access request, and is used to periodically access a corresponding file from the server, so as to achieve automatic file access.
The beneficial effects of the technical scheme are as follows: the file source to be called is determined, so that accurate and effective generation of file calling requests is realized, secondly, the calling tasks are analyzed, the calling frequency of the files is locked, finally, a preset clock generator is configured according to the calling frequency, and periodic pulses generated after configuration are combined with the file calling requests, so that the original coal mine water damage data files of different types are periodically obtained from a server, and convenience and guarantee are provided for unified operation of data formats.
Example 3
On the basis of embodiment 1, this embodiment provides a method for unified standardization of coal mine water disaster data in different formats, in step 1, the coal mine water disaster data in different original coal mine water disaster data files are read based on file attributes, including:
The method comprises the steps of obtaining an original coal mine water disaster data file, and analyzing the original coal mine water disaster data file based on file attributes to obtain a basic file and a real-time data file in the original coal mine water disaster data file;
analyzing the real-time data file to obtain data structure characteristics, and obtaining target positions of different types of data in the real-time data file based on the data structure characteristics;
and positioning the coal mine water disaster data in the original coal mine water disaster data file based on the target position, and reading the coal mine water disaster data obtained by positioning.
In the embodiment, the basic file is file information which is generated by different types of sensors in working and used for distinguishing equipment types, and is irrelevant to coal mine water damage data which are actually collected.
In the embodiment, the real-time data file is used for recording collected coal mine water damage data, so that coal mine water damage data in different formats can be unified conveniently.
In this embodiment, the data structure features are used to characterize specific data contained in the original coal mine water damage data files of different categories, association relations between different data, and the like.
In this embodiment, the target location is a location for recording different types of data in the corresponding file, so as to accurately locate the coal mine water damage data in the original coal mine water damage data file.
The beneficial effects of the technical scheme are as follows: the method has the advantages that the obtained original coal mine water damage data file is analyzed, the data structure characteristics are accurately and effectively determined, the positions of different types of data in the original coal mine water damage data file are positioned according to the data structure characteristics, and finally, the coal mine water damage data in the original coal mine water damage data file are effectively read according to the positioning result, so that orderly format unification operation of the coal mine water damage data in different formats is facilitated, and guarantee is provided for improving the unification efficiency of the data formats.
Example 4
On the basis of embodiment 3, the embodiment provides a method for unified standardization of coal mine water damage data in different formats, and the method for reading the coal mine water damage data obtained by positioning comprises the following steps:
acquiring read coal mine water damage data, and analyzing the coal mine water damage data to obtain character labels corresponding to all data in the coal mine water damage data and paragraph labels in the coal mine water damage data;
determining character values of all data based on character labels, determining paragraph values in coal mine water damage data based on paragraph labels, judging that the current data and the current paragraphs are blank characters and blank lines when the character values and the paragraph values are blank, and eliminating the blank characters and the blank lines based on preset eliminating rules;
Verifying the coal mine water damage data obtained after blank characters and blank rows are removed based on a preset context logic rule, and determining lost and distorted data in the coal mine water damage data based on a verification result;
analyzing front and rear target data of the lost and distorted data, obtaining a line text logic and a line text field value at the lost and distorted data based on an analysis result, and supplementing and repairing the lost and distorted data based on the line text logic and the line text field value;
and obtaining final coal mine water damage data based on the supplementing and repairing results.
In this embodiment, the character tag is a symbol used to characterize different data or characters.
In this embodiment, the paragraph tag is a symbol for characterizing a paragraph, and accurate locking can be performed on the paragraph by the paragraph tag.
In this embodiment, the character value is used to characterize whether different data or characters have specific content.
In this embodiment, the paragraph value is used to characterize whether the current paragraph is valid, i.e., whether there is specific data content in the paragraph.
In the embodiment, the preset eliminating rule is set in advance and is used for eliminating blank characters and blank rows, so that effective coal mine water damage data are ensured to be obtained.
In this embodiment, the preset context logic rule is set in advance, and is used for verifying the integrity of the data content in the coal mine water damage data, so as to find out the lost and distorted data in the coal mine water damage data.
In this embodiment, the front and rear target data refers to front and rear data adjacent to the lost and distorted data, so as to facilitate corresponding supplementation and repair of the lost and distorted data.
In this embodiment, the context logic refers to the association between the front and rear target data and the lost and distorted data, so as to facilitate the corresponding supplementing and repairing operations.
In this embodiment, the row field value refers to the specific data content that the lost and distorted data should represent.
The beneficial effects of the technical scheme are as follows: through analyzing the obtained coal mine water damage data, blank characters and blank rows in the coal mine water damage data are removed, and lost and distorted data are supplemented and repaired, so that the accuracy and reliability of the read coal mine water damage data are guaranteed, unified format conversion processing is facilitated on the coal mine water damage data, and corresponding management operation is facilitated on the coal mine water damage data.
Example 5
On the basis of embodiment 1, the embodiment provides a method for unified standardization of coal mine water damage data in different formats, in step 2, data formatting processing is performed on the coal mine water damage data based on configured file analysis rules, including:
acquiring the obtained coal mine water disaster data, and analyzing the coal mine water disaster data based on a configured file analysis rule to obtain a target character set in the coal mine water disaster data, wherein the target character set comprises a segmentation character, a file body separator, a line feed separation character and an ending character;
dividing the coal mine water disaster data based on the separator, dividing and line-feeding the first divided coal mine water disaster data based on the line-feeding separator and the ending character to obtain sub-coal mine water disaster data;
reading metadata in the sub-coal mine water disaster data, and performing second division on the sub-coal mine water disaster data based on the file header and the file body separator of the original coal mine water disaster data file to obtain a coal mine water disaster data field;
extracting data characteristics of coal mine water damage data fields, and matching target Chinese field notes, spare fields and default values from a preset database based on the data characteristics;
And associating the target Chinese field remarks, the spare fields and the default values with the coal mine water damage data fields, displaying association results based on a preset display interface, and completing data formatting processing of the coal mine water damage data based on the display results.
In this embodiment, the target character set refers to various characters contained in the coal mine water damage data, and specifically includes a segmentation character, a file body separator, a line feed separation character and an end character, wherein the file body separator is used for splitting the coal mine water damage data into single fields.
In the embodiment, the first segmentation refers to the fact that coal mine water damage data are subjected to sentence breaking so as to facilitate line separation operation, such as 1XXXX8; 2021-12-09 01:34:59~100000111111MN1212123;0503; XX water bin; 0;0.85; m is equal to min;2021-12-09 01:34:29~100000111111MN1212123; XX water bin; 0;2.25 m+ m/min; 2021-12-09 01:28:52~100000111111MN1212123; an XX sump outer port; 0;0.95; m is equal to min; 2021-12-09:33:41-formatted as: 1:1 XXXX8; XX coal mine; 2021-12-09:34:592: 1100000111111MN1212123;0503; XX water bin; 0;0.85; m is equal to min; 2021-12-09:34:29, 3:100000111111M N1212123;0503; XX sump; 0;2.25; m.sup.1-12-09:01:28:52.
In this embodiment, the sub-coal mine water damage data refers to coal mine water damage data corresponding to each line obtained after the coal mine water damage data is divided and line-fed.
In this embodiment, metadata refers to specific data content or data characters corresponding to each line of sub-coal mine water damage data.
In this embodiment, the header is the beginning of the data file that characterizes the original coal mine water damage.
In this embodiment, the second division refers to further splitting the coal mine water damage data, so as to obtain corresponding coal mine water damage data fields.
In this embodiment, the data characteristics refer to the data types of the different coal mine water damage data fields and the corresponding specific data contents.
In this embodiment, the preset database is preset in advance, and is used for storing remarks of target chinese fields, spare fields and default values corresponding to different types of coal mine water damage data fields.
In this embodiment, the preset display interface is set in advance, and is used for displaying data.
The beneficial effects of the technical scheme are as follows: the method comprises the steps of analyzing the obtained coal mine water damage data, accurately and effectively determining a target character set in the coal mine water damage data, carrying out corresponding formatting operation on the coal mine water damage data through each target character in the target character set, adding target Chinese field notes, spare fields and default values to the data after the formatting operation, effectively formatting the coal mine water damage data, and providing convenience and guarantee for carrying out corresponding format unified operation.
Example 6
On the basis of embodiment 1, the embodiment provides a method for unified standardization of coal mine water damage data in different formats, in step 2, the method for converting the coal mine water damage data in different original formats after data formatting into a target unified format based on format mapping rules comprises the following steps:
acquiring target requirements of a management terminal on coal mine water damage data formats, and determining expected coal mine water damage data unified formats based on the target requirements;
analyzing the expected coal mine water disaster data unified format to obtain format mapping relations between different original coal mine water disaster data formats and the expected coal mine water disaster data unified format, and determining format conversion characteristics based on the format mapping relations;
invoking the target code block on a preset format configuration page based on the format conversion characteristic, and performing flow adaptation on the target code block based on the preset format configuration page to obtain a format mapping rule;
constructing a distributed format conversion thread, deploying a format mapping rule in the distributed format conversion thread, and obtaining a target distributed format conversion thread based on a deployment result;
determining the number of threads in a target distributed format conversion thread, constructing a data uploading queue based on the number of threads, and averagely uploading the acquired coal mine water damage data of different types of file sources to the data uploading queue according to the number of threads;
And synchronously uploading the coal mine water disaster data in different data uploading queues to a target distributed format conversion thread for format conversion based on uploading results, and completing the conversion of the coal mine water disaster data in different original formats into a target unified format.
In this embodiment, the target requirement refers to a requirement of the management terminal on a coal mine water damage data format, and may specifically be a specific data format required, for example, may be: fields +: + data content format, such as: body column1: 100000111111MN1212123;0503.
in this embodiment, the expected unified format of the coal mine water damage data refers to a data format that the management terminal needs to acquire.
In the embodiment, the format mapping relation is used for representing the corresponding relation between different original coal mine water damage data formats and expected coal mine water damage data unified formats, so that format unified operation is conveniently carried out on the different original coal mine water damage data formats according to the mapping relation.
In this embodiment, the format conversion feature refers to a specific manner of performing format conversion, a specific step, and the like.
In the embodiment, the preset format configuration page is set in advance and is used for carrying out corresponding format unification operation on the original coal mine water damage data.
In this embodiment, the target code blocks are directly obtained according to the format conversion feature, so that encoding is avoided, and the data format conversion flow is effectively formulated by cooperating different target code blocks.
In this embodiment, the process adaptation refers to associating object code blocks according to execution logic, thereby obtaining a complete set of processing system.
In this embodiment, the distributed format conversion thread is configured according to conversion requirements, and is used to perform corresponding processing operations on multiple different types of data, different formats of data, and different types of files at the same time.
In this embodiment, the target distributed format conversion thread refers to a flow capable of performing format conversion obtained after the obtained format mapping rule is deployed in the constructed distributed format conversion thread.
In this embodiment, the data upload queue refers to a carrier for uploading coal mine water damage data in different formats to the target distributed format conversion thread.
The beneficial effects of the technical scheme are as follows: the method comprises the steps of analyzing target requirements of a management terminal coal mine water damage data format, accurately and effectively determining format mapping relations between different original coal mine water damage data formats and expected coal mine water damage data unified formats, constructing corresponding format mapping rules on a preset format configuration page according to the format mapping relations, deploying the obtained format mapping rules in a constructed distributed format conversion thread, and finally realizing unified format conversion operation on coal mine water damage data of different types and different formats through the obtained target distributed format conversion thread synchronously, so that flexibility and intelligence of data conversion are improved, meanwhile, efficiency and accuracy of data format conversion are improved, various original data formats can be adapted, data are automatically converted into unified formats, and unified management and analysis of data files of different contents and structures are facilitated.
Example 7
On the basis of embodiment 6, the embodiment provides a method for unified standardization of coal mine water damage data in different formats, and the method for obtaining target requirements of a management terminal on the coal mine water damage data formats comprises the following steps:
if the management terminal does not have a requirement on the coal mine water damage data format, acquiring a reference format conversion template, and configuring the working condition of the reference format conversion template;
performing interface adaptation on the reference format conversion model based on the configuration result, and associating the interface with the working condition;
when the management terminal has no requirement on the coal mine water disaster data format, the management terminal judges that the working condition is met, and inputs the coal mine water disaster data in different original formats into a reference format conversion template for processing based on the interface, so that the coal mine water disaster data in a target unified format is obtained.
In the embodiment, the reference format conversion template refers to a template provided by a system, and aims to automatically perform uniform format conversion operation on coal mine water damage data in different formats.
In the embodiment, the working conditions refer to the working environment and requirements of the standard format conversion template, and when the working conditions are that the management terminal has no requirements on the coal mine water disaster data format, the standard format conversion template is used for carrying out format unified operation on the coal mine water disaster data in the different types of original coal mine water disaster data files.
In this embodiment, the interface adaptation refers to adding an interface to the reference format conversion model in order to receive coal mine water damage data in different formats.
The beneficial effects of the technical scheme are as follows: the format conversion flow when the management terminal does not have the requirement on the format of the coal mine water damage data is analyzed, so that automatic format unification operation on the coal mine water damage data with different formats is realized through the standard format conversion template, various original data formats can be adapted, the data is automatically converted into the unified format, and unified management and analysis on the data files with different contents and structures are facilitated.
Example 8
On the basis of embodiment 1, the embodiment provides a method for unified standardization of coal mine water disaster data in different formats, and in step 3, classification storage is performed on the coal mine water disaster data in a target unified format, including:
acquiring coal mine water damage data in a uniform format of the obtained target, and determining classification labels based on different types of file sources;
clustering coal mine water disaster data in a target unified format based on the classification labels to obtain coal mine water disaster data sets in the target unified format, and setting storage space for each coal mine water disaster data set in the target unified format in a preset cache space based on the classification labels;
And determining the data quantity of the coal mine water disaster data sets in each target unified format, adapting the byte storage quantity of the storage space based on the data quantity, and storing the coal mine water disaster data sets in each target unified format in the corresponding storage space based on the adapting result to finish the classified storage of the coal mine water disaster data in the target unified format.
In the embodiment, the classification labels are determined according to different types of file sources and are the basis and the reference for classifying the coal mine water damage data.
In this embodiment, the target unified format coal mine water disaster data set refers to coal mine water disaster data of each type obtained after classification operation is performed on the target unified format coal mine water disaster data according to the classification tag.
In this embodiment, the preset buffer space is set in advance, and is used for storing the coal mine water damage data sets with different types and target unified formats.
In this embodiment, the purpose of adapting the byte storage amount of the storage space based on the data amount is to ensure that the storage space of the device can effectively store the data of the coal mine water damage data set in each target unified format.
The beneficial effects of the technical scheme are as follows: the classification labels are determined according to different types of file sources, so that the coal mine water damage data are clustered according to the classification labels, the data size of the coal mine water damage data of each type is determined, the storage byte size of the storage space is adapted according to the data size, and finally, the corresponding storage operation is carried out on the coal mine water damage data set with the unified format of each target through the adapted storage space, so that the management effectiveness of the coal mine water damage data after format conversion is improved.
Example 9
On the basis of embodiment 1, the embodiment provides a method for unified standardization of coal mine water damage data in different formats, in step 3, the coal mine water damage data to be called is packaged based on a calling request, and the packaged coal mine water damage data is output in a unified format, which comprises the following steps:
acquiring a retrieval request sent by a data acquisition terminal, analyzing the retrieval request, and determining a data identifier to be retrieved;
searching coal mine water damage data in a preset storage space based on the to-be-called data identifier, and determining the to-be-called coal mine water damage data based on the searching;
compressing and packaging the coal mine water damage data to be modulated, and adding the data mark to be modulated as a data packet header into the compressed and packaged data packet to obtain a target output data packet;
and feeding back the target output data packet to the data acquisition terminal based on the data transmission link, and completing the uniform format output of the coal mine water damage data.
In this embodiment, the data identifier to be called is a tag label for marking the type of data or the content of the data to be called.
In this embodiment, the packet header is used to characterize the type of the packet, so that the data acquisition terminal can effectively receive the packet.
In this embodiment, the target output data packet refers to a data packet that can be directly output, which is obtained by adding the identifier of the data to be extracted as a packet header to the compressed and packaged data packet.
The beneficial effects of the technical scheme are as follows: the method has the advantages that the data acquisition terminal sends the data acquisition request to be analyzed, accurate and effective determination of the data of the water damage of the coal mine is achieved, the determined data of the water damage of the coal mine is compressed and packaged, and finally, the obtained data packet is fed back to the data acquisition terminal through the data transmission link, so that the efficiency and reliability of the output of the data of the water damage of the coal mine in a unified format are guaranteed, and the data files with different contents and structures are convenient to manage and analyze in a unified mode.
Example 10
The embodiment provides a system for unified standardization of coal mine water damage data in different formats, as shown in fig. 3, including:
the data acquisition module is used for acquiring original coal mine water disaster data files of different types of file sources based on the local catalogue of the server and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes;
the format conversion module is used for carrying out data formatting processing on the coal mine water hazard data based on the configured file analysis rule and converting the coal mine water hazard data with different original formats after the data formatting processing into a target unified format based on the format mapping rule;
The data storage and output module is used for classifying and storing the coal mine water disaster data in the uniform format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the uniform format.
The beneficial effects of the technical scheme are as follows: the data conversion method has the advantages that the format conversion processing is carried out on the coal mine water damage data with different types and different formats, the flexibility and the intelligence of the data conversion are improved, meanwhile, the efficiency and the accuracy of the data format conversion are also improved, the method can adapt to various original data formats, and the data is automatically converted into a unified format, so that the unified management and analysis of the data files with different contents and structures are facilitated, and the management effect of the data with different formats is improved.
It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (9)
1. The method for unified standardization of coal mine water damage data in different formats is characterized by comprising the following steps:
Step 1: acquiring original coal mine water disaster data files of different types of file sources based on a server local catalog, and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes;
step 2: carrying out data formatting processing on coal mine water hazard data based on the configured file analysis rule, and converting the coal mine water hazard data in different original formats after the data formatting processing into a target unified format based on the format mapping rule;
step 3: classifying and storing the coal mine water disaster data in the target unified format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the unified format;
in step 2, the method converts coal mine water damage data in different original formats after data formatting processing into a target unified format based on a format mapping rule, and includes:
acquiring target requirements of a management terminal on coal mine water damage data formats, and determining expected coal mine water damage data unified formats based on the target requirements;
analyzing the expected coal mine water disaster data unified format to obtain format mapping relations between different original coal mine water disaster data formats and the expected coal mine water disaster data unified format, and determining format conversion characteristics based on the format mapping relations;
Invoking the target code block on a preset format configuration page based on the format conversion characteristic, and performing flow adaptation on the target code block based on the preset format configuration page to obtain a format mapping rule;
constructing a distributed format conversion thread, deploying a format mapping rule in the distributed format conversion thread, and obtaining a target distributed format conversion thread based on a deployment result;
determining the number of threads in a target distributed format conversion thread, constructing a data uploading queue based on the number of threads, and averagely uploading the acquired coal mine water damage data of different types of file sources to the data uploading queue according to the number of threads;
and synchronously uploading the coal mine water disaster data in different data uploading queues to a target distributed format conversion thread for format conversion based on uploading results, and completing the conversion of the coal mine water disaster data in different original formats into a target unified format.
2. The method for unified standardization of coal mine water damage data in different formats according to claim 1, wherein in step 1, obtaining original coal mine water damage data files of different types of file sources based on a server local directory includes:
acquiring a server local directory, determining a file source to be called based on the server local directory, and generating a file calling request based on the file source to be called;
Acquiring a calling task of a coal mine water damage data file, analyzing the calling task to obtain a calling frequency of the coal mine water damage data file, and configuring a preset clock generator based on the calling frequency;
generating periodic pulses based on configuration results, combining the periodic pulses with file retrieval requests to obtain periodic file retrieval requests, and sending the periodic file retrieval requests to a server based on the retrieval frequency;
and periodically acquiring the original coal mine water damage data files of different types of file sources from the server based on the transmission result.
3. The method for unified standardization of coal mine water disaster data in different formats according to claim 1, wherein in step 1, the coal mine water disaster data in different original coal mine water disaster data files is read based on file attributes, comprising:
the method comprises the steps of obtaining an original coal mine water disaster data file, and analyzing the original coal mine water disaster data file based on file attributes to obtain a basic file and a real-time data file in the original coal mine water disaster data file;
analyzing the real-time data file to obtain data structure characteristics, and obtaining target positions of different types of data in the real-time data file based on the data structure characteristics;
And positioning the coal mine water disaster data in the original coal mine water disaster data file based on the target position, and reading the coal mine water disaster data obtained by positioning.
4. A method for unified standardization of coal mine water damage data in different formats according to claim 3, wherein the method for reading the coal mine water damage data obtained by positioning comprises the following steps:
acquiring read coal mine water damage data, and analyzing the coal mine water damage data to obtain character labels corresponding to all data in the coal mine water damage data and paragraph labels in the coal mine water damage data;
determining character values of all data based on character labels, determining paragraph values in coal mine water damage data based on paragraph labels, judging that the current data and the current paragraphs are blank characters and blank lines when the character values and the paragraph values are blank, and eliminating the blank characters and the blank lines based on preset eliminating rules;
verifying the coal mine water damage data obtained after blank characters and blank rows are removed based on a preset context logic rule, and determining lost and distorted data in the coal mine water damage data based on a verification result;
analyzing front and rear target data of the lost and distorted data, obtaining a line text logic and a line text field value at the lost and distorted data based on an analysis result, and supplementing and repairing the lost and distorted data based on the line text logic and the line text field value;
And obtaining final coal mine water damage data based on the supplementing and repairing results.
5. The method for unified standardization of coal mine water damage data in different formats according to claim 1, wherein in step 2, the data formatting process is performed on the coal mine water damage data based on the configured file parsing rule, and the method comprises the following steps:
acquiring the obtained coal mine water disaster data, and analyzing the coal mine water disaster data based on a configured file analysis rule to obtain a target character set in the coal mine water disaster data, wherein the target character set comprises a segmentation character, a file body separator, a line feed separation character and an ending character;
dividing the coal mine water disaster data based on the separator, dividing and line-feeding the first divided coal mine water disaster data based on the line-feeding separator and the ending character to obtain sub-coal mine water disaster data;
reading metadata in the sub-coal mine water disaster data, and performing second division on the sub-coal mine water disaster data based on the file header and the file body separator of the original coal mine water disaster data file to obtain a coal mine water disaster data field;
extracting data characteristics of coal mine water damage data fields, and matching target Chinese field notes, spare fields and default values from a preset database based on the data characteristics;
And associating the target Chinese field remarks, the spare fields and the default values with the coal mine water damage data fields, displaying association results based on a preset display interface, and completing data formatting processing of the coal mine water damage data based on the display results.
6. The method for unified standardization of coal mine water disaster data in different formats according to claim 1, wherein obtaining target requirements of the management terminal on the coal mine water disaster data formats comprises:
if the management terminal does not have a requirement on the coal mine water damage data format, acquiring a reference format conversion template, and configuring the working condition of the reference format conversion template;
performing interface adaptation on the reference format conversion model based on the configuration result, and associating the interface with the working condition;
when the management terminal has no requirement on the coal mine water disaster data format, the management terminal judges that the working condition is met, and inputs the coal mine water disaster data in different original formats into a reference format conversion template for processing based on the interface, so that the coal mine water disaster data in a target unified format is obtained.
7. The method for unified standardization of coal mine water disaster data in different formats according to claim 1, wherein in step 3, the target coal mine water disaster data in the unified format is classified and stored, and the method comprises the following steps:
Acquiring coal mine water damage data in a uniform format of the obtained target, and determining classification labels based on different types of file sources;
clustering coal mine water disaster data in a target unified format based on the classification labels to obtain coal mine water disaster data sets in the target unified format, and setting storage space for each coal mine water disaster data set in the target unified format in a preset cache space based on the classification labels;
and determining the data quantity of the coal mine water disaster data sets in each target unified format, adapting the byte storage quantity of the storage space based on the data quantity, and storing the coal mine water disaster data sets in each target unified format in the corresponding storage space based on the adapting result to finish the classified storage of the coal mine water disaster data in the target unified format.
8. The method for unified standardization of coal mine water disaster data in different formats according to claim 1, wherein in step 3, the coal mine water disaster data to be called is packaged based on the call request, and the packaged coal mine water disaster data is output in a unified format, which comprises:
acquiring a retrieval request sent by a data acquisition terminal, analyzing the retrieval request, and determining a data identifier to be retrieved;
Searching coal mine water damage data in a preset storage space based on the to-be-called data identifier, and determining the to-be-called coal mine water damage data based on the searching;
compressing and packaging the coal mine water damage data to be modulated, and adding the data mark to be modulated as a data packet header into the compressed and packaged data packet to obtain a target output data packet;
and feeding back the target output data packet to the data acquisition terminal based on the data transmission link, and completing the uniform format output of the coal mine water damage data.
9. A system for unified standardization of coal mine water damage data in different formats, comprising:
the data acquisition module is used for acquiring original coal mine water disaster data files of different types of file sources based on the local catalogue of the server and reading coal mine water disaster data in the different original coal mine water disaster data files based on file attributes;
the format conversion module is used for carrying out data formatting processing on the coal mine water hazard data based on the configured file analysis rule and converting the coal mine water hazard data with different original formats after the data formatting processing into a target unified format based on the format mapping rule;
the data storage and output module is used for classifying and storing the coal mine water disaster data in the uniform format, packaging the coal mine water disaster data to be called based on the call request, and outputting the packaged coal mine water disaster data in the uniform format;
Wherein, the format conversion module includes:
acquiring target requirements of a management terminal on coal mine water damage data formats, and determining expected coal mine water damage data unified formats based on the target requirements;
analyzing the expected coal mine water disaster data unified format to obtain format mapping relations between different original coal mine water disaster data formats and the expected coal mine water disaster data unified format, and determining format conversion characteristics based on the format mapping relations;
invoking the target code block on a preset format configuration page based on the format conversion characteristic, and performing flow adaptation on the target code block based on the preset format configuration page to obtain a format mapping rule;
constructing a distributed format conversion thread, deploying a format mapping rule in the distributed format conversion thread, and obtaining a target distributed format conversion thread based on a deployment result;
determining the number of threads in a target distributed format conversion thread, constructing a data uploading queue based on the number of threads, and averagely uploading the acquired coal mine water damage data of different types of file sources to the data uploading queue according to the number of threads;
and synchronously uploading the coal mine water disaster data in different data uploading queues to a target distributed format conversion thread for format conversion based on uploading results, and completing the conversion of the coal mine water disaster data in different original formats into a target unified format.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310927999.3A CN116644031B (en) | 2023-07-27 | 2023-07-27 | Method and system for unified standardization of coal mine water damage data in different formats |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310927999.3A CN116644031B (en) | 2023-07-27 | 2023-07-27 | Method and system for unified standardization of coal mine water damage data in different formats |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116644031A CN116644031A (en) | 2023-08-25 |
| CN116644031B true CN116644031B (en) | 2023-10-13 |
Family
ID=87623393
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310927999.3A Active CN116644031B (en) | 2023-07-27 | 2023-07-27 | Method and system for unified standardization of coal mine water damage data in different formats |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116644031B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117708071B (en) * | 2024-02-06 | 2024-05-28 | 苔花科迈(西安)信息技术有限公司 | Processing method and device for coal mine equipment operation parameters based on big data |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1030254A1 (en) * | 1999-02-18 | 2000-08-23 | sd&m, Software design & management GbmH & Co. KG | Method and system to manage documents |
| CN104991929A (en) * | 2015-06-30 | 2015-10-21 | 李海军 | Traffic flow data collection method and system |
| CN108449407A (en) * | 2018-03-14 | 2018-08-24 | 中煤科工集团重庆研究院有限公司 | Multi-source heterogeneous coal mine safety monitoring data acquisition method |
| CN110781230A (en) * | 2019-09-12 | 2020-02-11 | 腾讯大地通途（北京）科技有限公司 | Data access method, device and equipment |
| CN111782690A (en) * | 2019-04-04 | 2020-10-16 | 上海晶赞融宣科技有限公司 | Multi-source heterogeneous data aggregation method and device, storage medium and terminal |
| CN116431752A (en) * | 2023-04-28 | 2023-07-14 | 西北核技术研究所 | GIS data quality inspection and warehousing method oriented to distributed storage |
-
2023
- 2023-07-27 CN CN202310927999.3A patent/CN116644031B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1030254A1 (en) * | 1999-02-18 | 2000-08-23 | sd&m, Software design & management GbmH & Co. KG | Method and system to manage documents |
| CN104991929A (en) * | 2015-06-30 | 2015-10-21 | 李海军 | Traffic flow data collection method and system |
| CN108449407A (en) * | 2018-03-14 | 2018-08-24 | 中煤科工集团重庆研究院有限公司 | Multi-source heterogeneous coal mine safety monitoring data acquisition method |
| CN111782690A (en) * | 2019-04-04 | 2020-10-16 | 上海晶赞融宣科技有限公司 | Multi-source heterogeneous data aggregation method and device, storage medium and terminal |
| CN110781230A (en) * | 2019-09-12 | 2020-02-11 | 腾讯大地通途（北京）科技有限公司 | Data access method, device and equipment |
| CN116431752A (en) * | 2023-04-28 | 2023-07-14 | 西北核技术研究所 | GIS data quality inspection and warehousing method oriented to distributed storage |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116644031A (en) | 2023-08-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN116644031B (en) | Method and system for unified standardization of coal mine water damage data in different formats | |
| US8316353B2 (en) | Problem analysis via matching contiguous stack trace lines to symptom rules | |
| US20100085165A1 (en) | Rfid chip memory utility | |
| CN113268615A (en) | Resource label generation method and device, electronic equipment and storage medium | |
| CN111324782A (en) | Big data storage system | |
| CN112506910A (en) | Multi-source data acquisition method and device, electronic equipment and storage medium | |
| CN114090736A (en) | Enterprise industry identification system and method based on text similarity | |
| CN112364618A (en) | Report file generation method and device, electronic equipment and storage medium | |
| CN111625689B (en) | SVG graph and monitoring information correlation verification method for transformer substation | |
| CN115544975B (en) | Log format conversion method and device | |
| CN110070665B (en) | Insurance bill classification method based on deep learning | |
| CN112598142A (en) | Wind turbine generator overhaul work quality examination assisting method and system | |
| CN111061779A (en) | Data processing method and device based on big data platform | |
| CN109359202B (en) | Electronic operation and maintenance work order automatic generation method and system based on audio and video recording | |
| CN114116811B (en) | Log processing method, device, equipment and storage medium | |
| CN101894098B (en) | Embedded font data processing method and device | |
| CN106598983A (en) | Information display method and device | |
| CN111400282B (en) | Data processing strategy adjustment method, device, equipment and storage medium | |
| CN113821555A (en) | Unstructured data collection processing method of intelligent supervision black box | |
| CN110874398A (en) | Forbidden word processing method and device, electronic equipment and storage medium | |
| CN110956022A (en) | Document processing method and system | |
| CN111597098A (en) | Data processing method and equipment | |
| CN116933143B (en) | Flight parameter data classification method | |
| CN112685994B (en) | Double-layer PDF file style formatting output method, device, equipment and medium | |
| CN117171418B (en) | Real-time combinable query system with multiple data forms |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |