CN112597342A - Environment-friendly data management method - Google Patents
Environment-friendly data management method Download PDFInfo
- Publication number
- CN112597342A CN112597342A CN202011472793.9A CN202011472793A CN112597342A CN 112597342 A CN112597342 A CN 112597342A CN 202011472793 A CN202011472793 A CN 202011472793A CN 112597342 A CN112597342 A CN 112597342A
- Authority
- CN
- China
- Prior art keywords
- data
- environmental protection
- environment
- protection data
- friendly
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/84—Mapping; Conversion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/83—Querying
- G06F16/835—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/80—Information retrieval; Database structures therefor; File system structures therefor of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML
- G06F16/83—Querying
- G06F16/838—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/604—Tools and structures for managing or administering access control systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2221/00—Indexing scheme relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/21—Indexing scheme relating to G06F21/00 and subgroups addressing additional information or applications relating to security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F2221/2141—Access rights, e.g. capability lists, access control lists, access tables, access matrices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Automation & Control Theory (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides an environmental protection data management method in the technical field of environmental protection, which comprises the following steps: s10, collecting environmental protection data from each service system in real time; step S20, preprocessing the collected environmental protection data; step S30, storing the preprocessed environmental protection data into a central database; and step S40, managing the environmental protection data stored in the central database. The invention has the advantages that: the method realizes the integration management of the mass environmental protection data, and greatly improves the application value of the environmental protection data.
Description
Technical Field
The invention relates to the technical field of environmental protection, in particular to an environmental protection data management method.
Background
With the gradual improvement of the construction of the Internet of things in the ecological environment and the environment-friendly related fields, massive environment-friendly data are generated. However, massive environment-friendly data are dispersed in different systems of different cities and different departments, and data interaction among the systems has certain obstacles due to different adopted data formats, so that an information isolated island is formed; and traditionally, only simple statistical analysis is carried out on the environmental protection data in the system, effective management and application are not carried out on the environmental protection data, and the value of the environmental protection data cannot be fully exerted.
Therefore, how to provide an environmental protection data management method to realize integrated management of massive environmental protection data and improve the application value of the environmental protection data becomes a problem to be solved urgently.
Disclosure of Invention
The technical problem to be solved by the invention is to provide an environmental protection data management method, which is used for realizing integrated management on massive environmental protection data and improving the application value of the environmental protection data.
The invention is realized by the following steps: an environmental protection data management method comprises the following steps:
s10, collecting environmental protection data from each service system in real time;
step S20, preprocessing the collected environmental protection data;
step S30, storing the preprocessed environmental protection data into a central database;
and step S40, managing the environmental protection data stored in the central database.
Further, the step S10 is specifically:
and (4) acquiring environmental protection data from each service system in real time by using an ETL tool.
Further, the step S20 specifically includes:
step S21, presetting a data transformation rule and a data filtering rule;
step S22, converting the environmental protection data collected from the business systems into a uniform format by using the data conversion rule;
step S23, filtering each environmental protection data by using the data filtering rule;
and S24, performing MD5 value verification on the environment-friendly data, and eliminating the environment-friendly data which fails in verification.
Further, the data conversion rule is specifically to convert the format into an XML format uniformly; the data filtering rule is specifically environment-friendly data with empty filtering content and preset keywords.
Further, the step S30 is specifically:
presetting a plurality of data types, classifying the preprocessed environment-friendly data based on the data types, setting data labels of the environment-friendly data, and storing the environment-friendly data after classifying and setting the data labels to a central database.
Further, the data categories at least comprise basic data, business data, document data, spatial data, theme data and metadata; the data label includes radiation base station, pollution sources, ecological red line, groundwater environment, blowdown right, rule unification more, soil environment, risk source, the useless diversion flow direction of danger, noise environment, blowdown permission, drain space at least.
Further, the step S40 is specifically:
creating an authority table provided with an account number and a password, and setting a data interface of a central database based on the authority table;
and acquiring the access right of a data interface through the account and the password, calling the environment-friendly data of the central database by using a neural network model to perform big data analysis to generate an analysis result, and displaying the analysis result on a visual interface through a report, a knowledge map or an electronic map.
Further, the step S40 further includes:
and each service system accesses a central database through the authority table to share and interact the environmental protection data.
The invention has the advantages that:
1. the environmental protection data are collected from each service system and subjected to preprocessing of format conversion, filtering and verification, the preprocessed environmental protection data are classified, data labels are set and then stored in the central database, and then the data interfaces of the central database are set based on the created authority table, so that massive environmental protection data with unified formats can be called through the data interfaces to carry out big data analysis.
2. By preprocessing format conversion, filtering and checking of the environmental protection data, some unnecessary, defective and incomplete environmental protection data are removed and converted into a uniform data format, so that the data quality of the environmental protection data is greatly improved, and a solid foundation is provided for subsequent big data analysis.
3. By classifying the environmental protection data and setting the data labels, the environmental protection data can be conveniently retrieved, classified and analyzed and subjected to multi-dimensional analysis in the later period, and the application value of the environmental protection data is further improved.
4. The data interface of the central database is set through the authority table with the account and the password, namely, a user who uses the account and the password can access the central database through the data interface, and the safety of the environment-friendly data is greatly improved.
Drawings
The invention will be further described with reference to the following examples with reference to the accompanying drawings.
FIG. 1 is a flow chart of a method for managing environmental protection data according to the present invention.
Detailed Description
The technical scheme in the embodiment of the application has the following general idea: the method comprises the steps of collecting environmental protection data of each business system in real time, carrying out format conversion, filtering, checking, classifying, setting data labels and the like, storing the data into a central database, carrying out unified maintenance and management on the environmental protection data, providing a data interface externally for obtaining the environmental protection data to carry out big data analysis, namely providing data support for artificial intelligence, machine learning, mode recognition, visualization technology and the like, and further improving the application value of the environmental protection data.
Referring to fig. 1, a preferred embodiment of an environmental protection data management method according to the present invention includes the following steps:
s10, collecting environmental protection data from each service system in real time; the environmental protection data can be data collected by various sensors, data collectors, monitoring stations and the like;
step S20, preprocessing the collected environmental protection data;
step S30, storing the preprocessed environmental protection data into a central database; the environmental protection data of each business system are stored in a central database, so that the maintenance, sharing and application of the environmental protection data are facilitated, and the management cost of the environmental protection data is reduced;
and step S40, managing the environmental protection data stored in the central database.
The step S10 specifically includes:
collecting environmental protection data from each business system in real time by using an ETL (data warehouse technology) tool; and collecting the environmental protection data in real time, so that the central database always keeps the latest data state.
The step S20 specifically includes:
step S21, presetting a data transformation rule and a data filtering rule;
step S22, converting the environmental protection data collected from the business systems into a uniform format by using the data conversion rule; the data are converted into a uniform format so as to facilitate later data analysis and processing;
step S23, filtering each environmental protection data by using the data filtering rule;
and S24, performing MD5 value verification on the environment-friendly data, and eliminating the environment-friendly data which fails in verification. Checking the MD5 value, namely calculating the MD5 value of the environmental protection data, comparing whether the calculated MD5 value is consistent with the MD5 value carried by the environmental protection data, and if the calculated MD5 value is consistent with the MD5 value carried by the environmental protection data, checking the environmental protection data; if the two are not consistent, the verification is not passed; the MD5 value verification can judge the integrity of the environmental protection data and avoid the environmental protection data from being distorted or lost.
The data conversion rule is specifically to convert the format into an XML format uniformly; the data filtering rule is specifically environment-friendly data with empty filtering content and preset keywords. XML is a markup language for marking electronic documents to be structured.
The step S30 specifically includes:
presetting a plurality of data types, classifying the preprocessed environment-friendly data based on the data types, setting data labels of the environment-friendly data, and storing the environment-friendly data after classifying and setting the data labels to a central database.
The data types at least comprise basic data, business data, document data, space data, theme data and metadata; the data label includes radiation base station, pollution sources, ecological red line, groundwater environment, blowdown right, rule unification more, soil environment, risk source, the useless diversion flow direction of danger, noise environment, blowdown permission, drain space at least.
The step S40 specifically includes:
creating an authority table provided with an account number and a password, and setting a data interface of a central database based on the authority table;
and acquiring the access right of a data interface through the account and the password, calling the environment-friendly data of the central database by using a neural network model to perform big data analysis to generate an analysis result, and displaying the analysis result on a visual interface through a report, a knowledge map or an electronic map.
During specific implementation, a pair of public key and private key can be created, the private key is used for encrypting the environment-friendly data, when a user obtains the access right of the data interface through the account number and the password, the public key sent by the central database is obtained, the public key is used for decrypting the environment-friendly data, and the safety of the environment-friendly data is further improved.
The step S40 further includes:
and each service system accesses a central database through the authority table to share and interact the environmental protection data.
In summary, the invention has the advantages that:
1. the environmental protection data are collected from each service system and subjected to preprocessing of format conversion, filtering and verification, the preprocessed environmental protection data are classified, data labels are set and then stored in the central database, and then the data interfaces of the central database are set based on the created authority table, so that massive environmental protection data with unified formats can be called through the data interfaces to carry out big data analysis.
2. By preprocessing format conversion, filtering and checking of the environmental protection data, some unnecessary, defective and incomplete environmental protection data are removed and converted into a uniform data format, so that the data quality of the environmental protection data is greatly improved, and a solid foundation is provided for subsequent big data analysis.
3. By classifying the environmental protection data and setting the data labels, the environmental protection data can be conveniently retrieved, classified and analyzed and subjected to multi-dimensional analysis in the later period, and the application value of the environmental protection data is further improved.
4. The data interface of the central database is set through the authority table with the account and the password, namely, a user who uses the account and the password can access the central database through the data interface, and the safety of the environment-friendly data is greatly improved.
Although specific embodiments of the invention have been described above, it will be understood by those skilled in the art that the specific embodiments described are illustrative only and are not limiting upon the scope of the invention, and that equivalent modifications and variations can be made by those skilled in the art without departing from the spirit of the invention, which is to be limited only by the appended claims.
Claims (8)
1. An environmental protection data management method is characterized in that: the method comprises the following steps:
s10, collecting environmental protection data from each service system in real time;
step S20, preprocessing the collected environmental protection data;
step S30, storing the preprocessed environmental protection data into a central database;
and step S40, managing the environmental protection data stored in the central database.
2. The environmental protection data management method according to claim 1, wherein: the step S10 specifically includes:
and (4) acquiring environmental protection data from each service system in real time by using an ETL tool.
3. The environmental protection data management method according to claim 1, wherein: the step S20 specifically includes:
step S21, presetting a data transformation rule and a data filtering rule;
step S22, converting the environmental protection data collected from the business systems into a uniform format by using the data conversion rule;
step S23, filtering each environmental protection data by using the data filtering rule;
and S24, performing MD5 value verification on the environment-friendly data, and eliminating the environment-friendly data which fails in verification.
4. The environmental protection data management method according to claim 3, wherein: the data conversion rule is specifically to convert the format into an XML format uniformly; the data filtering rule is specifically environment-friendly data with empty filtering content and preset keywords.
5. The environmental protection data management method according to claim 1, wherein: the step S30 specifically includes:
presetting a plurality of data types, classifying the preprocessed environment-friendly data based on the data types, setting data labels of the environment-friendly data, and storing the environment-friendly data after classifying and setting the data labels to a central database.
6. The environmental protection data management method according to claim 5, wherein: the data types at least comprise basic data, business data, document data, space data, theme data and metadata; the data label includes radiation base station, pollution sources, ecological red line, groundwater environment, blowdown right, rule unification more, soil environment, risk source, the useless diversion flow direction of danger, noise environment, blowdown permission, drain space at least.
7. The environmental protection data management method according to claim 1, wherein: the step S40 specifically includes:
creating an authority table provided with an account number and a password, and setting a data interface of a central database based on the authority table;
and acquiring the access right of a data interface through the account and the password, calling the environment-friendly data of the central database by using a neural network model to perform big data analysis to generate an analysis result, and displaying the analysis result on a visual interface through a report, a knowledge map or an electronic map.
8. The environmental-friendly data management method according to claim 7, wherein: the step S40 further includes:
and each service system accesses a central database through the authority table to share and interact the environmental protection data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011472793.9A CN112597342A (en) | 2020-12-15 | 2020-12-15 | Environment-friendly data management method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011472793.9A CN112597342A (en) | 2020-12-15 | 2020-12-15 | Environment-friendly data management method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112597342A true CN112597342A (en) | 2021-04-02 |
Family
ID=75195387
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011472793.9A Pending CN112597342A (en) | 2020-12-15 | 2020-12-15 | Environment-friendly data management method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112597342A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016082618A1 (en) * | 2014-11-27 | 2016-06-02 | 国家电网公司 | Power-grid-gis-based meteorological data calling and preprocessing method and system |
| CN107656956A (en) * | 2017-03-14 | 2018-02-02 | 上海墨翎数据科技有限公司 | A kind of wisdom environmental protection big data method for visualizing |
| CN110765173A (en) * | 2019-08-30 | 2020-02-07 | 贵州力创科技发展有限公司 | Data management method and system under big data environment |
| CN110852601A (en) * | 2019-11-07 | 2020-02-28 | 佛山市南海区环境技术中心 | Big data application method and system for environmental monitoring law enforcement decision |
-
2020
- 2020-12-15 CN CN202011472793.9A patent/CN112597342A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2016082618A1 (en) * | 2014-11-27 | 2016-06-02 | 国家电网公司 | Power-grid-gis-based meteorological data calling and preprocessing method and system |
| CN107656956A (en) * | 2017-03-14 | 2018-02-02 | 上海墨翎数据科技有限公司 | A kind of wisdom environmental protection big data method for visualizing |
| CN110765173A (en) * | 2019-08-30 | 2020-02-07 | 贵州力创科技发展有限公司 | Data management method and system under big data environment |
| CN110852601A (en) * | 2019-11-07 | 2020-02-28 | 佛山市南海区环境技术中心 | Big data application method and system for environmental monitoring law enforcement decision |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110852601B (en) | Big data application method and system for environmental monitoring law enforcement decision | |
| CN108446396B (en) | Power data processing method based on improved CIM model | |
| CN104486075B (en) | A kind of verification method of intelligent substation ICD model file digital signature | |
| CN112687097A (en) | Highway highway section level data center platform system | |
| CN104036365A (en) | Method for constructing enterprise-level data service platform | |
| CN108537422A (en) | Security risk early warning system and method | |
| CN111190982B (en) | Big data-based shared bicycle management method and system | |
| WO2013138722A1 (en) | System and method for automated compliance verification | |
| CN112883001A (en) | Data processing method, device and medium based on marketing and distribution through data visualization platform | |
| CN112200465B (en) | Electric power AI method and system based on multimedia information intelligent analysis | |
| CN114385609A (en) | Label-based government affair event processing system, method, equipment and storage medium | |
| CN107742162B (en) | Multidimensional feature association analysis method based on allocation monitoring information | |
| CN115424212B (en) | Electric power operation site violation identification system and application thereof | |
| CN112597342A (en) | Environment-friendly data management method | |
| CN113779125A (en) | Construction safety information management method and system | |
| CN112347106A (en) | Industrial data coding method based on data acquisition element | |
| CN114417345A (en) | Web attack detection method based on NLP | |
| CN114154476A (en) | Execution credibility judgment method for large instrument sharing experiment | |
| CN106528644A (en) | Method and device for retrieving remote sensing data | |
| CN118095442B (en) | Power data tracing method, power system, power equipment and storage medium | |
| CN113822021B (en) | Method and system for realizing file format conversion of test case | |
| CN107506448A (en) | A kind of method and system of intelligent grid time scale measurement data interchange format | |
| Gao et al. | Unlock the value of unstructured data in EAM | |
| Wang et al. | A Management Specification for Data Sharing Security in the System Construction of Smart Mine | |
| CN117114294A (en) | Design drawing standardized approval management system, method, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |