CN113792045A - Mixed storage method for ecological damage problem data of consultation ecological protection red line area - Google Patents

Abstract

The invention provides a mixed storage method for data of ecological damage problems in a red line area for consultation ecological protection, which comprises the following steps: downloading space data and multimedia data packets of ecological damage problems, and analyzing according to data organization specifications; automatically carrying out structure matching and quality verification on the spatial data to obtain the pattern spot spatial data which accords with the verification specification and the data table structure; archiving multimedia data, and performing centralized management by using a pre-established object storage service to obtain an online access address of an uploading interface of the object storage service; publishing the spot space data service according to the spot space data and publishing the file sharing service according to the object storage service sharing address corresponding to the multimedia name; and carrying out visual display on the spatial big data. The invention does not limit the constraints of ecological damage problem data type, data source, field structure and the like in the ecological protection red line area, and solves the problems that the standardization of the data structure, the release of the spatial data service and the configuration of the service address need a large amount of labor participation.

Description

Mixed storage method for ecological damage problem data of consultation ecological protection red line area

Technical Field

The invention relates to the technical field of geographic information management, in particular to a hybrid storage method for data of ecological damage problems in a red line area for ecological protection of meetings.

Background

In order to strengthen the supervision of ecological damage problems in the ecological protection red line area, important and typical ecological damage conditions are selected for consultation, and better technical support is provided for ecological restoration supervision. Because the ecological protection red line area is crossed or overlapped with the national parks, natural protection areas, key ecological functional areas, biodiversity priority protection areas, key drainage basins and other protection areas in space, the ecological destruction problem data has the characteristics of complex service division, multiple data types, wide data sources and different field structures. For example, from the aspects of service division and data types, the ecological destruction problem data of the meeter needs to include six service types, namely, vector result data (.shp), report result data (.pdf), remote sensing image screenshot data (.jpg), photo checking data (.jpg), video checking data (.mp4), auxiliary information data (.pdf), and the like. And dividing from a data source, wherein the data source comprises an ecological protection red line area remote sensing monitoring ecological destruction problem, a central ecological environment protection supervision problem list and the like. Different data sources lead to different field numbers and named structures, such as two types of ecological destruction problems of main meeters: the ecological damage problem of remote sensing monitoring in ecological protection red line district totals 39 fields, and the problem list of central ecological environment protection supervision totals 43 fields. Taking the data of the ecological damage problem of checking the type of secondary ground objects as an example, the field name in the ecological protection red line area remote sensing monitoring ecological damage problem is Hcejdwl, and the field name in the central ecological environment protection supervision problem list is Hchejlx.

In the business mode, the traditional meeter takes a primary ecological damage problem supervision task as a unit to develop specific spot meeters. However, the supervision task is driven by administrative management work, and is mostly in areas with large space span, such as province/autonomous regions, natural protection regions, key drainage basins and the like, and has a large difference from the pattern spots. If the supervision tasks with a large number of patterns and types including the ecological damage problem are taken as the consultation units, one consultation is not important, and the one consultation consumes long time, so that the experience of the staff of the consultation is poor.

Technically, due to the characteristic of large data difference, the space data processing process of the ecological damage problem of the ecological protection red line area comprises five steps: data structure full field normalization → spatial data storage → spatial data service publishing → service address configuration → auxiliary consultation, wherein the data structure normalization, the spatial data service publishing and the service address configuration require a great deal of manual involvement. The traditional consultation space data uses a space database to store space graphics and attribute information thereof. To solve the problem of non-uniform spatial data structure, two commonly used solutions are: (1) and (2) storing by using a plurality of spatial layers, and storing by using a fixed spatial layer after all fields of the data are subjected to normalization processing. In the first method, because the spatial layer name cannot be fixed, the spatial data service cannot be automatically issued; and the issuing space data service is more, and the management and configuration of the space data service still need to be participated by professional personnel. The second method fixes the names of the spatial layers, which can ensure the self-adaptive release of the spatial data service, but because of large data difference, the manual standardized processing of all the fields of the data takes a long time.

Therefore, how to provide a hybrid storage method for protecting data in red line area ecology by meeter ecology, which can improve data storage configuration and solve the problem of complicated service distribution, is a problem that needs to be solved by those skilled in the art.

Disclosure of Invention

In view of this, the present invention provides a hybrid storage method for data of ecological damage problems in a red line area for consultation ecological protection, which does not limit constraints such as data types, data sources, field structures, etc. of ecological damage problems in the red line area for ecological protection, and solves the problem that a large amount of labor is required for data structure normalization, spatial data service release and service address configuration.

In order to achieve the purpose, the invention adopts the following technical scheme:

a mixed storage method for ecological damage problem data in a consultation ecological protection red line area comprises the following steps:

s1, downloading the spatial data and the multimedia data packet of the ecological damage problem, analyzing according to a given data organization specification, and obtaining analyzed data;

s2, automatically performing structure matching and quality verification on the spatial data in the analyzed data according to a given specification to obtain the pattern spot spatial data which accords with the verification specification and the data table structure;

s3, archiving multimedia data in the analyzed data, and performing centralized management by using a pre-established object storage service to obtain an online access address of an object storage service uploading interface corresponding to a multimedia name;

s4, automatically publishing the plaque space data service according to the plaque space data, and publishing the file sharing service according to the object storage service sharing address corresponding to the multimedia name;

and S5, performing space big data visualization display according to the shared address of the spot space data service and the object storage service.

Preferably, in S1, the ecological destruction problem space data and the multimedia data packet include a folder of planar vector data, linear vector data, and dot vector data.

Preferably, in S2, the method includes the following steps:

s21, automatically screening space data in the folders of the planar vector data, the linear vector data and the dot vector data according to the data naming fields;

s22, performing preset field verification on the spatial data, and if the preset field verification fails, terminating the uploading of the ecological destruction problem in advance; if the preset field is successfully verified, the step S23 is entered;

s23, creating a task number, and creating a task management table according to the task information of the ecological destruction problem;

s24, extracting and clustering a problem list of the spatial data by using spatial analysis, and creating a problem management two-dimensional table according to the problem list;

s25, storing space data by using a PostGIS space data engine, wherein the space data of different tasks are stored in a point, line and surface space diagram layer according to the space forms of the space data, and comprise the type and the space information of the image spot problems carried by the space data, and the image spot associated problem number and the task number automatically written by the system;

s26, converting the two-dimensional attribute structure of the ecological destruction problem data into a field name, a field value and a belonging spot number, and storing the field name, the field value and the belonging spot number as a spot attribute table in an entry.

Preferably, the S3 includes the following steps:

s31, automatically screening multimedia data in the analyzed data according to the data naming fields;

and S32, using the pre-established uploading interface of the object storage service to file the multimedia data.

Preferably, the S4 includes the following steps:

s41, using the vector tiles to publish the spatial data stored in the corresponding spatial map layer as a spatial data service, and dynamically updating the spatial data service while updating the data;

s42, storing the multimedia data by using the object, and automatically publishing the multimedia data as a file sharing service; and storing the multimedia name and the online accessible address returned by the uploading interface in a multimedia management table.

Preferably, the S5 includes the following steps:

s51, calculating the coordinate range of the relative screen according to the circumscribed rectangle of the space pattern spot included in the ecological destruction problem;

s52, calculating, downloading and analyzing the vector tile data of the corresponding space layer according to the current screen coordinate range and the problem name;

and S53, viewing the multimedia data on line according to the file sharing service address associated with the image spot space data.

Through the technical scheme, compared with the prior art, the invention has the beneficial effects that:

the invention adopts a PostGIS spatial data engine to store ecological damage problem spatial data in an ecological protection red line area, and optimizes the traditional process of 'full field standardization of a data structure → spatial data storage → spatial data service release → service address configuration → auxiliary consultation' into 'single field standardization of a data structure → spatial data storage → automatic spatial data service release → preset service address configuration → auxiliary consultation'. The normalized processing of the data structure is reduced from that of all forty or so fields to that of only one field of the problem type; because the layer name of the storage space data is fixed, the space data service only needs to be issued once, the service address is configured once, and the space data service can be automatically updated after the subsequent new ecological damage problem data is put into a warehouse. The invention reduces the time of data structure standardization processing, space data service release and service address configuration without sacrificing the browsing efficiency and meeting the requirements, does not need to repeat the service release and configuration, shortens the whole process of manual participation to 40 percent of the traditional process, improves the working efficiency and saves the personnel cost by 60 percent.

1) Compared with the traditional method of storing by using a plurality of spatial layers, the method only needs to issue the spatial data service once and configure the service address once

The method uses a plurality of space layer storages to share four steps of 'space data storage → space data service release → service address configuration → auxiliary consultation'. Because data fields are not processed uniformly, a spatial data set is used for storing multiple types of spatial data; the task of one ecological destruction problem is a space map layer, and manual space data service release and manual service address configuration are carried out before each consultation.

2) Compared with the traditional data structure full-field standardization processing, the invention only needs to process one field

The data structure full-field standardization processing needs to process about forty fields, and the invention only needs to process one field of the problem type, thereby reducing the time for specification formulation and processing.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts;

fig. 1 is a flowchart of a hybrid storage method for ecological damage problem data in a red line area for conference ecological protection according to an embodiment of the present invention;

fig. 2 is a structure diagram of the spatial data and multimedia data packet organization according to the embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The mixed storage method for ecological damage problem data in the ecological protection red line area of the consultation is disclosed in the embodiment, the ecological damage problem data in the ecological protection red line area of the consultation is divided into three levels from macro to micro in a service mode, namely 'task-problem-pattern spot', and the consultation is developed by focusing on a specific pattern spot by taking a problem as a unit. Technically, structured storage, object storage and the like are used for mixed storage of ecological damage problem data in an ecological protection red line area for consultation, and vector tiles and object storage technologies are combined to automatically release the data into space data service and file sharing service. Comprises the following steps:

the ecological damage problem data are divided into two categories of spatial data (including ecological damage problem spatial pattern spots in three spatial forms of points, lines and surfaces) and multimedia data (including examination batch files such as. jpg image screenshot,. jpg scene examination photo,. mp4 scene examination video,. pdf monitoring report and. pdf environmental assessment report). Storing the space graph by using a PostGIS space data engine, and storing the attribute information of the pattern spot by using a PostgreSQL relational database table; the multimedia data is stored using objects. And then, realizing automatic publishing and updating of the spatial data service and the file sharing service based on the vector tiles and the object storage. And finally, performing visual display on the data based on WebGL by taking the ecological damage problem of the ecological protection red line area of the consultation as a unit. Therefore, flexible storage and rapid visual display of the data of the ecological damage problem of the consultation ecological protection red line area with different structures are realized.

The specific implementation procedure of this embodiment is as follows:

step S001, downloading the ecological destruction problem space data and the multimedia data compression packet organized according to the specification, decompressing the compression packet, comprising: the organization specifications of the HCSP (checking video data), the HCZP (checking photo data), the HPWJ (review file), the SPWJ (approval file), the TBYX (remote sensing image screenshot), the planar vector data, the linear vector data, the dotted vector data folder and the remote sensing monitoring report, the ecological destruction problem space data and the multimedia data compression package are shown in the attached figure 2.

And step S002, performing structure matching and quality verification on the spatial data according to the specification.

(1) According to the data naming specification, space data is found in folders of 'planar vector data', 'linear vector data' and 'dotted vector data', and the original data naming specification is shown in the following table 1.

TABLE 1

(2) Checking whether the spatial data contain a problem type field, a field value domain is correct, and whether spatial reference is in compliance; if the verification fails, uploading of the ecological damage problem is terminated in advance.

The quality check comprises the following steps:

and (3) compliance inspection: identifying and confirming the file structure, and comparing the file structure with a preset file structure; the field name and type are compared with the preset field.

And (3) spatial data inspection: comparing and checking according to a '2000 national geodetic coordinate system (CGCS 2000)', and taking degree as a unit of geographic coordinate; topology inspection (in the same layer element class, lines and lines/surfaces cannot be overlapped with each other, and self-intersection cannot be realized).

Checking the spatial data field: a field identification check is performed for the type of problem.

The field structure of the ecological damage problem data monitored by remote sensing in the ecological protection red line area is shown in the following table 2.

TABLE 2

(3) After the quality check is passed, a unique task number is automatically created in the task management table, and task information such as a task name, a task creation date, a zoning code, a task source, a general monitoring area type, a major special type, whether to check and the like is written into the task management table as shown in table 3.

TABLE 3

(4) And extracting a problem list by utilizing spatial analysis, clustering the same types of patches in the same county-level administrative district into problems, and obtaining information such as the name of the problem, the type of the problem, the administrative district to which the problem belongs and the like. According to a problem list, automatically creating a unique problem number in a problem management table, and simultaneously writing a problem name, a problem type, a task number to which the problem belongs and an administrative division code to which the problem belongs, which are obtained by aggregation, into a problem management two-dimensional table, wherein the problem list is generated by a service system, in the process of extracting and identifying the ecological damage problem, the system automatically generates task information according to a preset rule, and one task corresponds to one or more ecological damage problems, as shown in table 4.

TABLE 4

The field structure of the central ecological environment protection supervision problem list data is shown in the following table 5.

TABLE 5

For example, 4 mining area map spots in Maqu county in Gansu province are uniformly aggregated into 1 problem of mining resource mining in Maqu county in Gansu province. A record is newly added in the problem management table, the name of the record is 'mineral resource exploitation problem in Maqu county of Gansu province', the type of the problem is 'mineral resource exploitation', and meanwhile, the task number to which the problem belongs is written, namely the Id corresponding to the task in the task management table.

(5) And storing the space data by using a PostGIS space data engine, and writing the planar vector data, the linear vector data and the spot space data under the spot vector data folder which pass the quality inspection into a surface (polygon), line (line) and point (point) spot space table defined in advance by the database. And automatically creating a unique pattern spot number in the pattern spot space table, writing the question type field of the original pattern spot space data into the table, and simultaneously automatically writing the question number, the task number and the administrative division code of the pattern spot into which the program belongs. The spot space table is shown in table 5.

TABLE 5

(6) And storing all attribute information of the ecological destruction problem data by using the pattern spot attribute table. And converting the original two-dimensional attribute structure into a field name, a field value and a belonging pattern spot number for storing in an item. The spot attribute table is shown in table 6.

TABLE 6

Name of field	Field description	Remarks for note
			Id	Id
Descname	Name of field
			Descsvalue	Field value
Tbid	Pattern spot Id	The pattern spot Id corresponding to the pattern spot space table

For example, the original attribute information of the data part of the ecological damage problem of the inquiry spot number 50003 is { "Rlhdtdm": 1002"," Ygjyrlhdlx ": mineral resource exploitation problem", "Yswtms": 18-year image is suspected to be moving soil "," Ysstphwt ": ground vegetation is damaged", "Xdwlxx": mining land "," Sfxfhc ": yes", "Bhlx": new increase "}; after structure conversion, the query result is as follows:

[{"Id":"4567","Descname":"Rlhdtbdm","Descsvalue":"1002","Tbid":"50003"},

{ "Id": 4568"," Descname ": Ygjyrlhdlx", "Descsvalue": mineral resources mining problem "," Tbid ": 50003" },

{ "Id": 4569"," Descname ": Yswtms", "Descsvalue": 18-year image suspected to be motile soil "," Tbid ": 50003" },

{ "Id": 4570"," Descname ": Ysstphwt", "Descsvalue": to "destroy the surface vegetation", "Tbid": to "50003" },

{ "Id": 4571"," Descname ": Xdwlx", "Descsvalue": right to land for mining "," Tbid ": 50003" },

{ "Id": 4572"," Descname ": Sfxfhc", "Descsvalue": yes "," Tbid ": 50003" },

{ "Id": 4573"," Descname ": Bhlx", "Descsvalue": newly added "," Tbid ": 50003" } {

And step S003, archiving the multimedia data, and performing centralized management by using object storage built in advance.

The multimedia data is found in the "HCSP", "HCZP", "HPWJ", "SPWJ", "TBYX" directories according to the data naming specifications, which refer to fig. 2. And the multimedia data is filed by using an uploading interface of the object storage service which is set up in advance. A multimedia management table is obtained as shown in table 7.

TABLE 7

And step S004, automatically issuing the spatial data service and the file sharing service.

And the vector tiles and the object storage built in advance are used for realizing the automatic release of the space data service and the file sharing service. And issuing a surface (polygon), line (line) and point (point) graphic spot space table for storing space data as a vector tile service rendered according to the problem type, thereby realizing automatic updating of the service. And storing the multimedia name and the online accessible address returned by the object storage interface in a multimedia management table.

And step S005, visually displaying the spatial big data of the WebGL.

(1) Inquiring a problem number in a problem management table according to the problem name of the to-be-conferred business; the spatial patches included in the question are looked up in the patch space table. And taking the circumscribed rectangles of all the space pattern spots as the space range of the problem list. And (4) carrying out space positioning by using the central point of the circumscribed rectangle accounting for 80% of the screen range of the problem list, and determining the screen coordinate range.

(2) Calculating, downloading and analyzing vector tile data of a corresponding level according to the current screen coordinate range;

(3) and inquiring the associated multimedia data online access address in the multimedia management table according to the spot number, namely inquiring all records of which Tbid is equal to the Id of the spot space table in the spot association table.

If the information of the checking video and the checking photo associated with the query pattern spot 50003 is as follows, the online access address can be obtained:

[ { "Id": 101"," Name ": 29 days Maqu mineral exploitation problem checking photos at 3 months of 2021", "Type": 1"," Url ": https:// IP: port/2021032901.jpg", "Sort": 0"," Tbid ": 50003", "Uedtype": 2"}, {" Id ": 102", "Name": 29 days Maqu mineral exploitation problem checking videos at 3 months of 2021 "," Type ": 2", "Url": https:// IP: port/10329. mp4"," Sort ": 1", "Tbid": 50003"," Type ": 3" } { ]

(4) And viewing the inquired multimedia objects on line.

The embodiment focuses on specific pattern spots to develop a consultation by taking a problem as a unit. Technically, structured storage, object storage and the like are used for mixed storage of ecological damage problem data in an ecological protection red line area for consultation, and vector tiles and object storage technologies are combined to automatically release the data into space data service and file sharing service. The constraints of the ecological damage problem data type, the data source, the field structure and the like in the ecological protection red line area are not limited, and the problem that a large amount of labor is required for data structure standardization, space data service release and service address configuration is solved.

The mixed storage method for the data of the ecological damage problem in the red line area for the ecological protection of the consultation company provided by the invention is described in detail, a specific example is applied in the method to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (6)

1. A mixed storage method for ecological damage problem data in a red line area for consultation ecological protection is characterized by comprising the following steps:

s1, downloading the spatial data and the multimedia data packet of the ecological damage problem, analyzing according to a given data organization specification, and obtaining analyzed data;

s2, automatically performing structure matching and quality verification on the spatial data in the analyzed data according to a given specification to obtain the pattern spot spatial data which accords with the verification specification and the data table structure;

s3, archiving multimedia data in the analyzed data, and performing centralized management by using a pre-established object storage service to obtain an online access address of an object storage service uploading interface corresponding to a multimedia name;

s4, automatically publishing the plaque space data service according to the plaque space data, and publishing the file sharing service according to the object storage service sharing address corresponding to the multimedia name;

and S5, performing space big data visualization display according to the shared address of the spot space data service and the object storage service.

2. The hybrid storage method for ecological damage problem data in red line area for consultation ecological protection according to claim 1, wherein in S1, the ecological damage problem space data and the multimedia data packet include a planar vector data, a linear vector data and a dot vector data folder.

3. The hybrid storage method for the data of the ecological damage problem in the red line area for consultation ecological protection according to claim 2, wherein the step of S2 comprises the following steps:

s21, automatically screening space data in the folders of the planar vector data, the linear vector data and the dot vector data according to the data naming fields;

s22, performing preset field verification on the spatial data, and if the preset field verification fails, terminating the uploading of the ecological destruction problem in advance; if the preset field is successfully verified, the step S23 is entered;

s23, creating a task number, and creating a task management table according to the task information of the ecological destruction problem;

s24, extracting and clustering a problem list of the spatial data by using spatial analysis, and creating a problem management two-dimensional table according to the problem list;

s25, storing space data by using a PostGIS space data engine, wherein the space data of different tasks are stored in a point, line and surface space diagram layer according to the space forms of the space data, and comprise the type and the space information of the image spot problems carried by the space data, and the image spot associated problem number and the task number automatically written by the system;

s26, converting the two-dimensional attribute structure of the ecological destruction problem data into a field name, a field value and a belonging spot number, and storing the field name, the field value and the belonging spot number as a spot attribute table in an entry.

4. The hybrid storage method for the red line area ecological damage problem data in the consultation ecological protection according to claim 1, wherein the step of S3 comprises the following steps:

s31, automatically screening multimedia data in the analyzed data according to the data naming fields;

and S32, using the pre-established uploading interface of the object storage service to file the multimedia data.

5. The hybrid storage method for the red line area ecological damage problem data in the consultation ecological protection according to claim 4, wherein the step S4 comprises the following steps:

s41, using the vector tiles to publish the spatial data stored in the corresponding spatial map layer as a spatial data service, and dynamically updating the spatial data service while updating the data;

s42, storing the multimedia data by using the object, and automatically publishing the multimedia data as a file sharing service; and storing the multimedia name and the online accessible address returned by the uploading interface in a multimedia management table.

6. The hybrid storage method for the red line area ecological damage problem data in the consultation ecological protection according to claim 5, wherein the step S5 comprises the following steps:

s51, calculating the coordinate range of the relative screen according to the circumscribed rectangle of the space pattern spot included in the ecological destruction problem;

s52, calculating, downloading and analyzing the vector tile data of the corresponding space layer according to the current screen coordinate range and the problem name;

and S53, viewing the multimedia data on line according to the file sharing service address associated with the image spot space data.

Images