CN117459125A - Satellite remote sensing data access system - Google Patents
Satellite remote sensing data access system Download PDFInfo
- Publication number
- CN117459125A CN117459125A CN202311532240.1A CN202311532240A CN117459125A CN 117459125 A CN117459125 A CN 117459125A CN 202311532240 A CN202311532240 A CN 202311532240A CN 117459125 A CN117459125 A CN 117459125A
- Authority
- CN
- China
- Prior art keywords
- analysis
- module
- resolution
- rate
- remote sensing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004458 analytical method Methods 0.000 claims abstract description 511
- 238000001514 detection method Methods 0.000 claims abstract description 19
- 238000007405 data analysis Methods 0.000 claims description 22
- 230000003993 interaction Effects 0.000 claims description 17
- 230000001960 triggered effect Effects 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 abstract description 25
- 238000012545 processing Methods 0.000 abstract description 6
- 230000002159 abnormal effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000000034 method Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 3
- 238000011835 investigation Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 229910052500 inorganic mineral Inorganic materials 0.000 description 1
- 239000011707 mineral Substances 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
- H04B7/18519—Operations control, administration or maintenance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
- H04B7/18513—Transmission in a satellite or space-based system
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Astronomy & Astrophysics (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Radio Relay Systems (AREA)
Abstract
The invention relates to the technical field of remote sensing data processing, in particular to a satellite remote sensing data access system, which comprises: the system comprises a request acquisition module, a plurality of first analysis modules, an access acquisition module, an analysis planning module, an analysis detection module and an analysis adjustment module; according to the invention, through acquiring all satellite remote sensing data required by the data of the user side, carrying out data splitting, making an analysis plan with highest synchronous speed according to the idle state of each analysis module, improving the synchronous speed of analysis of the satellite remote sensing data, judging whether to adjust a subsequent analysis plan according to the analysis quality matching degree of each first analysis module, and further ensuring the analysis rate of the remote sensing data; the invention ensures the analysis rate of remote sensing data when the access data volume is large, and can further improve the analysis rate by timely adjusting the analysis strategy.
Description
Technical Field
The invention relates to the technical field of remote sensing data processing, in particular to a satellite remote sensing data access system.
Background
The satellite remote sensing survey has the characteristics of high viewpoint, wide viewing area, rapid and repeated data acquisition and continuous observation, and the acquired data are digitized and can directly enter a computer image processing system of a user. Satellite remote sensing surveys have advantages that are not comparable to conventional survey methods. The satellite remote sensing investigation has wide application prospects in the aspects of land resources, forest resources, geological mineral resources, water conservancy resource investigation, crop estimation and the like, and the analysis rate is very important when data access is ensured due to the large data volume transmitted when satellite remote sensing is used.
Chinese patent publication No.: CN102708156B discloses a remote sensing data processing system, which comprises a main control computer, a plurality of computing nodes and a disk array, wherein the disk array is used for storing remote sensing original data and remote sensing products; the main control machine is used for retrieving the required remote sensing original data according to the type of the produced remote sensing product, preprocessing the remote sensing original data and dispatching the preprocessed remote sensing data and the remote sensing original data to a plurality of computing nodes; the computing node is used for generating remote sensing products from the preprocessed remote sensing data; it follows that the remote sensing data processing system has the following problems: the data volume is large when remote sensing data is accessed, and indiscriminate analysis is performed at the same time, so that the data analysis is slow due to the difference of data processing modules and different data types.
Disclosure of Invention
Therefore, the invention provides a satellite remote sensing data access system which is used for solving the problems that in the prior art, when remote sensing data is accessed, the data amount is large, and data analysis is slow because corresponding analysis cannot be carried out according to data types.
In order to achieve the above object, the present invention provides a satellite remote sensing data access system, comprising:
the request acquisition module is used for determining a target satellite remote sensing data range to be acquired according to a remote sensing data request of a user side and acquiring the data quantity and the priority of the target satellite remote sensing data;
the first analysis modules are respectively connected with the request acquisition module, an information interaction channel is arranged among the first analysis modules, each first analysis module comprises analysis units with the same number, each analysis unit of a single first analysis module is numbered in sequence, and an information interaction channel is arranged among adjacent analysis units;
the access acquisition module is connected with the request acquisition module and used for acquiring the working states of each first analysis module and all analysis units thereof and the residual workload of the current analysis work of each analysis unit;
the analysis planning module is respectively connected with the request acquisition module and each first analysis module and is used for calculating the available calculation rate of each first analysis module according to the acquisition result of the access acquisition module and determining the analysis strategy of the satellite remote sensing data according to the available calculation rate;
the analysis detection module is connected with each first analysis module and is used for detecting the analysis rate of unit analysis time of each first analysis module and the analysis rate of each analysis unit and calculating the analysis quality matching degree of each first analysis module;
the analysis adjustment module is respectively connected with the request acquisition module, the analysis detection module, the analysis planning module, the access acquisition module and each first analysis module, and is used for judging whether to adjust a subsequent analysis plan according to the analysis quality matching degree, and determining an adjustment mode of the analysis plan according to the residual workload of the first analysis module and the analysis rate of the first analysis module acquired by the access acquisition module; judging whether the analysis unit needs to be replaced or newly added according to the analysis rate and the working state of the analysis unit;
the working state comprises a data analysis state and an idle state without data analysis; the single priority corresponds to a plurality of first analysis modules which can analyze the data of the corresponding priority;
the resolution strategy includes determining a first resolution module and determining a number of resolution elements corresponding to the first resolution module.
Further, the analysis planning module calculates the available calculation rate of the corresponding first analysis module according to the priority of the target satellite remote sensing data which is correspondingly analyzed by the current first analysis module and the number of available analysis units;
wherein the available parsing unit is a parsing unit in an idle state.
Further, the parsing planning module is provided with a plurality of parsing strategies, and the first parsing module adopted by each parsing strategy is different or the number of the adopted corresponding parsing units is different, wherein:
and the analysis strategy is that the analysis planning module determines the maximum available calculation rate of the current priority data according to the maximum available calculation rate of the first analysis module corresponding to each priority data, determines the synchronization speed according to the maximum available calculation rate with the minimum value in the maximum available calculation rate of each priority data, and determines the number of analysis units in the first analysis module used by other priority data according to the synchronization speed.
Further, the analysis planning module is further provided with a synchronous speed adjustment strategy, wherein the synchronous speed adjustment strategy is used for determining whether an analysis unit in the first analysis module can be preferentially called according to the priority weight of all the data of the target satellite remote sensing, if so, the analysis unit working in the first analysis module is adjusted to be in an idle state, and then the analysis strategy is used for determining the analysis plan of the satellite remote sensing data;
the synchronization speed adjustment strategy meets the condition that the available calculation rate of any first analysis module is smaller than the lowest expected analysis rate, and the synchronization speed adjustment strategy is triggered in preference to the analysis strategy.
Further, the analysis detection module determines analysis quality matching degree according to the actual analysis rate of the first analysis module unit analysis time, the available calculation rate and the analysis rate of each analysis unit;
resolution quality matching degree
Wherein alpha is the resolution quality matching degree, v 11 Actual resolution rate, v, in units of resolution time 10 To calculate the rate available, v j For the resolution rate of the j-th resolution unit, j=1, … … m, m is the number of resolution units currently used in the first resolution module, v 2 The parsing unit averages the parsing rate.
Further, the analysis adjustment module judges whether to adjust the analysis plan according to the analysis quality matching degree of the single first analysis module;
if the resolution quality matching degree is larger than or equal to a preset resolution quality matching degree standard value, the resolution adjustment module judges that the resolution plan does not need to be adjusted;
and if the resolution quality matching degree is smaller than a preset resolution quality matching degree standard value, the resolution adjustment module judges that the resolution plan needs to be adjusted.
Further, the analysis adjustment module determines an adjustment mode according to an actual difference between the analysis quality matching degree of the single first analysis module and the preset analysis quality matching degree standard value under a first preset adjustment condition;
if the actual difference value is smaller than the preset difference value, judging that an analysis unit with the analysis rate lower than the required analysis rate exists, stopping data analysis by the analysis unit with the minimum actual analysis rate in the analysis units, and replacing the analysis unit with the analysis unit in an idle state for analysis;
if the actual difference value is greater than or equal to the preset difference value, judging that the resolution rate of the current resolution plan is lower than the required resolution rate, and increasing the number of resolution units of the single first resolution module participating in resolution;
the first preset adjustment condition is that the analysis quality matching degree of the single first analysis module is smaller than a preset analysis quality matching degree standard value, and at least one analysis unit in an idle state exists in the single first analysis module.
Further, the analysis planning module periodically controls the access acquisition module to acquire the residual workload of the current analysis work of each analysis unit, calculates the current available calculation rate, and adjusts the analysis strategy according to the current available calculation rate.
Further, the analysis planning module adjusts the duration of the next detection period of the access acquisition module according to the residual workload of the analysis unit in the data analysis state acquired by the access acquisition module in the current period;
wherein the remaining workload is inversely related to the duration of the detection period.
Further, in each first analysis module, the number of analysis units corresponding to each first analysis module for analyzing the data with the same priority is the same, and an information interaction channel is also arranged between the analysis unit with the smallest number and the analysis unit with the largest number;
the information interaction channel between the analysis units is used for determining whether the working state of the current analysis unit is in a normal state or not.
Compared with the prior art, the method has the beneficial effects that through acquiring all satellite remote sensing data required by the data of the user side and splitting the data, the analysis plan with highest synchronous speed is formulated according to the idle state of each analysis module, the synchronous speed of analysis of the satellite remote sensing data is improved, whether the subsequent analysis plan is adjusted or not is judged according to the analysis quality matching degree of each first analysis module, and the analysis rate of the remote sensing data is further ensured; the invention ensures the analysis rate when the access data volume is large, and can further improve the analysis rate by adjusting the analysis strategy.
Furthermore, in the data access system, the analysis planning module calculates the available calculation rate of the first analysis module according to the data priority of the data quantity corresponding to the analysis of the first analysis module, and the available calculation rate of each first analysis module can be used as a data basis, so that the analysis planning can be adjusted conveniently subsequently, and the analysis rate in the data transmission process is improved.
Furthermore, the analysis planning module of the data access system is provided with a plurality of strategies for pertinently determining the analysis plan for each first analysis module under different conditions, so that the rationality of the analysis plan is improved, and the data analysis synchronization speed of the data access system is ensured.
Further, the analysis adjustment module of the data access system judges whether the subsequent analysis plan needs to be adjusted according to the analysis quality matching degree of the single first analysis module, the analysis quality matching degree is determined by the analysis rate of the first analysis module in unit analysis time, the preset analysis rate and the analysis rate of each analysis unit, so that the judgment rationality of the analysis adjustment module can be improved, and the data analysis speed of the data access system is further ensured.
Furthermore, the analysis adjustment module of the data access system of the invention calculates the available calculation rate of the first analysis module for the second time according to the newly added first analysis module in the analysis process, adjusts the subsequent work plan, can improve the synchronous analysis speed of the subsequent work plan, and further improves the synchronous speed of the data access system.
Furthermore, two transmission channels are arranged between each analysis unit of the first analysis module in the data access system, so that the accuracy of determining the working state of the analysis units is ensured, the adjacent analysis units are prevented from sending error signals, and the data analysis stability of the data access system is ensured.
Drawings
FIG. 1 is a schematic diagram of a satellite remote sensing data access system according to the present invention;
FIG. 2 is a flow chart of the operation of the satellite remote sensing data access system of the present invention;
FIG. 3 is a relationship diagram of a first analysis module and an analysis unit of the satellite remote sensing data access system of the present invention;
FIG. 4 is a logic control diagram of an adjustment follow-up analysis plan of the satellite remote sensing data access system according to the present invention;
in the figure: 1, a first analysis module; 2, an analysis unit; and 3, an information interaction channel.
Detailed Description
In order that the objects and advantages of the invention will become more apparent, the invention will be further described with reference to the following examples; it should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention.
It should be noted that, in the description of the present invention, terms such as "upper," "lower," "left," "right," "inner," "outer," and the like indicate directions or positional relationships based on the directions or positional relationships shown in the drawings, which are merely for convenience of description, and do not indicate or imply that the apparatus or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those skilled in the art according to the specific circumstances.
Referring to fig. 1, fig. 2 and fig. 3, fig. 1 is a schematic structural diagram of a satellite remote sensing data access system according to the present invention; FIG. 2 is a flow chart of the operation of the satellite remote sensing data access system of the present invention; FIG. 3 is a relationship diagram of a first analysis module and an analysis unit of the satellite remote sensing data access system of the present invention; the invention provides a satellite remote sensing data access system, which comprises:
the request acquisition module is used for determining a target satellite remote sensing data range to be acquired according to a remote sensing data request of a user side and acquiring the data quantity and the priority of the target satellite remote sensing data;
the first analysis modules 1 are respectively connected with the request acquisition module, an information interaction channel 3 is arranged among the first analysis modules 1, each first analysis module 1 comprises the same number of analysis units 2, the analysis units 2 of a single first analysis module 1 are numbered in sequence, and the information interaction channel 3 is arranged among the adjacent analysis units 2;
the access acquisition module is connected with the request acquisition module and used for acquiring the working states of each first analysis module and all analysis units thereof and the residual workload of the current analysis work of each analysis unit;
the analysis planning module is respectively connected with the request acquisition module and each first analysis module and is used for calculating the available calculation rate of each first analysis module according to the acquisition result of the access acquisition module and determining the analysis strategy of the satellite remote sensing data according to the available calculation rate;
the analysis detection module is connected with each first analysis module and is used for detecting the analysis rate of unit analysis time of each first analysis module and the analysis rate of each analysis unit and calculating the analysis quality matching degree of each first analysis module;
the analysis adjustment module is respectively connected with the request acquisition module, the analysis detection module, the analysis planning module, the access acquisition module and each first analysis module, and is used for judging whether to adjust a subsequent analysis plan according to the analysis quality matching degree, and determining an adjustment mode of the analysis plan according to the residual workload of the first analysis module and the analysis rate of the first analysis module acquired by the access acquisition module; judging whether the analysis unit needs to be replaced or newly added according to the analysis rate and the working state of the analysis unit;
the working state comprises a data analysis state and an idle state without data analysis; the single priority corresponds to a plurality of first analysis modules which can analyze the data of the corresponding priority;
the resolution strategy includes determining a first resolution module and determining a number of resolution elements corresponding to the first resolution module.
In practice, the data priority of the data volume is a specified priority, for example, according to the digital and image information received by the remote sensor, three recording modes are generally adopted: film, image and digital tape, wherein the image comprises panchromatic photograph and infrared color image, then the panchromatic photograph priority is specified to be 1, the infrared color image priority is specified to be 2, the digital tape priority is specified to be 3 and the film priority is specified to be 4, the smaller the data priority value is, the higher the priority is; and the data with different priorities also have different analysis time in the analysis process.
According to the invention, through acquiring all satellite remote sensing data required by the data of the user side, carrying out data splitting, making an analysis plan with highest synchronous speed according to the idle state of each analysis module, improving the synchronous speed of analysis of the satellite remote sensing data, judging whether to adjust a subsequent analysis plan according to the analysis quality matching degree of each first analysis module, and further ensuring the analysis rate; the invention ensures the analysis rate when the access data volume is large, and can further improve the analysis rate.
Specifically, the analysis planning module calculates the available calculation rate of the corresponding first analysis module according to the priority of the target satellite remote sensing data which is correspondingly analyzed by the current first analysis module and the number of available analysis units;
wherein the available parsing unit is a parsing unit in an idle state.
The available calculation rate calculation formula is:
available calculation rate
Wherein v is 10 Calculating a rate, v, for the available computation of the first parsing module i For a preset slave parsing rate of the i-th available parsing unit, i=1, … …, n, n is the number of available parsing units, c is the data priority of the current first parsing module parsing data, c max And the maximum data priority in all data is remotely sensed for the target satellite.
In the data access system, the analysis planning module calculates the available calculation rate of the first analysis module according to the data priority of the data quantity corresponding to the analysis of the first analysis module, and can take the available calculation rate of each first analysis module as a data basis, thereby facilitating the subsequent adjustment of the analysis plan and improving the analysis rate in the data transmission process.
Specifically, the analysis planning module is provided with a plurality of analysis strategies, the first analysis module adopted by each analysis strategy is different or the number of adopted corresponding analysis units is different, wherein:
and the analysis strategy is that the analysis planning module determines the maximum available calculation rate of the current priority data according to the maximum available calculation rate of the first analysis module corresponding to each priority data, determines the synchronization speed according to the maximum available calculation rate with the minimum value in the maximum available calculation rate of each priority data, and determines the number of analysis units in the first analysis module used by other priority data according to the synchronization speed.
In the implementation, when the available calculation rates of the first analysis modules required by the priority data are the same, performing data analysis by using any first analysis module required by the priority data, wherein the synchronization rate is the available calculation rate;
when the maximum available computing rate in the first parsing modules required by each priority data has the lowest value, i.e. for example, the first parsing module of the maximum available computing rate in the first parsing modules required by each priority data comprises a first parsing module a, a first parsing module B and a first parsing module C, if the available computing rate of the first parsing module B is the lowest, the available computing rate of the first parsing module B is used as the synchronous speed, and the first parsing module a and the first parsing module C select a corresponding number of parsing units according to the synchronous speed to parse the data.
Specifically, the analysis planning module is further provided with a synchronous speed adjustment strategy, wherein the synchronous speed adjustment strategy is used for determining whether an analysis unit in the first analysis module can be preferentially called according to the priority weight of all the remote sensing data of the target satellite, if so, the analysis unit working in the first analysis module is adjusted to be in an idle state, and then the analysis strategy is used for determining the analysis plan of the remote sensing data of the satellite;
the synchronization speed adjustment strategy meets the condition that the available calculation rate of any first analysis module is smaller than the lowest expected analysis rate, and the synchronization speed adjustment strategy is triggered in preference to the analysis strategy.
In the implementation, the lowest expected analysis rate is determined according to the data volume of the remote sensing data request of the current user side, and the larger the data volume is, the largest the lowest expected analysis rate is; the priority weight is calculated according to the data volume duty ratio and the priority level of each priority data, and the calculation formula of the priority weight is as follows:
priority weights
Where k is a priority weight, c max C, for the maximum data priority of all data of target satellite remote sensing p For the p-th first parsing module to parse the data for data priority, p=1, … … c max ，N p N is the data volume of the remote sensing data of the target satellite;
when triggering a synchronous speed adjustment strategy, for example, a first analysis module with the maximum available calculation rate in each priority data demand first analysis module comprises a first analysis module A, a first analysis module B, a first analysis module C and a first analysis module D, if the available calculation rate of the first analysis module B is lowest and is lower than the lowest expected analysis rate, the priority weight of all the data of the target satellite remote sensing is calculated, when the priority weight of all the data of the target satellite remote sensing is greater than the priority weight of all the data of the satellite remote sensing in the current analysis, an analysis unit working in the first analysis module B is adjusted to be in an idle state, then the analysis strategy is used for determining the analysis plan of the satellite remote sensing data, and after determining the analysis plan of the target satellite remote sensing data, the rest analysis units of the current first analysis module and the rest units of other first analysis modules are used for continuing to analyze the interrupted analysis work;
when the priority weight of all the data of the target satellite remote sensing is smaller than or equal to the priority weight of all the data of the satellite remote sensing in the current analysis, the residual analysis units of the current first analysis module and the residual analysis units of other first analysis modules are used for analyzing the target satellite remote sensing data until the satellite remote sensing data in the current analysis is analyzed.
The analysis planning module of the data access system is provided with a plurality of strategies for pertinently determining the analysis plan for each first analysis module under different conditions, so that the rationality of the analysis plan is improved, and the synchronous speed of data analysis of the data access system is ensured.
Specifically, the analysis detection module determines analysis quality matching degree according to the actual analysis rate of the unit analysis time of the first analysis module, the available calculation rate and the analysis rate of each analysis unit;
resolution quality matching degree
Wherein alpha is the resolution quality matching degree, v 11 Actual resolution rate, v, in units of resolution time 10 To calculate the rate available, v j For the resolution rate of the j-th resolution unit, j=1, … … m, m is the number of resolution units currently used in the first resolution module, v 2 The parsing unit averages the parsing rate.
Specifically, the analysis adjustment module judges whether to adjust the analysis plan according to the analysis quality matching degree of the single first analysis module;
if the resolution quality matching degree is larger than or equal to a preset resolution quality matching degree standard value, the resolution adjustment module judges that the resolution plan does not need to be adjusted;
and if the resolution quality matching degree is smaller than a preset resolution quality matching degree standard value, the resolution adjustment module judges that the resolution plan needs to be adjusted.
In the implementation, the analysis quality matching degree standard value is the analysis quality matching degree average value of each first analysis module, and when the subsequent analysis plan needs to be adjusted, the analysis unit in the current first analysis module is replaced preferentially, so that the adjustment result is reduced due to the error influence of different first analysis modules.
According to the analysis adjustment module of the data access system, whether the subsequent analysis plan needs to be adjusted is judged according to the analysis quality matching degree of the single first analysis module, the analysis quality matching degree is determined by the analysis rate of the first analysis module in unit analysis time, the preset analysis rate and the analysis rate of each analysis unit, the judgment rationality of the analysis adjustment module can be improved, and the data analysis speed of the data access system is further ensured.
Referring to fig. 4, a logic control diagram of an adjustment subsequent analysis plan of the satellite remote sensing data access system according to an embodiment of the present invention is shown; the analysis adjustment module determines an adjustment mode according to the actual difference between the analysis quality matching degree of the single first analysis module and the preset analysis quality matching degree standard value under a first preset adjustment condition;
if the actual difference value is smaller than the preset difference value, judging that an analysis unit with the analysis rate lower than the required analysis rate exists, stopping data analysis by the analysis unit with the minimum actual analysis rate in the analysis units, and replacing the analysis unit with the analysis unit in an idle state for analysis;
if the actual difference value is greater than or equal to the preset difference value, judging that the resolution rate of the current resolution plan is lower than the required resolution rate, and increasing the number of resolution units of the single first resolution module participating in resolution;
the first preset adjustment condition is that the analysis quality matching degree of the single first analysis module is smaller than a preset analysis quality matching degree standard value, and at least one analysis unit in an idle state exists in the single first analysis module.
In the implementation, the preset analysis quality matching degree standard value is determined according to the weighted average value of the analysis quality matching degree of each first analysis module during analysis,
presetting a standard value of analysis quality matching degree
Wherein, gamma is a preset analysis quality matching degree standard value, alpha p For the resolution quality matching degree of the p-th first resolution module, c p Is the p-thA parsing module for parsing the data with priority, p=1, … … c max ，c max For the maximum value of the data priority in all the data of the target satellite remote sensing, determining the weight of a first analysis module required by each priority data according to the data priority, wherein the higher the priority is, the larger the weight is; the preset difference is defined as a preset analysis quality matching degree standard value which is 0.05 times;
it can be understood that the actual difference value is smaller than the preset difference value, which indicates that the analysis rate of the first analysis module and the analysis unit thereof which are currently used has small phase difference with the synchronous speed, and the analysis unit which is lower than the average analysis rate of the analysis unit is replaced according to the analysis rate of the analysis unit which is detected by the analysis detection module; if the actual difference value is larger than or equal to the preset difference value, which indicates that the analysis rate of the first analysis module and the analysis unit thereof which are currently used is large in difference from the synchronous speed, the analysis rate of the unit analysis time of the first analysis module cannot reach the synchronous speed, the analysis unit is increased to improve the analysis rate of the first analysis module, when the analysis unit is replaced, the replaced analysis unit marks the task progress of the task which is currently being analyzed, and the replaced analysis unit continues to analyze the task at the mark;
when the analysis adjustment module is not under the first preset adjustment condition, namely when all the first analysis modules corresponding to the priority data do not have the analysis units in the idle state, the first analysis module with the lowest current actual analysis rate adjusts the continuous analysis plan by using the synchronous speed adjustment strategy and/or the analysis strategy.
Specifically, the analysis planning module periodically controls the access acquisition module to acquire the residual workload of the current analysis work of each analysis unit, calculates the current available calculation rate, and adjusts the analysis strategy according to the current available calculation rate.
In implementation, the access acquisition module can acquire the working states of each first analysis module and all analysis units thereof acquired by the request acquisition module when data is accessed, namely, whether the first analysis module and all analysis units thereof are in an idle state or not, the analysis planning module calculates an available calculation rate according to the analysis units in the idle state, when the current available calculation rate changes, judges that the analysis units in the data analysis state when the data is accessed in the current first analysis module complete an analysis task, recalculates the available calculation rate of the first analysis module, and determines the synchronous speed again by using an analysis strategy or a synchronous speed adjustment strategy, so as to achieve the effect of improving the synchronous speed;
it will be appreciated that adjusting the resolution plan according to the currently available computational rate also uses resolution policies and/or synchronization speed adjustment policies.
According to the analysis adjustment module of the data access system, when the first analysis module is newly added in the analysis process, the available calculation rate of the first analysis module is calculated for the second time, and the subsequent work plan is adjusted, so that the synchronous analysis speed of the subsequent work plan can be improved, and the synchronous speed of the data access system is further improved.
Specifically, the analysis planning module adjusts the duration of the next detection period of the access acquisition module according to the residual workload of the analysis unit in the data analysis state acquired by the access acquisition module in the current period;
wherein the remaining workload is inversely related to the duration of the detection period.
In implementation, for the same analysis unit, the more the residual workload is, the shorter the duration of the detection period is; it can be understood that the more the residual workload is, the more the detection times are increased, the analysis condition of the data can be timely determined, and the opportunity that the analysis plan adjustment is not timely affected by the state update and the analysis rate of all the data is missed is avoided.
Specifically, in each first analysis module, the number of analysis units corresponding to each first analysis module for analyzing the data with the same priority is the same, and an information interaction channel is also arranged between the analysis unit with the smallest number and the analysis unit with the largest number;
the information interaction channel between the analysis units is used for determining whether the working state of the current analysis unit is in a normal state or not.
For example, the number of a first analysis module for specifying and analyzing the current data priority is a, the number of the first analysis module a is 10, the number of the analysis units is A1, a 2..a 10, information interaction channels are respectively arranged between A2 and A1 and between A2 and A3, information interaction channels are respectively arranged between A1 and A2 and between A1 and a10, and similarly, information interaction channels are respectively arranged between a10 and A9 and between a10 and A1;
in implementation, if the working state of the analysis unit A2 is abnormal, the analysis unit A1 and the analysis unit A3 acquire information that the A2 is abnormal through an information interaction channel and feed the information back to the first analysis module A; the working state of the analysis unit is in a normal state, and the analysis speed of the analysis unit is consistent with the average analysis speed of other analysis units, or the difference value is in an allowable range.
The analysis adjustment module judges that the current analysis unit is in an abnormal working state when two analysis units connected with the current analysis unit send abnormal signals to the corresponding first analysis module at the same time;
the abnormal working state is that the analysis data priority of the analysis unit is different from the analysis data priority of the first analysis module, or the analysis rate of the analysis unit is lower than the standard subordinate analysis rate; when the analysis unit is detected to be in an abnormal working state or the analysis rate of the analysis unit is lower than a preset subordinate analysis rate, the current analysis unit is judged to need to be replaced.
The preset subordinate parsing rate is the average parsing speed of other parsing units which do not include the current parsing unit;
in an implementation, other parsing units within the current first parsing module are preferentially selected when replacing parsing units.
According to the invention, two transmission channels are arranged between each analysis unit of the first analysis module in the data access system, so that the accuracy of determining the working state of the analysis units is ensured, the adjacent analysis units are prevented from sending error signals, and the data analysis stability of the data access system is ensured.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
The foregoing description is only of the preferred embodiments of the invention and is not intended to limit the invention; various modifications and variations of the present invention will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A satellite remote sensing data access system, comprising:
the request acquisition module is used for determining a target satellite remote sensing data range to be acquired according to a remote sensing data request of a user side and acquiring the data quantity and the priority of the target satellite remote sensing data;
the first analysis modules are respectively connected with the request acquisition module, an information interaction channel is arranged among the first analysis modules, each first analysis module comprises analysis units with the same number, each analysis unit of a single first analysis module is numbered in sequence, and an information interaction channel is arranged among adjacent analysis units;
the access acquisition module is connected with the request acquisition module and used for acquiring the working states of each first analysis module and all analysis units thereof and the residual workload of the current analysis work of each analysis unit;
the analysis planning module is respectively connected with the request acquisition module and each first analysis module and is used for calculating the available calculation rate of each first analysis module according to the acquisition result of the access acquisition module and determining the analysis strategy of the satellite remote sensing data according to the available calculation rate;
the analysis detection module is connected with each first analysis module and is used for detecting the analysis rate of unit analysis time of each first analysis module and the analysis rate of each analysis unit and calculating the analysis quality matching degree of each first analysis module;
the analysis adjustment module is respectively connected with the request acquisition module, the analysis detection module, the analysis planning module, the access acquisition module and each first analysis module, and is used for judging whether to adjust a subsequent analysis plan according to the analysis quality matching degree, and determining an adjustment mode of the analysis plan according to the residual workload of the first analysis module and the analysis rate of the first analysis module acquired by the access acquisition module; judging whether the analysis unit needs to be replaced or newly added according to the analysis rate and the working state of the analysis unit;
the working state comprises a data analysis state and an idle state without data analysis; the single priority corresponds to a plurality of first analysis modules which can analyze the data of the corresponding priority;
the resolution strategy includes determining a first resolution module and determining a number of resolution elements corresponding to the first resolution module.
2. The satellite remote sensing data access system according to claim 1, wherein the resolution planning module calculates an available calculation rate corresponding to the first resolution module according to a priority of the target satellite remote sensing data which is correspondingly resolved by the current first resolution module and the number of available resolution units;
wherein the available parsing unit is a parsing unit in an idle state.
3. The satellite remote sensing data access system according to claim 2, wherein the resolution planning module is provided with a plurality of resolution strategies, the first resolution module adopted by each resolution strategy is different or the number of corresponding resolution units adopted by each resolution strategy is different, wherein:
and the analysis strategy is that the analysis planning module determines the maximum available calculation rate of the current priority data according to the maximum available calculation rate of the first analysis module corresponding to each priority data, determines the synchronization speed according to the maximum available calculation rate with the minimum value in the maximum available calculation rate of each priority data, and determines the number of analysis units in the first analysis module used by other priority data according to the synchronization speed.
4. The satellite remote sensing data access system according to claim 3, wherein the analysis planning module is further provided with a synchronization speed adjustment strategy, the synchronization speed adjustment strategy is used for determining whether an analysis unit in the first analysis module can be preferentially called according to priority weights of all data of the target satellite remote sensing, if so, the analysis unit in the first analysis module working is adjusted to be in an idle state, and then the analysis strategy is used for determining an analysis plan of the satellite remote sensing data;
the synchronization speed adjustment strategy meets the condition that the available calculation rate of any first analysis module is smaller than the lowest expected analysis rate, and the synchronization speed adjustment strategy is triggered in preference to the analysis strategy.
5. The satellite remote sensing data access system according to claim 4, wherein the analysis detection module determines an analysis quality matching degree according to an actual analysis rate of the first analysis module per unit analysis time, the available calculation rate, and an analysis rate of each analysis unit;
resolution quality matching degree
Wherein alpha is the resolution quality matching degree, v 11 Actual resolution rate, v, in units of resolution time 10 To calculate the rate available, v j For the resolution rate of the j-th resolution unit, j=1, … … m, m is the number of resolution units currently used in the first resolution module, v 2 The parsing unit averages the parsing rate.
6. The satellite remote sensing data access system according to claim 5, wherein the resolution adjustment module determines whether to adjust the resolution plan according to a resolution quality match of a single first resolution module;
if the resolution quality matching degree is larger than or equal to a preset resolution quality matching degree standard value, the resolution adjustment module judges that the resolution plan does not need to be adjusted;
and if the resolution quality matching degree is smaller than a preset resolution quality matching degree standard value, the resolution adjustment module judges that the resolution plan needs to be adjusted.
7. The satellite remote sensing data access system according to claim 6, wherein the resolution adjustment module determines an adjustment mode according to an actual difference between the resolution quality matching degree of the single first resolution module and the preset resolution quality matching degree standard value under a first preset adjustment condition;
if the actual difference value is smaller than the preset difference value, judging that an analysis unit with the analysis rate lower than the required analysis rate exists, stopping data analysis by the analysis unit with the minimum actual analysis rate in the analysis units, and replacing the analysis unit with the analysis unit in an idle state for analysis;
if the actual difference value is greater than or equal to the preset difference value, judging that the resolution rate of the current resolution plan is lower than the required resolution rate, and increasing the number of resolution units of the single first resolution module participating in resolution;
the first preset adjustment condition is that the analysis quality matching degree of the single first analysis module is smaller than a preset analysis quality matching degree standard value, and at least one analysis unit in an idle state exists in the single first analysis module.
8. The satellite remote sensing data access system of claim 7, wherein the resolution planning module periodically controls the access acquisition module to collect a remaining workload of a current resolution job of each resolution unit and calculate a current available calculation rate, and the resolution planning module adjusts a resolution policy according to the current available calculation rate.
9. The satellite remote sensing data access system according to claim 8, wherein the analysis planning module adjusts the duration of the next detection period of the access acquisition module according to the residual workload of the analysis unit in the data analysis state acquired by the access acquisition module in the current period;
wherein the remaining workload is inversely related to the duration of the detection period.
10. The satellite remote sensing data access system according to claim 1, wherein in each of the first analysis modules, the number of analysis units corresponding to each of the first analysis modules analyzing the data with the same priority is the same, and an information interaction channel is also provided between the analysis unit with the smallest number and the analysis unit with the largest number;
the information interaction channel between the analysis units is used for determining whether the working state of the current analysis unit is in a normal state or not.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311532240.1A CN117459125B (en) | 2023-11-17 | 2023-11-17 | Satellite remote sensing data access system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311532240.1A CN117459125B (en) | 2023-11-17 | 2023-11-17 | Satellite remote sensing data access system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117459125A true CN117459125A (en) | 2024-01-26 |
| CN117459125B CN117459125B (en) | 2024-06-04 |
Family
ID=89583537
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311532240.1A Active CN117459125B (en) | 2023-11-17 | 2023-11-17 | Satellite remote sensing data access system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117459125B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180341894A1 (en) * | 2017-05-24 | 2018-11-29 | Telespazio S.P.A. | Innovative satellite scheduling method based on genetic algorithms and simulated annealing and related mission planner |
| CN111313997A (en) * | 2020-02-11 | 2020-06-19 | 哈尔滨工业大学 | Remote sensing satellite multi-priority non-equilibrium rate load data dynamic multiplexer simulation system |
| JP2022022627A (en) * | 2020-06-30 | 2022-02-07 | 国立研究開発法人宇宙航空研究開発機構 | Information processing device, information processing method, and program |
| CN116470954A (en) * | 2023-04-27 | 2023-07-21 | 上海航天电子通讯设备研究所 | Communication broadband distribution method and system for remote sensing satellite constellation |
-
2023
- 2023-11-17 CN CN202311532240.1A patent/CN117459125B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180341894A1 (en) * | 2017-05-24 | 2018-11-29 | Telespazio S.P.A. | Innovative satellite scheduling method based on genetic algorithms and simulated annealing and related mission planner |
| CN111313997A (en) * | 2020-02-11 | 2020-06-19 | 哈尔滨工业大学 | Remote sensing satellite multi-priority non-equilibrium rate load data dynamic multiplexer simulation system |
| JP2022022627A (en) * | 2020-06-30 | 2022-02-07 | 国立研究開発法人宇宙航空研究開発機構 | Information processing device, information processing method, and program |
| CN116470954A (en) * | 2023-04-27 | 2023-07-21 | 上海航天电子通讯设备研究所 | Communication broadband distribution method and system for remote sensing satellite constellation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117459125B (en) | 2024-06-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5140523A (en) | Neural network for predicting lightning | |
| CN107943078A (en) | More rotor dual systems unmanned plane inspection fault diagnosis systems and method | |
| CN116633816A (en) | Media display terminal safety supervision early warning system based on enterprise digitization | |
| CN105873211A (en) | Positioning method and device | |
| EP3771152B1 (en) | Network analysis program, network analysis device, and network analysis method | |
| CN109613517A (en) | A kind of anti-interference working method of TOF Lidar multimachine | |
| CN112073460A (en) | Data acquisition unit, data transmission method and comprehensive energy monitoring system | |
| CN106501774A (en) | A kind of underwater acoustic sensor network node positioning method | |
| US20080126274A1 (en) | Auto-adaptive network | |
| CN117459125B (en) | Satellite remote sensing data access system | |
| CN116342063A (en) | Data processing method applied to intelligent agriculture | |
| CN116708134A (en) | Point-to-point network transmission system based on flow control | |
| CN107087252A (en) | A kind of method that Bluetooth broadcast carries out data transmission | |
| CN110289090A (en) | Event finds method and device, storage medium, terminal | |
| CN110139315A (en) | A kind of wireless network fault detection method based on self-teaching | |
| CN112488193A (en) | Multi-channel data fusion method and greenhouse monitoring system applying same | |
| CN117029900A (en) | Metering instrument detection method based on dynamic multipath synchronous detection | |
| US7130805B2 (en) | Method and apparatus for generating progressive queries and models for decision support | |
| CN107222918A (en) | A kind of transmission power adjustment method and device | |
| CN116340876A (en) | Spatial target situation awareness method for local multisource data fusion | |
| KR102206968B1 (en) | Method and server for analyzing soil condition for applying manure in real time according to growth cycle of crop | |
| CN117978769B (en) | Big data fusion analysis system based on multi-source heterogeneous data | |
| CN117119500B (en) | Intelligent CPE (customer premise equipment) module-based inspection robot data transmission optimization method | |
| WO2023116703A1 (en) | Precoding matrix obtaining method and apparatus, electronic device, and storage medium | |
| CN114900845B (en) | Beam management method based on coverage environment and channel quality under NR |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |