CN114465652B - General extensible remote sensing satellite data real-time quick-viewing processing scheduling system - Google Patents
General extensible remote sensing satellite data real-time quick-viewing processing scheduling system Download PDFInfo
- Publication number
- CN114465652B CN114465652B CN202111581931.1A CN202111581931A CN114465652B CN 114465652 B CN114465652 B CN 114465652B CN 202111581931 A CN202111581931 A CN 202111581931A CN 114465652 B CN114465652 B CN 114465652B
- Authority
- CN
- China
- Prior art keywords
- module
- sensor
- task
- data
- flow
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000005111 flow chemistry technique Methods 0.000 claims abstract description 16
- 230000006837 decompression Effects 0.000 claims description 5
- 238000000034 method Methods 0.000 claims description 4
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000007726 management method Methods 0.000 description 7
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B7/00—Radio transmission systems, i.e. using radiation field
- H04B7/14—Relay systems
- H04B7/15—Active relay systems
- H04B7/185—Space-based or airborne stations; Stations for satellite systems
- H04B7/1851—Systems using a satellite or space-based relay
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Astronomy & Astrophysics (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
Abstract
Aiming at the scheduling system of the quick-looking processing, the application provides a general extensible remote sensing satellite data real-time quick-looking processing scheduling system, which solves the problem that a set of scheduling system is required to be developed for quick-looking processing of each satellite in the prior art, and can increase the support of a new quick-looking processing flow of a new satellite in a platform through the template configuration of the scheduling flow and the configuration of a satellite sensor. Comprising the following steps: the sensor corresponding relation processing unit, the task flow processing unit and the data flow processing unit; the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module; the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; the data stream processing unit comprises a data stream template customizing module and a data stream management module.
Description
Technical Field
The application belongs to the technical field of ground processing of remote sensing satellites, and particularly relates to a universal expandable real-time quick-viewing processing scheduling system for remote sensing satellite data.
Background
The current remote sensing satellite data real-time quick-viewing processing system generally comprises a quick-viewing processing module (decompression, quick-viewing processing, quick-viewing display, quick-viewing data compression, quick-viewing data transmission and the like) and a scheduling system. The processing module is required to carry out customization processing according to the on-board sensor, and the scheduling system carries out customization processing according to the processing flow combination of the processing module. Because the satellite-ground interfaces of each satellite are different, the load types are different, the processing flows are different, the sensor processing granularity of decompression and quick-vision processing is also different, and the prior art adopts a scheme for independently developing a scheduling program for each satellite.
For example, in a real-time fast-looking method of original data of a high code rate remote sensing satellite disclosed in a patent with publication number of CN109872268A, remote sensing image fast-looking is completed by adopting a mode of cuDA and OpenGL interoperation; according to the remote sensing satellite data quick-looking substitution method disclosed in the patent with the publication number of CN103763059A, error code conditions are judged according to known frame synchronous words, RS codes, virtual channel counters and other information in original data, and then different colors are used for representing the data error code conditions.
Disclosure of Invention
Aiming at the scheduling system of the quick-looking processing, the application provides a general extensible remote sensing satellite data real-time quick-looking processing scheduling system, which solves the problem that a set of scheduling system is required to be developed for quick-looking processing of each satellite in the prior art, and can increase the support of a new quick-looking processing flow of a new satellite in a platform through the template configuration of the scheduling flow and the configuration of a satellite sensor.
The application is realized by the following technical scheme.
A universal scalable remote sensing satellite data real-time fast-view processing scheduling system, comprising: the sensor corresponding relation processing unit, the task flow processing unit and the data flow processing unit;
the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module; the sensor relation model configuration module is used for establishing a corresponding relation model of granularity of a remote control sensor, a decompression sensor and a quick-vision processing sensor, and customizing each satellite sensor model through configuration; the sensor configuration model analysis module acquires a sensor which needs to be processed by the task according to the corresponding relation model, and acquires a secondary task flow of a corresponding sensor of the task by combining a secondary task flow template in a task flow processing unit, so as to generate an internal job ticket;
the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; the secondary task flow template customizing module is used for dividing the task into secondary tasks, and the secondary task flow scheduling module is used for scheduling the primary task and the secondary task respectively;
the data stream processing unit comprises a data stream template customizing module and a data stream management module; the data flow template customizing module is used for customizing the flow direction of data between the secondary tasks and the execution units; the data flow management module is used for designating the data flow according to the data flow defined by the data flow template customization module.
The application has the beneficial effects that:
the application can realize the configuration expansion support of the newly added satellite quick-vision processing flow by configuring the sensor corresponding relation model, the secondary operation flow template and the data flow template without developing a set of quick-vision processing system for each satellite.
Drawings
FIG. 1 is a block diagram of a general scalable remote sensing satellite data real-time fast-view processing scheduling system according to the present application.
Detailed Description
In order to enable those skilled in the art to better understand the present application, the following description will make clear and complete descriptions of the technical solutions according to the embodiments of the present application with reference to the accompanying drawings.
As shown in fig. 1, a universal scalable remote sensing satellite data real-time fast-view processing and scheduling system in this embodiment specifically includes: the sensor corresponding relation processing unit, the task flow processing unit and the data flow processing unit;
the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module;
the sensor relation model configuration module is used for establishing a corresponding relation model of granularity of a remote control sensor, a decompression sensor and a quick-vision processing sensor, and customizing each satellite sensor model through configuration; the sensor configuration model analysis module acquires a sensor which needs to be processed by the task according to the corresponding relation model, and acquires a secondary task flow of a corresponding sensor of the task by combining a secondary task flow template in a task flow processing unit, so as to generate an internal job ticket;
in the specific implementation, because the quick-view sensors required to be made for each task are different, the sensors required to be processed for the task are required to be obtained according to the established sensor corresponding relation model, and the secondary task flow of the corresponding sensor for the task is obtained by combining the secondary task flow template in the task flow processing unit, so that an internal job ticket is generated;
the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; in the specific implementation, as the quick-view processing flow of each satellite is various and complex, in order to facilitate the management of each flow, the secondary task flow template customizing module is used for dividing a task into secondary tasks, and a complex quick-view task is divided into a plurality of secondary tasks by adopting a secondary template mode;
in this embodiment, the secondary template specifically includes: and taking one data stream as a basic unit, carrying out combined management on the secondary template by the primary template, and combining to form a real-time quick-looking processing task flow of a certain satellite.
The secondary task flow scheduling module is used for scheduling the primary task and the secondary task respectively.
In this embodiment, the primary task scheduling performs serial and parallel scheduling according to the execution sequence and the dependency relationship of the secondary tasks, performs start and stop management on each secondary task, monitors the execution process of the secondary task, and obtains the execution result.
In this embodiment, the secondary task scheduling performs serial and parallel scheduling according to the execution sequence and the dependency relationship among the execution units, manages the start and stop of each execution unit, and performs real-time tracking on the execution state of the started module, so as to feed back the final execution result of each module.
The data stream processing unit comprises a data stream template customizing module and a data stream management module; the data flow template customizing module is used for customizing the flow direction of data between the secondary tasks and the execution units; the data flow management module is used for designating the data flow according to the data flow defined by the data flow template customization module.
In this embodiment, the data stream is divided into a real-time data stream and a non-real-time data stream: the real-time data stream is used for transmitting network data frames in a socket mode and is used for transmitting data among modules working in parallel; the non-real-time data stream is read-write of data files for data transmission between modules working in series.
The foregoing is merely a preferred embodiment of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (3)
1. A universal expandable remote sensing satellite data real-time fast-view processing scheduling system, comprising: the sensor corresponding relation processing unit, the task flow processing unit and the data flow processing unit;
the sensor corresponding relation processing unit comprises a sensor relation model configuration module and a sensor configuration model analysis module; the sensor relation model configuration module is used for establishing a corresponding relation model of granularity of a remote control sensor, a decompression sensor and a quick-vision processing sensor, and customizing each satellite sensor model through configuration; the sensor configuration model analysis module acquires a sensor which needs to be processed by the task according to the corresponding relation model, and acquires a secondary task flow of a corresponding sensor of the task by combining a secondary task flow template in a task flow processing unit, so as to generate an internal job ticket;
the task flow processing unit comprises a secondary task flow template customizing module and a secondary task flow scheduling module; the secondary task flow template customizing module is used for splitting a quick-looking task into a plurality of secondary tasks, and the secondary task flow scheduling module is used for scheduling the primary task and the secondary task respectively; the second-stage task scheduling performs serial and parallel scheduling according to the execution sequence and the dependency relationship among the execution units;
the data stream processing unit comprises a data stream template customizing module and a data stream management module; the data flow template customizing module is used for customizing the flow direction of data between the secondary tasks and the execution units; the data flow management module is used for designating the data flow direction of the starting parameter file of the execution unit according to the data flow direction defined by the data flow template customization module;
the second-level task flow template takes a data stream as a basic unit, and the first-level template carries out combination management on the second-level template to jointly form a real-time quick-looking processing task flow of a certain satellite;
the system can realize the configuration extension support of the newly-added satellite quick-vision processing flow by configuring the sensor corresponding relation model, the secondary task flow template and the data flow template;
the data stream is divided into a real-time data stream and a non-real-time data stream: the real-time data stream is used for transmitting network data frames in a socket mode and is used for transmitting data among modules working in parallel; the non-real-time data stream is read-write of data files for data transmission between modules working in series.
2. The system for real-time fast-view processing and scheduling of universal extensible remote sensing satellite data according to claim 1, wherein the first-stage task scheduling performs serial and parallel scheduling according to the execution sequence and the dependency relationship of the second-stage tasks, performs starting and stopping management on each second-stage task, monitors the execution process of the second-stage task, and obtains the execution result.
3. The system of claim 1, wherein the second-level task scheduling manages starting and stopping of each execution unit, and tracks the execution state of the started modules in real time, and feeds back the final execution result of each module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111581931.1A CN114465652B (en) | 2021-12-22 | 2021-12-22 | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111581931.1A CN114465652B (en) | 2021-12-22 | 2021-12-22 | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114465652A CN114465652A (en) | 2022-05-10 |
| CN114465652B true CN114465652B (en) | 2023-11-14 |
Family
ID=81405062
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111581931.1A Active CN114465652B (en) | 2021-12-22 | 2021-12-22 | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114465652B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101315424A (en) * | 2008-07-29 | 2008-12-03 | 中国科学院对地观测与数字地球科学中心 | Multi-satellite remote sensing data integrated parallel ground pretreatment system |
| CN102412990A (en) * | 2011-11-18 | 2012-04-11 | 中国科学院对地观测与数字地球科学中心 | Remote sensing satellite raw data recording system with centralized management and real-time transmission functions |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN104239143A (en) * | 2014-09-17 | 2014-12-24 | 中国科学院遥感与数字地球研究所 | Satellite data receiving task scheduling system based on OSGI (Open Service Gateway Initiative) and workflow and satellite data receiving task scheduling method based on OSGI and workflow |
| CN106845792A (en) * | 2016-12-27 | 2017-06-13 | 中国电子科技集团公司第五十四研究所 | Mission planning general-purpose platform based on star ground resource model |
| WO2020108303A1 (en) * | 2018-11-30 | 2020-06-04 | 中兴通讯股份有限公司 | Heterogeneous computing-based task processing method and software-hardware framework system |
-
2021
- 2021-12-22 CN CN202111581931.1A patent/CN114465652B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101315424A (en) * | 2008-07-29 | 2008-12-03 | 中国科学院对地观测与数字地球科学中心 | Multi-satellite remote sensing data integrated parallel ground pretreatment system |
| CN102412990A (en) * | 2011-11-18 | 2012-04-11 | 中国科学院对地观测与数字地球科学中心 | Remote sensing satellite raw data recording system with centralized management and real-time transmission functions |
| CN102521687A (en) * | 2011-12-01 | 2012-06-27 | 中国资源卫星应用中心 | Miniaturized universal platform for preprocessing remote-sensing satellite data |
| CN104239143A (en) * | 2014-09-17 | 2014-12-24 | 中国科学院遥感与数字地球研究所 | Satellite data receiving task scheduling system based on OSGI (Open Service Gateway Initiative) and workflow and satellite data receiving task scheduling method based on OSGI and workflow |
| CN106845792A (en) * | 2016-12-27 | 2017-06-13 | 中国电子科技集团公司第五十四研究所 | Mission planning general-purpose platform based on star ground resource model |
| WO2020108303A1 (en) * | 2018-11-30 | 2020-06-04 | 中兴通讯股份有限公司 | Heterogeneous computing-based task processing method and software-hardware framework system |
Non-Patent Citations (7)
| Title |
|---|
| 一种支持多星多任务遥感卫星地面***综合处理的运行控制技术;赵文波等;《电子与信息学报》;20050620(第06期);全文 * |
| 冯阳等.基于工作流技术的遥感卫星数据接收调度***的设计与实现.《无线电工程》.2018,第48卷(第11期), * |
| 基于工作流技术的遥感卫星数据接收调度***的设计与实现;冯阳等;《无线电工程》;20181019;第48卷(第11期);论文第1-4节，图1-2 * |
| 基于插件的星地资源管理***的设计与实现;孔庆玲 等;《信息***与网络》;20171106;第47卷(第11期);全文 * |
| 基于流式计算的遥感卫星数据快视处理方法;宋峣 等;《计算机工程与应用》;20180809;第55卷(第10期);全文 * |
| 通用遥感卫星快视处理***技术研究;杨仁忠;蔡兴文;杨蕾;石璐;;遥感信息(05);全文 * |
| 高性能遥感卫星地面预处理***中的任务管理与调度技术研究;向彪等;《宇航学报》;20080730;第29卷(第04期);论文摘要、引言、第1-3节，图1 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114465652A (en) | 2022-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109933306B (en) | Self-adaptive hybrid cloud computing framework generation method based on operation type recognition | |
| CN102521687B (en) | Miniaturized universal platform for preprocessing remote-sensing satellite data | |
| EP3684033A1 (en) | Systems and methods for collecting, monitoring, and analyzing vehicle data from a plurality of vehicles using edge computing | |
| CN108733358A (en) | Spark-based machine learning workflow construction method and device | |
| CN106408271A (en) | Method and device for monitoring project | |
| CN105243499A (en) | Order distribution method and system | |
| CN114461357A (en) | Remote sensing satellite raw data real-time processing flow scheduling engine | |
| CN111475137A (en) | Method, system and equipment for predicting software development requirements | |
| CN109086044B (en) | Simulation model development method based on components | |
| CN114465652B (en) | General extensible remote sensing satellite data real-time quick-viewing processing scheduling system | |
| CN116661978B (en) | Distributed flow processing method and device and distributed business flow engine | |
| CN102541539B (en) | Method for designing intelligent panel of supply chain based on M2M (Machine to Machine) | |
| CN109144840A (en) | A kind of test method, device and its equipment | |
| CN116820714A (en) | Scheduling method, device, equipment and storage medium of computing equipment | |
| CN103824162B (en) | Reliability and performance integrated flexible workflow implementing method based on instruction chain | |
| CN106598721B (en) | Media asset data streaming method and device | |
| CN106503162B (en) | SAP platform based page dynamic generation method and system | |
| US20180218060A1 (en) | Rollup engine for internet of things | |
| CN111176624B (en) | Method and device for generating stream type calculation index | |
| CN110515595B (en) | Resource modeling and management method of avionics distributed management system | |
| CN111143057B (en) | Heterogeneous cluster data processing method and system based on multiple data centers and electronic equipment | |
| Parkhomenko | Complex requirements analysis for the high-level design of Embedded Systems | |
| CN112232960B (en) | Transaction application system monitoring method and device | |
| CN115544672A (en) | Digital twin simulation method, system, device and server | |
| EP4109365A1 (en) | Method and device for managing project by using cost payment time point setting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |