CN110297926A - The spaceborne in-orbit configuration method of image processing apparatus - Google Patents
The spaceborne in-orbit configuration method of image processing apparatus Download PDFInfo
- Publication number
- CN110297926A CN110297926A CN201910586872.3A CN201910586872A CN110297926A CN 110297926 A CN110297926 A CN 110297926A CN 201910586872 A CN201910586872 A CN 201910586872A CN 110297926 A CN110297926 A CN 110297926A
- Authority
- CN
- China
- Prior art keywords
- injection
- file
- image processing
- processing apparatus
- data frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6227—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database where protection concerns the structure of data, e.g. records, types, queries
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Library & Information Science (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Image Processing (AREA)
Abstract
A kind of spaceborne in-orbit configuration method of image processing apparatus of the present invention is related to satellite technology field, and this method is applied to spaceborne image processing apparatus, including receiving ground control station according to the default injection file for sending rule and sending;Injection file is injected into default injection file area according to default write-in rule;It injects file and default injection file area corresponds;Injection file based on injection is configured according to preset configuration rule.Technical solution provided in an embodiment of the present invention, multiple injection files can be injected into the data storage file area of spaceborne image processing apparatus, it is that spaceborne image processing apparatus selects different configuration files to be reconfigured by different task scenes, it can be reconfigured according to different in-orbit process demands, so that spaceborne image processing apparatus adapts to different detection missions, alleviate spaceborne image processing apparatus detection scene in the prior art it is single, can not in-orbit configuration the problem of.
Description
Technical field
The present invention relates to satellite technology fields, more particularly, to a kind of spaceborne in-orbit configuration method of image processing apparatus.
Background technique
With making rapid progress for spaceborne imaging device, the detectivity of spaceborne imaging device is gradually increased, and spaceborne imaging is set
The task scene of standby detection is also more and more.
Currently, traditional spaceborne image processing apparatus configuration method is on the ground in advance by task scene to be detected
The spaceborne imaging device of file write-in, however this kind of spaceborne image processing apparatus configuration method existing defects, can only be to a kind of task
Scene is detected, then helpless when needing to detect other task scenes.Therefore, needing to develop one kind can be real
The spaceborne image processing apparatus configuration method of present rail configuration, matches the different images processing unit of different task scene with meeting
The detection demand set.
Summary of the invention
In view of this, the purpose of the present invention is to provide a kind of spaceborne in-orbit configuration method of image processing apparatus, Neng Goushi
The existing in-orbit configuration of image processing apparatus.
In a first aspect, being applied to star the embodiment of the invention provides a kind of spaceborne in-orbit configuration method of image processing apparatus
Carry image processing apparatus, comprising the following steps:
Spaceborne image processing apparatus receives ground control station according to the default injection file for sending rule and sending, each note
Enter file and is assigned a reference number of a document different from alternative document in advance;
The injection file is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule;Institute
It states injection file and the default injection file area corresponds;
The injection file based on injection configures spaceborne image processing apparatus according to preset configuration rule.
With reference to first aspect, the embodiment of the invention provides the first possible embodiments of first aspect, wherein institute
It is as follows to state default transmission rule:
The command frame decomposed to the injection file is successively sent according to the sequence of decomposition;Wherein, described instruction frame
It is further decomposed and is obtained by the data frame that the injection file decomposes, the data frame carries the file of the injection file
Number and each data frame are assigned the effective number of a sequential encoding.
With reference to first aspect, the embodiment of the invention provides second of possible embodiments of first aspect, wherein institute
It states and the injection file is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule, comprising:
Spaceborne image processing apparatus receives the command frame that ground control station is sent;Wherein, described instruction frame is by the injection
The data frame that file decomposes further is decomposed and is obtained;
Assembly is carried out to received described instruction frame and obtains the data frame;
The check code for extracting the data frame verifies the data frame;
Correct data frame will be verified, the default injection file area is written.
The possible embodiment of second with reference to first aspect, the embodiment of the invention provides the third of first aspect
Possible embodiment, wherein the method also includes:
The data frame that the default injection file area of the spaceborne image processing apparatus is written is read and carries out secondary verification;
It is recorded as the secondary correct data frame of verification that successful data frame is written.
The third possible embodiment with reference to first aspect, the embodiment of the invention provides the third of first aspect
Possible embodiment, wherein the method also includes:
The effective number that successful data frame is written is sent to the ground control station, so that the ground control station is true
The fixed data frame injected not successfully, and decompose again and refill.
It should be noted that ground control station is literary by the injection after the completion of the data frame of an injection file all injects
The file size of part is sent to spaceborne image processing apparatus.
The 4th kind of possible embodiment with reference to first aspect, the embodiment of the invention provides the 5th kind of first aspect
Possible embodiment, wherein the method also includes:
The identical data frame of reference number of a document for being written successfully and inject file is combined based on effective number, is spelled
Fill data frame;
Judge whether frame length and the file size of the injection file of assembled data frame are equal;
If so, it is complete for updating and recording the injection state for injecting file.
With reference to first aspect, the embodiment of the invention provides the 6th kind of possible embodiments of first aspect, wherein institute
The injection file based on write-in is stated to configure spaceborne image processing apparatus according to preset configuration rule, comprising:
Spaceborne image processing apparatus determines the configuration-direct that the ground control station is sent;The configuration-direct carries
State the file identification of injection file;
The injection state of the injection file is obtained according to the configuration-direct;
Judge whether the injection state is complete;
If so, starting configuration flow.
If it is not, then sending error message to the ground control station, the error message is used to indicate configuration failure.
The 6th kind of possible embodiment with reference to first aspect, the embodiment of the invention provides the 7th kind of first aspect
Possible embodiment, wherein the starting configuration flow, comprising:
The injection file is sequential read out from the default injection file area of the spaceborne image processing apparatus according to preset order
Data frame;
The data frame of reading is verified three times;
Correct data frame output configuration will be verified three times;
According to preset configuration timing, spaceborne image processing apparatus preset configuration successively is written into the data frame for injecting file
Area, until completing configuration.
Second aspect, the embodiment of the present invention also provide a kind of in-orbit configuration method of spaceborne file, are applied to ground control station,
Include:
Injection file is sent to spaceborne image processing apparatus, so that the spaceborne image procossing dress according to default transmission rule
It sets and the injection file is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule, and based on note
The injection file entered configures spaceborne image processing apparatus according to preset configuration rule.
In conjunction with second aspect, the embodiment of the invention provides the first possible embodiments of second aspect, wherein institute
It states and sends injection file to spaceborne image processing apparatus according to default transmission rule, comprising:
The injection file is decomposed into multiple data frames;
Each data frame is decomposed into some instructions frame;
For each data frame, some instructions frame of decomposition is successively sent to the spaceborne image according to the sequence of decomposition
Processing unit.
The third aspect, the embodiment of the present invention also provide a kind of electronic equipment, including memory, processor and are stored in described
On memory and the computer program that can run on the processor, the processor are realized when executing the computer program
The step of above-mentioned method.
Fourth aspect, the embodiment of the present invention also provide a kind of meter of non-volatile program code that can be performed with processor
The step of calculation machine readable medium, said program code makes the processor execute above-mentioned method.
The embodiment of the present invention brings following the utility model has the advantages that spaceborne image processing apparatus provided in an embodiment of the present invention is in-orbit
Configuration method is applied to spaceborne image processing apparatus, and image processing apparatus spaceborne first receives ground control station according to default hair
The injection file for sending rule to send;Then the injection file is injected into spaceborne image processing apparatus according to default write-in rule
Default injection file area;It injects file and the default injection file area corresponds;The finally injection text based on injection
Part configures spaceborne image processing apparatus according to preset configuration rule.Therefore, technical solution provided in an embodiment of the present invention,
Multiple injection files can be injected into spaceborne image processing apparatus data storage file area, be selected by different task scenes
Different configuration files reconfigures spaceborne image processing apparatus, i.e., spaceborne image processing apparatus can be according to different
In-orbit process demand is reconfigured, and different detection missions is adapted to, and alleviates spaceborne image processing apparatus in the prior art
Detect scene it is single, can not in-orbit configuration the problem of.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
It obtains it is clear that understand through the implementation of the invention.The objectives and other advantages of the invention are in specification, claims
And specifically noted structure is achieved and obtained in attached drawing.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate
Appended attached drawing, is described in detail below.
Detailed description of the invention
It, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical solution in the prior art
Embodiment or attached drawing needed to be used in the description of the prior art be briefly described, it should be apparent that, it is described below
Attached drawing is some embodiments of the present invention, for those of ordinary skill in the art, before not making the creative labor
It puts, is also possible to obtain other drawings based on these drawings.
Fig. 1 is the structural schematic diagram of spaceborne image processing apparatus provided in an embodiment of the present invention;
Fig. 2 is the application principle figure of spaceborne image processing apparatus provided in an embodiment of the present invention;
Fig. 3 is the flow chart of the spaceborne in-orbit configuration method of file provided in an embodiment of the present invention;
Fig. 4 is the configuration scene figure of the spaceborne in-orbit configuration method of file provided in an embodiment of the present invention;
Fig. 5 is modularization design figure provided in an embodiment of the present invention;
Fig. 6 is configuration flow figure provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with attached drawing to the present invention
Technical solution be clearly and completely described, it is clear that described embodiments are some of the embodiments of the present invention, rather than
Whole embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not making creative work premise
Under every other embodiment obtained, shall fall within the protection scope of the present invention.
Currently, traditional spaceborne image processing apparatus configuration method is on the ground in advance by task scene to be detected
The spaceborne imaging device of file write-in, however this kind of spaceborne image processing apparatus configuration method existing defects, can only be to a kind of task
Scene is detected, then helpless when needing to detect other task scenes, is based on this, and the embodiment of the present invention provides
A kind of spaceborne in-orbit configuration method of image processing apparatus, it may be possible to realize the in-orbit configuration of spaceborne image processing apparatus, meet
To the detection demand of the different file configurations of different task scene, spaceborne image processing apparatus probe field in the prior art is alleviated
Scape is single, can not in-orbit configuration the problem of.
For convenient for understanding the present embodiment, first to the spaceborne image of one kind disclosed in the embodiment of the present invention at
Reason device describes in detail.
Embodiment one:
The embodiment of the invention provides a kind of spaceborne image processing apparatus, are generally disposed on satellite.
Referring to Fig.1, which includes: processing unit 100 and parallel computation unit;Wherein, parallel
Computing unit includes the first parallel computation unit 200 and the second parallel computation unit 300;
Wherein the first parallel computation unit and the second parallel computation unit are connected with processing unit respectively.
Specifically, processing unit 100 is for completing image data transmitting/receiving, image preprocessing, mission planning and task pipe
Reason etc.;
For carrying out image processing algorithm acceleration processing, described image Processing Algorithm includes first parallel computation unit 200
But it is not limited to object detecting and tracking algorithm, object extraction algorithm;
Second parallel computation unit 300 is used to carry out target identification and target based on image of the deep learning algorithm to input
Detection etc..
Further, which can also include being set to processing unit and the first parallel computation unit
Between configuration unit (not being shown in Fig. 1).
Here configuration unit is implemented for the in-orbit reconstruct to the first parallel computation unit, it should be noted that place
Reason unit also passes through the configuration unit and is connected with the first parallel computation unit.
Make spaceborne image processing apparatus that there is in-orbit recombination function by configuration unit, it can be by multiple and different injections
File is injected into the file storage area for the first data storage device connecting with processing unit, and processing unit passes through different tasks
Scene selects different configuration files to reconfigure the first parallel computation unit, to realize spaceborne image procossing and decision
The diversification of function.
In view of the anti-fuse FPGA not influence vulnerable to high-intensitive cosmic radiation, in order to improve reliability, configuration unit by
The higher anti-fuse FPGA of reliability is realized.
Processing unit passes through the field programmable gate array of system level chip (System on Chip, SoC) type
(Field Programmed Gate Array, FPGA) Lai Shixian, specifically, as shown in Fig. 2, processing unit includes centre
Unit (Central Process Unit, CPU) and FPGA are managed, is cooperateed with inside unit by CPU and FPGA and completes image data
Transmitting-receiving, pretreatment and mission planning and management.Processing unit is externally provided with the data-interface of high speed transmitting-receiving, realizes that data pass
Defeated agreement;Processing unit is externally also provided with observing and controlling interface, for receiving, verifying and parsing the observing and controlling instruction of monitoring platform, ring
The remote-control romote-sensing of monitoring platform is answered to request and export the feedback information etc. of image procossing;Processing unit internally then carries image
The forwarding of data, and carry out mission planning and management starts parallel computation unit, configure the algorithm logic of parallel computation unit with
And algorithm parameter etc., further, it is also possible to monitor the task status of parallel computation unit;It is used in addition, processing unit is also circumscribed with
The data storage of the data such as storage injection file, injection data packet (data frame), processing unit are also circumscribed with for exented memory
With the data buffer storage of injection file, injection data packet (data frame) etc. data, processing unit by connection data buffer storage to avoid
It is duplicate to read storage file from the data connecting with processing unit storage, to improve file reading speed and processing effect
Rate.
Parallel computation unit 1 (the first i.e. above-mentioned parallel computation unit) is for realizing image processing algorithm acceleration, such as mesh
Mark detection and track algorithm, object extraction algorithm etc..Parallel computation unit 1 includes a FPGA, and parallel computation unit 1 and processing are single
Data interaction is realized by some HSSI High-Speed Serial Interface GTx (Gigabit Transceiver x) that FPGA is integrated between member,
The message transmission rate of GTx is up to 58Gbps, meets high speed image transmission demand.
Parallel computation unit 2 (i.e. the second parallel computation unit) is then by graphics processor (Graphics Processing
Unit, abbreviation GPU) it realizes, data friendship is carried out by high-speed interface PCIe between parallel computation unit 2 and data processing unit
Mutually, specifically, high-speed interface PCIe uses 3.0 agreement of PCIe, which can reach the output transmission of 8GT/s
Width, to meet the needs of high speed image transmission;Parallel computation unit 2 is realized and is quickly known then by using deep learning algorithm
The functions such as other target and accurate detection target.Parallel computation unit 2 in Fig. 2 is connected with for exented memory and load depth
The data buffer storage of the model parameter of learning algorithm and for storage depth learning algorithm model parameter data store.
Spaceborne image processing apparatus has the function of in-orbit isomery equipped with configuration unit, can be according to different in-orbit processing
Demand reconfigures parallel computation unit, adapts to different detection missions.In order to make it easy to understand, below with reference to Fig. 2 pairs
The configuration of the different application scene of the device is briefly described: Objective extraction function may be implemented in such as injection file A, injects
Data compression function may be implemented in file B, will inject file A respectively first, in accordance with reconstruct step (hereafter will be described in more detail)
It is injected into No. 1 file area of the data storage of processing unit, injection file B is injected into No. 2 texts of the data storage of processing unit
Part area.Under the task scene of target following, processing unit selects the injection file A of No. 1 file area to the first parallel computation list
Member is configured, spaceborne image processing apparatus performance objective abstraction function;Under the task scene of acquisition data, processing unit is then
The injection file B of No. 2 file areas is selected to configure the first parallel computation unit, spaceborne image processing apparatus is also equipped with data
Compression function descends into ground control station after compressing to image data.
Spaceborne image processing apparatus provided in an embodiment of the present invention can be handled simultaneously by using a variety of parallel computation units
Great amount of images data can alleviate the anxiety of satellite-ground link transfer resource existing for data processing method, image procossing on existing star
The low problem of timeliness, can reduce the burden of satellite-ground link, and can be improved the timeliness of image procossing.In addition, the device
Image data can be handled, Analysis And Evaluation in real time, according to preset target property, analyze imaging circumstances, extract mesh
Mark feature.The device uses a variety of parallel computation units, comes while handling great amount of images data, in real time by the knot of image procossing
Fruit feedback carries out multi-modality imaging to load, aid imaging load is imaged;The device by selection by the effective information of image (such as
Coordinate, size, gray scale of target etc.) under reach ground, reduce the data volume of lower blit picture, so that ground control station is being got
While effective information, satellite-ground link burden is reduced.
Embodiment two:
As shown in figure 3, the embodiment of the invention provides a kind of spaceborne in-orbit configuration method of image processing apparatus, application
In spaceborne image processing apparatus, comprising the following steps:
Step S101, spaceborne image processing apparatus receive ground control station according to the default injection text for sending rule and sending
Part, each injection file are assigned a reference number of a document different from alternative document in advance;
Wherein, preset that send rule as follows: to it is described inject the command frame decomposed of file according to decomposition sequence according to
Secondary transmission;Wherein, described instruction frame is further decomposed by the data frame that the injection file decomposes and is obtained, the data frame
It carries the reference number of a document of the injection file and each data frame is assigned the effective number of a sequential encoding.
Specifically, injection file is decomposed into multiple data frames first according to above-mentioned default transmission rule by ground control station;
Then each data frame is decomposed into some instructions frame;Finally for each data frame, by some instructions frame of decomposition according to point
The sequence of solution is successively sent to the spaceborne image processing apparatus.
Injection file is injected into the default injection file of spaceborne image processing apparatus according to default write-in rule by step S102
Area;
Wherein, injection file and the default injection file area of spaceborne image processing apparatus correspond;It should be noted that pre-
If injection file area can be in the data storage area for the first data storage device being connected with processing unit, it is also possible to the
The data buffer area of one data buffer storage device.
Specifically, step S102 is realized by following steps:
1, spaceborne image processing apparatus receives the command frame that ground control station is sent;Wherein, described instruction frame is by the note
Enter the data frame that file decomposes and further decompose to obtain, the data frame carries the reference number of a document of the injection file and every
One data frame is assigned the effective number of a sequential encoding;
2, spaceborne image processing apparatus carries out assembly to received described instruction frame and obtains the data frame;
3, the check code for extracting the data frame verifies the data frame;
4, correct data frame will be verified, the default injection file area of spaceborne image processing apparatus is written.
After data frame writes, further, this method further includes:
5, the data frame that the default injection file area of the spaceborne image processing apparatus is written is read and is carried out secondary verification,
It is recorded as the secondary correct data frame of verification that successful data frame is written.
For the ease of ground control station understand process, to cope in time, further, this method can also include: by
The effective number that successful data frame is written is sent to the ground control station, so that the ground control station determines failed note
The data frame entered, and decompose again and refill.
For the data frame of one injection file all after the completion of injection, ground control station sends out the file size of the injection file
It send to spaceborne image processing apparatus.
6, judge whether injection file is complete.
Specifically, to be written successfully and inject file the identical data frame of reference number of a document be based on effective number carry out group
It closes, obtains assembled data frame;Judge whether frame length and the file size of the injection file of assembled data frame are equal;If
Be then update and record it is described injection file injection state be it is complete, otherwise, then decomposed again again according to ground control station
Integrality judgement is carried out after injection again.
It should be noted that injection file is imperfect, it is not used to the configuration of algorithm accelerator module.
Step S103, the injection file based on injection are configured according to preset configuration rule.
Specifically, step S103 mainly includes following sub-step:
S1031, the configuration-direct that the ground control station is sent is determined;The configuration-direct carries the injection file
File identification;
Wherein, the file identification includes task scene, injection reference number of a document and the file size for injecting file etc..
Specifically, receiving the instruction that ground control station is sent first, then identify whether the instruction is configuration-direct, if
It is, it is determined that the instruction that ground control station is sent is configuration-direct.
S1032, the injection state that the injection file is obtained according to the configuration-direct;
S1033, judge whether the injection state is complete;
If so, thening follow the steps S1034;If it is not, thening follow the steps S1035.
S1034, starting configuration flow.
Specifically, step S1034 includes:
1) data frame of the injection file is sequential read out according to preset order from the default injection file area;
2) data frame of reading is verified three times, correct data frame output configuration will be verified three times;
3) according to preset configuration timing, preset configuration area successively is written into the data frame for injecting file, until completing configuration.
S1035, Xiang Suoshu ground control station send error message, and the error message is used to indicate configuration failure.
The in-orbit configuration method of spaceborne image processing apparatus provided in an embodiment of the present invention is applied to spaceborne image procossing and fills
It sets, image processing apparatus spaceborne first receives ground control station according to the default injection file for sending rule and sending;Then by institute
It states injection file and is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule;Inject file with it is described
Default injection file area corresponds;Finally the injection file based on injection according to preset configuration rule to spaceborne image at
Reason device is configured.Therefore, multiple injection files can be injected into data and deposited by technical solution provided in an embodiment of the present invention
File area is stored up, selects different configuration files to reconfigure spaceborne image processing apparatus by different task scenes,
Spaceborne image processing apparatus can be reconfigured according to different in-orbit process demands, adapt to different detections and appoint
Business, alleviate spaceborne image processing apparatus detection scene in the prior art it is single, can not in-orbit configuration the problem of.
The embodiment of the present invention also provides another spaceborne in-orbit configuration method of image processing apparatus, is applied to ground observing and controlling
It stands, comprising: send injection file to spaceborne image processing apparatus, so that the spaceborne image procossing dress according to default transmission rule
It sets and the injection file is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule, and based on note
The injection file entered is configured according to preset configuration rule.
Specifically, described send injection file to spaceborne image processing apparatus according to default transmission rule, comprising:
The injection file is decomposed into multiple data frames by A, each injection file is assigned one and other texts in advance
The different reference number of a document of part, the data frame carries the reference number of a document of the injection file and each data frame is assigned one
The effective number of sequential encoding;
Each data frame is decomposed into some instructions frame by B;
C is successively sent to the spaceborne figure according to the sequence of decomposition for each data frame, by some instructions frame of decomposition
As processing unit.
Further, file write phase is being injected, the method also includes:
A receives the effective number that successful data frame is written in the spaceborne image processing apparatus;
B determines the data frame injected not successfully according to the effective number;
C decompose again to the data frame injected not successfully and be refilled;
The data frame of d mono- injection file is all after the completion of injection, and ground control station is by the file size of the injection file
It is sent to spaceborne image processing apparatus, spaceborne image processing apparatus receives the file size of the injection file.
Below with reference to Fig. 4, to the spaceborne in-orbit configuration method of file provided in an embodiment of the present invention to parallel computation unit 1
In-orbit restructuring procedure is described in detail:
In-orbit restructuring procedure is divided into 3 stages:
First stage injects the decomposition of file, is completed by ground control station.
G1: injection frame decomposes: injection file is decomposed into multiple data frames.
Injection file is decomposed into the data frame for meeting certain byte length by ground control station, for the integrality for guaranteeing data
And correctness, the frame head part of each data frame include that injection reference number of a document, the file of injection file belonging to data frame are long
Effective frame number of degree and data frame, contains the CRC16 check code of 2 bytes in the trailer sections of data frame, naturally it is also possible to be
Other check codes, such as MD5 check code.
G2: data frame decomposes: each data frame is decomposed into some instructions frame.
For the safety for meeting satellite-ground link transmission, data frame is decomposed into the command frame of the word lengths such as several, each data
Frame decomposites the command frame come according to the byte sequencing of decomposition labeled as first frame, intermediate frame and tail frame.
G3: command frame is sent: for each data frame, the command frame of decomposition being sent out according to the sequencing of decomposition
It goes.
For each data frame, the command frame of decomposition is sent to star by satellite-ground link according to the sequencing of decomposition
Image processing apparatus is carried, is received by processing unit.
Second stage, file injection, is completed by spaceborne image processing apparatus.
S1: command frame receives: the instruction after the processing unit of spaceborne image processing apparatus receives command frame, to command frame
Coding is identified and is parsed, and is determined as injecting command frame and be received.
S2: command frame is assembled: carrying out assembly to received command frame and obtains data frame;
Based on the received the first frame of sequencing and command frame, intermediate frame and tail frame flag to command frame carry out it is assembled and
Framing forms complete data frame.
S3: data frame check: the check code for extracting the postamble position of data frame verifies data frame.
Identify and record the injection reference number of a document of the frame head part of data frame, the file size of injection file and data frame
Effective frame number is extracted the CRC16 check code of the trailer sections of data frame, is verified to entire data frame, and verification is correct
Data frame be written data buffer area, abandon the data frame of check errors.
S4: correct data frame write-in data storage device will data frame write-in: be verified.
Correct data frame will be verified, according to the injection reference number of a document of record and effective frame number, data storage is written
Respective file area, the data of memory block are written, in addition to inject data frame, also include CRC16 check code.
S5: (i.e. the secondary verification of data frame) is verified after data frame write-in: the data frame of write-in data storage device is carried out
Secondary verification.
The data frame of write-in is read, and one check code (verification after write-in is calculated using checking algorithm to the data frame
Code), the existing check code (check code before write-in) of the check code being calculated and the data frame is compared;It is write if consistent
Enter success, otherwise write-in failure.
Specifically, reading the data frame of write-in, and execute CRC16 verification to the data frame of reading and calculate after data frame writes
Method calculates verification, by the result of calculating and the CRC16 check code of write-in and is compared, and success is written if unanimously, otherwise
Write-in failure.If be written successfully, processing unit needs the effective number of the successful data frame of tracking telemetry and command station return write-in to the ground,
Write-in failure does not have to then return.The effective number for the data frame that ground is returned by statistical disposition unit, it may be determined which data
Frame is successfully injected into configuration unit, by the comparison with injection file, can be divided again the data frame injected not successfully
Solution, refills.
S6: injection File Integrity Checking: for the file size ratio of the data frame length and injection file that are successfully written
To judge whether injection file is complete.
Can determine whether injection file is complete with the data frame length for being successfully written into data storage by comparing file size
Whole, if file size is equal to the data frame length for being successfully written data storage area, then the injection file is complete, updates injection text
The injection state of part is complete;Otherwise the injection file is imperfect, is not used to the configuration of parallel computation unit 1.
Phase III, the configuration of parallel computation unit 1 are completed by spaceborne image processing apparatus.
S7: it is whether complete that file injection file status inspection: is injected according to configuration-direct inspection.
After determining to the configuration-direct of parallel engines 1, according to the injection reference number of a document specified in configuration-direct, system is checked
Whether the state of the specified injection file of record is complete, such as complete, then the processing unit of spaceborne image processing apparatus starts configuration
Process, otherwise configuration failure, returns to the error message of configuration failure to the ground.
S8: injection file data frame reader check (i.e. data frame verifies three times):
Data frame is sequential read out from injection file area according to the incremental order of effective frame number, is carried out during reading
CRC16 verification, and check results are compared with the CRC16 check code of reading, (write-in) is exported if consistent to parallel meter
Unit 1 is calculated, otherwise configuration failure, returns to the error message of configuration failure to the ground.
S9: injection file data frame output configuration:
According to the modularization design of parallel computation unit 1, will successively inject matching for file data frame write-in parallel computation unit 1
Area is set, until completing configuration.
Specifically, step s9 further include: judge whether data frame all exports, if so, configuration successful, if it is not, then
Return step s8.
Specifically, realizing control register, data register and the Status register for configuring operation in configuration unit
Device, according to specified modularization design, (Fig. 5 is the modularization design figure of parallel computation unit 1, and table 1 is the configuration of parallel computation unit 1
Signal), effective controlling value is written by the control register to configuration unit to initiate to configure in processing unit, passes through configuration unit
Data register effective configuration data is written to realize the transmission of configuration data, pass through read status register and obtain configuration
Progress and state.
The function of configuration unit is exactly the reading for realizing processing unit to control register, data register and status register
Write operation is converted to modularization design figure as shown in Figure 5.
For parallel computation unit 1, the modularization design figure of port requirements is configured as shown in figure 5, the following table 1 is parallel computation list
The configuration signal instruction of member 1:
Table 1
Based on processing unit, supplemented by configuration unit, the configuration flow of initiation is as shown in Figure 6:
Firstly, PROG_B signal is set to effectively (1 be invalid, 0 is effective) by processing unit, persistently by PROG_ after 300ns
B signal is set in vain, then continues to monitor the level value of INIT_B signal, if INIT_B is invalid (1 be invalid, 0 is effective)
Afterwards, it is continuously written into configuration data, each configuration data and configurable clock generator rising edge alignment, continuing 1 clock cycle can be by simultaneously
Row computing unit Unit 1 receives.After writing all configuration datas, processing unit persistently detects parallel computation list by configuration unit
Whether the DONE signal of 1 output of member becomes effectively (1 be effective, 0 is invalid), the successful configuration parallel computation list if becoming effective
Member 1.
By in-orbit recombination function, multiple injection files can be injected into the data storage file area of data processing unit,
It selects different configuration files to reconfigure parallel computation unit 1 by different task scenes, realizes spaceborne image
The diversification of processing platform.Such as injection file A realizes Objective extraction function, injection file B realizes data compression function, according to
Configuration file A (the injection file A of configuration) is injected into No. 1 file of processing unit data storage by above-mentioned reconstruct step respectively
Area, configuration file B (the injection file B of configuration) are injected into No. 2 file areas of processing unit data storage.In target following task
Under scene, processing unit selects No. 1 file to configure parallel computation unit 1, and spaceborne image processing apparatus performance objective mentions
Take function;In the case where acquiring data scene, processing unit selects No. 2 files to configure parallel computation unit 1, at spaceborne image
Manage device complete data compression function, to image data carry out compression and under pass.
Unless specifically stated otherwise, the opposite step of the component and step that otherwise illustrate in these embodiments, digital table
It is not limit the scope of the invention up to formula and numerical value.
In all examples being illustrated and described herein, any occurrence should be construed as merely illustratively, without
It is as limitation, therefore, other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.
The flow chart and block diagram in the drawings show the system of multiple embodiments according to the present invention, method and computer journeys
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, section or code of table, a part of the module, section or code include one or more use
The executable instruction of the logic function as defined in realizing.It should also be noted that in some implementations as replacements, being marked in box
The function of note can also occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually base
Originally it is performed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that
It is the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, can uses and execute rule
The dedicated hardware based system of fixed function or movement is realized, or can use the group of specialized hardware and computer instruction
It closes to realize.
The computer program product of the spaceborne in-orbit configuration method of file, including storage are carried out provided by the embodiment of the present invention
The computer readable storage medium of the executable non-volatile program code of processor, the instruction that said program code includes can
For executing previous methods method as described in the examples, specific implementation can be found in embodiment of the method, and details are not described herein.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed systems, devices and methods, it can be with
It realizes by another way.The apparatus embodiments described above are merely exemplary, for example, the division of the unit,
Only a kind of logical function partition, there may be another division manner in actual implementation, in another example, multiple units or components can
To combine or be desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or beg for
The mutual coupling, direct-coupling or communication connection of opinion can be through some communication interfaces, device or unit it is indirect
Coupling or communication connection can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in the executable non-volatile computer-readable storage medium of a processor.Based on this understanding, of the invention
Technical solution substantially the part of the part that contributes to existing technology or the technical solution can be with software in other words
The form of product embodies, which is stored in a storage medium, including some instructions use so that
One computer equipment (can be personal computer, server or the network equipment etc.) executes each embodiment institute of the present invention
State all or part of the steps of method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-
Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. are various can be with
Store the medium of program code.
Finally, it should be noted that embodiment described above, only a specific embodiment of the invention, to illustrate the present invention
Technical solution, rather than its limitations, scope of protection of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, those skilled in the art should understand that: anyone skilled in the art
In the technical scope disclosed by the present invention, it can still modify to technical solution documented by previous embodiment or can be light
It is readily conceivable that variation or equivalent replacement of some of the technical features;And these modifications, variation or replacement, do not make
The essence of corresponding technical solution is detached from the spirit and scope of technical solution of the embodiment of the present invention, should all cover in protection of the invention
Within the scope of.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (10)
1. a kind of in-orbit configuration method of spaceborne image processing apparatus, which is characterized in that it is applied to spaceborne image processing apparatus, including
Following steps:
Spaceborne image processing apparatus receives ground control station according to the default injection file for sending rule and sending, each injection text
Part is assigned a reference number of a document different from alternative document in advance;
The injection file is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule;The note
Enter file and the default injection file area corresponds;
The injection file based on injection configures spaceborne image processing apparatus according to preset configuration rule.
2. the method according to claim 1, wherein the default transmission rule is as follows:
The command frame decomposed to the injection file is successively sent according to the sequence of decomposition;Wherein, described instruction frame is by institute
It states the data frame that decomposes of injection file and further decomposes and obtain.
3. the method according to claim 1, wherein described infuse the injection file according to default write-in rule
Enter to the default injection file area of spaceborne image processing apparatus, comprising:
Spaceborne image processing apparatus receives the command frame that ground control station is sent;Wherein, described instruction frame is by the injection file
The data frame that decomposition obtains, which further decomposes, to be obtained, and the data frame carries the reference number of a document of the injection file and each number
The effective number of a sequential encoding is assigned according to frame;
Spaceborne image processing apparatus carries out assembly to received described instruction frame and obtains the data frame;
The check code for extracting the data frame verifies the data frame;
Correct data frame will be verified, the default injection file area of the spaceborne image processing apparatus is written.
4. according to the method described in claim 3, it is characterized in that, the method also includes:
The data frame that the default injection file area of the spaceborne image processing apparatus is written is read and is carried out secondary verification, it will be secondary
Correct data frame is verified to be recorded as that successful data frame is written.
5. according to the method described in claim 4, it is characterized in that, the method also includes:
The effective number that successful data frame is written is sent to the ground control station, so that the ground control station determines not
The data frame that success is injected, and decompose again and refill.
6. according to the method described in claim 5, it is characterized in that, the method also includes:
The identical data frame of reference number of a document for being written successfully and inject file is combined based on effective number, obtains assembled number
According to frame;
Judge whether frame length and the file size of the injection file of assembled data frame are equal;
If so, it is complete for updating and recording the injection state for injecting file.
7. the method according to claim 1, wherein the injection file based on injection is according to pre- establishing
Rule is set to be configured, comprising:
Determine the configuration-direct that the ground control station is sent;The configuration-direct carries the files-designated of the injection file
Know;
The injection state of the injection file is obtained according to the configuration-direct;
Judge whether the injection state is complete;
If so, starting configuration flow;
If it is not, then sending error message to the ground control station, the error message is used to indicate configuration failure.
8. the method according to the description of claim 7 is characterized in that the starting configuration flow, comprising:
The number of the injection file is sequential read out according to preset order from the default injection file area of the spaceborne image processing apparatus
According to frame;
The data frame of reading is verified three times;
Correct data frame output configuration will be verified three times;
According to preset configuration timing, preset configuration area successively is written into the data frame for injecting file, until completing configuration.
9. a kind of in-orbit configuration method of spaceborne image processing apparatus, which is characterized in that be applied to ground control station, comprising:
Injection file is sent to spaceborne image processing apparatus, so that the spaceborne image processing apparatus will according to default transmission rule
The injection file is injected into the default injection file area of spaceborne image processing apparatus according to default write-in rule, and based on injection
The injection file configures spaceborne image processing apparatus according to preset configuration rule.
10. according to the method described in claim 9, it is characterized in that, described send injection file extremely according to default transmission rule
Spaceborne image processing apparatus, comprising:
The injection file is decomposed into multiple data frames;
Each data frame is decomposed into some instructions frame;
For each data frame, some instructions frame of decomposition is successively sent to the spaceborne image procossing according to the sequence of decomposition
Device.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201811654222X | 2018-12-29 | ||
CN201811654222 | 2018-12-29 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110297926A true CN110297926A (en) | 2019-10-01 |
CN110297926B CN110297926B (en) | 2022-06-07 |
Family
ID=68029834
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910586872.3A Active CN110297926B (en) | 2018-12-29 | 2019-07-01 | On-orbit configuration method of satellite-borne image processing device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110297926B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113190510A (en) * | 2021-03-26 | 2021-07-30 | 中国科学院软件研究所 | Method, device and system for large-scale neural network upward injection for software defined satellite |
WO2023019507A1 (en) * | 2021-08-19 | 2023-02-23 | 浙江吉利控股集团有限公司 | Road image generation method and apparatus based on deep learning, and device and storage medium |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101788927A (en) * | 2010-01-20 | 2010-07-28 | 哈尔滨工业大学 | Self-adaption on-board computer based on FPGA and method thereby for realizing dynamic allocation of internal resource |
CN102779079A (en) * | 2011-05-12 | 2012-11-14 | 中国科学院空间科学与应用研究中心 | Configuration method and system used for satellite-bone SRAM (Static Random Access Memory) type FPGA (Field Programmable Gate Array) working on track for long time |
CN103955411A (en) * | 2014-05-21 | 2014-07-30 | 北京空间机电研究所 | On-orbit transmitting and configuring method for spaceborne high-capacity FPGA (Field Programmable Gate Array) program |
CN104202182A (en) * | 2014-08-20 | 2014-12-10 | 西安空间无线电技术研究所 | Satellite system reconstruction method on orbit based on information hiding |
CN104239090A (en) * | 2014-07-15 | 2014-12-24 | 上海微小卫星工程中心 | FPGA (Field Programmable Gate Array)-based on-orbit reconfiguration system and method for satellite on-board computer |
CN105099540A (en) * | 2015-08-21 | 2015-11-25 | 西安空间无线电技术研究所 | Method for reconstructing in-orbit function of satellite processing type loads |
CN106851084A (en) * | 2016-11-21 | 2017-06-13 | 北京空间机电研究所 | Noted on real-time processing algorithm on a kind of remote sensing camera star and update platform |
CN107168732A (en) * | 2017-04-17 | 2017-09-15 | 商丘工学院 | A kind of in-orbit update method of spaceborne computer software |
CN107566028A (en) * | 2017-07-07 | 2018-01-09 | 南京航空航天大学 | A kind of in-orbit file updating method of satellite based on VxWorks |
CN108052355A (en) * | 2017-11-22 | 2018-05-18 | 西南电子技术研究所(中国电子科技集团公司第十研究所) | The spaceborne in-orbit recombination method of load cell software |
US20180309508A1 (en) * | 2017-04-21 | 2018-10-25 | U.S.A. as represented by the Administrator of NASA | Providing Continuous Two-Way High-Speed Data Transfer for Leo Based Satellites |
-
2019
- 2019-07-01 CN CN201910586872.3A patent/CN110297926B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101788927A (en) * | 2010-01-20 | 2010-07-28 | 哈尔滨工业大学 | Self-adaption on-board computer based on FPGA and method thereby for realizing dynamic allocation of internal resource |
CN102779079A (en) * | 2011-05-12 | 2012-11-14 | 中国科学院空间科学与应用研究中心 | Configuration method and system used for satellite-bone SRAM (Static Random Access Memory) type FPGA (Field Programmable Gate Array) working on track for long time |
CN103955411A (en) * | 2014-05-21 | 2014-07-30 | 北京空间机电研究所 | On-orbit transmitting and configuring method for spaceborne high-capacity FPGA (Field Programmable Gate Array) program |
CN104239090A (en) * | 2014-07-15 | 2014-12-24 | 上海微小卫星工程中心 | FPGA (Field Programmable Gate Array)-based on-orbit reconfiguration system and method for satellite on-board computer |
CN104202182A (en) * | 2014-08-20 | 2014-12-10 | 西安空间无线电技术研究所 | Satellite system reconstruction method on orbit based on information hiding |
CN105099540A (en) * | 2015-08-21 | 2015-11-25 | 西安空间无线电技术研究所 | Method for reconstructing in-orbit function of satellite processing type loads |
CN106851084A (en) * | 2016-11-21 | 2017-06-13 | 北京空间机电研究所 | Noted on real-time processing algorithm on a kind of remote sensing camera star and update platform |
CN107168732A (en) * | 2017-04-17 | 2017-09-15 | 商丘工学院 | A kind of in-orbit update method of spaceborne computer software |
US20180309508A1 (en) * | 2017-04-21 | 2018-10-25 | U.S.A. as represented by the Administrator of NASA | Providing Continuous Two-Way High-Speed Data Transfer for Leo Based Satellites |
CN107566028A (en) * | 2017-07-07 | 2018-01-09 | 南京航空航天大学 | A kind of in-orbit file updating method of satellite based on VxWorks |
CN108052355A (en) * | 2017-11-22 | 2018-05-18 | 西南电子技术研究所(中国电子科技集团公司第十研究所) | The spaceborne in-orbit recombination method of load cell software |
Non-Patent Citations (4)
Title |
---|
YONGQING WANG等: "Repeated sending file delivery protocol in satellite networking communication", 《 JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS ( VOLUME: 23, ISSUE: 6, DEC. 2012)》 * |
YONGQING WANG等: "Repeated sending file delivery protocol in satellite networking communication", 《 JOURNAL OF SYSTEMS ENGINEERING AND ELECTRONICS ( VOLUME: 23, ISSUE: 6, DEC. 2012)》, 31 December 2012 (2012-12-31), pages 815 - 823 * |
韦涌泉等: "一种基于文件的嵌入式星载软件在轨升级方法", 《单片机与嵌入式***应用》 * |
韦涌泉等: "一种基于文件的嵌入式星载软件在轨升级方法", 《单片机与嵌入式***应用》, 31 May 2018 (2018-05-31), pages 32 - 35 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113190510A (en) * | 2021-03-26 | 2021-07-30 | 中国科学院软件研究所 | Method, device and system for large-scale neural network upward injection for software defined satellite |
CN113190510B (en) * | 2021-03-26 | 2023-05-30 | 中国科学院软件研究所 | Method, device and system for uploading large-scale neural network oriented to software defined satellite |
WO2023019507A1 (en) * | 2021-08-19 | 2023-02-23 | 浙江吉利控股集团有限公司 | Road image generation method and apparatus based on deep learning, and device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN110297926B (en) | 2022-06-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109598517B (en) | Commodity clearance processing, object processing and category prediction method and device thereof | |
CN110134845A (en) | Project public sentiment monitoring method, device, computer equipment and storage medium | |
US8838559B1 (en) | Data mining through property checks based upon string pattern determinations | |
CN110297926A (en) | The spaceborne in-orbit configuration method of image processing apparatus | |
CN109902471A (en) | Detection method, device, computer equipment and the storage medium of sliding block verifying | |
CN114612921B (en) | Form recognition method and device, electronic equipment and computer readable medium | |
CN111737974A (en) | Semantic abstract representation method and device for statement | |
CN105975269A (en) | Process model-based demand verification method | |
CN110222323A (en) | A kind of voucher generation method, device, readable storage medium storing program for executing and terminal device | |
CN107451058A (en) | A kind of software development methodology and device | |
CN103220685A (en) | Sensor network software model test method based on dynamic programming | |
CN116245097A (en) | Method for training entity recognition model, entity recognition method and corresponding device | |
CN112035345A (en) | Mixed depth defect prediction method based on code segment analysis | |
CN103164907B (en) | Bill resolver and taxation control system | |
CN109032850A (en) | Field device debugging system and field device adjustment method | |
CN109634569A (en) | Process implementation method, device, equipment and readable storage medium storing program for executing based on note | |
CN110175022A (en) | Automatically generate the method, apparatus and storage medium, computer equipment of POJO class | |
CN110472063A (en) | Social media data processing method, model training method and relevant apparatus | |
Gyapay et al. | Joint optimization and reachability analysis in graph transformation systems with time | |
CN106155881A (en) | Applied program testing method and system for VxWorks platform | |
CN112597764B (en) | Text classification method and device, storage medium and electronic device | |
Schluter | Restarting automata with auxiliary symbols restricted by lookahead size | |
CN109542665A (en) | Power loss recovery method, method for writing data and device | |
CN103106556A (en) | Model automatic combination method and model automatic combination system based on artificial intelligent planning | |
CN104572595A (en) | Word stock check device and word stock check method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |