CN110990086A - Coprocessor calling method and system for image target detection - Google Patents
Coprocessor calling method and system for image target detection Download PDFInfo
- Publication number
- CN110990086A CN110990086A CN201911173233.0A CN201911173233A CN110990086A CN 110990086 A CN110990086 A CN 110990086A CN 201911173233 A CN201911173233 A CN 201911173233A CN 110990086 A CN110990086 A CN 110990086A
- Authority
- CN
- China
- Prior art keywords
- command packet
- functional
- main command
- coprocessor
- current
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Advance Control (AREA)
Abstract
The invention discloses a coprocessor calling method and a system for image target detection, belonging to the field of image target detection, wherein the method comprises the following steps: the user side calls different function IP modules in the coprocessor by adopting a main command packet with a preset format to carry out image preprocessing; the master command packet includes: the main command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling the functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; data source and data destination, which represent the source of image data required by the functional IP module called by the current IP number and the receiving object of the processing result; and the parameter data is used for configuring parameters of the functional IP module called by the current IP number. The command packet format provided by the invention has the advantages of simplicity, effectiveness for the user side and the coprocessor and convenience for the parallel work of a plurality of functional IP modules in the coprocessor.
Description
Technical Field
The invention belongs to the field of image target detection, and particularly relates to a coprocessor calling method and a coprocessor calling system for image target detection.
Background
In the field of image target detection, along with the improvement of image resolution, the calculated amount is increased, meanwhile, each field has higher requirements on the real-time performance of image target detection, the huge calculated amount and the requirements on the calculation speed make the image target detection technology difficult to realize by a software method, and currently, a hardware acceleration method is mostly adopted to improve the calculation speed, so that accurate image target detection is completed under the condition of meeting the real-time performance requirement.
In the current hardware acceleration system for image target detection, it is a common method to accelerate image processing by using the feature that hardware circuits can perform parallel operation. Generally, a user terminal (DSP/CPU) inputs image data into a hardware acceleration circuit for image preprocessing, and the hardware acceleration circuit outputs a processing result to the user terminal for further processing. Currently, a coprocessor integrated with a plurality of functional IP modules with image preprocessing has appeared, each functional IP module is a hardware acceleration circuit capable of implementing a specific image processing flow (grayscale morphological filtering, histogram statistics, connected domain labeling, and eigenvalue statistics, etc.), and a user side calls different functional IP modules of the coprocessor to implement acceleration of different image processing flows. Therefore, the user side can flexibly call different functional IP modules in the coprocessor to accelerate different algorithm flows, the flexibility and the universality of the hardware acceleration architecture are greatly improved, meanwhile, the user side can call the functional IP modules in an idle state to work, the parallel work among the functional IP modules is realized, and the working speed of the hardware acceleration architecture is improved.
However, the coprocessor, which integrates a plurality of functional IP blocks and each of which can be flexibly called, has the following problems: when the user side calls the work, a standard and effective calling method is not formed; when a user side calls a plurality of functional IP modules to work in parallel to improve the efficiency of hardware acceleration, the correlation problem among the functional IP modules needs to be considered, namely the called functional IP module needs to wait for the operation results of other working functional IP modules; the IP module of the coordination function needs a plurality of groups of data sources to transmit data.
Disclosure of Invention
In view of the above defects or improvement needs in the prior art, the present invention provides a coprocessor invoking method and system for image target detection, which aims to provide a normative and effective invoking method for a coprocessor integrated with a plurality of functional IP modules and flexibly invoked by each functional IP module, so as to implement parallel work of the plurality of functional IP modules.
To achieve the above object, according to an aspect of the present invention, there is provided a coprocessor call method for image object detection, including:
the user side calls different function IP modules in the coprocessor by adopting a main command packet with a preset format to carry out image preprocessing;
the master command packet includes; a main command number, a current IP number, a preorder IP number, a data source, a data destination and parameter data;
the main command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling the functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; the data source represents the source of image data required by the functional IP module called by the current IP number; data go, which represents the receiving object of the function IP module processing result called by the current IP number; and the parameter data is used for configuring parameters of the functional IP module called by the current IP number.
Further, the master command packet further includes: a main command packet header, an address format, image data and a main command packet tail;
the header of the main command packet is the initial mark of the main command packet; the address format is used for appointing the address format for accessing the memory data block when the source of the image data required by the functional IP module called by the current IP number or the receiving object of the processing result is the memory data block; the image data is used for transmitting a group of image data required by the work of the functional IP module called by the main command packet; the tail of the main command packet is an end mark of the main command packet; the main command packet head and the main command packet tail are jointly used for ensuring the synchronization of the main command packet between the user terminal and the coprocessor.
Furthermore, when the functional IP module called by the main command packet needs a plurality of groups of image data, the user side also needs to send a plurality of auxiliary command packets to the coprocessor; each secondary command packet includes: the auxiliary command packet head, the auxiliary command number, the IP number, the image data and the auxiliary command packet tail;
the auxiliary command number and the IP number are correspondingly the same as the main command number and the current IP number in the main command packet;
and image data for providing other single-group image data required for the operation thereof to the function IP module called by the main command packet.
Furthermore, the coprocessor comprises a plurality of functional IP modules, and each functional IP module works according to the call command of the user side.
According to another aspect of the present invention, there is provided a coprocessor call system for image object detection, comprising:
the main command packet transmission module is used for sending the main command packet with the set format provided by the user side to the coprocessor so as to call different functional IP modules in the coprocessor to carry out image preprocessing;
the master command packet includes; a main command number, a current IP number, a preorder IP number, a data source, a data destination and parameter data;
the main command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling the functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; the data source represents the source of image data required by the functional IP module called by the current IP number; data go, which represents the receiving object of the function IP module processing result called by the current IP number; and the parameter data is used for configuring parameters of the functional IP module called by the current IP number.
Further, the master command packet further includes: a main command packet header, an address format, image data and a main command packet tail;
the header of the main command packet is the initial mark of the main command packet; the address format is used for appointing the address format for accessing the memory data block when the source of the image data required by the functional IP module called by the current IP number or the receiving object of the processing result is the memory data block; the image data is used for transmitting a group of image data required by the work of the functional IP module called by the main command packet; the tail of the main command packet is an end mark of the main command packet; the main command packet head and the main command packet tail are jointly used for ensuring the synchronization of the main command packet between the user terminal and the coprocessor.
Furthermore, when the function IP module called by the main command packet needs a plurality of groups of image data, the system also comprises a plurality of auxiliary command packet transmission modules; each auxiliary command packet transmission module is used for sending an auxiliary command packet with a set format provided by a user side to the coprocessor so as to provide other single-group image data required by the work of the functional IP module called by the main command packet;
the sub command packet includes: the auxiliary command packet head, the auxiliary command number, the IP number, the image data and the auxiliary command packet tail;
the sub command number and the IP number are the same as the main command number and the current IP number in the main command packet.
Furthermore, the coprocessor comprises a plurality of functional IP modules, and each functional IP module works according to the call command of the user side
In general, compared with the prior art, the above technical solution contemplated by the present invention can achieve the following beneficial effects:
(1) according to the invention, the preorder IP number is added in the main command packet, when the user side continuously calls a plurality of functional IP modules, the functional IP module corresponding to the current IP number can be called to work only after the functional IP module corresponding to the preorder IP number works, so that the problem of the relevance of each functional IP module is solved, and the parallel work of a plurality of functional IP modules in the coprocessor is realized.
(2) The command packet format provided by the invention is standard and simple, and is convenient for the user terminal to simply and efficiently call different function IP modules in the coprocessor.
(3) The invention simplifies the calling mode of the function IP module which needs a plurality of image data sources through the form of the auxiliary command packet.
(4) In the command packet format of the invention, the main command packet is provided with a packet head and a packet tail, thereby ensuring the command synchronization of the user terminal and the coprocessor; the auxiliary command packet sets the same command number and current IP number corresponding to the main command packet, and the synchronization of the auxiliary command packet and the main command packet is ensured.
Drawings
Fig. 1 is a main command packet format applied to a coprocessor having multiple functional IP modules according to an embodiment of the present invention.
Fig. 2 is a diagram illustrating a format of a sub command packet applied to a coprocessor according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
The embodiment of the invention provides a coprocessor calling method for image target detection, which comprises the following steps: the user side calls different function IP modules in the coprocessor by adopting a main command packet with a preset format to carry out image preprocessing; as shown in FIG. 1, the master command packet includes; the system comprises a packet header, a command number, a current IP number, a preorder IP number, a data source, a data destination, an address format, parameter data, image data and a packet tail; the packet head is the initial mark of the main command packet; the command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling the functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; if the preorder IP number is the control part of the extensible coprocessor, the current IP can start working immediately; the data source represents the source of image data required by the functional IP module called by the current IP number; data go, which represents the receiving object of the function IP module processing result called by the current IP number; the address format is used for appointing the address format for accessing the memory data block when the source of the image data required by the functional IP module called by the current IP number or the receiving object of the processing result is the memory data block; if the data source and data destination are not memory, the set of data is invalid; parameter data, which is used for configuring parameters of the functional IP module called by the current IP number; the image data is used for transmitting the image data required by the work of the functional IP module called by the main command packet; the packet tail is an end mark of the main command packet; the packet head and the packet tail are respectively composed of two specific data and are used for ensuring the synchronization of the main command packet between the user end and the coprocessor.
When the functional IP module called by the main command packet needs a plurality of groups of image data, the user side also needs to send a plurality of auxiliary command packets to the coprocessor; as shown in fig. 2, each sub command packet includes: a packet header, a command number, a current IP number, image data and a packet tail; the command number and the current IP number are correspondingly the same as the command number and the current IP number in the main command packet; and the image data is used for providing other single image data required by the work of the functional IP module called by the main command packet.
The coprocessor aimed at by the method of the invention comprises a plurality of functional IP modules, and each functional IP module can be flexibly called by the command of a user side.
Another aspect of the embodiments of the present invention further provides a coprocessor invoking system for image target detection, including: the main command packet transmission module is used for sending the main command packet with the set format provided by the user side to the coprocessor so as to call different functional IP modules in the coprocessor to carry out image preprocessing; the master command packet includes; the system comprises a packet header, a command number, a current IP number, a preorder IP number, a data source, a data destination, an address format, parameter data, image data and a packet tail; the packet head is the initial mark of the main command packet; the command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling the functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; if the preorder IP number is the control part of the extensible coprocessor, the current IP can start working immediately; the data source represents the source of image data required by the functional IP module called by the current IP number; data go, which represents the receiving object of the function IP module processing result called by the current IP number; the address format is used for appointing the address format for accessing the memory data block when the source of the image data required by the functional IP module called by the current IP number or the receiving object of the processing result is the memory data block; if the data source and data destination are not memory, the set of data is invalid; parameter data, which is used for configuring parameters of the functional IP module called by the current IP number; the image data is used for transmitting the image data required by the work of the functional IP module called by the main command packet; the packet tail is an end mark of the main command packet; the packet head and the packet tail are respectively composed of two specific data and are used for ensuring the synchronization of the main command packet between the user end and the coprocessor.
When the function IP module called by the main command packet needs a plurality of groups of image data, the system also comprises a plurality of auxiliary command packet transmission modules; each auxiliary command packet transmission module is used for sending an auxiliary command packet with a set format provided by a user side to the coprocessor so as to provide other single image data required by the work of the functional IP module called by the main command packet; the sub command packet includes: a packet header, a command number, a current IP number, image data and a packet tail; the command number and the current IP number are correspondingly the same as those in the main command packet.
It will be understood by those skilled in the art that the foregoing is only a preferred embodiment of the present invention, and is not intended to limit the invention, and that any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the scope of the present invention.
Claims (8)
1. A coprocessor call method for image object detection, comprising:
the user side calls different function IP modules in the coprocessor by adopting a main command packet with a preset format to carry out image preprocessing;
the master command packet includes; a main command number, a current IP number, a preorder IP number, a data source, a data destination and parameter data;
the main command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling a functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; the data source represents the source of image data required by the functional IP module called by the current IP number; the data destination represents a receiving object of a processing result of the functional IP module called by the current IP number; and the parameter data is used for configuring parameters of the functional IP module called by the current IP number.
2. The coprocessor call method for image target detection according to claim 1, wherein the main command packet further includes: a main command packet header, an address format, image data and a main command packet tail;
the head of the main command packet is the initial mark of the main command packet; the address format is used for appointing the address format for accessing the memory data block when the source of the image data required by the functional IP module called by the current IP number or the receiving object of the processing result is the memory data block; the image data is used for transmitting a group of image data required by the work of the functional IP module called by the main command packet; the tail of the main command packet is an end mark of the main command packet; the main command packet head and the main command packet tail are jointly used for ensuring the synchronization of the main command packet between the user terminal and the coprocessor.
3. The coprocessor call method for image target detection according to claim 1 or 2, characterized in that when the functional IP module called by the main command packet needs multiple sets of image data, the user side needs to send multiple auxiliary command packets to the coprocessor; each secondary command packet includes: the auxiliary command packet head, the auxiliary command number, the IP number, the image data and the auxiliary command packet tail;
the auxiliary command number and the IP number are correspondingly the same as the main command number and the current IP number in the main command packet;
and the image data is used for providing other single-group image data required by the work of the functional IP module called by the main command packet.
4. The coprocessor calling method for image target detection according to any one of claims 1 to 3, wherein the coprocessor comprises a plurality of functional IP modules, and each functional IP module operates according to a calling command of a user terminal.
5. A coprocessor call system for image object detection, comprising:
the main command packet transmission module is used for sending a main command packet with a set format provided by a user side to the coprocessor so as to call different functional IP modules in the coprocessor to carry out image preprocessing;
the master command packet includes; a main command number, a current IP number, a preorder IP number, a data source, a data destination and parameter data;
the main command number is used for numbering the main command packet; the current IP number is used for specifying a functional IP module called by the main command packet; the preorder IP number is used for calling a functional IP module corresponding to the current IP number after the functional IP module corresponding to the preorder IP number finishes working; the data source represents the source of image data required by the functional IP module called by the current IP number; the data destination represents a receiving object of a processing result of the functional IP module called by the current IP number; and the parameter data is used for configuring parameters of the functional IP module called by the current IP number.
6. The coprocessor call system for image target detection according to claim 5, wherein the master command packet further includes: a main command packet header, an address format, image data and a main command packet tail;
the head of the main command packet is the initial mark of the main command packet; the address format is used for appointing the address format for accessing the memory data block when the source of the image data required by the functional IP module called by the current IP number or the receiving object of the processing result is the memory data block; the image data is used for transmitting a group of image data required by the work of the functional IP module called by the main command packet; the tail of the main command packet is an end mark of the main command packet; the main command packet head and the main command packet tail are jointly used for ensuring the synchronization of the main command packet between the user terminal and the coprocessor.
7. The coprocessor call system for image target detection according to claim 5 or 6, characterized in that when the function IP module called by the main command packet requires multiple sets of image data, the system further comprises a plurality of auxiliary command packet transmission modules; each auxiliary command packet transmission module is used for sending an auxiliary command packet with a set format provided by a user side to the coprocessor so as to provide other single-group image data required by the work of the functional IP module called by the main command packet;
the sub command packet includes: the auxiliary command packet head, the auxiliary command number, the IP number, the image data and the auxiliary command packet tail;
the auxiliary command number and the IP number are the same as the main command number and the current IP number in the main command packet.
8. The coprocessor call system for image target detection according to any one of claims 5 to 7, wherein the coprocessor includes a plurality of functional IP modules, and each functional IP module operates according to a call command of a user terminal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911173233.0A CN110990086B (en) | 2019-11-26 | 2019-11-26 | Coprocessor calling method and system for image target detection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911173233.0A CN110990086B (en) | 2019-11-26 | 2019-11-26 | Coprocessor calling method and system for image target detection |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110990086A true CN110990086A (en) | 2020-04-10 |
| CN110990086B CN110990086B (en) | 2021-07-02 |
Family
ID=70087056
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911173233.0A Active CN110990086B (en) | 2019-11-26 | 2019-11-26 | Coprocessor calling method and system for image target detection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110990086B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040225885A1 (en) * | 2003-05-05 | 2004-11-11 | Sun Microsystems, Inc | Methods and systems for efficiently integrating a cryptographic co-processor |
| CN101609544A (en) * | 2009-07-21 | 2009-12-23 | 华中科技大学 | A kind of image processor data load and method of testing and device |
| CN101650645A (en) * | 2009-09-04 | 2010-02-17 | 浙江大学 | Device for expanding coprocessor command set |
| CN101719115A (en) * | 2009-11-04 | 2010-06-02 | 北京中星微电子有限公司 | Communication method, device and system for main control processor and coprocessor system |
| DE202012009380U1 (en) * | 2011-09-30 | 2013-02-26 | Intel Corporation | Command and logic for performing a dynamic binary translation |
| CN105243309A (en) * | 2015-10-08 | 2016-01-13 | 宁波大学 | Industrial drawing encryption system based on image of intelligent mobile terminal and encryption method of system |
-
2019
- 2019-11-26 CN CN201911173233.0A patent/CN110990086B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040225885A1 (en) * | 2003-05-05 | 2004-11-11 | Sun Microsystems, Inc | Methods and systems for efficiently integrating a cryptographic co-processor |
| CN101609544A (en) * | 2009-07-21 | 2009-12-23 | 华中科技大学 | A kind of image processor data load and method of testing and device |
| CN101650645A (en) * | 2009-09-04 | 2010-02-17 | 浙江大学 | Device for expanding coprocessor command set |
| CN101719115A (en) * | 2009-11-04 | 2010-06-02 | 北京中星微电子有限公司 | Communication method, device and system for main control processor and coprocessor system |
| DE202012009380U1 (en) * | 2011-09-30 | 2013-02-26 | Intel Corporation | Command and logic for performing a dynamic binary translation |
| CN105243309A (en) * | 2015-10-08 | 2016-01-13 | 宁波大学 | Industrial drawing encryption system based on image of intelligent mobile terminal and encryption method of system |
Non-Patent Citations (2)
| Title |
|---|
| SCHOLZ, M等: "Development of an Endoscopic Navigation System Based on Digital Image Processing", 《COMPUTER AIDED SURGERY》 * |
| 邓凌煊等: "一种CORDIC协处理器核的设计与实现", 《电子设计工程》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110990086B (en) | 2021-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106375175B (en) | Method and system for flashing electronic control unit for automobile diagnosis | |
| CN108270676B (en) | Network data processing method and device based on Intel DPDK | |
| US10432506B2 (en) | Data processing method and apparatus | |
| CN110995598B (en) | Variable-length message data processing method and scheduling device | |
| CN104580550A (en) | Method and equipment for NAT (network address translation) processing during distribution of multiple service boards in distributed system | |
| CN111416865A (en) | Protocol proxy processing method and system based on mimicry defense | |
| CN106686021B (en) | Service calling method and gateway | |
| EP3633934A1 (en) | Sdn-based arp implementation method and apparatus | |
| CN114567481B (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN111865978B (en) | Method, device, equipment and medium for updating request identifier of micro-service | |
| CN110958189A (en) | Multi-core FPGA network processor | |
| CN112437028A (en) | Method and system for expanding multiple network ports of embedded system | |
| CN110990086B (en) | Coprocessor calling method and system for image target detection | |
| CN112769716B (en) | Data forwarding method and device of virtual switch based on hybrid virtual network bridge | |
| US11012542B2 (en) | Data processing method and apparatus | |
| CN106790162B (en) | Virtual network optimization method and system | |
| CN109617821B (en) | Transmission method, main control board and equipment of multicast message | |
| CN101141417A (en) | Inter-task message communicating method in equipment | |
| CN101471858A (en) | Build-in cooperative method of business identification and control system | |
| CN114513383B (en) | Real-time Ethernet field bus data packet processing method based on original socket | |
| CN114362872A (en) | Multi-network cooperative edge intelligent device based on TSN (transmission time network) | |
| Chiu et al. | Boosting the OpenFlow control-plane message exchange performance of OpenvSwitch | |
| CN110532110A (en) | A kind of UART master control system for automatically switching to send data outside in multicore scene | |
| CN114513381B (en) | AF_XDP-based real-time Ethernet field bus data packet processing method | |
| CN109347678B (en) | Method and device for determining routing loop |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |