CN114786041A - Visual signal processing method and device based on integrated chip and electronic equipment - Google Patents
Visual signal processing method and device based on integrated chip and electronic equipment Download PDFInfo
- Publication number
- CN114786041A CN114786041A CN202210215262.4A CN202210215262A CN114786041A CN 114786041 A CN114786041 A CN 114786041A CN 202210215262 A CN202210215262 A CN 202210215262A CN 114786041 A CN114786041 A CN 114786041A
- Authority
- CN
- China
- Prior art keywords
- visual signal
- visual
- signal
- signal processing
- processing module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 265
- 238000003672 processing method Methods 0.000 title claims abstract description 21
- 238000012545 processing Methods 0.000 claims abstract description 161
- 238000000034 method Methods 0.000 claims abstract description 35
- 230000006835 compression Effects 0.000 claims description 21
- 238000007906 compression Methods 0.000 claims description 21
- 230000015654 memory Effects 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 abstract description 22
- 238000005516 engineering process Methods 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 8
- 238000000605 extraction Methods 0.000 description 6
- 238000004458 analytical method Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000002427 irreversible effect Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000005336 cracking Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2347—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving video stream encryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4408—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream encryption, e.g. re-encrypting a decrypted video stream for redistribution in a home network
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The application discloses a visual signal processing method and device based on an integrated chip and electronic equipment. Wherein, the method comprises the following steps: receiving an initial visual signal based on a visual sensor on the integrated chip; processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level than the visual sensor; outputting the target characteristic signal based on an output module on the integrated chip. The method and the device solve the technical problem that the data security of the visual signals in the transmission process is low in the related technology.
Description
Technical Field
The present disclosure relates to the field of power technologies, and in particular, to a method and an apparatus for processing a visual signal based on an integrated chip, and an electronic device.
Background
In various application scenarios, the intelligent home system often directly uses the original visual signal data to perform intelligent analysis at different processing stages of the visual signal data. Once the user sensitive privacy data in the original visual signal is leaked at a certain stage, the privacy safety hidden trouble problem can be caused. In a related art, a data storage module is usually disposed between acquisition and processing of a visual signal processing chip, which is prone to data leakage, thereby resulting in low data security of a visual signal in a transmission process.
Disclosure of Invention
The embodiment of the application provides a visual signal processing method and device based on an integrated chip and electronic equipment, and aims to at least solve the technical problem that data security of a visual signal in a transmission process is low in the related technology.
According to an aspect of an embodiment of the present application, there is provided an integrated chip based visual signal processing method, including: acquiring an initial visual signal based on a visual sensor on the integrated chip; processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor; and outputting the target characteristic signal based on an output module on the integrated chip.
According to another aspect of the embodiments of the present application, there is also provided an integrated chip-based visual signal processing apparatus, including: the receiving unit is used for acquiring an initial visual signal based on the visual sensor on the integrated chip; the processing unit is used for processing the initial visual signal according to a preset processing rule through the visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor; and the output unit is used for outputting the target characteristic signal based on the output module on the integrated chip.
According to yet another aspect of the embodiments of the present application, there is also provided a computer-readable storage medium having a computer program stored therein, wherein the computer program is configured to execute the above-mentioned integrated chip-based visual signal processing method when running.
According to another aspect of the embodiments of the present application, there is also provided an electronic device, including a memory and a processor, where the memory stores a computer program, and the processor is configured to execute the above-mentioned integrated chip-based visual signal processing method through the computer program.
In the embodiment of the application, an initial visual signal is acquired through a visual sensor based on the integrated chip; processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor; and outputting the target characteristic signal based on an output module on the integrated chip. Because the acquisition and processing of the visual signal are processed by the adjacent module positioned on the integrated chip, and the adjacent module has no intermediate passage, the processing time of the visual signal is shortened, a storage area is not required to be arranged to store the visual signal, and the technical problem of lower data security of the visual signal in the transmission process in the related technology is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic diagram of an application environment of an alternative integrated chip based visual signal processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of an application environment of an alternative integrated chip based visual signal processing method according to an embodiment of the present invention;
FIG. 3 is a flow diagram illustrating an alternative method for integrated chip based visual signal processing according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a visual signal processing system according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of an alternative integrated chip-based visual signal processing apparatus according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of another alternative visual signal processing apparatus based on an integrated chip according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an alternative integrated chip based visual signal processing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an alternative electronic device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the accompanying drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
According to an aspect of the embodiments of the present invention, an integrated chip based visual signal processing method is provided, and optionally, as an optional implementation manner, the integrated chip based visual signal processing method may be applied, but is not limited to, in a hardware environment as shown in fig. 1. The hardware environment comprises: the terminal equipment 102, the network 104 and the server 106 are in man-machine interaction with a user. The user 108 and the terminal device 102 can perform human-computer interaction, and a visual signal processing application client based on an integrated chip runs in the terminal device 102. The terminal device 102 includes a human-machine interaction screen 1022, a processor 1024, and a memory 1026. The man-machine interaction screen 1022 is an interface for presenting a target feature signal; the processor 1024 is configured to receive an initial visual signal based on the visual sensor on the integrated chip; processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor; and outputting the target characteristic signal based on an output module on the integrated chip. The memory 1026 is used for storing the target characteristic signal.
In addition, the server 106 includes a database 1062 and a processing engine 1064, and the database 1062 is used for storing the target feature signal.
As another alternative, the integrated chip based visual signal processing method described above in this application can be applied to fig. 2. As shown in fig. 2, a human-computer interaction may be performed between a user 202 and a user device 204. The user device 204 includes a memory 206 and a processor 208. The user equipment 204 in this embodiment may refer to, but is not limited to, performing the operation performed by the terminal equipment 102 to obtain the target characteristic signal.
Alternatively, the terminal device 102 and the user device 204 may be, but not limited to, a smart camera, a monitoring device, a mobile phone, a tablet computer, a notebook computer, or the like, and the network 104 may include, but is not limited to, a wireless network or a wired network. Wherein, this wireless network includes: WIFI and other networks that enable wireless communication. Such wired networks may include, but are not limited to: wide area networks, metropolitan area networks, local area networks. The server 106 may include, but is not limited to, any hardware device capable of performing calculations. The server may be a single server, a server cluster composed of a plurality of servers, or a cloud server. The above is merely an example, and this is not limited in this embodiment.
Optionally, in one or more embodiments, as shown in fig. 3, the integrated chip based visual signal processing method includes:
s302, receiving an initial visual signal based on the visual sensor on the integrated chip.
In an embodiment of the present invention, the visual sensor may be one or more image sensors in various types of cameras, and the initial visual signal is an image signal collected through a lens of the camera.
S304, processing the initial visual signal through a visual signal processing module according to a preset processing rule to obtain a target characteristic signal; the visual signal processing module is located on the integrated chip and at a lower level of the visual sensor.
Specifically, the visual signal processing module and the visual sensor are two adjacent-level modules which are closely connected through a stack process, so that the initial visual signal is directly input into the visual signal processing module from the visual sensor and is processed according to a preset processing rule, and a target characteristic signal can be obtained; here, the target feature signal includes, but is not limited to, an image signal obtained by performing logical operation, encryption, or compression on the initial visual signal.
S306, outputting the target characteristic signal based on the output module on the integrated chip.
Here, the output module includes, but is not limited to, various data output interfaces integrated on the integrated chip, and the target characteristic signal is transmitted to a storage device or a server through the output module via a wired or wireless network.
In the embodiment of the application, an initial visual signal is acquired through a visual sensor based on the integrated chip; processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor; and outputting the target characteristic signal based on an output module on the integrated chip. The acquisition and processing of the visual signals are processed by the adjacent module positioned on the integrated chip, and the adjacent module has no intermediate passage, so that the processing time of the visual signals is shortened, a storage area is not required to be arranged to store the visual signals, and the technical problem of low data security of the visual signals in the transmission process in the related technology is solved.
In one or more embodiments, the processing, by the visual signal processing module, the initial visual signal according to a preset processing rule to obtain a target feature signal includes at least one of:
carrying out logic operation on the initial visual signal through a visual signal processing module to obtain a target characteristic signal;
compressing the initial visual signal through a visual signal processing module to obtain a target characteristic signal;
and extracting visual characteristic information in the initial visual signal through a visual signal processing module to obtain a target characteristic signal.
In one or more embodiments, the logic operation of the initial visual signal through the visual signal processing module to obtain the target feature signal includes:
and carrying out XOR processing on the initial visual signals through a visual signal processing module to obtain target characteristic signals.
For example, suppose x is one of the data in the initial visual signal, if x is 0101, y is 1011; then x ≦ y 1110.
Through the exclusive-or processing operation, the initial visual signal can be subjected to preliminary encryption, so that the safety of the visual signal in the transmission process is improved.
In one or more embodiments, the logic operation performed on the initial visual signal by the visual signal processing module to obtain the target feature signal further includes:
and performing negation processing or zero padding processing on the initial visual signal through a visual signal processing module to obtain a target characteristic signal.
Specifically, for example, assuming that x is one of the data in the initial visual signal, if x is 0101, the characteristic signal value of 1010 is obtained after negating x. Then x is zero padded to obtain 01010000 characteristic signal value with 8 bits.
Through the negation processing or zero padding processing operation, initial visual signals can be subjected to preliminary encryption, and therefore the safety of the visual signals in the transmission process is improved.
In one or more embodiments, the compressing the initial visual signal by the visual signal processing module to obtain the target feature signal includes:
lossless compression is carried out on the initial visual signal through a visual signal processing module to obtain a target characteristic signal; or
And performing lossy compression on the initial visual signal by using a high code rate through a visual signal processing module to obtain a target characteristic signal.
Specifically, the compression method may adopt compression standards such as H264 and H265, or adopt Video Coding compression standards of Advanced Video Coding (AVS) series developed in China; after lossy compression encoding, the original visual signal will be converted to an irreversible video signal. Through the lossy or lossless compression processing operation, the data size of the initial visual signal can be further reduced, and the information transmission amount of the visual signal can be reduced.
In one or more embodiments, the extracting, by the visual signal processing module, the visual feature information in the initial visual signal to obtain a target feature signal includes:
extracting visual characteristic information in the initial visual signal through a visual signal processing module to obtain a compact visual descriptor; wherein the target feature signal comprises the compact-based visual descriptor.
Specifically, only important Visual feature information in the initial Visual signal, such as Compact Descriptor for Visual Search (CDVS) or Compact Descriptor for Video Analysis (CDVA), is extracted by the Visual signal processing module, and the feature information can fully support Video Analysis and detection functions of the monitored Video. In addition, only the characteristic information of partial video needs to be transmitted through the technical means, the storage space and the bandwidth are saved, the characteristic information is irreversible, even if partial information is leaked in network transmission, the original video information is difficult to translate, and the technical problem that the privacy of visual signals is exposed is avoided.
In one or more embodiments, the target feature signal includes vehicle identification information and human face information, and the method further includes:
and performing vehicle recognition based on the vehicle identification information and/or performing face recognition based on the face information.
Specifically, the video feature model output by the signal processing module in the integrated chip can be directly applied to various scenes of intelligent life, such as license plate recognition, face recognition or face tracking and the like.
As shown in fig. 4, in the signal data acquisition-processing in the related art, the visual signals acquired by the visual sensor are usually directly stored in a storage device external to the board card, and then transmitted through the transmission unit.
As shown in fig. 5, fig. 5 is a device for protecting the visual signal processing of a chip based on stack process according to an embodiment of the present invention. By adopting the acquisition-processing device, common external networking storage can be removed, the visual signal is acquired by adopting the visual acquisition unit inside the integrated chip, the visual signal is directly processed by the visual signal processing module in the integrated chip without physical storage, for example, the operations such as exclusive or and other complex processing are directly carried out on the visual signal inside the chip, and then the privacy safety problem caused by the leakage of the original video acquired in the transmission process can be avoided by adopting the transmission device inside the chip for transmission. In addition, the high-performance stack process chip can realize acquisition to high processing integration.
Fig. 6 is a protection device for a visual signal based on a stack process, wherein a visual signal processing unit comprises an original first processing unit, an original second processing unit and a video feature extraction unit, and the device can convert an original video signal which is easy to leak into an insensitive visual signal so as to protect the video privacy and safety.
Optionally, in an application embodiment, the integrated chip-based visual signal processing method includes:
firstly, as shown in fig. 5, the embodiment of the present invention adopts a chip-based acquisition-processing device, which can remove common external networking storage, and an acquisition device inside the chip acquires a visual signal, which is processed by a visual signal processing module in the chip directly without physical storage, for example, the visual signal is processed simply or complicatedly inside the chip, and then a transmission device inside the chip is used for transmission, so that the problem of privacy security caused by leakage of an original video acquired in a transmission process can be avoided. In addition, the high-performance stacked stack process chip can realize high integration of acquisition and processing of visual signals.
Secondly, the invention provides a method for encrypting the collected visual signals between the collection and the transmission of the chip, for example, the operations of addition and subtraction, XOR and the like or other complex operations are carried out on the original signals to convert the video signals into corresponding characteristic signals. Compared with the method that the original visual signals are converted into the characteristic signals in the external memory card, the video signals are converted into the irreversible and encrypted video characteristic signals in the highly integrated chip, and the potential safety hazard problems that the visual signals are cracked and exposed after being leaked can be avoided. The video characteristic signals output by the signal processing module in the chip can be directly applied to various scenes of intelligent life, such as car shooting recognition, face tracking and the like. The video characteristic signals processed by the chip have high confidentiality, and even if the visual characteristic signals are leaked, the acquired personnel cannot translate and understand the meanings represented by the signals, so that the risk of cracking and exposing the visual signals is greatly reduced. Therefore, the device for integrating the video processing module in the video acquisition chip can avoid the technical problem of poor safety of visual signals caused by external storage leakage of a common acquisition transmission channel.
Thirdly, the specific visual signal processing method is as follows:
as shown in fig. 6, the original video is subjected to simple logic operations, such as xor, negation, zero padding, etc., by the original video first processing unit.
The method for performing complex processing on the original video through the second original video processing unit comprises the steps of performing lossless compression on the video or performing lossy compression on the video by using a high code rate through the second original video processing unit under the condition of not influencing subsequent video analysis and tracking functions, wherein the specific compression method can adopt H264 and H265 compression standards or adopt AVS series video coding compression standards which are self-developed in China.
The extraction of the video features through the video feature extraction unit comprises the steps of not changing an original video, and extracting important visual feature information in the video, such as CDVS (visual context versus video) or CDVA (visual context versus video), through the video feature extraction unit, wherein the feature information can support the video analysis and detection functions of the acquired video. In addition, by adopting the method, only the characteristic information of partial video needs to be transmitted, the subsequent storage space and bandwidth are saved, the visual characteristic information is irreversible, even if partial information is leaked by the later networking, the original video information cannot be translated, and the problem that the visual signal exposes the privacy is avoided.
The embodiment of the invention has the following technical effects:
the embodiment of the invention can overcome the problems that the visual signal privacy data are easy to leak in the acquisition-processing stage and the privacy safety problem possibly caused by direct exposure of the visual signal privacy data in the subsequent processing-transmission-cloud service application stage.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
According to another aspect of the embodiments of the present application, there is also provided an integrated chip based visual signal processing apparatus for implementing the integrated chip based visual signal processing method. As shown in fig. 7, the apparatus includes:
a receiving unit 702, which receives an initial visual signal based on the visual sensor on the integrated chip;
a processing unit 704, configured to process the initial visual signal according to a preset processing rule through a visual signal processing module, so as to obtain a target feature signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor;
an output unit 706, configured to output the target feature signal based on an output module on the integrated chip.
In the embodiment of the application, an initial visual signal is acquired through a visual sensor based on the integrated chip; processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor; and outputting the target characteristic signal based on an output module on the integrated chip. The acquisition and processing of the visual signals are processed by the adjacent module positioned on the integrated chip, and the adjacent module has no intermediate passage, so that the processing time of the visual signals is shortened, a storage area is not required to be arranged to store the visual signals, and the technical problem of low data security of the visual signals in the transmission process in the related technology is solved.
In one or more embodiments, the processing unit 704 includes at least one of:
the logic processing module is used for carrying out logic operation on the initial visual signal through the visual signal processing module to obtain a target characteristic signal;
the compression module is used for compressing the initial visual signal through the visual signal processing module to obtain a target characteristic signal;
and the extraction module is used for extracting the visual characteristic information in the initial visual signal through the visual signal processing module to obtain a target characteristic signal.
In one or more embodiments, the logic processing module includes:
and the first processing subunit is used for carrying out XOR processing on the initial visual signal through the visual signal processing module to obtain a target characteristic signal.
In one or more embodiments, the logic processing module further includes:
and the second processing sub-module is used for performing negation processing or zero filling processing on the initial visual signal through the visual signal processing module to obtain a target characteristic signal.
In one or more embodiments, the compression module includes:
the first compression subunit is used for carrying out lossless compression on the initial visual signal through the visual signal processing module to obtain a target characteristic signal; or
And the second compression subunit is used for performing lossy compression on the initial visual signal by using a high code rate through the visual signal processing module to obtain a target characteristic signal.
In one or more embodiments, the extracting module includes:
the extraction subunit is used for extracting visual characteristic information in the initial visual signal through the visual signal processing module to obtain a compact visual descriptor; wherein the target feature signal comprises the compact-based visual descriptor.
In one or more embodiments, the target feature signal includes vehicle identification information and human face information, and the integrated chip-based visual signal processing apparatus further includes:
and the identification unit is used for carrying out vehicle identification based on the vehicle identification information and/or carrying out face identification based on the face information.
According to still another aspect of the embodiments of the present application, there is also provided an electronic device for implementing the integrated chip based visual signal processing method, where the electronic device may be a terminal device or a server shown in fig. 1. The present embodiment takes the electronic device as a server as an example for explanation. As shown in fig. 8, the electronic device comprises a processor 802 and a memory 804, wherein the processor 802 has a computer program stored therein, and the processor 802 is configured to execute the steps of any of the method embodiments described above by means of the computer program.
Optionally, in this embodiment, the electronic device may be located in at least one network device of a plurality of network devices of a computer network.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, receiving initial visual signals based on the visual sensor on the integrated chip;
s2, processing the initial visual signal through a visual signal processing module according to a preset processing rule to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor;
s3, outputting the target characteristic signal based on the output module on the integrated chip.
Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 8 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 8 is a diagram illustrating a structure of the electronic device. For example, the electronics may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 8, or have a different configuration than shown in FIG. 8.
The processor 802 may be configured to store software programs and modules, such as program instructions/modules corresponding to the integrated chip-based visual signal processing method and apparatus in the embodiment of the present application, and the processor 802 executes various functional applications and data processing by running the software programs and modules stored in the memory 804, so as to implement the integrated chip-based visual signal processing method. The processor 802 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the processor 802 can further include memory located remotely from the memory 804, which can be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. The processor 802 may be particularly, but not exclusively, for storing visual signals. As an example, as shown in fig. 8, the processor 802 may include, but is not limited to, a receiving unit 702, a processing unit 704, and an output unit 706 in the integrated chip based visual signal processing apparatus. In addition, the device may further include, but is not limited to, other module units in the integrated chip-based visual signal processing apparatus, which is not described in detail in this example.
Optionally, the transmission device 806 is used for receiving or sending data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transmission device 806 includes a Network adapter (NIC) that can be connected to a router via a Network cable and can communicate with the internet or a local area Network. In one example, the transmission device 806 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In addition, the electronic device further includes: a display 808 for displaying a target visual signal; and a connection bus 810 for connecting the respective module parts in the above-described electronic apparatus.
In other embodiments, the terminal device or the server may be a node in a distributed system, where the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting a plurality of nodes through a network communication. Nodes can form a Peer-To-Peer (P2P, Peer To Peer) network, and any type of computing device, such as a server, a terminal, and other electronic devices, can become a node in the blockchain system by joining the Peer-To-Peer network.
In one or more embodiments, the present application further provides a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the integrated chip-based visual signal processing method. Wherein the computer program is arranged to perform the steps of any of the above method embodiments when executed.
Alternatively, in the present embodiment, the above-mentioned computer-readable storage medium may be configured to store a computer program for executing the steps of:
s1, receiving initial visual signals based on the visual sensor on the integrated chip;
s2, processing the initial visual signal through a visual signal processing module according to a preset processing rule to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level of the visual sensor;
and S3, outputting the target characteristic signal based on the output module on the integrated chip.
Alternatively, in this embodiment, a person skilled in the art may understand that all or part of the steps in the various methods in the foregoing embodiments may be implemented by a program instructing hardware related to the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like. The above-mentioned serial numbers of the embodiments of the present application are merely for description, and do not represent the advantages and disadvantages of the embodiments.
The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in the above computer-readable storage medium. Based on such understanding, the technical solutions of the present application, which are essential or part of the technical solutions contributing to the prior art, or all or part of the technical solutions, may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the above methods of the embodiments of the present application.
In the embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.
In the several embodiments provided in the present application, it should be understood that the disclosed client may be implemented in other manners. The above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. An integrated chip based visual signal processing method, comprising:
receiving an initial visual signal based on a visual sensor on the integrated chip;
processing the initial visual signal according to a preset processing rule through a visual signal processing module to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level than the visual sensor;
outputting the target characteristic signal based on an output module on the integrated chip.
2. The method according to claim 1, wherein the processing the initial visual signal by a visual signal processing module according to a preset processing rule to obtain a target feature signal comprises at least one of:
carrying out logic operation on the initial visual signal through a visual signal processing module to obtain a target characteristic signal;
compressing the initial visual signal through a visual signal processing module to obtain a target characteristic signal;
and extracting visual characteristic information in the initial visual signal through a visual signal processing module to obtain a target characteristic signal.
3. The method of claim 2, wherein performing a logic operation on the initial visual signal through a visual signal processing module to obtain a target feature signal comprises:
and carrying out XOR processing on the initial visual signal through a visual signal processing module to obtain a target characteristic signal.
4. The method of claim 2, wherein said performing a logic operation on the initial visual signal through a visual signal processing module to obtain a target characteristic signal further comprises:
and performing negation processing or zero padding processing on the initial visual signal through a visual signal processing module to obtain a target characteristic signal.
5. The method according to claim 2, wherein the compressing the initial visual signal by a visual signal processing module to obtain a target feature signal comprises:
lossless compression is carried out on the initial visual signal through a visual signal processing module to obtain a target characteristic signal; or alternatively
And carrying out lossy compression on the initial visual signal by using a high code rate through a visual signal processing module to obtain a target characteristic signal.
6. The method of claim 2, wherein the extracting, by a visual signal processing module, the visual feature information in the initial visual signal to obtain a target feature signal comprises:
extracting visual characteristic information in the initial visual signal through a visual signal processing module to obtain a compact visual descriptor; wherein the target feature signal comprises the compact-based visual descriptor.
7. The method of claim 1, wherein the target feature signal includes vehicle identification information and face information, the method further comprising:
and performing vehicle identification based on the vehicle identification information, and/or performing face identification based on the face information.
8. An integrated chip based visual signal processing apparatus, comprising:
a receiving unit for receiving an initial visual signal based on a visual sensor on the integrated chip;
the processing unit is used for processing the initial visual signal through a visual signal processing module according to a preset processing rule to obtain a target characteristic signal; wherein the visual signal processing module is a module located on the integrated chip and at a lower level than the visual sensor;
and the output unit is used for outputting the target characteristic signal based on an output module on the integrated chip.
9. A computer-readable storage medium, comprising a stored program, wherein the program when executed performs the method of any one of claims 1 to 7.
10. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and the processor is arranged to execute the method of any of claims 1 to 7 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210215262.4A CN114786041A (en) | 2022-03-04 | 2022-03-04 | Visual signal processing method and device based on integrated chip and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210215262.4A CN114786041A (en) | 2022-03-04 | 2022-03-04 | Visual signal processing method and device based on integrated chip and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114786041A true CN114786041A (en) | 2022-07-22 |
Family
ID=82423337
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210215262.4A Pending CN114786041A (en) | 2022-03-04 | 2022-03-04 | Visual signal processing method and device based on integrated chip and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114786041A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101514966A (en) * | 2009-03-20 | 2009-08-26 | 何流 | Industrial line scanning intelligent camera |
| CN103198462A (en) * | 2013-04-08 | 2013-07-10 | 南华大学 | Intense radiation resistant visual sensing device based on information fusion |
| US20150312475A1 (en) * | 2014-04-23 | 2015-10-29 | Imperx, Inc. | User programmable image capturing and processing device |
| CN113240744A (en) * | 2020-01-23 | 2021-08-10 | 华为技术有限公司 | Image processing method and device |
-
2022
- 2022-03-04 CN CN202210215262.4A patent/CN114786041A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101514966A (en) * | 2009-03-20 | 2009-08-26 | 何流 | Industrial line scanning intelligent camera |
| CN103198462A (en) * | 2013-04-08 | 2013-07-10 | 南华大学 | Intense radiation resistant visual sensing device based on information fusion |
| US20150312475A1 (en) * | 2014-04-23 | 2015-10-29 | Imperx, Inc. | User programmable image capturing and processing device |
| CN113240744A (en) * | 2020-01-23 | 2021-08-10 | 华为技术有限公司 | Image processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111866024B (en) | Network encryption traffic identification method and device | |
| CN101848374A (en) | Wireless video monitoring system and wireless video monitoring method thereof | |
| CN205883299U (en) | Data storage system based on cloud computing | |
| CN111815842A (en) | Health information uplink method and device, storage medium and electronic device | |
| CN112261038B (en) | Big data acquisition method and system, computer equipment and storage medium thereof | |
| CN104751105A (en) | Fingerprint data verification method, fingerprint data verification device, related equipment and system | |
| EP3404895A1 (en) | Multimedia data transmission method and device | |
| CN108965339A (en) | A kind of block chain school data access system | |
| CN112492383A (en) | Video frame generation method and device, storage medium and electronic equipment | |
| CN108833500B (en) | Service calling method, service providing method, data transmission method and server | |
| CN112437034B (en) | False terminal detection method and device, storage medium and electronic device | |
| CN115563600A (en) | Data auditing method and device, electronic equipment and storage medium | |
| US20210099772A1 (en) | System and method for verification of video integrity based on blockchain | |
| CN113132678B (en) | Data transmission method and device, electronic equipment and storage medium | |
| CN117061165A (en) | Safety protection system based on space-time data lake technology of monitoring and control system | |
| CN114786041A (en) | Visual signal processing method and device based on integrated chip and electronic equipment | |
| CN115134080B (en) | Data transmission method and device based on security encryption chip | |
| CN115914578A (en) | Case handling full-process management method and system based on block chain | |
| CN107172718B (en) | Information processing method and electronic equipment | |
| CN115659375A (en) | Data processing method, data processing device, storage medium and electronic equipment | |
| CN115114667A (en) | Privacy information processing and classifying method and device for security chip | |
| CN114938465A (en) | Encrypted data transmission method and device based on characteristic sequence | |
| CN111221803B (en) | Feature library management method and coprocessor | |
| CN112702623A (en) | Video processing method, device, equipment and storage medium | |
| CN113890754A (en) | Data transmission method, terminal, system and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |