CN116016942A - Image data processing method of multi-path camera and related equipment - Google Patents
Image data processing method of multi-path camera and related equipment Download PDFInfo
- Publication number
- CN116016942A CN116016942A CN202211633459.6A CN202211633459A CN116016942A CN 116016942 A CN116016942 A CN 116016942A CN 202211633459 A CN202211633459 A CN 202211633459A CN 116016942 A CN116016942 A CN 116016942A
- Authority
- CN
- China
- Prior art keywords
- video
- virtual
- camera
- path
- virtual channels
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Studio Devices (AREA)
Abstract
The application provides an image data processing method of a multi-path camera, which comprises the following steps: acquiring analog video signals of the image pickup devices; after the video decoding chip converts the analog video signals into digital signals corresponding to the virtual channels, the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion; and displaying the processed digital signal on an application end. The method and the device enable the processed digital signals to support the android native interface, can be compatible with various application software, are higher in compatibility, and meanwhile facilitate the effect addition of the video data by using the image processor, so that the displayed image is clearer and more stable. The application also provides image data processing equipment of the multipath camera, an image data processing device of the multipath camera and a computer readable storage medium, and the image data processing equipment has the beneficial effects.
Description
Technical Field
The present invention relates to the field of image acquisition, and in particular, to a method for processing image data of a multi-path camera, an apparatus for processing image data of a multi-path camera, and a computer readable storage medium.
Background
Currently, in a third party implementation scheme, an AHD-4-MIPI chip is provided with a multi-path camera, direct access of original data is realized through a virtual channel, the AHD camera starts working after being powered on and can immediately generate continuous high-definition analog video signals, the analog video signals input by the camera are converted into digital signals through the AHD-4-MIPI chip, but Android (Android) native interfaces cannot be supported, most of application software (APP) on the market cannot be compatible, and the effect of adding original data (RAW data) of the camera cannot be realized.
Disclosure of Invention
The application aims to provide an image data processing method of a multi-path camera, image data processing equipment of the multi-path camera, an image data processing device of the multi-path camera and a computer readable storage medium, which can support an android native interface and improve the compatibility of video data.
In order to solve the technical problems, the application provides an image data processing method of a multi-path camera, which comprises the following specific technical scheme:
acquiring analog video signals of the image pickup devices;
after the video decoding chip converts the analog video signals into digital signals corresponding to the virtual channels, the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion;
and displaying the processed digital signal on an application end.
Optionally, the method further comprises:
creating the same number of device file descriptors as the virtual channels; and each equipment file descriptor is used for managing and controlling the image pickup equipment corresponding to the virtual channel.
Optionally, after creating the same number of device file descriptors as the virtual channel in the kernel, the method further includes:
enabling the data interrupt interfaces corresponding to the device file descriptors respectively so as to enable the camera device to establish connection with the virtual sensor device contained in the video decoding chip through the data interrupt interfaces.
Optionally, after the video decoding chip converts the analog video signal into a digital signal corresponding to each virtual channel, the method further includes:
transmitting the digital signal to a physical layer of a camera serial interface, and analyzing the digital signal in the physical layer to obtain frame data;
performing data decoding on the frame data by using a preset decoding interface to obtain decoded data of digital signals corresponding to each virtual channel;
correspondingly, the method for converting the format of the digital signals corresponding to one path of virtual channels transmitted to the GPU node comprises the steps of:
and transmitting the decoded data corresponding to one path of virtual channel into a video acquisition driving frame for processing, and transmitting the decoded data corresponding to the other paths of virtual channel into a GPU node for format conversion.
Optionally, transmitting the decoded data corresponding to one path of virtual channel into the video acquisition driving frame for processing, and transmitting the decoded data corresponding to the other paths of virtual channel into the GPU node for format conversion includes:
determining a channel ID corresponding to the decoded data;
and determining one path of virtual channels which are transmitted into the video acquisition driving frame and the other paths of virtual channels which are transmitted into the GPU node for format conversion according to the channel ID.
Optionally, before displaying the processed digital signal on the application end, the method further includes:
and performing effect processing on the digital signal by using an image processor, and executing the step of displaying the processed digital signal on an application end after the effect processing.
The application also provides an image data processing device of a multi-path camera, comprising:
the video decoding chip comprises N virtual channels, wherein N is a positive integer not less than 1; each virtual channel is virtualized as a virtual sensor device, and each virtual sensor device is used for connecting one path of camera equipment; the video decoding chip is used for converting the video signal transmitted by the camera equipment end into a digital signal;
the image processing component is used for transmitting the digital signals corresponding to one path of virtual channels into the video acquisition driving frame for processing, and transmitting the digital signals corresponding to the other paths of virtual channels into the GPU node for format conversion; and displaying the processed digital signal on an application end.
Optionally, the image processing component further includes:
a camera serial interface and a video acquisition driving frame;
the camera serial interface is used for analyzing the digital signal to obtain frame data;
the video acquisition driving framework is used for carrying out parameter processing on the frame data.
The application also provides an image data processing device of multichannel camera, each way camera equipment of multichannel camera links to each other with the virtual sensor of four ways of video decoding chip, each way virtual channel virtualization of video decoding chip is one virtual sensor equipment includes:
a signal acquisition module configured to acquire analog video signals of the respective image pickup apparatuses;
the signal processing module is used for converting the analog video signal into digital signals corresponding to the virtual channels by the video decoding chip, wherein the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion;
and the video display module is used for displaying the processed digital signals on the application end.
The present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the method as described above.
The application provides an image data processing method of a multi-path camera, which comprises the following steps: acquiring analog video signals of the image pickup devices; after the video decoding chip converts the analog video signals into digital signals corresponding to the virtual channels, the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion; and displaying the processed digital signal on an application end.
According to the method and the device, after the digital signals are obtained through analog video signal processing of the camera equipment, only one path of the digital signals are directly transmitted into the video acquisition driving frame for processing, and the other paths of the digital signals are transmitted into the GPU node for format conversion, so that the image processor can recognize and execute effect processing, the processed digital signals can support an android native interface and can be compatible with various application software, the compatibility is stronger, meanwhile, the effect addition of the video data by the image processor can be facilitated on the basis, the displayed images are clearer and more stable, and the video display effect is enriched.
The application further provides image data processing equipment of the multipath camera, an image data processing device of the multipath camera and a computer readable storage medium, which have the beneficial effects and are not repeated here.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings may be obtained according to the provided drawings without inventive effort to a person skilled in the art.
Fig. 1 is a flowchart of a method for processing image data of a multi-path camera according to an embodiment of the present application;
fig. 2 is a schematic diagram of a video stream data processing flow of a multi-path camera according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of an image data processing device of a multi-path camera according to an embodiment of the present application.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
In order to better describe the image data processing method provided by the present application, the following describes an image data processing device provided by the present application, which may specifically include:
the video decoding chip comprises N virtual channels, wherein N is a positive integer not less than 1; each virtual channel is virtualized as a virtual sensor device, and each virtual sensor device is used for connecting one path of camera equipment; the video decoding chip is used for converting the video signal transmitted by the camera equipment end into a digital signal;
the image processing component is used for transmitting the digital signals corresponding to one path of virtual channels into the video acquisition driving frame for processing, and transmitting the digital signals corresponding to the other paths of virtual channels into the GPU node for format conversion; and displaying the processed digital signal on an application end.
The video decoding chip is not limited, and for example, a common AHD-4-MIPI chip may be used, where the AHD-4-MIPI chip includes 4 virtual channels, i.e., n=4. The video decoding chip is used for converting the video signal into a digital signal, namely, an analog-to-digital conversion process for converting the analog signal into the digital signal is realized.
After the video decoding chip converts video data from analog signals to digital signals, the image processing component outputs the digital signals through different output channels, specifically, one path of the digital signals can be directly processed by using the video acquisition driving frame, and the other paths of the digital signals can be converted into video formats adapting to client interfaces or adapting to application software types through GPU processing nodes.
According to the method and the device, the digital signals are processed in two different processing modes, so that the processed digital signals can support an android native interface, can be compatible with various application software, and is high in compatibility.
In order to better control the image pickup device connected with each path of virtual channel, at least N device file descriptors can be stored in the kernel, each device file descriptor is used for corresponding one path of virtual channel, taking an AHD-4-MIPI chip as an example, at least four device file descriptors should be stored in the kernel at this time, so as to meet the application requirement of the AHD-4-MIPI chip. Here, how to create the device file descriptor, and the specific content of the device file descriptor are not limited, it should at least include attribute information of the corresponding virtual channel, such as a name or a number of the virtual channel, etc.
It should be noted that, although a plurality of device file descriptors are stored at this time, when power is applied, only one of the device file descriptors is enabled, but at the same time, the other device file descriptors all perform the same operation as the device file descriptor for which the valid operation is performed, that is, the virtual channel corresponding to the controller opens the corresponding data interrupt interface after the device file descriptor is performed, so as to correspond to the corresponding image capturing device, and interface with the virtual channel included in the video decoding chip. In a specific application, an enabling instruction for a device file descriptor may be issued, where the enabling instruction is used to perform an enabling operation for a target device file descriptor, and the target device file descriptor refers to a device file descriptor that is a valid operation performed by the enabling instruction, and the target device file descriptor may be any one of multiple device file descriptors.
After the butt joint is finished, each path of camera equipment can continuously transmit shot video data to the video decoding chip through the virtual channel, and the video data enters the video decoding signal in the form of analog signals. The video decoding signals can be used for converting video data transmitted by each path of image pickup equipment into digital signals corresponding to each path of virtual channels.
It can be seen that, in this embodiment, each virtual channel of the video decoding chip is virtualized into a virtual sensor device and is connected with the image capturing device, and by constructing a plurality of device file descriptors and corresponding to the virtual channels, the virtual sensor device is used for enabling the image capturing device connected with the virtual channels, and only one device file descriptor is required to be normally enabled when the device is powered on or powered off, so that each virtual channel directly corresponds to the corresponding image capturing device, the virtual channels are guaranteed to correspond to the image capturing devices one by one, the virtual channels are not idle any more, the application rate of the virtual channels is guaranteed, and the application cost of the monitoring system is reduced.
On the basis of the above embodiment, as a preferred embodiment, the image processing component may further include a camera serial interface and a video acquisition driving frame, where the camera serial interface is used to parse the digital signal to obtain frame data, and the video acquisition driving frame is used to perform parameter processing on the frame data.
Meanwhile, the image processing component may further include an image processor, where the image processor is configured to perform effect processing on frame data, for example, noise reduction, white balance, and 3A algorithm may be performed, and the 3A algorithm refers to automatic exposure control, automatic focus control, and automatic white balance control, and is sequentially used to adjust brightness of an image, focal length of the image, and color temperature of the image under a light source, respectively.
Referring to fig. 1, fig. 1 is a flowchart of a method for processing image data of a multi-path camera according to an embodiment of the present application, and the present application further provides a method for processing image data of a multi-path camera, including:
s101: acquiring analog video signals of the image pickup devices;
s102: after the video decoding chip converts the analog video signals into digital signals corresponding to the virtual channels, the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion;
s103: and displaying the processed digital signal on an application end.
Before the image data processing method of the embodiment is executed, configuration needs to be performed for multiple cameras and video decoding chips, specifically, each path of virtual channel of the video decoding chip can be virtualized into virtual sensor equipment, and each path of imaging equipment of the multiple cameras needs to be connected with each path of virtual sensor equipment of the video decoding chip in a one-to-one correspondence manner.
In step S101, it is necessary to acquire an analog video signal originating from each image pickup apparatus, and the video decoding chip may acquire video data acquired by each image pickup apparatus through a virtual sensor apparatus connected to each image pickup apparatus. And video data acquired by the image pickup device exist as analog signals and are transmitted to the video decoding chip. In a specific application process of the present application, step S101 may be a continuously executed process, for example, if the image capturing apparatus is a real-time monitoring camera. The analog video signal of the image pickup apparatus may be acquired periodically or periodically, and is not particularly limited herein.
The video decoding chip is used for converting the analog video signals into digital signals corresponding to each virtual channel for processing. The specific digital signal processing method is not limited, but two processing methods are required for the digital signal. Namely, the digital signals corresponding to one path of virtual channels are directly transmitted into the video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into the GPU node for format conversion.
In other words, after the digital signal is obtained, the digital signal is transmitted to the physical layer of the camera serial interface. The camera serial interface, i.e. CSI (Camera Serial Interface), parses the digital signal in the physical layer to obtain the corresponding image frame data for decoding at the preset decoding interface, where the preset decoding interface is not limited, and for example, a MIPI interface (mobile industry processor interface ) may be used to obtain the decoded data. Decoding can facilitate subsequent image processing.
In this embodiment, the digital signals corresponding to different virtual channels need to be split. After decoding, decoding data corresponding to one path of virtual channels can be transmitted to a video acquisition driving frame for processing, and decoding data corresponding to the other paths of virtual channels are transmitted to a GPU node for format conversion.
The decoded data of different virtual channels analyzed by the CSID (Camera serial interface decoder, the serial interface decoder of the camera) may specify different output channels for output, for example, the current CSID hardware interface supports 4 output channels, namely RDI0, RDI1, RDI2 and PIX channels, and for different data processing modes, it may be determined that the following may be specific:
if the decoded digital signal enters the PIX channel, carrying out parameter processing on the digital signal by utilizing a video acquisition driving frame;
if the decoded digital signal enters the RDI channel, the GPU node is utilized to convert the format of the digital signal, and the digital signal can be converted into a set format corresponding to the image processor.
Therefore, the decoded data enter the PIX channel, enter the video acquisition driving frame to process parameters, and then are transmitted to the application end for display through the image processor. If the decoded data is RDI channel, the decoded data is directly transmitted through the video acquisition driving frame, at this time, the decoded data can be processed by using a user-defined preset processing node, and format conversion is performed on the decoded data so as to meet the format processing standard of a subsequent image processor, for example, the decoded data in RAW format can be converted into NV12 image format which can be directly processed by the image processor. Therefore, video signals of different types of image pickup devices can pass through the RDI channel and are subjected to format conversion by utilizing the GPU node, and the image processing requirements can be met. In other words, by applying GPU nodes, different types and formats of image capturing apparatuses can be compatible. And meanwhile, the video data after format conversion is conveniently transmitted into an image processor for effect processing.
After the decoded data is obtained, image processing may be further performed. Specifically, the channel ID corresponding to the decoded data may be determined first, and then the corresponding data processing channel may be determined according to the channel ID. Taking the camera serial interface as an example, it currently supports 4 output channels, namely RDI0, RDI1, RDI2 and PIX channels, where RDI0, RDI1 and RDI2 are RDI channels, and the PIX channel refers to a pixel channel (pixel channel).
As can be seen from the above, for each virtual channel included in the video decoding chip, when video data of each path of image capturing device enters the video decoding chip, each path of video data occupies one virtual channel of the video decoding chip, i.e. one virtual channel is selected from the currently idle virtual channels. If the virtual channel of the video decoding chip has a corresponding channel ID, an output channel corresponding to the specific channel can be preset, and when image processing is executed, a corresponding data processing channel can be determined according to the channel ID.
Meanwhile, the embodiment performs format conversion through the GPU node, so that the image processor is convenient for processing the effect of the video data, the developed image effect is clearer than that of directly adopting the original video signal, and meanwhile, previewing of special scenes such as snow scenes, HDR (high dynamic range), superNight (super night scenes), MFNR (multi-frame noise reduction) and the like can be realized.
Referring to fig. 2, fig. 2 is a schematic diagram of a video stream data processing flow of a multi-path camera provided by the present application, in fig. 2, an AHD-serial deserializer including 4 paths of virtual channels is used as a video decoding chip, 4 imaging devices such as cam1, cam2, cam3, cam4 send captured video signals to the AHD-serial deserializer to obtain digital signals of the 4 paths of virtual channels, and the digital signals correspond to sensor_1, sensor_2, sensor_3, and sensor_4 in fig. 2 respectively, and then the digital signals are transmitted to an ISP (Image Signal Processing ) device to execute an Image processing flow, and enter a physical layer of a camera serial interface, namely, a CSI physical layer in fig. 2, where the digital signals are parsed to obtain frame data, and then transmitted to a CSID in an IFE (Image Front End) indicated by a dotted line in fig. 2 to perform data decoding. The decoded data is transmitted to RDI0, RDI1, RDI2 and PIX channels according to the channel IDs, respectively. For the three decoding data belonging to RDI channels, RDI0, RDI1, RDI2, the decoding data is processed by the predetermined processing node, i.e., the GPU node in fig. 2, and then is transmitted to the Image processing engine IPE (Image-processing engine), i.e., the Image processor, and the video data can be displayed on the display screen after being processed by the Image processor. The digital signal entering the PIX channel, which is the camera interface, is first part of VFE (video front-end) hardware, and then enters the WM window manager for processing and then is sent to the image processing engine IPE.
The image data processing apparatus provided in the embodiments of the present application will be described below, and the application apparatus described below and the image data processing method described above may be referred to correspondingly.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an image data processing device of a multi-path camera according to an embodiment of the present application, and the present application further provides an image data processing device of a multi-path camera, including:
a signal acquisition module configured to acquire analog video signals of the respective image pickup apparatuses;
the signal processing module is used for converting the analog video signal into digital signals corresponding to the virtual channels by the video decoding chip, wherein the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion;
and the video display module is used for displaying the processed digital signals on the application end.
Based on the above embodiment, as a preferred embodiment, further comprising:
the file configuration module is used for creating the same number of device file descriptors as the virtual channels; and each equipment file descriptor is used for managing and controlling the image pickup equipment corresponding to the virtual channel.
Based on the above embodiment, as a preferred embodiment, further comprising:
enabling the data interrupt interfaces corresponding to the device file descriptors respectively so as to enable the camera device to establish connection with the virtual sensor device contained in the video decoding chip through the data interrupt interfaces.
Based on the above embodiment, as a preferred embodiment, further comprising:
the signal decoding module is used for transmitting the digital signal to a physical layer of a camera serial interface and analyzing the digital signal in the physical layer to obtain frame data; performing data decoding on the frame data by using a preset decoding interface to obtain decoded data of digital signals corresponding to each virtual channel;
correspondingly, the signal processing module comprises:
and the decoding signal processing unit is used for transmitting decoding data corresponding to one path of virtual channels into the video acquisition driving frame for processing, and transmitting decoding data corresponding to the other paths of virtual channels into the GPU node for format conversion.
Based on the above-described embodiments, as a preferred embodiment, the decoded signal processing unit includes:
a channel determining subunit, configured to determine a channel ID corresponding to the decoded data;
and the signal transmission subunit is used for determining one path of virtual channel which is transmitted into the video acquisition driving frame and the other paths of virtual channels which are transmitted into the GPU node for format conversion according to the channel ID.
Based on the above embodiment, as a preferred embodiment, further comprising:
and the image processing module is used for performing effect processing on the digital signals by utilizing the image processor and executing the step of displaying the processed digital signals on an application end after the effect processing.
The present application also provides a computer-readable storage medium having stored thereon a computer program which, when executed, implements the steps provided by the above embodiments. The storage medium may include: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The present application also provides a server, which may include a memory and a processor, where the memory stores a computer program, and the processor may implement the steps provided in the foregoing embodiments when calling the computer program in the memory. The server may of course also include various network interfaces, power supplies, etc.
In the description, each embodiment is described in a progressive manner, and each embodiment is mainly described by the differences from other embodiments, so that the same similar parts among the embodiments are mutually referred. The system provided by the embodiment is relatively simple to describe as it corresponds to the method provided by the embodiment, and the relevant points are referred to in the description of the method section.
Specific examples are set forth herein to illustrate the principles and embodiments of the present application, and the description of the examples above is only intended to assist in understanding the methods of the present application and their core ideas. It should be noted that it would be obvious to those skilled in the art that various improvements and modifications can be made to the present application without departing from the principles of the present application, and such improvements and modifications fall within the scope of the claims of the present application.
It should also be noted that in this specification, relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Claims (10)
1. The image data processing method of the multipath camera is characterized in that each path of camera equipment of the multipath camera is connected with each path of virtual sensor equipment of a video decoding chip in a one-to-one correspondence manner, and each path of virtual channel of the video decoding chip is virtualized into one virtual sensor equipment, and the method comprises the following steps:
acquiring analog video signals of the image pickup devices;
after the video decoding chip converts the analog video signals into digital signals corresponding to the virtual channels, transmitting the digital signals corresponding to one path of virtual channels into a video acquisition driving frame for processing, and transmitting the digital signals corresponding to the other paths of virtual channels into a GPU node for format conversion;
and displaying the processed digital signal on an application end.
2. The image data processing method according to claim 1, characterized by further comprising:
creating the same number of device file descriptors as the virtual channels; and each equipment file descriptor is used for managing and controlling the image pickup equipment corresponding to the virtual channel.
3. The image data processing method according to claim 2, further comprising, after creating the same number of device file descriptors as the virtual channel in the kernel:
enabling the data interrupt interfaces corresponding to the device file descriptors respectively so as to enable the camera device to establish connection with the virtual sensor device contained in the video decoding chip through the data interrupt interfaces.
4. The image data processing method according to claim 3, further comprising, after the video decoding chip converts the analog video signal into a digital signal corresponding to each of the virtual channels:
transmitting the digital signal to a physical layer of a camera serial interface, and analyzing the digital signal in the physical layer to obtain frame data;
performing data decoding on the frame data by using a preset decoding interface to obtain decoded data of digital signals corresponding to each virtual channel;
correspondingly, the method for converting the format of the digital signals corresponding to one path of virtual channels transmitted to the GPU node comprises the steps of:
and transmitting the decoded data corresponding to one path of virtual channel into a video acquisition driving frame for processing, and transmitting the decoded data corresponding to the other paths of virtual channel into a GPU node for format conversion.
5. The method according to claim 4, wherein transmitting the decoded data corresponding to one of the virtual channels to the video acquisition driving frame for processing, and transmitting the decoded data corresponding to the other virtual channels to the GPU node for format conversion comprises:
determining a channel ID corresponding to the decoded data;
and determining one path of virtual channels which are transmitted into the video acquisition driving frame and the other paths of virtual channels which are transmitted into the GPU node for format conversion according to the channel ID.
6. The image data processing method according to any one of claims 1 to 5, characterized by displaying the processed digital signal before the application side, further comprising:
and performing effect processing on the digital signal by using an image processor, and executing the step of displaying the processed digital signal on an application end after the effect processing.
7. An image data processing apparatus of a multi-path camera, comprising:
the video decoding chip comprises N virtual channels, wherein N is a positive integer not less than 1; each virtual channel is virtualized as a virtual sensor device, and each virtual sensor device is used for connecting one path of camera equipment; the video decoding chip is used for converting the video signal transmitted by the camera equipment end into a digital signal;
the image processing component is used for transmitting the digital signals corresponding to one path of virtual channels into the video acquisition driving frame for processing, and transmitting the digital signals corresponding to the other paths of virtual channels into the GPU node for format conversion; and displaying the processed digital signal on an application end.
8. The image data processing device of claim 7, wherein the image processing component further comprises:
a camera serial interface and a video acquisition driving frame;
the camera serial interface is used for analyzing the digital signal to obtain frame data;
the video acquisition driving framework is used for carrying out parameter processing on the frame data.
9. The image data processing device of the multipath camera is characterized in that each path of camera equipment of the multipath camera is connected with four paths of virtual sensors of a video decoding chip, and each path of virtual channel of the video decoding chip is virtualized as one virtual sensor equipment, and the image data processing device comprises:
a signal acquisition module configured to acquire analog video signals of the respective image pickup apparatuses;
the signal processing module is used for converting the analog video signal into digital signals corresponding to the virtual channels by the video decoding chip, wherein the digital signals corresponding to one path of virtual channels are transmitted into a video acquisition driving frame for processing, and the digital signals corresponding to the other paths of virtual channels are transmitted into a GPU node for format conversion;
and the video display module is used for displaying the processed digital signals on the application end.
10. A computer-readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the steps of the image data processing method of a multi-channel camera as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211633459.6A CN116016942A (en) | 2022-12-19 | 2022-12-19 | Image data processing method of multi-path camera and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211633459.6A CN116016942A (en) | 2022-12-19 | 2022-12-19 | Image data processing method of multi-path camera and related equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116016942A true CN116016942A (en) | 2023-04-25 |
Family
ID=86020265
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211633459.6A Pending CN116016942A (en) | 2022-12-19 | 2022-12-19 | Image data processing method of multi-path camera and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116016942A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117729394A (en) * | 2024-02-18 | 2024-03-19 | 厦门瑞为信息技术有限公司 | Method for simultaneously processing multiple image sensors by single image processing module |
-
2022
- 2022-12-19 CN CN202211633459.6A patent/CN116016942A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117729394A (en) * | 2024-02-18 | 2024-03-19 | 厦门瑞为信息技术有限公司 | Method for simultaneously processing multiple image sensors by single image processing module |
| CN117729394B (en) * | 2024-02-18 | 2024-04-30 | 厦门瑞为信息技术有限公司 | Method for simultaneously processing multiple image sensors by single image processing module |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8564679B2 (en) | Image processing apparatus, image processing method and program | |
| US10148860B2 (en) | Imaging apparatus, external apparatus, imaging system, control method for imaging apparatus, control method for external apparatus, control method for imaging system, and program | |
| US9578224B2 (en) | System and method for enhanced monoimaging | |
| CN103248863B (en) | A kind of picture pick-up device, communication system and corresponding image processing method | |
| RU2015143011A (en) | Server node device and method | |
| CN116016942A (en) | Image data processing method of multi-path camera and related equipment | |
| US6446155B1 (en) | Resource bus interface | |
| CN112788431A (en) | Video playing method, device, system, medium and browser based on HTML5 | |
| WO2022111717A1 (en) | Image processing method and apparatus, and electronic device | |
| CN106131563A (en) | The method and system of hardware decoding H264 video flowing are carried out based on DXVA | |
| CN112492247B (en) | Video display design method based on LVDS input | |
| US9699402B2 (en) | Method and apparatus for transmitting video signal | |
| CN110634564B (en) | Pathological information processing method, device and system, electronic equipment and storage medium | |
| EP2230834A1 (en) | Apparatus and method for image processing | |
| US11138703B2 (en) | Dynamic range compression method | |
| CN108461157A (en) | A kind of multi-party Tele-consultation System based on APP | |
| CN116208851A (en) | Image processing method and related device | |
| WO2023010753A1 (en) | Color gamut mapping method and apparatus, terminal device, and storage medium | |
| CN113472439A (en) | OCC system utilizing multi-light source parallel transmission and control method | |
| CN110661785A (en) | Video processing method, device and system, electronic equipment and readable storage medium | |
| JP2013115666A (en) | Imaging apparatus, video recording apparatus, control method, program, and video recording system | |
| CN110753229A (en) | Video acquisition device and method based on H.265 coding | |
| US20230062933A1 (en) | Data processing method, apparatus, and device for non-sequential point cloud media | |
| CN202035109U (en) | Novel multichannel digital video server | |
| WO2022063060A1 (en) | System and method for processing dual-modal signal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |