Disclosure of Invention
In view of this, embodiments of the present invention provide a video encoding method for a combination device, which overcomes the encoding rate and solves the technical problem that the existing encoding technology cannot meet the user requirement in real time; the embodiment of the invention also provides a video coding system of the combined device, which solves the technical problem that the real-time reliable transmission of useful information carried in the video cannot be realized due to the unreasonable existing video coding system.
The video coding method of the combined device provided by the embodiment of the invention comprises the following steps:
step 10: acquiring a source video, and optimizing images in the source video according to a preset optimization model to form an optimized video;
step 20: obtaining an optimized video, and forming a video object in the optimized video according to a preset analysis model;
step 30: forming object coordinate information by the range of the video object in the optimized video;
step 40: acquiring an optimized video, a video object and corresponding object coordinate information thereof, and performing key optimization on the video object in a corresponding coordinate area in the optimized video according to a preset key optimization model to form a key optimized video;
step 50: obtaining an optimized video or a key optimized video, and carrying out video coding to form a coded video;
wherein, the video coding method of the joint apparatus further comprises:
step 60: acquiring a coded video or a key optimization video, a video object and corresponding object coordinate information thereof, and performing video optimization coding on the video object in a corresponding coordinate area in the coded video or the key optimization video according to a preset optimization coding model;
wherein, for step 40, further comprising:
step 41: distributing a corresponding key optimization model for the video object;
step 42: forming adaptive parallel key optimization sequences according to a preset key optimization distribution model in the key optimization process of the corresponding video object and the corresponding optimized video content, and distributing the adaptive parallel key optimization sequences to corresponding key optimization processing modules;
step 43: forming a dynamic connection structure of an image key optimization module, adapting to the key optimization sequence of the acquired corresponding video object, processing the corresponding optimized video content, and forming a corresponding key optimized video;
the method comprises the following steps that corresponding key optimization models are distributed to video objects according to the properties and the importance degree of the video objects, and different key optimization models correspond to different key optimization processing modules and corresponding key optimization processing methods;
when one key optimization processing module corresponds to a plurality of video objects, different processing parameters are selected to perform key optimization processing on the plurality of video objects respectively;
the preset optimization coding model adopts a corresponding video optimization coding strategy according to the property and the importance degree of the video object;
the embodiment of the invention provides a video coding system of a combined device, which comprises an image signal processor, an intelligent analysis processor, a video area capturing device, an image emphasis optimizing device and a video coder, wherein:
the image signal processor is used for acquiring a source video, and optimizing images in the source video according to a preset optimization model to form an optimized video;
the intelligent analysis processor is used for acquiring an optimized video and forming a video object in the optimized video according to a preset analysis model;
the video area capturing device is used for forming object coordinate information of the range of the video object in the optimized video;
the image key optimization device is used for acquiring an optimized video, a video object and corresponding object coordinate information thereof, and performing key optimization on the video object in a corresponding coordinate area in the optimized video according to a preset key optimization model to form a key optimized video;
the video encoder is used for acquiring an optimized video or a key optimized video, and performing video encoding to form an encoded video;
wherein the video coding system of the joint apparatus further comprises:
the video optimization coding device is used for acquiring a coded video or a key optimization video, a video object and corresponding object coordinate information thereof, and performing video optimization coding on the video object in a corresponding coordinate area in the coded video or the key optimization video according to a preset optimization coding model;
the image key optimization device further comprises a key optimization model distribution unit, a key optimization module control unit and a key optimization processing module, wherein:
the key optimization model distribution unit is used for distributing a corresponding key optimization model for the video object;
the key optimization module control unit is used for forming an adaptive parallel key optimization sequence according to a preset key optimization distribution model in the key optimization process of the corresponding video object and the corresponding optimized video content, and distributing the adaptive parallel key optimization sequence to the corresponding key optimization processing module;
and the key optimization processing module is used for forming a dynamic connection structure of the image key optimization module, adapting the obtained key optimization sequence of the corresponding video object, processing the corresponding optimized video content and forming a corresponding key optimized video.
According to the video coding method of the combination device, provided by the embodiment of the invention, an intelligent analysis process and an image key optimization process and/or a video optimization coding process are organically combined, different key optimization methods and/or optimization coding strategies are adopted for different video objects according to the result output by intelligent analysis, so that the real-time requirements of users on information carried in videos are met while the coding rate is overcome; the video coding system of the combination device provided by the embodiment of the invention ensures the real-time reliable transmission of the useful information in the video.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. The step numbers in the drawings are used only as reference numerals for the steps, and do not indicate the execution order.
As shown in fig. 1, a video encoding method of a joint apparatus according to an embodiment of the present invention includes:
step 10: acquiring a source video, and optimizing images in the source video according to a preset optimization model to form an optimized video;
step 20: obtaining an optimized video, and forming a video object in the optimized video according to a preset analysis model;
step 30: forming object coordinate information by the range of the video object in the optimized video;
step 40: acquiring an optimized video, a video object and corresponding object coordinate information thereof, and performing key optimization on the video object in a corresponding coordinate area in the optimized video according to a preset key optimization model to form a key optimized video;
step 50: obtaining an optimized video or a key optimized video, and carrying out video coding to form a coded video;
step 70: and outputting the compressed code stream as required.
An embodiment of the present invention provides a video encoding method for a combined device, which further includes, for step 40:
step 41: distributing a corresponding key optimization model for the video object;
step 42: forming adaptive parallel key optimization sequences according to a preset key optimization distribution model in the key optimization process of the corresponding video object and the corresponding optimized video content, and distributing the adaptive parallel key optimization sequences to corresponding key optimization processing modules;
step 43: and forming a dynamic connection structure of the image key optimization module, adapting the obtained key optimization sequence of the corresponding video object, processing the corresponding optimized video content, and forming a corresponding key optimized video.
The video object is an object, a range, a boundary, a symbol, and the like in a video scene that can be recognized in the preset analysis model, and includes but is not limited to a people stream region, a human face region, a vehicle stream region, a license plate region, and the like, and further includes but is not limited to the above object having a moving or moving state. The object coordinate information includes object coordinate information of at least one video object.
The parallel key optimization sequence includes, but is not limited to, one or more key optimization sequences of a single video object, one or more key optimization sequences of a plurality of video objects, a same key optimization sequence of a plurality of video objects, and the like.
In step 41, different emphasis optimization models are assigned to the video objects according to different properties and importance degrees of the video objects, and the different emphasis optimization models correspond to different emphasis optimization processing modules and corresponding emphasis optimization processing methods, where the emphasis optimization processing methods include, but are not limited to, image dead pixel repairing, white balance, gamma correction, sharpness, color interpolation, and the like, such that one video object may be assigned to one or more emphasis optimization processing modules for emphasis optimization processing, and one emphasis optimization processing module may also correspond to one or more video objects, and when one emphasis optimization processing module corresponds to multiple video objects, different processing parameters may be selected to perform emphasis optimization processing on the multiple video objects, respectively.
The video coding method of the combination device of the embodiment organically combines the intelligent analysis process and the image optimization process, performs image emphasis optimization processing on the corresponding area of the video object in the optimized video according to the analysis result fed back by the preset analysis model, and adopts different optimization processing methods according to the difference of the properties and the importance degree of the video object, so that the visual effect of the area which is interested by a user is obviously enhanced, the subsequent observation and analysis are facilitated, the bandwidth occupied by the area which is not interested is smaller, and the video coding method is more suitable for the transmission of code streams.
As shown in fig. 2, another embodiment of the present invention provides a video encoding method for a joint apparatus, further comprising:
step 60: acquiring a coded video or a key optimization video, a video object and corresponding object coordinate information thereof, and performing video optimization coding on the video object in a corresponding coordinate area in the coded video or the key optimization video according to a preset optimization coding model.
The preset optimized coding model also adopts corresponding different optimized coding strategies according to different properties and importance degrees of the video objects. The video optimization coding and the video coding are carried out in a synchronous and/or asynchronous mode. The synchronization can accelerate the optimization speed, the asynchronization can improve the optimization quality, and the combination of the synchronization and the asynchronization can balance the optimization effect and the operation load.
The video coding method of the combination unit provided in this embodiment combines an intelligent analysis process, an image optimization process, and an optimization coding process, further performs an optimization coding process on a corresponding region of a video object in a coded video or a key optimization video according to an analysis result fed back by a preset analysis model, and respectively adopts different optimization coding strategies according to differences in properties and importance degrees of the video object, thereby overcoming a coding rate and further satisfying a real-time requirement of a user on information carried in the video.
As shown in fig. 3, the video coding system of the integrated device according to the embodiment of the present invention includes an image signal processor 80, an intelligent analysis processor 90, a video area capturing device 91, an image emphasis optimizing device 81, and a video encoder 100, wherein:
the image signal processor 80 is configured to obtain a source video, and optimize an image in the source video according to a preset optimization model to form an optimized video;
the intelligent analysis processor 90 is used for acquiring an optimized video and forming a video object in the optimized video according to a preset analysis model;
a video area capturing means 91 for forming a range of the video object in the optimized video into object coordinate information;
the image key optimization device 81 is used for acquiring an optimized video, a video object and corresponding object coordinate information thereof, and performing key optimization on the video object in a corresponding coordinate area in the optimized video according to a preset key optimization model to form a key optimized video;
the video encoder 100 is configured to obtain an optimized video or an emphasized optimized video, and perform video encoding to form an encoded video.
In the video coding system of the combination apparatus provided in an embodiment of the present invention, the image emphasis optimization apparatus 81 further includes an emphasis optimization model allocation unit 82, an emphasis optimization module control unit 83, and an emphasis optimization processing module 84, where:
a key optimization model allocation unit 82, configured to allocate a corresponding key optimization model to the video object;
a key optimization module control unit 83, configured to form an adaptive parallel key optimization sequence according to a preset key optimization allocation model according to the key optimization process of the corresponding video object and the corresponding optimized video content, and allocate the adaptive parallel key optimization sequence to the corresponding key optimization processing module 84;
and the key optimization processing module 84 is configured to form a dynamic connection structure of the image key optimization module, adapt the obtained key optimization sequence of the corresponding video object, process the corresponding optimized video content, and form a corresponding key optimized video.
In an embodiment of the present invention, the key optimization model allocating unit 82 allocates different key optimization models to the video objects according to different properties and importance degrees of the video objects, where the different key optimization models correspond to different key optimization processing modules 84 and corresponding key optimization processing methods, so that a video object may be allocated to one or more key optimization processing modules 84, and a key optimization processing module 84 may also correspond to one or more video objects, and when a key optimization processing module 84 corresponds to a plurality of video objects, different processing parameters may be selected to perform key optimization processing on the plurality of video objects, respectively.
In an embodiment of the present invention, the function of the intelligent analysis processor 90 is implemented by a neural network processing unit (or a neural network processor), and the flexibility of the functional configuration is strong, so that the parallel processing quantity and the processing performance of the functional modules can be improved.
As shown in fig. 4, the video coding system of the combination apparatus according to another embodiment of the present invention further includes a video optimization coding apparatus 101, configured to obtain a coded video or an emphasized optimized video, a video object, and corresponding object coordinate information thereof, and perform video optimization coding on the video object in a corresponding coordinate area in the coded video or the emphasized optimized video according to a preset optimization coding model.
The preset optimized coding model also adopts corresponding different optimized coding strategies according to different properties and importance degrees of the video objects.
The video coding device of the combination device provided by the embodiment of the invention organically combines the intelligent analysis processor, the image signal processor and the coder, and adopts different key optimization processing methods and/or optimization coding strategies aiming at different video objects according to the analysis result output by the intelligent analysis processor, thereby not only solving the transmission problem of the coding rate, but also ensuring the real-time reliable transmission of useful information in the video.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and the like that are within the spirit and principle of the present invention are included in the present invention.