CN117579896B - Unmanned aerial vehicle video transmission processing method, device, equipment and storage medium - Google Patents
Unmanned aerial vehicle video transmission processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN117579896B CN117579896B CN202410054721.4A CN202410054721A CN117579896B CN 117579896 B CN117579896 B CN 117579896B CN 202410054721 A CN202410054721 A CN 202410054721A CN 117579896 B CN117579896 B CN 117579896B
- Authority
- CN
- China
- Prior art keywords
- video
- target
- standard format
- aerial vehicle
- unmanned aerial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 83
- 238000003672 processing method Methods 0.000 title claims description 23
- 238000012545 processing Methods 0.000 claims abstract description 36
- 238000000034 method Methods 0.000 claims abstract description 29
- 238000006243 chemical reaction Methods 0.000 claims abstract description 9
- 238000007906 compression Methods 0.000 claims description 22
- 230000006835 compression Effects 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 15
- 238000004364 calculation method Methods 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 6
- 230000006870 function Effects 0.000 claims description 6
- 238000005286 illumination Methods 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 6
- 238000009432 framing Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 6
- 238000007689 inspection Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 2
- 238000007405 data analysis Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/71—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23109—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion by placing content in organized collections, e.g. EPG data repository
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The application relates to the technical field of image transmission and provides a method, a device, equipment and a storage medium for processing unmanned aerial vehicle video transmission, wherein the method comprises the steps of carrying out standard format processing on unmanned aerial vehicle video to obtain standard format video, and storing the standard format video into a buffer arranged on an unmanned aerial vehicle; coding the video in the standard format to obtain coded video, and carrying out feature coding on the video in the standard format to obtain feature identification; transmitting the encoded video to a server; the server is provided with a plurality of databases, and each database is provided with different database identifications; matching the coded video with a target database based on the characteristic identification and each database identification, and storing the coded video into the target database; responding to an acquisition request of a user for the coded video, performing format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to terminal equipment of the user. The method can improve the stability of unmanned aerial vehicle video transmission processing.
Description
Technical Field
The application relates to the technical field of image transmission, in particular to an unmanned aerial vehicle video transmission processing method, device, equipment and storage medium.
Background
With the continuous development of unmanned aerial vehicle aerial photography technology, unmanned aerial vehicle aerial photography technology is widely applied in the fields of emergency communication, public security technology detection, electric power line inspection, oil field wireless network remote coverage, pipeline inspection, unmanned aerial vehicle ocean monitoring, fire protection and the like, and unmanned aerial vehicle video transmission processing is one of key links of unmanned aerial vehicle aerial photography technology and is widely paid attention to.
The existing unmanned aerial vehicle video transmission processing method generally transmits videos shot by an unmanned aerial vehicle to receiving equipment on the ground directly through specific transmission equipment, and the transmission stability of the method is poor, so that the video quality is easily reduced, and the aerial shooting experience of a user is affected.
Disclosure of Invention
The application provides an unmanned aerial vehicle video transmission processing method, device, equipment and storage medium, so as to solve the problems of the background technology.
In a first aspect, the present application provides a method for processing video transmission of an unmanned aerial vehicle, including:
controlling an illumination device of the unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through a camera device of the unmanned aerial vehicle, performing standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle;
Determining a target coding mode of the standard format video based on the byte number of the standard format video, coding the standard format video based on the target coding mode to obtain a coded video, and performing feature coding on the standard format video to obtain a feature identifier of the standard format video;
transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications;
matching the coded video with a target database based on the characteristic identification and each database identification, and storing the coded video into the target database;
responding to an acquisition request of a user for the coded video, performing format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to terminal equipment of the user based on a preset transmission protocol.
In one implementation, the determining the target coding mode of the standard format video based on the byte number of the standard format video includes:
if the byte number is smaller than a first preset byte number, determining that the first coding mode is the target coding mode;
If the byte number is not less than the first preset byte number and is less than the second preset byte number, determining a second coding mode as the target coding mode;
if the byte number is not less than the second preset byte number, determining that the third coding mode is the target coding mode;
the second preset byte number is larger than the first preset byte number, the compression rate of the first coding mode is smaller than that of the second coding mode, and the third coding mode comprises a video segmentation process and a video compression process.
In one implementation manner, if the target coding mode is the third coding mode, the coding processing is performed on the standard format video based on the target coding mode to obtain a coded video, including:
dividing the standard format video based on a preset dividing rule of the third coding mode to obtain a plurality of initial video segments, and respectively marking a first serial number of each video segment based on the playing sequence of the standard format video to obtain a plurality of target video segments;
aiming at each target video segment, compressing the target video segment based on a preset compression rule of the third coding mode to obtain a coded video segment;
And sequentially arranging the coded video clips based on the first serial numbers corresponding to the coded video clips to obtain the coded video.
In one implementation manner, the compressing the target video segment based on the preset compression rule of the third coding manner to obtain a coded video segment includes:
framing the coded video segments to obtain a plurality of initial image frames, and respectively marking the second serial numbers of the initial image frames based on the playing sequence of the coded video segments to obtain a plurality of target image frames;
calculating the chromaticity of each pixel in each target image frame based on a preset chromaticity calculation function for each target image frame, and calculating chromaticity standard differences among all the chromaticities of the target image frames;
inputting a chromaticity standard deviation corresponding to each target image frame into a preset compression rate calculation function to obtain the compression rate of the target image frame, and compressing the target image frame based on the compression rate to obtain an encoded image frame;
and based on the second serial numbers corresponding to the coded image frames, arranging the coded image frames in sequence to obtain the coded video segments.
In one implementation manner, the feature encoding the standard format video to obtain the feature identifier of the standard format video includes:
and inputting the standard format video into a preset feature identification extraction model to obtain the feature identification of the standard format video.
In one implementation, the matching the encoded video for the target database based on the feature identification and each of the database identifications includes:
determining an intermediate target database identification set matched with each feature identification character based on each database identification aiming at each feature identification character in the feature identifications; wherein the set of intermediate target database identifications comprises at least one target database identification comprising the feature identification character;
determining a target database identification set in all the intermediate target database identification sets; the number of the target database identifiers in the target database identifier set is equal to the number of the characteristic identifier characters of the characteristic identifiers;
acquiring a preset initial character sequence; the initial character sequence includes a plurality of character slots;
and sequentially inserting database identification characters of the target database identifications in the designated positions into the character gaps aiming at each target database identification in the target database identification set to obtain a target character sequence, and determining a database corresponding to the target database identification as the target database when the target character sequence is consistent with the characteristic identifications.
In one implementation, before transmitting the target video to the terminal device of the user based on a preset transmission protocol, the method further includes:
acquiring a device identifier of the terminal device, and determining a target character in the feature identifier and the device identifier; wherein the target character is a character which does not repeatedly appear in the feature identifier and the equipment identifier;
sequentially arranging target characters in the feature identifiers to obtain a first initial encryption sequence, and sequentially arranging target characters in the equipment identifiers to obtain a second initial encryption sequence;
comparing the first number to the second number; wherein the first number is the number of target characters of the first initial encryption sequence and the second number is the number of target characters of the second initial encryption sequence;
if the first number is not less than the second number, sequentially inserting each target character in the second initial encryption sequence into a target character gap of the first initial encryption sequence to obtain an intermediate encryption sequence;
counting the occurrence times of the target characters in all the database identifications aiming at each target character of the intermediate encryption sequence, and determining the target characters as target encryption characters when the occurrence times of the target characters in all the database identifications are the total number;
And sequentially arranging the target encryption characters based on the positions of the target encryption characters in the intermediate encryption sequence to obtain a target encryption sequence, and carrying out encryption processing on the target video based on the target encryption sequence.
In a second aspect, the present application provides an unmanned aerial vehicle video transmission processing device, including:
the acquisition module is used for controlling the lighting device of the unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through the camera device of the unmanned aerial vehicle, carrying out standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle;
the encoding module is used for determining a target encoding mode of the standard format video based on the byte number of the standard format video, encoding the standard format video based on the target encoding mode to obtain an encoded video, and performing feature encoding on the standard format video to obtain a feature identifier of the standard format video;
the first transmission module is used for transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications;
The matching module is used for matching the coded video with a target database based on the characteristic identification and the database identifications, and storing the coded video into the target database;
the second transmission module is used for responding to the acquisition request of the user for the coded video, carrying out format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to the terminal equipment of the user based on a preset transmission protocol.
In a third aspect, the present application provides a terminal device, the terminal device comprising a processor, a memory and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the unmanned aerial vehicle video transmission processing method as described above.
In a fourth aspect, the present application provides a computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the unmanned aerial vehicle video transmission processing method as described above.
The application provides an unmanned aerial vehicle video transmission processing method, device, equipment and storage medium, wherein the method comprises the steps of controlling an illumination device of an unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through a camera device of the unmanned aerial vehicle, carrying out standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle; determining a target coding mode of the standard format video based on the byte number of the standard format video, coding the standard format video based on the target coding mode to obtain a coded video, and performing feature coding on the standard format video to obtain a feature identifier of the standard format video; transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications; matching the coded video with a target database based on the characteristic identification and each database identification, and storing the coded video into the target database; responding to an acquisition request of a user for the coded video, performing format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to terminal equipment of the user based on a preset transmission protocol. According to the method, on one hand, the standard format video is stored in a buffer arranged on the unmanned aerial vehicle, when the standard format video is lost or damaged in the transmission process under the condition of unstable network, the standard format video can be re-extracted in the buffer, the integrity of the standard format video is ensured, the stability of the unmanned aerial vehicle video transmission processing is improved, on the other hand, the target coding mode of the standard format video is determined based on the byte number of the standard format video, the standard format video is coded based on the target coding mode, the transmission efficiency of the standard format video is improved, and when the byte number of the standard format video is too large, the third coding mode is adopted to code the standard format video, so that the probability of damaging the standard format video can be reduced as much as possible, on the other hand, the coded video is transmitted to a server based on the preset transmission protocol, the characteristic identification and each database identification are matched with the coded video, the video is stored in the target database, the video is coded, and the efficient stability of the unmanned aerial vehicle is realized.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flow chart of a video transmission processing method of an unmanned aerial vehicle according to an embodiment of the present application;
fig. 2 is a schematic block diagram of a structure of a video transmission processing device of an unmanned aerial vehicle according to an embodiment of the present application;
fig. 3 is a schematic block diagram of a structure of a terminal device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The flow diagrams depicted in the figures are merely illustrative and not necessarily all of the elements and operations/steps are included or performed in the order described. For example, some operations/steps may be further divided, combined, or partially combined, so that the order of actual execution may be changed according to actual situations.
It is also to be understood that the terminology used in the description of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
It should be further understood that the term "and/or" as used in this specification and the appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes such combinations.
With the continuous development of unmanned aerial vehicle aerial photography technology, unmanned aerial vehicle aerial photography technology is widely applied in the fields of emergency communication, public security technology detection, electric power line inspection, oil field wireless network remote coverage, pipeline inspection, unmanned aerial vehicle ocean monitoring, fire protection and the like, and unmanned aerial vehicle video transmission processing is one of key links of unmanned aerial vehicle aerial photography technology and is widely paid attention to.
The existing unmanned aerial vehicle video transmission processing method generally transmits videos shot by an unmanned aerial vehicle to receiving equipment on the ground directly through specific transmission equipment, and the transmission stability of the method is poor, so that the video quality is easily reduced, and the aerial shooting experience of a user is affected. Therefore, the embodiment of the application provides a method, a device, equipment and a storage medium for processing video transmission of an unmanned aerial vehicle, so as to solve the problems.
Some embodiments of the present application are described in detail below with reference to the accompanying drawings. The following embodiments and features of the embodiments may be combined with each other without conflict.
Referring to fig. 1, fig. 1 is a flowchart of a method for processing video transmission of a drone according to an embodiment of the present application, and as shown in fig. 1, the method for processing video transmission of a drone according to an embodiment of the present application includes steps S100 to S500.
Step S100, controlling an illumination device of the unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through a camera device of the unmanned aerial vehicle, carrying out standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle.
The method for carrying out standard format processing on the unmanned aerial vehicle video is to carry out standard format processing on the unmanned aerial vehicle video by utilizing a protocol analyzer arranged on the unmanned aerial vehicle, wherein the protocol analyzer comprises a data analysis module and a protocol matching module, the data analysis module is used for extracting key video data of the unmanned aerial vehicle video, such as image frame information, time stamps corresponding to each image frame information, picture resolution of each image frame and the like, and the protocol matching module is used for identifying a transmission protocol of the unmanned aerial vehicle video and analyzing the key video data based on the transmission protocol to obtain the standard format video.
It can be appreciated that the illumination device of the unmanned aerial vehicle irradiates the target area, so that the camera device can be helped to accurately acquire the video of the target area.
It can be understood that the standard format video is stored in a buffer provided on the unmanned aerial vehicle, so that when the standard format video is lost or damaged in the transmission process under the condition of unstable network, the standard format video can be re-extracted in the buffer, and the integrity of the standard format video is ensured.
Step 200, determining a target coding mode of the standard format video based on the byte number of the standard format video, coding the standard format video based on the target coding mode to obtain a coded video, and performing feature coding on the standard format video to obtain a feature identifier of the standard format video.
It should be noted that, the determining the target coding manner of the standard format video based on the byte number of the standard format video includes the following steps:
if the byte number is smaller than a first preset byte number, determining that the first coding mode is the target coding mode;
if the byte number is not less than the first preset byte number and is less than the second preset byte number, determining a second coding mode as the target coding mode;
If the byte number is not less than the second preset byte number, determining that the third coding mode is the target coding mode;
the second preset byte number is larger than the first preset byte number, the compression rate of the first coding mode is smaller than that of the second coding mode, and the third coding mode comprises a video segmentation process and a video compression process. For example, the first coding mode is h.265/HEVC, the second coding mode is h.264/AVC, and the third coding mode is a combination of a video segmentation process and h.265/HEVC or a combination of a video segmentation process and h.264/AVC.
It will be appreciated that the first encoding scheme and the second encoding scheme do not include a video segmentation process.
It can be understood that, the target coding manner determined by the above method is on the one hand helpful for improving the transmission efficiency of the standard format video, and on the other hand, when the number of bytes is not less than the second preset number of bytes, the third coding manner is used for coding the standard format video, so that the probability of damaging the standard format video can be reduced as much as possible.
It should be noted that, the feature encoding is performed on the standard format video to obtain the feature identifier of the standard format video, and the method includes the following steps:
And inputting the standard format video into a preset feature identification extraction model to obtain the feature identification of the standard format video. The feature identification extraction model comprises an input layer, a feature extraction layer, a feature identification generation layer and an output layer, wherein the input layer is used for receiving the standard format video, the feature extraction layer is used for extracting video features of the standard format video, the feature identification generation layer is used for generating the feature identification based on the video features, and the output layer is used for outputting the feature identification.
Step S300, transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications.
Wherein the transmission protocol is any one of HTTP, FTP, RTP/RTSP, UDP, RTMP and WebRTC.
Step S400, matching the coded video with a target database based on the feature identifiers and the database identifiers, and storing the coded video in the target database.
It should be noted that, the matching target database for the encoded video based on the feature identifier and the database identifiers includes the following steps:
Determining an intermediate target database identification set matched with each feature identification character based on each database identification aiming at each feature identification character in the feature identifications; wherein the set of intermediate target database identifications comprises at least one target database identification comprising the feature identification character;
determining a target database identification set in all the intermediate target database identification sets; the number of the target database identifiers in the target database identifier set is equal to the number of the characteristic identifier characters of the characteristic identifiers;
acquiring a preset initial character sequence; the initial character sequence includes a plurality of character slots;
and sequentially inserting database identification characters of the target database identifications in the designated positions into the character gaps aiming at each target database identification in the target database identification set to obtain a target character sequence, and determining a database corresponding to the target database identification as the target database when the target character sequence is consistent with the characteristic identifications.
It will be appreciated that the number of character slots is equal to the number of feature identification characters of the feature identification.
It can be appreciated that the method can accurately match the target database for the encoded video, thereby facilitating the management of the encoded video and the quick finding of the position of the encoded video when the user retrieves the encoded video.
And step 500, responding to an acquisition request of a user for the coded video, performing format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to terminal equipment of the user based on a preset transmission protocol.
Wherein the acquisition request includes a format requirement of the target video by a user, and the transmission protocol is any one of HTTP, FTP, RTP/RTSP, UDP, RTMP and WebRTC.
According to the method provided by the embodiment, on one hand, the standard format video is stored in the buffer arranged on the unmanned aerial vehicle, when the standard format video is lost or damaged in the transmission process under the condition of unstable network, the standard format video can be re-extracted in the buffer, the integrity of the standard format video is ensured, the stability of the unmanned aerial vehicle video transmission processing is improved, on the other hand, the target coding mode of the standard format video is determined based on the byte number of the standard format video, the standard format video is coded based on the target coding mode, the transmission efficiency of the standard format video is improved, and when the byte number of the standard format video is too large, the third coding mode is adopted to code the standard format video, so that the probability of damaging the standard format video can be reduced as much as possible, on the other hand, the coded video is transmitted to the server based on the preset transmission protocol, the characteristic identification and the database identification are matched with the video, and the target video is stored in the target database, so that the stability of the unmanned aerial vehicle is effectively coded.
In some embodiments, if the target coding mode is the third coding mode, the coding processing is performed on the standard format video based on the target coding mode to obtain a coded video, which includes the following steps:
dividing the standard format video based on a preset dividing rule of the third coding mode to obtain a plurality of initial video segments, and respectively marking a first serial number of each video segment based on the playing sequence of the standard format video to obtain a plurality of target video segments;
aiming at each target video segment, compressing the target video segment based on a preset compression rule of the third coding mode to obtain a coded video segment;
and sequentially arranging the coded video clips based on the first serial numbers corresponding to the coded video clips to obtain the coded video.
It should be noted that, the compressing process is performed on the target video segment based on the preset compression rule of the third encoding mode to obtain an encoded video segment, which includes the following steps:
framing the coded video segments to obtain a plurality of initial image frames, and respectively marking the second serial numbers of the initial image frames based on the playing sequence of the coded video segments to obtain a plurality of target image frames;
Calculating the chromaticity of each pixel in each target image frame based on a preset chromaticity calculation function for each target image frame, and calculating chromaticity standard differences among all the chromaticities of the target image frames;
inputting a chromaticity standard deviation corresponding to each target image frame into a preset compression rate calculation function to obtain the compression rate of the target image frame, and compressing the target image frame based on the compression rate to obtain an encoded image frame;
and based on the second serial numbers corresponding to the coded image frames, arranging the coded image frames in sequence to obtain the coded video segments.
As can be appreciated, when the chromaticity standard deviations corresponding to the target image frames are inconsistent, if the same compression rate is used to compress the target image frames, the problem of uneven video quality distribution of the compressed encoded video segments can be caused.
In some embodiments, before transmitting the target video to the user's terminal device based on a preset transmission protocol, the method further comprises the steps of:
acquiring a device identifier of the terminal device, and determining a target character in the feature identifier and the device identifier; wherein the target character is a character which does not repeatedly appear in the feature identifier and the equipment identifier;
sequentially arranging target characters in the feature identifiers to obtain a first initial encryption sequence, and sequentially arranging target characters in the equipment identifiers to obtain a second initial encryption sequence;
comparing the first number to the second number; wherein the first number is the number of target characters of the first initial encryption sequence and the second number is the number of target characters of the second initial encryption sequence;
if the first number is not less than the second number, sequentially inserting each target character in the second initial encryption sequence into a target character gap of the first initial encryption sequence to obtain an intermediate encryption sequence;
if the first number is smaller than the second number, sequentially inserting each target character in the first initial encryption sequence into a target character gap of the second initial encryption sequence to obtain an intermediate encryption sequence;
Counting the occurrence times of the target characters in all the database identifications aiming at each target character of the intermediate encryption sequence, and determining the target characters as target encryption characters when the occurrence times of the target characters in all the database identifications are the total number;
and sequentially arranging the target encryption characters based on the positions of the target encryption characters in the intermediate encryption sequence to obtain a target encryption sequence, and carrying out encryption processing on the target video based on the target encryption sequence.
Illustratively, the device identifier of the terminal device is qbgfhewlck, the feature identifier is MBTFHNYACU, the first initial encryption sequence is qgraewlk, the second initial encryption sequence is MTNYAU, the intermediate encryption sequence is QMGTRNEYWA LUK, and the respective target characters Q, M, G, T, R, N, E, Y, W, a, L, U, K of the intermediate encryption sequence occur 12, 13, 17, 11, 18, 23, 24, 14, 16, 19, 21, 13, 22, respectively, in all of the database identifiers, and the target encryption sequence is QREYWLK.
According to the method, by conducting encryption processing on the target video, unauthorized persons can be prevented from obtaining the target video, safety of the target video in the transmission process is improved, and benefits brought by the target video to the user are further guaranteed.
Referring to fig. 2, fig. 2 is a schematic block diagram of a structure of a video transmission processing device 100 of a drone according to an embodiment of the present application, where the video transmission processing device 100 of a drone according to an embodiment of the present application shown in fig. 2 includes:
the acquisition module 110 is used for controlling the lighting device of the unmanned aerial vehicle to irradiate the target area, acquiring the unmanned aerial vehicle video of the target area through the camera device of the unmanned aerial vehicle, carrying out standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle.
The encoding module 120 is configured to determine a target encoding manner of the standard format video based on the byte number of the standard format video, encode the standard format video based on the target encoding manner to obtain an encoded video, and perform feature encoding on the standard format video to obtain a feature identifier of the standard format video.
A first transmission module 130, configured to transmit the encoded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications.
And the matching module 140 is used for matching the coded video with a target database based on the characteristic identification and each database identification, and storing the coded video into the target database.
The second transmission module 150 is configured to respond to an acquisition request of a user for the encoded video, perform format conversion on the encoded video based on the acquisition request to obtain a target video, and transmit the target video to a terminal device of the user based on a preset transmission protocol.
It should be noted that, for convenience and brevity of description, specific working processes of the above-described apparatus and each module may refer to corresponding processes in the foregoing embodiment of the unmanned aerial vehicle video transmission processing method, which is not described herein again.
The unmanned aerial vehicle video transmission processing apparatus 100 provided in the above-described embodiment may be implemented in the form of a computer program that can be run on the terminal device 200 as shown in fig. 3.
Referring to fig. 3, fig. 3 is a schematic block diagram of a structure of a terminal device 200 according to an embodiment of the present application, where the terminal device 200 includes a processor 201 and a memory 202, and the processor 201 and the memory 202 are connected through a system bus 203, and the memory 202 may include a nonvolatile storage medium and an internal memory.
The non-volatile storage medium may store a computer program. The computer program comprises program instructions that, when executed by the processor 201, cause the processor 201 to perform any of the unmanned aerial vehicle video transmission processing methods described above.
The processor 201 is used to provide computing and control capabilities supporting the operation of the overall terminal device 200.
The internal memory provides an environment for the execution of a computer program in a non-volatile storage medium, which when executed by the processor 201, causes the processor 201 to perform any of the drone video transmission processing methods described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 3 is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation of the terminal device 200 related to the present application, and that a specific terminal device 200 may include more or less components than those shown in the drawings, or may combine some components, or have a different arrangement of components.
It should be appreciated that the processor 201 may be a central processing unit (Central Processing Unit, CPU), and the processor 201 may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. Wherein the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
In some embodiments, the processor 201 is configured to execute a computer program stored in the memory to implement the following steps:
controlling an illumination device of the unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through a camera device of the unmanned aerial vehicle, performing standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle;
determining a target coding mode of the standard format video based on the byte number of the standard format video, coding the standard format video based on the target coding mode to obtain a coded video, and performing feature coding on the standard format video to obtain a feature identifier of the standard format video;
transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications;
matching the coded video with a target database based on the characteristic identification and each database identification, and storing the coded video into the target database;
Responding to an acquisition request of a user for the coded video, performing format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to terminal equipment of the user based on a preset transmission protocol.
The embodiment of the application also provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and when the computer program is executed by one or more processors, the one or more processors implement the unmanned aerial vehicle video transmission processing method provided by the embodiment of the application.
The computer readable storage medium may be an internal storage unit of the terminal device 200 of the foregoing embodiment, for example, a hard disk or a memory of the terminal device 200. The computer readable storage medium may also be an external storage device of the terminal device 200, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which the terminal device 200 is equipped with.
While the invention has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. The unmanned aerial vehicle video transmission processing method is characterized by comprising the following steps of:
controlling an illumination device of the unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through a camera device of the unmanned aerial vehicle, performing standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle;
determining a target coding mode of the standard format video based on the byte number of the standard format video, coding the standard format video based on the target coding mode to obtain a coded video, and performing feature coding on the standard format video to obtain a feature identifier of the standard format video;
transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications;
matching the coded video with a target database based on the characteristic identification and each database identification, and storing the coded video into the target database;
responding to an acquisition request of a user for the coded video, performing format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to terminal equipment of the user based on a preset transmission protocol.
2. The unmanned aerial vehicle video transmission processing method of claim 1, wherein the determining the target encoding mode of the standard format video based on the byte count of the standard format video comprises:
if the byte number is smaller than a first preset byte number, determining that the first coding mode is the target coding mode;
if the byte number is not less than the first preset byte number and is less than the second preset byte number, determining a second coding mode as the target coding mode;
if the byte number is not less than the second preset byte number, determining that the third coding mode is the target coding mode;
the second preset byte number is larger than the first preset byte number, the compression rate of the first coding mode is smaller than that of the second coding mode, and the third coding mode comprises a video segmentation process and a video compression process.
3. The unmanned aerial vehicle video transmission processing method of claim 2, wherein if the target coding mode is the third coding mode, the encoding processing is performed on the standard format video based on the target coding mode to obtain an encoded video, comprising:
Dividing the standard format video based on a preset dividing rule of the third coding mode to obtain a plurality of initial video segments, and respectively marking a first serial number of each video segment based on the playing sequence of the standard format video to obtain a plurality of target video segments;
aiming at each target video segment, compressing the target video segment based on a preset compression rule of the third coding mode to obtain a coded video segment;
and sequentially arranging the coded video clips based on the first serial numbers corresponding to the coded video clips to obtain the coded video.
4. The unmanned aerial vehicle video transmission processing method of claim 3, wherein the compressing the target video segment based on the preset compression rule of the third encoding mode to obtain an encoded video segment comprises:
framing the coded video segments to obtain a plurality of initial image frames, and respectively marking the second serial numbers of the initial image frames based on the playing sequence of the coded video segments to obtain a plurality of target image frames;
Calculating the chromaticity of each pixel in each target image frame based on a preset chromaticity calculation function for each target image frame, and calculating chromaticity standard differences among all the chromaticities of the target image frames;
inputting a chromaticity standard deviation corresponding to each target image frame into a preset compression rate calculation function to obtain the compression rate of the target image frame, and compressing the target image frame based on the compression rate to obtain an encoded image frame;
and based on the second serial numbers corresponding to the coded image frames, arranging the coded image frames in sequence to obtain the coded video segments.
5. The unmanned aerial vehicle video transmission processing method of claim 1, wherein the feature encoding the standard format video to obtain the feature identifier of the standard format video comprises:
and inputting the standard format video into a preset feature identification extraction model to obtain the feature identification of the standard format video.
6. The unmanned aerial vehicle video transmission processing method of claim 1, wherein the matching the target database for the encoded video based on the feature identification and the respective database identification comprises:
Determining an intermediate target database identification set matched with each feature identification character based on each database identification aiming at each feature identification character in the feature identifications; wherein the set of intermediate target database identifications comprises at least one target database identification comprising the feature identification character;
determining a target database identification set in all the intermediate target database identification sets; the number of the target database identifiers in the target database identifier set is equal to the number of the characteristic identifier characters of the characteristic identifiers;
acquiring a preset initial character sequence; the initial character sequence includes a plurality of character slots;
and sequentially inserting database identification characters of the target database identifications in the designated positions into the character gaps aiming at each target database identification in the target database identification set to obtain a target character sequence, and determining a database corresponding to the target database identification as the target database when the target character sequence is consistent with the characteristic identifications.
7. The unmanned aerial vehicle video transmission processing method of claim 1, wherein before transmitting the target video to the user's terminal device based on a preset transmission protocol, the method further comprises:
Acquiring a device identifier of the terminal device, and determining a target character in the feature identifier and the device identifier; wherein the target character is a character which does not repeatedly appear in the feature identifier and the equipment identifier;
sequentially arranging target characters in the feature identifiers to obtain a first initial encryption sequence, and sequentially arranging target characters in the equipment identifiers to obtain a second initial encryption sequence;
comparing the first number to the second number; wherein the first number is the number of target characters of the first initial encryption sequence and the second number is the number of target characters of the second initial encryption sequence;
if the first number is not less than the second number, sequentially inserting each target character in the second initial encryption sequence into a target character gap of the first initial encryption sequence to obtain an intermediate encryption sequence;
counting the occurrence times of the target characters in all the database identifications aiming at each target character of the intermediate encryption sequence, and determining the target characters as target encryption characters when the occurrence times of the target characters in all the database identifications are the total number;
And sequentially arranging the target encryption characters based on the positions of the target encryption characters in the intermediate encryption sequence to obtain a target encryption sequence, and carrying out encryption processing on the target video based on the target encryption sequence.
8. An unmanned aerial vehicle video transmission processing apparatus, characterized by comprising:
the acquisition module is used for controlling the lighting device of the unmanned aerial vehicle to irradiate a target area, acquiring an unmanned aerial vehicle video of the target area through the camera device of the unmanned aerial vehicle, carrying out standard format processing on the unmanned aerial vehicle video to obtain a standard format video, and storing the standard format video into a buffer arranged on the unmanned aerial vehicle;
the encoding module is used for determining a target encoding mode of the standard format video based on the byte number of the standard format video, encoding the standard format video based on the target encoding mode to obtain an encoded video, and performing feature encoding on the standard format video to obtain a feature identifier of the standard format video;
the first transmission module is used for transmitting the coded video to a server based on a preset transmission protocol; the server is provided with a plurality of databases, and each database is provided with different database identifications;
The matching module is used for matching the coded video with a target database based on the characteristic identification and the database identifications, and storing the coded video into the target database;
the second transmission module is used for responding to the acquisition request of the user for the coded video, carrying out format conversion on the coded video based on the acquisition request to obtain a target video, and transmitting the target video to the terminal equipment of the user based on a preset transmission protocol.
9. A terminal device, characterized in that the terminal device comprises a processor, a memory and a computer program stored on the memory and executable by the processor, wherein the computer program, when executed by the processor, implements the unmanned aerial vehicle video transmission processing method according to any one of claims 1 to 7.
10. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and wherein the computer program, when executed by a processor, implements the unmanned aerial vehicle video transmission processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410054721.4A CN117579896B (en) | 2024-01-15 | 2024-01-15 | Unmanned aerial vehicle video transmission processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410054721.4A CN117579896B (en) | 2024-01-15 | 2024-01-15 | Unmanned aerial vehicle video transmission processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117579896A CN117579896A (en) | 2024-02-20 |
| CN117579896B true CN117579896B (en) | 2024-04-02 |
Family
ID=89886539
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410054721.4A Active CN117579896B (en) | 2024-01-15 | 2024-01-15 | Unmanned aerial vehicle video transmission processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117579896B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020057609A1 (en) * | 2018-09-20 | 2020-03-26 | 深圳市道通智能航空技术有限公司 | Image transmission method and apparatus, image sending terminal, and aircraft image transmission system |
| CN111343455A (en) * | 2020-02-25 | 2020-06-26 | 西安万像电子科技有限公司 | Encoding mode determining method and device |
| CN115329378A (en) * | 2022-08-15 | 2022-11-11 | 安徽省极光智能科技有限公司 | Unmanned aerial vehicle air patrol platform with encryption function |
| CN115348422A (en) * | 2022-08-12 | 2022-11-15 | 亿航智能设备（广州）有限公司 | Unmanned aerial vehicle image transmission method, system and computer readable storage medium |
-
2024
- 2024-01-15 CN CN202410054721.4A patent/CN117579896B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020057609A1 (en) * | 2018-09-20 | 2020-03-26 | 深圳市道通智能航空技术有限公司 | Image transmission method and apparatus, image sending terminal, and aircraft image transmission system |
| CN111343455A (en) * | 2020-02-25 | 2020-06-26 | 西安万像电子科技有限公司 | Encoding mode determining method and device |
| CN115348422A (en) * | 2022-08-12 | 2022-11-15 | 亿航智能设备（广州）有限公司 | Unmanned aerial vehicle image transmission method, system and computer readable storage medium |
| CN115329378A (en) * | 2022-08-15 | 2022-11-11 | 安徽省极光智能科技有限公司 | Unmanned aerial vehicle air patrol platform with encryption function |
Non-Patent Citations (1)
| Title |
|---|
| 基于航天视频监测的H265编码***设计;周鑫;王安迪;陆壮志;万志江;;军民两用技术与产品;20180908(第17期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117579896A (en) | 2024-02-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11418677B2 (en) | Method for preventing image modification, image capturing device and image verification method | |
| CN111898416A (en) | Video stream processing method and device, computer equipment and storage medium | |
| CN112104570A (en) | Traffic classification method and device, computer equipment and storage medium | |
| CN110929656A (en) | Advertisement putting monitoring method, device and system based on image recognition | |
| CN108200387A (en) | A kind of transmission method of file, system and camera | |
| CN108712400A (en) | Data transmission method, device, computer readable storage medium and electronic equipment | |
| CN117692611B (en) | Security image transmission method and system based on 5G | |
| CN114915753A (en) | Architecture of cloud server, data processing method and storage medium | |
| CN117579896B (en) | Unmanned aerial vehicle video transmission processing method, device, equipment and storage medium | |
| US20210099772A1 (en) | System and method for verification of video integrity based on blockchain | |
| CN111263113B (en) | Data packet sending method and device and data packet processing method and device | |
| CN110855947B (en) | Image snapshot processing method and device | |
| CN115632780B (en) | Use management system and method for seal of Internet of things | |
| CN112261417A (en) | Video pushing method and system, equipment and readable storage medium | |
| CN108307191B (en) | Image data alignment method and device | |
| CN108401070B (en) | Mobile phone and unbinding reminding method | |
| CN112202985B (en) | Information processing method, client device, server device and information processing system | |
| CN113014609B (en) | Multimedia file processing and tracing method, device, equipment and medium | |
| US10564601B2 (en) | Method and system for image processing and data transmission in network-based multi-camera environment | |
| CN108347451B (en) | Picture processing system, method and device | |
| CN110855930B (en) | Intelligent identification method and system for network equipment | |
| CN112333540B (en) | Method and device for determining video encryption length | |
| CN111698226B (en) | Method and device for verifying and selling ticket | |
| CN109246434B (en) | Video encoding method, video decoding method and electronic equipment | |
| CN117176979B (en) | Method, device, equipment and storage medium for extracting content frames of multi-source heterogeneous video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |