US20200236276A1 - Method, system, device for video data transmission and photographing apparatus - Google Patents
Method, system, device for video data transmission and photographing apparatus Download PDFInfo
- Publication number
- US20200236276A1 US20200236276A1 US16/838,598 US202016838598A US2020236276A1 US 20200236276 A1 US20200236276 A1 US 20200236276A1 US 202016838598 A US202016838598 A US 202016838598A US 2020236276 A1 US2020236276 A1 US 2020236276A1
- Authority
- US
- United States
- Prior art keywords
- frame rate
- image frames
- video image
- acquisition
- photographing apparatus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H04N5/23232—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0127—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H04N5/2257—
-
- H04N5/232—
-
- H04N5/23245—
-
- H04N5/23293—
Definitions
- the present disclosure relates to video transmission technologies and, in particular, to a method, a system, a device for video data transmission and a photographing apparatus.
- a video photographing apparatus such as a camera may be installed on a flight system such as an unmanned aerial vehicle, for obtaining video data.
- the video data needs to be transmitted in real time to a receiving and display apparatus such as a remote control.
- a receiving and display apparatus such as a remote control.
- various steps of video image frame acquisition, compression encoding, wireless transmission, wireless reception, compression decoding, display, etc. may be needed.
- the time needed for completing this process should be as short as possible, so as to reflect a current flight situation in time to avoid accidents.
- the video data includes a plurality of successive image frames.
- the camera acquires the video image at a fixed frame rate and continuously sends it to the remote control for display.
- the user will see dynamic video pictures.
- most of the cameras are configured to use the same frame rate as that used at a display side, i.e., the remote control, for acquiring the video image. That is, the camera's acquisition frame rate is equal to the display's display frame rate, thus a delay introduced by acquisition time determines the delay introduced by display time, which eventually results in a larger video image transmission delay.
- the embodiments of the present disclosure provide a method, a system, a device for video data transmission, and a photographing apparatus which reduce an overall transmission delay of video data and increase an instantaneity of a video data transmission by reducing an acquisition time needed to capture video images.
- a method for video data transmission including acquiring images based on an acquisition frame rate, performing frame dropping processing on the images to obtain target video image frames, encoding the target video image frames to obtain encoded target video image frames having an encoded output frame rate lower than the acquisition frame rate, and transmitting the encoded target video image frames to a display apparatus.
- a photographing apparatus including a camera, a processor coupled to the camera, and, and a transmitter coupled to the processor.
- the processor is configured to control the camera to acquire images based on an acquisition frame rate, perform frame dropping processing on the images to obtain target video image frames, and encode the target video image frames to obtain encoded target video image frames having an encoded output frame rate lower than the acquisition frame rate.
- the transmitter is configured to transmit the encoded target video image frames to a display apparatus.
- a device for video data transmission including a photographing apparatus and a display apparatus configured to receive and display a video transmitted from the photographing apparatus.
- the photographing apparatus includes a camera, a processor coupled to the camera, and a transmitter coupled to the processor.
- the processor is configured to control the camera to acquire images based on an acquisition frame rate higher than a display frame rate of the display apparatus, perform frame dropping processing on the images to obtain target video image frames, and encode the target video image frames to obtain encoded target video image frames having an encoded output frame rate equal to the display frame rate.
- the transmitter is configured to transmit the encoded target video image frames to the display apparatus.
- FIG. 1 is a flowchart of a method for video data transmission according to an embodiment of the present disclosure
- FIG. 2 is a flowchart of a method for video data transmission according to another embodiment of the present disclosure
- FIG. 3 is a flowchart of a method for video data transmission according to another embodiment of the present disclosure.
- FIG. 4 is a schematic structural diagram of a system for video data transmission according to an embodiment of the present disclosure
- FIG. 5 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure.
- FIG. 6 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure.
- FIG. 7 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present disclosure.
- FIG. 8 is a schematic structural diagram of a device for video data transmission according to an embodiment of the present disclosure.
- the time for acquiring each video image frame is approximately 33 ms, and even if a delay in the transmission to a receiving display terminal is 0, an acquisition delay introduced by the acquisition will be 33 ms.
- the delay introduced by the time for acquiring image frames determines the delay introduced by the time for display, which also limits a scale of an overall delay of video data.
- the acquisition frame rate can be increased to be higher than the display frame rate, and hence the delay introduced in the acquisition stage can be reduced, and an instantaneity for image display can be promoted.
- FIG. 1 is a flowchart of a method for video data transmission according to an embodiment of the present disclosure. The method can be implemented by a photographing apparatus for transmitting video data to a display apparatus, as described in more detail below.
- images are acquired based on a predetermined acquisition frame rate.
- the acquisition frame rate is higher than a display frame rate at which the display apparatus displays video images.
- the above photographing apparatus can be mounted on an unmanned aerial vehicle having an image transmitting unit or can be mounted on a gimbal or the like having an image unit.
- the photographing apparatus itself has an image transmitting function. Taking the unmanned aerial vehicle as an example, the photographing apparatus acquires video images at a certain acquisition frame rate, and transmits the acquired images to the display apparatus on the ground for real time display of the video images.
- the acquisition frame rate refers to, e.g., the number of image frames acquired per second by the photographing apparatus
- the display frame rate refers to, e.g., the number of image frames displayed per second by the display apparatus.
- frame dropping processing is performed on the acquired images to obtain target video image frames.
- the acquisition frame rate is the number of image frames acquired per second, while in a practical application, a complete segment of video data can include many image frames acquired during a certain time period.
- the frame dropping processing is performed sequentially and respectively on the image frames acquired per second. Therefore, the finally obtained target video image frames refer to the video image frames after the frame dropping processing is performed on the images acquired per second.
- equal interval frame dropping also referred to as equal interval extraction
- image fusion may be adopted for frame dropping. The detailed process of frame dropping will be described in detail below.
- the target video image frames are encoded so that an encoded output frame rate equal to the display frame rate. That is, the target video image frames are encoded to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate.
- the number of image frames per second after the frame dropping is performed should be equal to the display frame rate, i.e., the number of frames displayed per second.
- the encoded output frame rate should be equal to the display frame rate. That is, for the target video image frames after frame dropping that correspond to one second, the number of image frames output per second after encoding should be equal to the number of image frames displayed per second by the display apparatus.
- the encoded target video image frames are transmitted to the display apparatus.
- the image frames acquired per second are transmitted to the display apparatus.
- the display apparatus receives and displays the video images including the target video image frames.
- the method for video data transmission will be described in more detail using a photographing apparatus mounted on an aircraft, such as an unmanned aerial vehicle, as an example, which can transmit acquired video images to a display apparatus on the ground.
- a photographing apparatus mounted on an aircraft such as an unmanned aerial vehicle, as an example, which can transmit acquired video images to a display apparatus on the ground.
- the photographing apparatus acquires video images at an acquisition frame rate higher than a display frame rate when photographing and acquiring the video data.
- the acquisition frame rate can be 120 frames per second, thus the acquisition time for each image frame can be 1/120 second, i.e., about 8.3 ms.
- the display apparatus When the video images are acquired at an acquisition frame rate higher than the display frame rate, the number of video image frames acquired per second is large. If the transmission to the display apparatus, such as a remote control, a smartphone terminal, or the like, is performed using the large number of video image frames, it will increase the transmission time at the transmission stage and result in mismatching with the display frame rate. That is, although the display apparatus receives images at a frame rate of 120 frames per second, it may only display the images at a display frame rate of 30 frames per second.
- the acquisition delay is reduced by acquiring the video images at a higher acquisition frame rate
- frame dropping processing is performed on the images acquired per second to obtain target video image frames.
- the target video image frames are encoded so that an encoded output frame rate is equal to the display frame rate. As such, the number of video image frames that need to be transmitted is reduced, and display reliability is ensured.
- the frame dropping processing performed on the acquired images to obtain the target video image frame can be implemented in various manners, as described in more detail below.
- the target video image frames are extracted from the video image frames by way of equal interval extraction.
- the encoded output frame rate needs to be equal to the display frame rate.
- certain processing may need to be performed on the 120 image frames acquired per second to reduce the number of target video image frames for image encoding, so as to ensure that the encoded output frame rate is equal to the display frame rate.
- the equal interval extraction can be performed by extracting one frame from every 4 frames, and dropping the other 3 frames, so that the number of target video image frames within one second is 30 frames. If the extraction starts from the first frame, then the extracted video image frames can be the first frame, the fifth frame, the eighth frame, and etc.
- Extracting the target video image frames is equivalent to grouping all the video image frames acquired per second to groups each including a certain number of image frames (where the certain number equals the acquisition frame rate divided by the display frame rate), so that the number of groups and the value of display frame rate are equal.
- one of the frames is extracted according to a strategy of equal interval extraction, e.g., when the extraction of the target video image frames is performed, the first frame of each group may be extracted, and the other frames may be dropped.
- the acquisition frame rate is set to be an integer multiple of the display frame rate, thereby making the equal interval extraction more convenient and faster.
- the acquisition frame rate is not an integer multiple of the display frame rate
- the image frames can be similarly grouped, but the number of image frames included in the last group can be different from the number of image frames in any other group.
- each of the groups except the last group can include four frames, and the last group can include three frames. That is, the remainder of division of the acquisition frame rate by the display frame rate can be set as the number of image frames in the last group.
- the frame dropping processing can be performed in accordance with the strategy of extracting a first frame and dropping the remaining frames in each group.
- the target video image frames can be obtained by image fusion. That is, a preset number of adjacent video image frames of the video images can be fused to obtain one of the target video image frames.
- the video image frames acquired per second can be divided into groups.
- the number of groups can be equal to the value of the display frame rate so that the video image frames included in each group can be fused into one image frame for subsequent image encoding processing to ensure that the encoded output frame rate is equal to the display frame rate.
- the image fusion includes but is not limited to fusion by performing weighted average on corresponding pixel data, or image fusion by motion prediction based on image content, or the like.
- the encoding processing can be performed on the target video image frames and the encoded target video image frames are transmitted to the display apparatus.
- the display apparatus can decode the received encoded target video image frames, and display the decoded image frames at the display frame rate.
- an acquisition frame rate higher than the display frame rate is used to acquire the image frames so as to decrease the acquisition delay at the stage of acquiring the video images.
- frame dropping processing is performed on the acquired images so as to cause the encoded output frame rate to be equal to the display frame rate, thus guaranteeing the reliability of display. Therefore, the transmission delay of video data from the aircraft to the display is reduced and the instantaneity of video data transmission is improved by reducing the acquisition delay.
- the acquisition of the video image frames at the acquisition frame rate higher than the display frame rate can reduce the delay introduced at the acquisition stage.
- the acquisition frame rate can be determined such that the selected acquisition frame rate is adapted to the processing capability of the photographing apparatus and the actual situation of the flight.
- FIG. 2 is a flowchart of a method for video data transmission according to an embodiment of the present disclosure.
- the method shown in FIG. 2 is similar to the method shown in FIG. 1 , except that the method shown in FIG. 2 further includes setting a resolution of the photographing apparatus to match a resolution of the display apparatus ( 201 ) and selecting a maximum frame rate from optional frame rates corresponding to the set resolution as the acquisition frame rate ( 202 ).
- the optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus.
- processing capabilities of different apparatuses may vary widely.
- parameters that are usually involved include the resolution and the frame rate.
- a photographing apparatus usually has a supported maximum limit for a combination of the resolution and the frame rate. In general for a particular photographing apparatus, the lower the resolution is, the greater frame rate can be supported. Therefore, in the case where the resolution of the photographing apparatus is set to match the resolution of the display apparatus from the viewpoint of reducing the acquisition delay to the greatest extent, the video images can be acquired at an acquisition frame rate equaling a maximum frame rate selected from at least one frame rate corresponding to this resolution determined based on the corresponding relation between resolutions and frame rates of the photographing apparatus.
- setting the resolution of the photographing apparatus to match the resolution of the display apparatus can include setting the resolutions of both to be equal. In some embodiments, the highest resolution (the maximum resolution) supported by the photographing apparatus is lower than the resolution of the display apparatus. In these embodiments, setting the resolution of the photographing apparatus to match the resolution of the display apparatus can include setting the resolution of photographing apparatus to the maximum resolution that can be supported by the photographing apparatus.
- the acquisition frame rate of the photographing apparatus can be set based on the processing capabilities of the photographing apparatus and the display apparatus. As such, while the instantaneity for the video data transmission is improved reducing an acquisition delay, the applicability can also be improved by taking into consideration the processing capabilities of the apparatuses.
- FIG. 3 is a flowchart of a method for video data transmission according to another embodiment of the present disclosure.
- the method shown in FIG. 3 is similar to the method shown in FIG. 1 , except that the method shown in FIG. 3 further includes obtaining state information of a movable device at which the photographing apparatus is arranged ( 301 ) and adjusting the acquisition frame rate according to the state information of the movable device ( 302 ).
- obtaining the state information ( 301 ) and adjusting the acquisition frame rate ( 302 ) can be performed before acquiring the images ( 101 ), performing the frame dropping processing ( 102 ), encoding the target video image frames ( 103 ), and transmitting the encoded target video image frames ( 104 ).
- the determination and the adjustment of the acquisition frame rate are described taking the scenario where the photographing apparatus is mounted on an aircraft, such as an unmanned aerial vehicle, as an example.
- the photographing apparatus can be mounted on another movable device, such as an unmanned vehicle, an unmanned boat, a gimbal, or the like.
- the determination of the acquisition frame rate can be implemented in accordance with a state of the aircraft, which may also be referred to as a flight state of the aircraft.
- the flight state information includes, for example, a change in the flying altitude of the aircraft, a change in the angle of turning, a change in the flying speed, and/or the like.
- These parameters may be acquired using at least one of a barometer, a Global Positioning System (GPS), a visual assist system, or an inertial sensor provided at the aircraft.
- the inertial sensor may include a sensor (such as a barometer, a GPS, and/or etc.) for detecting parameters which can be configured to acquire the corresponding parameters at a certain time interval to determine the change in the aforementioned flight state.
- adjusting the acquisition frame rate according to the flight state information can includes increasing the acquisition frame rate when the flight state information indicates that the flight scenario of the aircraft changes. In some embodiments, adjusting the acquisition frame rate according to the flight state information can include decreasing or maintaining the acquisition frame rate when the flight state information indicates that the flight scenario of the aircraft does not change.
- the flight scenario of the aircraft can be determined to have changed when an amount of change in the flight state information is greater than a corresponding threshold.
- the flight scenario of the aircraft can be determined to have not changed when the amount of change in the flight state information is not greater than the corresponding threshold.
- whether the flight scenario of the aircraft has changed is determined by detecting the flight state information. For example, if the change in the flying altitude of the aircraft is greater than a certain threshold, or if the angle of turning of the aircraft is greater than a certain threshold, or if the change in the flight speed is greater than a certain threshold, etc., then it is determined that there is a change in the flight scenario. On the other hand, if none of the above changes is greater than the corresponding threshold, then it is determined that there is no change in the flight scenario.
- the acquisition frame rate can be increased at a certain step-length based on the current acquisition frame rate that is higher than the display frame rate, thereby further reducing the acquisition delay so that the acquired video image frames can be transmitted in real time to the receiving and display apparatus for timely display so as to guide the flight control.
- the acquisition frame rate can be decreased at a certain step-length or be maintained unchanged based on the current acquisition frame rate that is higher than the display frame rate.
- the reduced acquisition frame rate should still be greater than the display frame rate, so that the processing load can be reduced with the acquisition delay being reduced.
- the adjustment scope of the above adjustment may or may not be limited to the plurality of optional frame rates.
- the embodiments shown in FIGS. 2 and 3 may be combined to include obtaining the state information of the mobile device ( 301 ) and adjusting the acquisition frame rate according to the state information ( 302 ) can be performed, for example, after the maximum frame rate is selected as the acquisition frame rate ( 202 ) or after transmitting the encoded target video image frames.
- the movable device can be another movable device such as an unmanned boat or an unmanned vehicle.
- the above state information can be, for example, parameter information such as a travel speed and an angle of turning of the other movable device.
- the acquisition frame rate can be increased when the state information indicates that the scenario where the movable device is located changes, and/or the acquisition frame rate can be decreased or maintained when the state information indicates that the scenario in which the movable device is located does not change. As the principle is similar to that of the examples of the aforementioned aircraft, it will not be repeated herein.
- FIG. 4 is a schematic structural diagram of a system for video data transmission according to an embodiment of the present disclosure.
- the transmission system is configured to transmit the video data to a display apparatus.
- the transmission system includes an acquisition circuit 11 , a dropping processing circuit 12 , an encoding circuit 13 , and a transmitting circuit 14 .
- the acquisition circuit 11 is configured to acquire images based on a predetermined acquisition frame rate.
- the acquisition frame rate is higher than a display frame rate at which the display apparatus displays video image.
- the dropping processing circuit 12 is configured to perform frame dropping processing on the acquired images to obtain target video image frames
- the encoding circuit 13 is configured to encode the target video image frames so that an encoded output frame rate is equal to the display frame rate. That is, the encoding circuit 13 can encode the target video image frames to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate.
- the transmitting circuit 14 is configured to transmit the encoded target video image frames to the display apparatus.
- the dropping processing circuit 12 includes a first processing sub-circuit 121 or a second processing sub-circuit 122 .
- the first processing sub-circuit 121 is configured to extract the target video image frame from the acquired images by equal interval extraction.
- the second processing sub-circuit 122 is configured to fuse a preset number of adjacent video image frames of the acquired images to obtain one of the target video image frames by image fusion.
- the system for video data transmission according to the embodiment can be used to implement a method consistent with the disclosure, such as the example method shown in FIG. 1 .
- the principle for implementation and technical effects of the system are similar to those of the method, which will not be repeated here.
- FIG. 5 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure.
- the system shown in FIG. 5 is similar to the system shown in FIG. 4 , except that the system shown in FIG. 5 further includes a setting circuit 21 and a selecting circuit 22 .
- the setting circuit 21 is configured to set a resolution of the photographing apparatus to match a resolution of the display apparatus.
- the selecting circuit 22 is configured to select a maximum frame rate from optional frame rates corresponding to the set resolution as the acquisition frame rate.
- the optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus.
- the system for video data transmission according to the embodiment can be used to implement a method consistent with the disclosure, such as the example method shown in FIG. 2 .
- the principle for implementation and technical effects of the system are similar to those of the method, which will not be repeated here.
- FIG. 6 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure.
- the system shown in FIG. 6 is similar to the system shown in FIG. 4 or FIG. 5 , except that the system shown in FIG. 6 further includes an obtaining circuit 31 and an adjusting circuit 32 .
- the obtaining circuit 31 is configured to obtain state information of a movable device at which the photographing apparatus is arranged.
- the adjusting circuit 32 is configured to adjust the acquisition frame rate according to the state information.
- the adjusting circuit 32 includes a first adjusting sub-circuit 321 and a second adjusting sub-circuit 322 .
- the first adjusting sub-circuit 321 is configured to increase the acquisition frame rate when the state information indicates that a scenario in which the movable device is located changes.
- the second adjusting sub-circuit 322 is configured to decrease or maintain the acquisition frame rate when the state information indicates that the scenario in which the movable device is located does not change.
- the first adjusting sub-circuit 321 is further configured to determine that the scenario in which the movable device is located changes and increase the acquisition frame rate when an amount of change in the state information is greater than a corresponding threshold.
- the second adjusting sub-circuit 322 is further configured to determine that the scenario in which the movable device is located does not change and decrease or maintain the acquisition frame rate when the amount of change in the state information is not greater than the corresponding threshold.
- the state information includes at least one of a speed, an angle of turning, or an altitude.
- the system for video data transmission according to the embodiment can be used to implement a method consistent with the disclosure, such as the example method shown in FIG. 3 .
- the principle for implementation and technical effects of the system are similar to those of the method, which will not be repeated here.
- FIG. 7 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present disclosure. As shown in FIG. 7 , the photographing apparatus includes a camera 41 , a processor 42 , and a transmitter 43 .
- the processor 42 is configured to control the camera 41 to acquire images based on a predetermined acquisition frame rate higher than a display frame rate at which a display apparatus displays video images.
- the processor 42 is further configured to perform frame dropping processing on the acquired images to obtain target video image frames, and encode the target video image frames so that an encoded output frame rate is equal to the display frame rate. That is, the target video image frames are encoded to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate.
- the transmitter 43 is configured to transmit the encoded target video image frames to the display apparatus.
- the processor 42 is further configured to extract the target video image frames from the acquired images by equal interval extraction.
- the processor 42 is further configured to fuse a preset number of adjacent video image frames of the acquired images to obtain one of the target video image frames by image fusion.
- the processor 42 is further configured to set a resolution of the photographing apparatus to match a resolution of a receiving and display apparatus, and select a maximum frame rate from optional frame rates corresponding to the resolution as the acquisition frame rate.
- the optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus.
- the photographing apparatus is arranged on a movable device, and the processor 42 is further configured to obtain state information of the movable device, and adjust the acquisition frame rate according to the state information.
- the processor 42 is further configured to increase the acquisition frame rate when the state information indicates that a scenario in which the movable device is located changes, and/or decrease or maintain the acquisition frame rate when the state information indicates that the scenario in which the movable device is located does not change.
- the processor 42 is configured to determine that the scenario in which the movable device is located changes when an amount of change in the state information is greater than a corresponding threshold, and/or determine that the scenario in which the movable device is located does not change when the amount of change in the state information is not greater than the corresponding threshold.
- the state information includes at least one of a speed, an angle of turning, or an altitude.
- the photographing apparatus according to the embodiment can be used to implement a method consistent with the disclosure, such as one of the example methods shown in FIGS. 1, 2 , and 3 .
- the principle for implementation and technical effects of the apparatus are similar to those of the methods, which will not be repeated here.
- FIG. 8 is a schematic structural diagram of a device for video data transmission according to an embodiment of the present disclosure.
- the device includes a camera 51 , a processor 52 , a transmitter 53 , and a display apparatus 54 .
- the camera 51 , the processor 52 , and the transmitter 53 can constitute a photographing apparatus.
- the processor 52 is configured to control the camera 51 to acquire images based on a predetermined acquisition frame rate higher than a display frame rate at which a display apparatus displays video images.
- the processor 52 is further configured to perform frame dropping processing on the acquired images to obtain target video image frames, and encode the target video image frames so that an encoded output frame rate is equal to the display frame rate. That is, the target video image frames are encoded to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate.
- the transmitter 53 is configured to transmit the encoded target video image frames to the display apparatus 54 .
- the display apparatus 54 is configured to receive and display a video including the target video image frames.
- the processor 52 is further configured to extract the target video image frames from the acquired images by equal interval extraction.
- the processor 52 is further configured to fuse a preset number of adjacent video image frames of the acquired images to obtain the target video image frames by image fusion.
- the processor 52 is further configured to set a resolution of the photographing apparatus to match a resolution of the display apparatus 54 , select a maximum frame rate from optional frame rates corresponding to the resolution as the acquisition frame rate.
- the optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus.
- the photographing device is arranged on a movable device, and the processor 52 is further configured to obtain state information of the movable device, and adjust the acquisition frame rate according to the state information.
- the processor 52 is further configured to increase the acquisition frame rate when the state information indicates that the scenario in which the movable device is located changes, and/or decrease or maintain the acquisition frame rate when the state information indicates that the scenario in which the movable device is located does not change.
- the processor 52 is configured to determine that the scenario in which the movable device is located changes when an amount of change in the state information is greater than a corresponding threshold, and/or determine that the scenario in which the movable device is located does not change when the amount of change in the state information is not greater than the corresponding threshold.
- the state information includes at least one of a speed, an angle of turning, or an altitude.
- the display apparatus includes a receiver, a processor, a display screen, a memory, etc.
- the display apparatus can receive video images transmitted by the photographing apparatus through the receiver.
- the memory can be used to store the received video images.
- the processor can decode the received video images and control the display screen to display the video images.
- the processor may be, for example, a Central Processing Unit (CPU) or another general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC).
- the general purpose processor may be a microprocessor or any conventional processor.
- a method consistent with the disclosure may be implemented completely by a hardware processor or by a combination of hardware and software of a processor.
- a storage medium can include, for example, read-only memory (ROM), a random-access memory (RAM), a flash memory, a hard disk, a solid state hard drive, a magnetic tape, a floppy disk, an optical disc, or any combination thereof.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Studio Devices (AREA)
Abstract
A method for wirelessly transmitting video data from a photographing apparatus to a display apparatus includes: setting an acquisition resolution for the photographing apparatus to match a display resolution of the display apparatus; acquiring images by the photographing apparatus with the acquisition resolution and an acquisition frame rate; performing frame dropping processing on the images to obtain target video image frames; encoding the target video image frames to obtain encoded target video image frames having an encoded output frame rate, the encoded output frame rate being equal to a display frame rate of the display apparatus and lower than the acquisition frame rate of the photographing apparatus; and transmitting the encoded target video image frames to the display apparatus.
Description
- This application is a continuation application of U.S. patent application Ser. No. 16/047,557, filed on Jul. 27, 2018, which is a continuation application of International Application No. PCT/CN2016/072854, filed on Jan. 29, 2016, the entire contents of both of which are incorporated herein by reference.
- The present disclosure relates to video transmission technologies and, in particular, to a method, a system, a device for video data transmission and a photographing apparatus.
- A video photographing apparatus such as a camera may be installed on a flight system such as an unmanned aerial vehicle, for obtaining video data. The video data needs to be transmitted in real time to a receiving and display apparatus such as a remote control. During this process, various steps of video image frame acquisition, compression encoding, wireless transmission, wireless reception, compression decoding, display, etc. may be needed. The time needed for completing this process should be as short as possible, so as to reflect a current flight situation in time to avoid accidents.
- The video data includes a plurality of successive image frames. The camera acquires the video image at a fixed frame rate and continuously sends it to the remote control for display. The user will see dynamic video pictures. At present, most of the cameras are configured to use the same frame rate as that used at a display side, i.e., the remote control, for acquiring the video image. That is, the camera's acquisition frame rate is equal to the display's display frame rate, thus a delay introduced by acquisition time determines the delay introduced by display time, which eventually results in a larger video image transmission delay.
- The embodiments of the present disclosure provide a method, a system, a device for video data transmission, and a photographing apparatus which reduce an overall transmission delay of video data and increase an instantaneity of a video data transmission by reducing an acquisition time needed to capture video images.
- In accordance with the disclosure, there is provided a method for video data transmission including acquiring images based on an acquisition frame rate, performing frame dropping processing on the images to obtain target video image frames, encoding the target video image frames to obtain encoded target video image frames having an encoded output frame rate lower than the acquisition frame rate, and transmitting the encoded target video image frames to a display apparatus.
- Also in accordance with the disclosure, there is provided a photographing apparatus including a camera, a processor coupled to the camera, and, and a transmitter coupled to the processor. The processor is configured to control the camera to acquire images based on an acquisition frame rate, perform frame dropping processing on the images to obtain target video image frames, and encode the target video image frames to obtain encoded target video image frames having an encoded output frame rate lower than the acquisition frame rate. The transmitter is configured to transmit the encoded target video image frames to a display apparatus.
- Also in accordance with the disclosure, there is provided a device for video data transmission including a photographing apparatus and a display apparatus configured to receive and display a video transmitted from the photographing apparatus. The photographing apparatus includes a camera, a processor coupled to the camera, and a transmitter coupled to the processor. The processor is configured to control the camera to acquire images based on an acquisition frame rate higher than a display frame rate of the display apparatus, perform frame dropping processing on the images to obtain target video image frames, and encode the target video image frames to obtain encoded target video image frames having an encoded output frame rate equal to the display frame rate. The transmitter is configured to transmit the encoded target video image frames to the display apparatus.
- To describe the technical solutions in embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings needed for describing the embodiments. Apparently, the accompanying drawings in the following description illustrate merely some embodiments of the present disclosure, and persons of ordinary skill in the art may still derive other drawings from these accompanying drawings without creative effort.
-
FIG. 1 is a flowchart of a method for video data transmission according to an embodiment of the present disclosure; -
FIG. 2 is a flowchart of a method for video data transmission according to another embodiment of the present disclosure; -
FIG. 3 is a flowchart of a method for video data transmission according to another embodiment of the present disclosure; -
FIG. 4 is a schematic structural diagram of a system for video data transmission according to an embodiment of the present disclosure; -
FIG. 5 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure; -
FIG. 6 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure; -
FIG. 7 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present disclosure; and -
FIG. 8 is a schematic structural diagram of a device for video data transmission according to an embodiment of the present disclosure. - In order to make the objective, the technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the present disclosure is hereinafter described in detail with reference to the accompanying drawings. It is evident that the embodiments are only some exemplary embodiments of the present disclosure, and the present disclosure is not limited to such embodiments. Other embodiments that those skilled in the art could obtain based on embodiments of the present disclosure also fall within the scope of the present disclosure.
- Before the technical solution of the present disclosure is described in detail, the technical concept of the present disclosure is first set forth here. At present, most of photographing devices installed in aircrafts, such an unmanned aerial vehicles, are configured to acquire image frames at an acquisition frame rate equal to a display frame rate at a display side. Assume that the display frame rate is N, i.e., N video frames are displayed per second. When the acquisition frame rate is equal to the display frame rate, i.e., N frames of image are acquired per second, the time it takes to acquire each video image frame is 1/N second. Take N=30 as an example, the time for acquiring each video image frame is approximately 33 ms, and even if a delay in the transmission to a receiving display terminal is 0, an acquisition delay introduced by the acquisition will be 33 ms. The delay introduced by the time for acquiring image frames determines the delay introduced by the time for display, which also limits a scale of an overall delay of video data. Thus, consistent with the present disclosure, the acquisition frame rate can be increased to be higher than the display frame rate, and hence the delay introduced in the acquisition stage can be reduced, and an instantaneity for image display can be promoted.
- The solution of the present disclosure will now be described in detail below in some embodiments with reference to the drawings.
-
FIG. 1 is a flowchart of a method for video data transmission according to an embodiment of the present disclosure. The method can be implemented by a photographing apparatus for transmitting video data to a display apparatus, as described in more detail below. - As shown in
FIG. 1 , at 101, images are acquired based on a predetermined acquisition frame rate. The acquisition frame rate is higher than a display frame rate at which the display apparatus displays video images. - In some embodiments, the above photographing apparatus can be mounted on an unmanned aerial vehicle having an image transmitting unit or can be mounted on a gimbal or the like having an image unit. In some embodiments, the photographing apparatus itself has an image transmitting function. Taking the unmanned aerial vehicle as an example, the photographing apparatus acquires video images at a certain acquisition frame rate, and transmits the acquired images to the display apparatus on the ground for real time display of the video images.
- Here, the acquisition frame rate refers to, e.g., the number of image frames acquired per second by the photographing apparatus, and the display frame rate refers to, e.g., the number of image frames displayed per second by the display apparatus.
- At 102, frame dropping processing is performed on the acquired images to obtain target video image frames.
- The acquisition frame rate is the number of image frames acquired per second, while in a practical application, a complete segment of video data can include many image frames acquired during a certain time period. In some embodiments, the frame dropping processing is performed sequentially and respectively on the image frames acquired per second. Therefore, the finally obtained target video image frames refer to the video image frames after the frame dropping processing is performed on the images acquired per second.
- In some embodiments, equal interval frame dropping, also referred to as equal interval extraction, may be adopted for frame dropping. In some embodiments, image fusion may be adopted for frame dropping. The detailed process of frame dropping will be described in detail below.
- At 103, the target video image frames are encoded so that an encoded output frame rate equal to the display frame rate. That is, the target video image frames are encoded to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate.
- After the frame dropping is performed on the images acquired per second, the number of image frames per second after the frame dropping is performed should be equal to the display frame rate, i.e., the number of frames displayed per second.
- Since encoding is needed after images are acquired and before they are transmitted, that is, acquired images are encoded and then output, the encoded output frame rate should be equal to the display frame rate. That is, for the target video image frames after frame dropping that correspond to one second, the number of image frames output per second after encoding should be equal to the number of image frames displayed per second by the display apparatus.
- At 104, the encoded target video image frames are transmitted to the display apparatus.
- After the foregoing dropping and encoding are performed, the image frames acquired per second are transmitted to the display apparatus. The display apparatus receives and displays the video images including the target video image frames.
- The method for video data transmission provided will be described in more detail using a photographing apparatus mounted on an aircraft, such as an unmanned aerial vehicle, as an example, which can transmit acquired video images to a display apparatus on the ground.
- In some embodiments, the photographing apparatus acquires video images at an acquisition frame rate higher than a display frame rate when photographing and acquiring the video data. For example, in the case of a display frame rate of 30 frames per second, the acquisition frame rate can be 120 frames per second, thus the acquisition time for each image frame can be 1/120 second, i.e., about 8.3 ms. Compared to the acquisition frame rate of 30 frames per second, the time saved in the acquisition stage is about: 33 ms−8.3 ms=24.7 ms.
- When the video images are acquired at an acquisition frame rate higher than the display frame rate, the number of video image frames acquired per second is large. If the transmission to the display apparatus, such as a remote control, a smartphone terminal, or the like, is performed using the large number of video image frames, it will increase the transmission time at the transmission stage and result in mismatching with the display frame rate. That is, although the display apparatus receives images at a frame rate of 120 frames per second, it may only display the images at a display frame rate of 30 frames per second.
- Therefore, in some embodiments, when the acquisition delay is reduced by acquiring the video images at a higher acquisition frame rate, in order to ensure reliable display of the video data at the display apparatus and to reduce the transmission time of the video data from the aircraft to the display apparatus, frame dropping processing is performed on the images acquired per second to obtain target video image frames. Further, the target video image frames are encoded so that an encoded output frame rate is equal to the display frame rate. As such, the number of video image frames that need to be transmitted is reduced, and display reliability is ensured.
- The frame dropping processing performed on the acquired images to obtain the target video image frame can be implemented in various manners, as described in more detail below.
- In some embodiments, the target video image frames are extracted from the video image frames by way of equal interval extraction.
- For example, in the case where the acquisition frame rate is 120 frames per second and the display frame rate is 30 frames per second, in order to make the frame rate transmitted to the display apparatus equal to the display frame rate, the encoded output frame rate needs to be equal to the display frame rate. In other words, certain processing may need to be performed on the 120 image frames acquired per second to reduce the number of target video image frames for image encoding, so as to ensure that the encoded output frame rate is equal to the display frame rate.
- In the case of an acquisition frame rate of 120 frames per second and a display frame rate of 30 frames per second, the equal interval extraction can be performed by extracting one frame from every 4 frames, and dropping the other 3 frames, so that the number of target video image frames within one second is 30 frames. If the extraction starts from the first frame, then the extracted video image frames can be the first frame, the fifth frame, the eighth frame, and etc.
- Extracting the target video image frames is equivalent to grouping all the video image frames acquired per second to groups each including a certain number of image frames (where the certain number equals the acquisition frame rate divided by the display frame rate), so that the number of groups and the value of display frame rate are equal. For each group, one of the frames is extracted according to a strategy of equal interval extraction, e.g., when the extraction of the target video image frames is performed, the first frame of each group may be extracted, and the other frames may be dropped.
- In some embodiments, the acquisition frame rate is set to be an integer multiple of the display frame rate, thereby making the equal interval extraction more convenient and faster. In some embodiments, the acquisition frame rate is not an integer multiple of the display frame rate, the image frames can be similarly grouped, but the number of image frames included in the last group can be different from the number of image frames in any other group. For example, each of the groups except the last group can include four frames, and the last group can include three frames. That is, the remainder of division of the acquisition frame rate by the display frame rate can be set as the number of image frames in the last group. Similarly, the frame dropping processing can be performed in accordance with the strategy of extracting a first frame and dropping the remaining frames in each group.
- In some other embodiments, the target video image frames can be obtained by image fusion. That is, a preset number of adjacent video image frames of the video images can be fused to obtain one of the target video image frames.
- Similar to the equal interval extraction, in the image fusion approach, the video image frames acquired per second can be divided into groups. The number of groups can be equal to the value of the display frame rate so that the video image frames included in each group can be fused into one image frame for subsequent image encoding processing to ensure that the encoded output frame rate is equal to the display frame rate.
- In some embodiments, the image fusion includes but is not limited to fusion by performing weighted average on corresponding pixel data, or image fusion by motion prediction based on image content, or the like.
- After the target video image frames for image encoding are extracted from the acquired video image frames, the encoding processing can be performed on the target video image frames and the encoded target video image frames are transmitted to the display apparatus. The display apparatus can decode the received encoded target video image frames, and display the decoded image frames at the display frame rate.
- Consistent with the disclosure, an acquisition frame rate higher than the display frame rate is used to acquire the image frames so as to decrease the acquisition delay at the stage of acquiring the video images. In order to ensure normal display of the video data on the display, after the video images are acquired at the higher acquisition frame rate, frame dropping processing is performed on the acquired images so as to cause the encoded output frame rate to be equal to the display frame rate, thus guaranteeing the reliability of display. Therefore, the transmission delay of video data from the aircraft to the display is reduced and the instantaneity of video data transmission is improved by reducing the acquisition delay.
- As described above, the acquisition of the video image frames at the acquisition frame rate higher than the display frame rate can reduce the delay introduced at the acquisition stage. In some embodiments, the acquisition frame rate can be determined such that the selected acquisition frame rate is adapted to the processing capability of the photographing apparatus and the actual situation of the flight.
-
FIG. 2 is a flowchart of a method for video data transmission according to an embodiment of the present disclosure. The method shown inFIG. 2 is similar to the method shown inFIG. 1 , except that the method shown inFIG. 2 further includes setting a resolution of the photographing apparatus to match a resolution of the display apparatus (201) and selecting a maximum frame rate from optional frame rates corresponding to the set resolution as the acquisition frame rate (202). The optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus. - Processing capabilities of different apparatuses may vary widely. For the acquiring and display of video images, parameters that are usually involved include the resolution and the frame rate. A photographing apparatus usually has a supported maximum limit for a combination of the resolution and the frame rate. In general for a particular photographing apparatus, the lower the resolution is, the greater frame rate can be supported. Therefore, in the case where the resolution of the photographing apparatus is set to match the resolution of the display apparatus from the viewpoint of reducing the acquisition delay to the greatest extent, the video images can be acquired at an acquisition frame rate equaling a maximum frame rate selected from at least one frame rate corresponding to this resolution determined based on the corresponding relation between resolutions and frame rates of the photographing apparatus.
- In some embodiments, setting the resolution of the photographing apparatus to match the resolution of the display apparatus can include setting the resolutions of both to be equal. In some embodiments, the highest resolution (the maximum resolution) supported by the photographing apparatus is lower than the resolution of the display apparatus. In these embodiments, setting the resolution of the photographing apparatus to match the resolution of the display apparatus can include setting the resolution of photographing apparatus to the maximum resolution that can be supported by the photographing apparatus.
- Consistent with the disclosure, the acquisition frame rate of the photographing apparatus can be set based on the processing capabilities of the photographing apparatus and the display apparatus. As such, while the instantaneity for the video data transmission is improved reducing an acquisition delay, the applicability can also be improved by taking into consideration the processing capabilities of the apparatuses.
-
FIG. 3 is a flowchart of a method for video data transmission according to another embodiment of the present disclosure. The method shown inFIG. 3 is similar to the method shown inFIG. 1 , except that the method shown inFIG. 3 further includes obtaining state information of a movable device at which the photographing apparatus is arranged (301) and adjusting the acquisition frame rate according to the state information of the movable device (302). - The order of the processes described above is not limited to that shown in the figures, and some processes, such as
processes - Hereinafter, the determination and the adjustment of the acquisition frame rate are described taking the scenario where the photographing apparatus is mounted on an aircraft, such as an unmanned aerial vehicle, as an example. In some other embodiments, the photographing apparatus can be mounted on another movable device, such as an unmanned vehicle, an unmanned boat, a gimbal, or the like.
- The determination of the acquisition frame rate can be implemented in accordance with a state of the aircraft, which may also be referred to as a flight state of the aircraft. In some embodiments, the flight state information includes, for example, a change in the flying altitude of the aircraft, a change in the angle of turning, a change in the flying speed, and/or the like. These parameters may be acquired using at least one of a barometer, a Global Positioning System (GPS), a visual assist system, or an inertial sensor provided at the aircraft. The inertial sensor may include a sensor (such as a barometer, a GPS, and/or etc.) for detecting parameters which can be configured to acquire the corresponding parameters at a certain time interval to determine the change in the aforementioned flight state.
- In some embodiments, adjusting the acquisition frame rate according to the flight state information can includes increasing the acquisition frame rate when the flight state information indicates that the flight scenario of the aircraft changes. In some embodiments, adjusting the acquisition frame rate according to the flight state information can include decreasing or maintaining the acquisition frame rate when the flight state information indicates that the flight scenario of the aircraft does not change.
- In some embodiments, the flight scenario of the aircraft can be determined to have changed when an amount of change in the flight state information is greater than a corresponding threshold. The flight scenario of the aircraft can be determined to have not changed when the amount of change in the flight state information is not greater than the corresponding threshold.
- In some embodiments, whether the flight scenario of the aircraft has changed is determined by detecting the flight state information. For example, if the change in the flying altitude of the aircraft is greater than a certain threshold, or if the angle of turning of the aircraft is greater than a certain threshold, or if the change in the flight speed is greater than a certain threshold, etc., then it is determined that there is a change in the flight scenario. On the other hand, if none of the above changes is greater than the corresponding threshold, then it is determined that there is no change in the flight scenario.
- When the flight scenario changes, the acquisition frame rate can be increased at a certain step-length based on the current acquisition frame rate that is higher than the display frame rate, thereby further reducing the acquisition delay so that the acquired video image frames can be transmitted in real time to the receiving and display apparatus for timely display so as to guide the flight control.
- On the other hand, when the flight scenario does not change, the acquisition frame rate can be decreased at a certain step-length or be maintained unchanged based on the current acquisition frame rate that is higher than the display frame rate. The reduced acquisition frame rate should still be greater than the display frame rate, so that the processing load can be reduced with the acquisition delay being reduced.
- In some embodiments, when the resolution corresponds to a plurality of optional frame rates, the adjustment scope of the above adjustment may or may not be limited to the plurality of optional frame rates. For example, the embodiments shown in
FIGS. 2 and 3 may be combined to include obtaining the state information of the mobile device (301) and adjusting the acquisition frame rate according to the state information (302) can be performed, for example, after the maximum frame rate is selected as the acquisition frame rate (202) or after transmitting the encoded target video image frames. - In some embodiments, the movable device can be another movable device such as an unmanned boat or an unmanned vehicle. Correspondingly, the above state information can be, for example, parameter information such as a travel speed and an angle of turning of the other movable device. Correspondingly, the acquisition frame rate can be increased when the state information indicates that the scenario where the movable device is located changes, and/or the acquisition frame rate can be decreased or maintained when the state information indicates that the scenario in which the movable device is located does not change. As the principle is similar to that of the examples of the aforementioned aircraft, it will not be repeated herein.
-
FIG. 4 is a schematic structural diagram of a system for video data transmission according to an embodiment of the present disclosure. The transmission system is configured to transmit the video data to a display apparatus. As shown inFIG. 4 , the transmission system includes anacquisition circuit 11, a droppingprocessing circuit 12, anencoding circuit 13, and a transmittingcircuit 14. - The
acquisition circuit 11 is configured to acquire images based on a predetermined acquisition frame rate. The acquisition frame rate is higher than a display frame rate at which the display apparatus displays video image. - The dropping
processing circuit 12 is configured to perform frame dropping processing on the acquired images to obtain target video image frames - The
encoding circuit 13 is configured to encode the target video image frames so that an encoded output frame rate is equal to the display frame rate. That is, theencoding circuit 13 can encode the target video image frames to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate. - The transmitting
circuit 14 is configured to transmit the encoded target video image frames to the display apparatus. - In some embodiments, as shown in
FIG. 4 , the droppingprocessing circuit 12 includes afirst processing sub-circuit 121 or asecond processing sub-circuit 122. - The
first processing sub-circuit 121 is configured to extract the target video image frame from the acquired images by equal interval extraction. - The
second processing sub-circuit 122 is configured to fuse a preset number of adjacent video image frames of the acquired images to obtain one of the target video image frames by image fusion. - The system for video data transmission according to the embodiment can be used to implement a method consistent with the disclosure, such as the example method shown in
FIG. 1 . The principle for implementation and technical effects of the system are similar to those of the method, which will not be repeated here. -
FIG. 5 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure. The system shown inFIG. 5 is similar to the system shown inFIG. 4 , except that the system shown inFIG. 5 further includes asetting circuit 21 and a selectingcircuit 22. - The setting
circuit 21 is configured to set a resolution of the photographing apparatus to match a resolution of the display apparatus. - The selecting
circuit 22 is configured to select a maximum frame rate from optional frame rates corresponding to the set resolution as the acquisition frame rate. The optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus. - The system for video data transmission according to the embodiment can be used to implement a method consistent with the disclosure, such as the example method shown in
FIG. 2 . The principle for implementation and technical effects of the system are similar to those of the method, which will not be repeated here. -
FIG. 6 is a schematic structural diagram of a system for video data transmission according to another embodiment of the present disclosure. The system shown inFIG. 6 is similar to the system shown inFIG. 4 orFIG. 5 , except that the system shown inFIG. 6 further includes an obtainingcircuit 31 and an adjustingcircuit 32. - The obtaining
circuit 31 is configured to obtain state information of a movable device at which the photographing apparatus is arranged. - The adjusting
circuit 32 is configured to adjust the acquisition frame rate according to the state information. - In some embodiments, as shown in
FIG. 6 , the adjustingcircuit 32 includes a first adjustingsub-circuit 321 and asecond adjusting sub-circuit 322. - The
first adjusting sub-circuit 321 is configured to increase the acquisition frame rate when the state information indicates that a scenario in which the movable device is located changes. - The
second adjusting sub-circuit 322 is configured to decrease or maintain the acquisition frame rate when the state information indicates that the scenario in which the movable device is located does not change. - In some embodiments, the first adjusting
sub-circuit 321 is further configured to determine that the scenario in which the movable device is located changes and increase the acquisition frame rate when an amount of change in the state information is greater than a corresponding threshold. - The
second adjusting sub-circuit 322 is further configured to determine that the scenario in which the movable device is located does not change and decrease or maintain the acquisition frame rate when the amount of change in the state information is not greater than the corresponding threshold. - In some embodiments, the state information includes at least one of a speed, an angle of turning, or an altitude.
- The system for video data transmission according to the embodiment can be used to implement a method consistent with the disclosure, such as the example method shown in
FIG. 3 . The principle for implementation and technical effects of the system are similar to those of the method, which will not be repeated here. -
FIG. 7 is a schematic structural diagram of a photographing apparatus according to an embodiment of the present disclosure. As shown inFIG. 7 , the photographing apparatus includes acamera 41, aprocessor 42, and atransmitter 43. - In some embodiments, the
processor 42 is configured to control thecamera 41 to acquire images based on a predetermined acquisition frame rate higher than a display frame rate at which a display apparatus displays video images. - The
processor 42 is further configured to perform frame dropping processing on the acquired images to obtain target video image frames, and encode the target video image frames so that an encoded output frame rate is equal to the display frame rate. That is, the target video image frames are encoded to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate. - The
transmitter 43 is configured to transmit the encoded target video image frames to the display apparatus. - In some embodiments, the
processor 42 is further configured to extract the target video image frames from the acquired images by equal interval extraction. - In some embodiments, the
processor 42 is further configured to fuse a preset number of adjacent video image frames of the acquired images to obtain one of the target video image frames by image fusion. - In some embodiments, the
processor 42 is further configured to set a resolution of the photographing apparatus to match a resolution of a receiving and display apparatus, and select a maximum frame rate from optional frame rates corresponding to the resolution as the acquisition frame rate. The optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus. - In some embodiments, the photographing apparatus is arranged on a movable device, and the
processor 42 is further configured to obtain state information of the movable device, and adjust the acquisition frame rate according to the state information. - In some embodiments, the
processor 42 is further configured to increase the acquisition frame rate when the state information indicates that a scenario in which the movable device is located changes, and/or decrease or maintain the acquisition frame rate when the state information indicates that the scenario in which the movable device is located does not change. - In some embodiments, the
processor 42 is configured to determine that the scenario in which the movable device is located changes when an amount of change in the state information is greater than a corresponding threshold, and/or determine that the scenario in which the movable device is located does not change when the amount of change in the state information is not greater than the corresponding threshold. - In some embodiments, the state information includes at least one of a speed, an angle of turning, or an altitude.
- The photographing apparatus according to the embodiment can be used to implement a method consistent with the disclosure, such as one of the example methods shown in
FIGS. 1, 2 , and 3. The principle for implementation and technical effects of the apparatus are similar to those of the methods, which will not be repeated here. -
FIG. 8 is a schematic structural diagram of a device for video data transmission according to an embodiment of the present disclosure. As shown inFIG. 8 , the device includes acamera 51, aprocessor 52, atransmitter 53, and adisplay apparatus 54. Thecamera 51, theprocessor 52, and thetransmitter 53 can constitute a photographing apparatus. - In some embodiments, the
processor 52 is configured to control thecamera 51 to acquire images based on a predetermined acquisition frame rate higher than a display frame rate at which a display apparatus displays video images. - The
processor 52 is further configured to perform frame dropping processing on the acquired images to obtain target video image frames, and encode the target video image frames so that an encoded output frame rate is equal to the display frame rate. That is, the target video image frames are encoded to obtain encoded target video image frames having the encoded output frame rate equal to the display frame rate, i.e., lower than the acquisition frame rate. - The
transmitter 53 is configured to transmit the encoded target video image frames to thedisplay apparatus 54. - The
display apparatus 54 is configured to receive and display a video including the target video image frames. - In some embodiments, the
processor 52 is further configured to extract the target video image frames from the acquired images by equal interval extraction. - In some embodiments, the
processor 52 is further configured to fuse a preset number of adjacent video image frames of the acquired images to obtain the target video image frames by image fusion. - In some embodiments, the
processor 52 is further configured to set a resolution of the photographing apparatus to match a resolution of thedisplay apparatus 54, select a maximum frame rate from optional frame rates corresponding to the resolution as the acquisition frame rate. The optional frame rates are determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus. - In some embodiments, the photographing device is arranged on a movable device, and the
processor 52 is further configured to obtain state information of the movable device, and adjust the acquisition frame rate according to the state information. - In some embodiments, the
processor 52 is further configured to increase the acquisition frame rate when the state information indicates that the scenario in which the movable device is located changes, and/or decrease or maintain the acquisition frame rate when the state information indicates that the scenario in which the movable device is located does not change. - In some embodiments, the
processor 52 is configured to determine that the scenario in which the movable device is located changes when an amount of change in the state information is greater than a corresponding threshold, and/or determine that the scenario in which the movable device is located does not change when the amount of change in the state information is not greater than the corresponding threshold. - In some embodiments, the state information includes at least one of a speed, an angle of turning, or an altitude.
- In some embodiments, the display apparatus includes a receiver, a processor, a display screen, a memory, etc. The display apparatus can receive video images transmitted by the photographing apparatus through the receiver. The memory can be used to store the received video images. The processor can decode the received video images and control the display screen to display the video images.
- As for the execution of processing procedure of each component in the device for video data transmission according to the embodiment, reference can be made to the example embodiments described above in connection with
FIGS. 1, 2, and 3 . Since the implementation principle and the technical effect thereof are similar, they will not be repeated here. - In the embodiments of the above photographing apparatus, the processor may be, for example, a Central Processing Unit (CPU) or another general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC). The general purpose processor may be a microprocessor or any conventional processor. A method consistent with the disclosure may be implemented completely by a hardware processor or by a combination of hardware and software of a processor.
- Those skilled in the art understand that the entire or a portion of a method consistent with the disclosure, such as one of the example methods described above can be implemented by related hardware under the instruction of a program stored in a storage medium. When the program is executed, the method is performed. The aforementioned storage medium can include, for example, read-only memory (ROM), a random-access memory (RAM), a flash memory, a hard disk, a solid state hard drive, a magnetic tape, a floppy disk, an optical disc, or any combination thereof.
- Finally, it should be noted that the above embodiments are merely for describing the technical solutions of the present disclosure other than limiting the present disclosure. Although the present disclosure is described in detail with reference to the foregoing embodiments, a person of ordinary skill in the art should understand that modifications can be made to the technical solutions described in the present disclosure, or make equivalent replacements to some or all of technical features thereof, without departing from the scope of the technical solutions of the embodiments of the present disclosure.
Claims (20)
1. A method for wirelessly transmitting video data from a photographing apparatus to a display apparatus, comprising:
setting an acquisition resolution for the photographing apparatus to match a display resolution of the display apparatus;
acquiring images by the photographing apparatus with the acquisition resolution and an acquisition frame rate;
performing frame dropping processing on the images to obtain target video image frames;
encoding the target video image frames to obtain encoded target video image frames having an encoded output frame rate, the encoded output frame rate being equal to a display frame rate of the display apparatus and lower than the acquisition frame rate of the photographing apparatus; and
transmitting the encoded target video image frames to the display apparatus.
2. The method according to claim 1 , wherein performing the frame dropping processing on the images to obtain the target video image frames includes:
extracting the target video image frames from the images by equal interval extraction.
3. The method according to claim 1 , wherein performing the frame dropping processing on the images to obtain the target video image frame includes:
fusing a preset number of adjacent video image frames of the images to obtain one of the target video image frames by image fusion.
4. The method according to claim 1 , further comprising:
from optional frame rates corresponding to the set acquisition resolution determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus, selecting a maximum frame rate as the acquisition frame rate.
5. The method according to claim 1 ,
wherein the photographing apparatus is arranged on a movable device,
the method further comprising:
obtaining state information of the movable device; and
adjusting the acquisition frame rate according to the state information.
6. The method according to claim 5 , wherein adjusting the acquisition frame rate according to the state information includes:
increasing the acquisition frame rate in response to the state information indicating that a scenario in which the movable device is located changes; or
decreasing or maintaining the acquisition frame rate in response to the state information indicating that the scenario in which the movable device is located does not change.
7. The method according to claim 6 , wherein:
determining that the scenario changes includes determining that the scenario changes in response to an amount of change in the state information is greater than a threshold; or
determining that the scenario does not change includes determining that the scenario does not change in response to the amount of change in the state information is not greater than the threshold.
8. The method according to claim 5 , wherein the state information includes at least one of a speed, an angle of turning, or an altitude.
9. The method according to claim 1 , wherein setting the acquisition resolution for the photographing apparatus to match a display resolution of the display apparatus includes:
in response to a maximum resolution supported the photographing apparatus being equal to or greater than the display resolution of the display apparatus, setting the acquisition resolution of photographing apparatus to be equal to the display resolution of the display apparatus; and
in response to the maximum resolution supported the photographing apparatus being lower than the display resolution of the display apparatus, setting the acquisition resolution of photographing apparatus to be equal to maximum resolution.
10. A photographing apparatus comprising:
a camera;
a processor coupled to the camera and configured to:
set an acquisition resolution of the camera to match a display resolution of a display apparatus;
control the camera to acquire images with the acquisition resolution and an acquisition frame rate;
perform frame dropping processing on the images to obtain target video image frames; and
encode the target video image frames to obtain encoded target video image frames having an encoded output frame rate, the output frame rate being lower than the acquisition frame rate; and
a transmitter coupled to the processor and configured to transmit the encoded target video image frames to the display apparatus.
11. The photographing apparatus according to claim 10 , wherein the processor is further configured to:
extract the target video image frames from the images by equal interval extraction.
12. The photographing apparatus according to claim 10 , wherein the processor is further configured to:
fuse a preset number of adjacent video image frames of the images to obtain one of the target video image frames by image fusion.
13. The photographing apparatus according to claim 10 , wherein the processor is further configured to:
from optional frame rates corresponding to the set acquisition resolution determined according to a corresponding relation between resolutions and frame rates of the photographing apparatus, select a maximum frame rate as the acquisition frame rate.
14. The photographing apparatus according to claim 10 , wherein:
the photographing apparatus is arranged at a movable device; and
the processor is further configured to:
obtain state information of the movable device; and
adjust the acquisition frame rate according to the state information.
15. The photographing apparatus according to claim 14 , wherein the processor is further configured to:
increase the acquisition frame rate in response to the state information indicating that a scenario in which the movable device is located changes; or
decrease or maintain the acquisition frame rate in response to the state information indicating that the scenario in which the movable device is located does not change.
16. The photographing apparatus according to claim 15 , wherein the processor is further configured to:
determine that the scenario in which the movable device is located changes in response to an amount of change in the state information being greater than a threshold; or
determine that the scenario in which the movable device is located does not change in response to the amount of change in the state information being not greater than the threshold.
17. The photographing apparatus according to claim 14 , wherein the state information includes at least one of a speed, an angle of turning, or an altitude.
18. A photographing apparatus arranged at a movable device, the photographing apparatus comprising:
a camera;
a processor coupled to the camera and configured to:
obtain an altitude of the movable device;
adjust an acquisition frame rate of the camera according to the altitude;
control the camera to acquire images with the acquisition frame rate;
perform frame dropping processing on the images to obtain target video image frames; and
encode the target video image frames to obtain encoded target video image frames having an encoded output frame rate, the output frame rate being lower than the acquisition frame rate; and
a transmitter coupled to the processor and configured to transmit the encoded target video image frames to the display apparatus.
19. The photographing apparatus according to claim 18 , wherein the processor is further configured to:
extract the target video image frames from the images by equal interval extraction.
20. The photographing apparatus according to claim 18 , wherein the processor is further configured to:
fuse a preset number of adjacent video image frames of the images to obtain one of the target video image frames by image fusion.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/838,598 US20200236276A1 (en) | 2016-01-29 | 2020-04-02 | Method, system, device for video data transmission and photographing apparatus |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2016/072854 WO2017128314A1 (en) | 2016-01-29 | 2016-01-29 | Method, system and device for video data transmission, and photographic apparatus |
US16/047,557 US10616480B2 (en) | 2016-01-29 | 2018-07-27 | Method, system, device for video data transmission and photographing apparatus |
US16/838,598 US20200236276A1 (en) | 2016-01-29 | 2020-04-02 | Method, system, device for video data transmission and photographing apparatus |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/047,557 Continuation US10616480B2 (en) | 2016-01-29 | 2018-07-27 | Method, system, device for video data transmission and photographing apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
US20200236276A1 true US20200236276A1 (en) | 2020-07-23 |
Family
ID=59397261
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/047,557 Active US10616480B2 (en) | 2016-01-29 | 2018-07-27 | Method, system, device for video data transmission and photographing apparatus |
US16/838,598 Abandoned US20200236276A1 (en) | 2016-01-29 | 2020-04-02 | Method, system, device for video data transmission and photographing apparatus |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/047,557 Active US10616480B2 (en) | 2016-01-29 | 2018-07-27 | Method, system, device for video data transmission and photographing apparatus |
Country Status (3)
Country | Link |
---|---|
US (2) | US10616480B2 (en) |
CN (2) | CN107079135B (en) |
WO (1) | WO2017128314A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023064581A1 (en) * | 2021-10-14 | 2023-04-20 | Meta Platforms, Inc. | Dynamically identifying visual media capture formats based upon conditions |
US11948533B2 (en) | 2021-02-05 | 2024-04-02 | Samsung Electronics Co., Ltd. | Display system including plurality of displays and image output method thereof |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6941769B2 (en) * | 2016-04-22 | 2021-09-29 | パナソニックIpマネジメント株式会社 | Video splitting method, video splitting device and video processing system |
WO2018212013A1 (en) * | 2017-05-18 | 2018-11-22 | ソニー株式会社 | Information processing device, information processing method and information processing program |
EP3681156B1 (en) * | 2017-09-06 | 2021-07-14 | SZ DJI Technology Co., Ltd. | Method and device for transmitting wireless data |
WO2019090491A1 (en) * | 2017-11-07 | 2019-05-16 | 深圳市大疆创新科技有限公司 | Image data processing and transmission method, and control terminal |
CN110291776B (en) * | 2018-05-30 | 2021-08-03 | 深圳市大疆创新科技有限公司 | Flight control method and aircraft |
WO2020024103A1 (en) * | 2018-07-31 | 2020-02-06 | 深圳市大疆创新科技有限公司 | Video display control method and device, and computer readable storage medium |
CN109168013B (en) * | 2018-09-19 | 2020-09-25 | 广州华多网络科技有限公司 | Method, device and equipment for extracting frame and computer readable storage medium |
CN109040840B (en) | 2018-09-20 | 2021-09-21 | 深圳市道通智能航空技术股份有限公司 | Image transmission method and device, image sending end and aircraft image transmission system |
CN110832539A (en) * | 2018-09-29 | 2020-02-21 | 深圳市大疆创新科技有限公司 | Method for adjusting image transmission resolution, image shooting device and machine-readable storage medium |
CN109714556A (en) * | 2018-12-10 | 2019-05-03 | 珠海研果科技有限公司 | Kinescope method and device when a kind of monocular panorama contracting |
CN110062204A (en) * | 2019-03-13 | 2019-07-26 | 江励 | Instant video remote control technology |
CN111754544B (en) * | 2019-03-29 | 2023-09-05 | 杭州海康威视数字技术股份有限公司 | Video frame fusion method and device and electronic equipment |
CN111988533B (en) * | 2019-05-23 | 2022-07-22 | 川田科技株式会社 | Welding assistance method and device |
CN112335223B (en) * | 2019-10-31 | 2022-03-18 | 深圳市大疆创新科技有限公司 | Control method, device, system, holder, movable platform and storage medium |
CN110996170B (en) * | 2019-12-10 | 2022-02-15 | Oppo广东移动通信有限公司 | Video file playing method and related equipment |
CN111290672A (en) * | 2020-01-17 | 2020-06-16 | 惠州Tcl移动通信有限公司 | Image display method and device, storage medium and terminal |
CN111385637B (en) * | 2020-03-18 | 2022-05-20 | Oppo广东移动通信有限公司 | Media data encoding method and device and electronic equipment |
WO2021237616A1 (en) * | 2020-05-28 | 2021-12-02 | 深圳市大疆创新科技有限公司 | Image transmission method, mobile platform, and computer readable storage medium |
CN113824992B (en) * | 2020-06-19 | 2023-04-14 | 京东方科技集团股份有限公司 | Terminal and uploading method, server and monitoring method, medium, equipment and system |
WO2021253436A1 (en) * | 2020-06-19 | 2021-12-23 | 深圳市大疆创新科技有限公司 | Image processing method, mobile terminal, and electronic device |
CN111757180B (en) * | 2020-07-13 | 2022-10-04 | 杭州海康威视数字技术股份有限公司 | Video display control device, video display system, video display method and device |
CN114071227A (en) * | 2020-08-06 | 2022-02-18 | 北京小米移动软件有限公司 | Data processing method and device |
CN112135190B (en) * | 2020-09-23 | 2022-08-16 | 成都市喜爱科技有限公司 | Video processing method, device, system, server and storage medium |
CN112468781A (en) * | 2020-11-25 | 2021-03-09 | 中国人民解放军国防科技大学 | Array type low-light-level scene video imaging device and method |
WO2022133782A1 (en) * | 2020-12-23 | 2022-06-30 | 深圳市大疆创新科技有限公司 | Video transmission method and system, video processing method and device, playing terminal, and movable platform |
KR20220113180A (en) * | 2021-02-05 | 2022-08-12 | 삼성전자주식회사 | Display system including a plurality of display and method for outputting image the same |
CN114302140B (en) * | 2021-11-30 | 2023-11-03 | 山东云海国创云计算装备产业创新中心有限公司 | Pre-frame-loss method, system, equipment and computer readable storage medium |
CN114827662B (en) * | 2022-03-18 | 2024-06-25 | 百果园技术(新加坡)有限公司 | Video resolution adaptive adjustment method, device, equipment and storage medium |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4515465B2 (en) * | 2004-12-24 | 2010-07-28 | パナソニック株式会社 | Moving picture photographing apparatus and moving picture photographing method, moving picture reproducing apparatus and moving picture reproducing method for reproducing a video signal recorded on a recording medium |
JP4887727B2 (en) * | 2005-10-20 | 2012-02-29 | ソニー株式会社 | Image signal processing apparatus, camera system, and image signal processing method |
US7782993B2 (en) * | 2007-01-04 | 2010-08-24 | Nero Ag | Apparatus for supplying an encoded data signal and method for encoding a data signal |
JP4777274B2 (en) * | 2007-02-19 | 2011-09-21 | キヤノン株式会社 | Video playback apparatus and control method thereof |
JP2009141474A (en) * | 2007-12-04 | 2009-06-25 | Olympus Imaging Corp | Imaging and display apparatus |
CN101345892B (en) * | 2008-08-19 | 2012-10-31 | 北京中星微电子有限公司 | Video display method and system |
CN201251437Y (en) * | 2008-09-12 | 2009-06-03 | 南京信息工程大学 | CCD video real-time display |
CN101778285B (en) * | 2010-02-09 | 2015-10-14 | 中国电信股份有限公司 | A kind of audio-video signal wireless transmitting system and method thereof |
US9137569B2 (en) * | 2010-05-26 | 2015-09-15 | Qualcomm Incorporated | Camera parameter-assisted video frame rate up conversion |
CN102377730A (en) * | 2010-08-11 | 2012-03-14 | 中国电信股份有限公司 | Audio/video signal processing method and mobile terminal |
KR20120105615A (en) * | 2011-03-16 | 2012-09-26 | 삼성전자주식회사 | Color space determination device and display device including the same |
US20140078390A1 (en) * | 2012-09-20 | 2014-03-20 | Broadcom Corporation | Field conversions to slower video rates |
KR101981685B1 (en) * | 2012-10-04 | 2019-08-28 | 삼성전자주식회사 | Display apparatus, user terminal apparatus, external apparatus, display method, data receiving method and data transmitting method |
CN104166614B (en) * | 2013-05-17 | 2017-12-15 | 腾讯科技(深圳)有限公司 | The frame per second detection method and relevant apparatus of a kind of mobile device |
WO2015053352A1 (en) * | 2013-10-10 | 2015-04-16 | シャープ株式会社 | Display device and super-resolution processing method |
CN103986517B (en) * | 2014-05-30 | 2017-01-18 | 中国人民解放军信息工程大学 | Method and system for transmitting information through dynamic two-dimensional image information |
CN105282547B (en) * | 2014-07-03 | 2019-06-25 | 深圳市腾讯计算机***有限公司 | A kind of bit rate control method and device of Video coding |
-
2016
- 2016-01-29 CN CN201680002800.4A patent/CN107079135B/en not_active Expired - Fee Related
- 2016-01-29 WO PCT/CN2016/072854 patent/WO2017128314A1/en active Application Filing
- 2016-01-29 CN CN202010006461.5A patent/CN111182268B/en active Active
-
2018
- 2018-07-27 US US16/047,557 patent/US10616480B2/en active Active
-
2020
- 2020-04-02 US US16/838,598 patent/US20200236276A1/en not_active Abandoned
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11948533B2 (en) | 2021-02-05 | 2024-04-02 | Samsung Electronics Co., Ltd. | Display system including plurality of displays and image output method thereof |
WO2023064581A1 (en) * | 2021-10-14 | 2023-04-20 | Meta Platforms, Inc. | Dynamically identifying visual media capture formats based upon conditions |
Also Published As
Publication number | Publication date |
---|---|
CN111182268B (en) | 2021-08-17 |
CN107079135B (en) | 2020-02-07 |
WO2017128314A1 (en) | 2017-08-03 |
CN111182268A (en) | 2020-05-19 |
CN107079135A (en) | 2017-08-18 |
US10616480B2 (en) | 2020-04-07 |
US20180359413A1 (en) | 2018-12-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200236276A1 (en) | Method, system, device for video data transmission and photographing apparatus | |
US10021339B2 (en) | Electronic device for generating video data | |
EP3289764B1 (en) | Camera mode control | |
CN109076194B (en) | Video processing method, device, aircraft, system and storage medium | |
US20180364705A1 (en) | Monitoring control system, monitoring control device, and monitoring control method | |
US20210278836A1 (en) | Method and device for dual-light image integration, and unmanned aerial vehicle | |
US11523085B2 (en) | Method, system, device for video data transmission and photographing apparatus | |
WO2018133589A1 (en) | Aerial photography method, device, and unmanned aerial vehicle | |
US20200036944A1 (en) | Method and system for video transmission | |
US10735653B1 (en) | Electronic image stabilization to improve video analytics accuracy | |
US20200126286A1 (en) | Method and device for image transmission, movable platform, monitoring device, and system | |
CN113056904A (en) | Image transmission method, movable platform and computer readable storage medium | |
WO2021035756A1 (en) | Aircraft-based patrol inspection method and device, and storage medium | |
WO2017198143A1 (en) | Video processing method, video playback method, set-top box, and vr apparatus | |
CN108512600B (en) | Face-to-face data transmission method and device | |
CN108419052B (en) | Panoramic imaging method for multiple unmanned aerial vehicles | |
US11425316B2 (en) | Image fusion method, image capturing apparatus, and mobile platform system | |
CN110637340A (en) | Speaker control method and device for unmanned aerial vehicle | |
US11303810B2 (en) | Image data processing method, device, platform, and storage medium | |
US20190289322A1 (en) | Video encoding quality through the use of oncamera sensor information | |
US20080174697A1 (en) | Apparatus of processing image sections and control method thereof | |
JP6726649B2 (en) | Flight device, management device, shooting control method, and shooting control program | |
CN111164962A (en) | Image processing method, device, unmanned aerial vehicle, system and storage medium | |
WO2021115192A1 (en) | Image processing device, image processing method, program and recording medium | |
JP6899473B2 (en) | Flight equipment, imaging control methods, and imaging control programs |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SZ DJI TECHNOLOGY CO., LTD., CHINA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WU, JUN;ZHU, LEI;SIGNING DATES FROM 20180717 TO 20180718;REEL/FRAME:052298/0640 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |