CN114125275B - Bandwidth adjustment method and device for shooting device, computer equipment and storage medium - Google Patents
Bandwidth adjustment method and device for shooting device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN114125275B CN114125275B CN202111318050.0A CN202111318050A CN114125275B CN 114125275 B CN114125275 B CN 114125275B CN 202111318050 A CN202111318050 A CN 202111318050A CN 114125275 B CN114125275 B CN 114125275B
- Authority
- CN
- China
- Prior art keywords
- shooting
- target
- devices
- overlapping
- photographing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000005540 biological transmission Effects 0.000 claims abstract description 62
- 238000011156 evaluation Methods 0.000 claims description 25
- 238000003384 imaging method Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 2
- 238000001514 detection method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000012163 sequencing technique Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
- H04N23/662—Transmitting camera control signals through networks, e.g. control via the Internet by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/917—Television signal processing therefor for bandwidth reduction
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a bandwidth adjusting method and device of a shooting device, computer equipment and a storage medium. The method comprises the following steps: if the shooting device of the target area meets the bandwidth adjustment condition, shooting picture information of the shooting device in the target area is determined; according to the shooting picture information of the shooting device, determining a candidate shooting device with overlapped shooting pictures; and sending an overlapped shooting picture cutting instruction to at least one candidate shooting device, and instructing the candidate shooting device to cut the overlapped shooting pictures so as to adjust the transmission bandwidth of the candidate shooting device. By using the technical scheme of the invention, the transmission bandwidth of the shooting device can be reduced while the quality of the shooting picture transmitted by the shooting device is ensured.
Description
Technical Field
The embodiment of the invention relates to the technical field of data transmission, in particular to a bandwidth adjusting method and device of a shooting device, computer equipment and a storage medium.
Background
In the process of real-time transmission of a shooting picture by a shooting device such as a camera, the real-time shooting picture data transmission is interrupted or the transmission quality is poor due to the reasons of network bandwidth, network fluctuation and the like, so that the communication quality is affected.
In the prior art, in order to solve the problem of transmission interruption or poor transmission quality in the real-time transmission process of a shot picture, the bandwidth is generally reduced by adopting a mode of frame extraction and discarding of a shot video frame image, or the data volume is reduced by adopting a mode of reducing the image resolution of a sender of the shot picture. However, the mode of frame extraction and discarding of the video frame image can reduce image picture details, and the mode of reducing the image resolution of the data sender can lead to the reduction of picture definition and image quality.
Disclosure of Invention
The embodiment of the invention provides a bandwidth adjusting method, a device, computer equipment and a storage medium of a shooting device, so as to reduce the transmission bandwidth of the shooting device while guaranteeing the quality of shooting pictures transmitted by the shooting device.
In a first aspect, an embodiment of the present invention provides a method for adjusting bandwidth of a photographing apparatus, where the method includes:
if the shooting device of the target area meets the bandwidth adjustment condition, shooting picture information of the shooting device in the target area is determined;
according to the shooting picture information of the shooting device, determining a candidate shooting device with overlapped shooting pictures;
and sending an overlapped shooting picture cutting instruction to at least one candidate shooting device, and instructing the candidate shooting device to cut the overlapped shooting pictures so as to adjust the transmission bandwidth of the candidate shooting device.
In a second aspect, an embodiment of the present invention further provides a bandwidth adjustment device of a photographing apparatus, where the device includes:
the shooting picture information determining module is used for determining shooting picture information of the shooting device in the target area if the shooting device in the target area meets the bandwidth adjustment condition;
a candidate shooting device determining module, configured to determine, according to shooting picture information of the shooting devices, candidate shooting devices with overlapping shooting pictures;
and the overlapping shooting picture cutting instruction sending module is used for sending an overlapping shooting picture cutting instruction to at least one candidate shooting device and instructing the candidate shooting device to cut the overlapping shooting picture so as to adjust the transmission bandwidth of the candidate shooting device.
In a third aspect, an embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the processor implements a bandwidth adjustment method of a photographing apparatus according to any one of the embodiments of the present invention when the processor executes the program.
In a fourth aspect, embodiments of the present invention further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a bandwidth adjustment method of a photographing apparatus according to any of the embodiments of the present invention.
According to the embodiment of the invention, when the shooting devices in the target area meet the bandwidth adjustment condition, shooting picture information of the shooting devices in the target area is obtained, the candidate shooting devices with overlapped shooting pictures are determined according to the shooting picture information, at least one candidate shooting device is selected, and an overlapped shooting picture cutting instruction is sent to the candidate shooting device so as to instruct the candidate shooting devices to cut the overlapped shooting pictures, and the transmission bandwidth is reduced. The bandwidth adjusting method solves the problems that in the prior art, the details of an image picture can be reduced, the definition of the picture is reduced, and the quality of the image is reduced, and reduces the transmission bandwidth of a shooting device while ensuring the quality of the shooting picture transmitted by the shooting device.
Drawings
Fig. 1 is a flowchart of a bandwidth adjustment method of a photographing apparatus according to a first embodiment of the present invention;
fig. 2a is a flowchart of a bandwidth adjustment method of a photographing apparatus according to a second embodiment of the present invention;
fig. 2b is a schematic view illustrating cropping of overlapping shooting pictures of a target shooting device according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a bandwidth adjusting device of a photographing device according to a third embodiment of the present invention;
fig. 4 is a schematic structural diagram of a computer device in a fourth embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
Fig. 1 is a flowchart of a bandwidth adjustment method for a photographing device according to an embodiment of the present invention, where the method is applicable to bandwidth adjustment of a photographing device in a target area when transmission is interrupted or transmission quality is poor, and the method may be performed by a bandwidth adjustment device for a photographing device, which may be implemented by software and/or hardware and is generally integrated in a computer device, and used in cooperation with each photographing device in the target area.
As shown in fig. 1, the technical solution of the embodiment of the present invention specifically includes the following steps:
s110, if the shooting device of the target area meets the bandwidth adjustment condition, shooting picture information of the shooting device in the target area is determined.
The target area comprises at least two associated shooting devices, and the association refers to that the visual areas of the shooting devices are adjacent or the geographic positions of the shooting devices are adjacent.
Optionally, the determining that the photographing device of the target area meets the bandwidth adjustment condition includes: if the shooting devices in the target area are determined to meet the packet loss condition and the sum of the transmission bandwidths required by the shooting devices meets the transmission bandwidth condition, the shooting devices in the target area are determined to meet the bandwidth adjustment condition.
Packet loss (Packet loss) means that data of one or more data packets cannot reach a destination through the internet, and in the embodiment of the present invention, a shooting device in a target area meets a Packet loss condition, which may mean that a Packet loss event exists, that is, a shooting device exists in the target area, and transmission of video data transmitted by the shooting device is interrupted. The packet loss rate of each photographing device may be greater than or equal to a certain value, which is not limited in this embodiment.
The transmission bandwidth required by each photographing device, that is, the bandwidth required to be occupied by the video data currently transmitted by each photographing device, where the sum of the transmission bandwidths required by each photographing device meets the transmission bandwidth condition, may mean that the sum of the transmission bandwidths required by each photographing device is greater than the available bandwidth of the current link, or the difference between the sum of the transmission bandwidths required by each photographing device and the available bandwidth of the current link is greater than a certain value, which is not limited in this embodiment. The available bandwidth of the current link, i.e., the maximum transmission rate of the link over which the camera is transmitting video data.
In the embodiment of the invention, if the shooting devices in the target area meet the packet loss condition and the sum of the transmission bandwidths required by the shooting devices meets the transmission bandwidth condition, bandwidth adjustment is required to be performed on the shooting devices in the target area so as to prevent the occurrence of a packet loss event.
The image information may be an image of the image captured by the image capturing device or may be positional information of the image captured by the image capturing device. The image information of each image pickup device in the target area is acquired in order to determine the target image pickup device having the overlapped image pickup image, and the present embodiment does not limit the form of the image pickup image information.
S120, determining candidate shooting devices with overlapped shooting pictures according to shooting picture information of the shooting devices.
In the embodiment of the present invention, when the shot image information is an image of the shot image shot by the shooting device, whether the shot images between the shooting devices overlap or not may be determined by the image processing technology, and the embodiment does not limit the image processing technology. When the shot picture information is the position information of the shot pictures of the shooting devices, whether the shot pictures of the shooting devices are overlapped or not can be determined by judging whether the position information of the shooting devices is overlapped or not.
And S130, sending an overlapped shooting picture cutting instruction to at least one candidate shooting device, and instructing the candidate shooting device to cut the overlapped shooting picture so as to adjust the transmission bandwidth of the candidate shooting device.
When there are candidate photographing apparatuses whose photographing screens overlap, a overlapping photographing screen cropping instruction is transmitted to at least one of the candidate photographing apparatuses. When the candidate shooting device receives the overlapping shooting picture cutting instruction, shooting picture adjusting parameters are determined according to the overlapping shooting picture cutting instruction, and the image sensor is adjusted according to the shooting picture adjusting parameters, so that the purpose of cutting the overlapping shooting pictures is achieved.
In the embodiment of the invention, by clipping the overlapped shooting pictures in the candidate shooting devices, the transmission bandwidth of the candidate shooting devices can be reduced by reducing the size of the shooting pictures of the candidate shooting devices, and because the clipped shooting pictures are overlapped, the clipped shooting pictures can be observed by other candidate shooting devices, so that the shooting picture quality of each shooting device is not influenced.
On the premise that the bandwidth requirement can be met, only the overlapped shooting pictures of part of the candidate shooting devices can be cut, and only part of areas in the overlapped shooting pictures can be cut, so that the completeness of the shooting pictures of all the shooting devices is ensured.
According to the technical scheme of the embodiment, when the shooting devices in the target area meet the bandwidth adjustment condition, shooting picture information of the shooting devices in the target area is obtained, candidate shooting devices with overlapped shooting pictures are determined according to the shooting picture information, at least one candidate shooting device is selected, and an overlapped shooting picture cutting instruction is sent to the at least one candidate shooting device so as to instruct the candidate shooting devices to cut the overlapped shooting pictures, and therefore transmission bandwidth is reduced. The bandwidth adjusting method solves the problems that in the prior art, the details of an image picture can be reduced, the definition of the picture is reduced, and the quality of the image is reduced, and reduces the transmission bandwidth of a shooting device while ensuring the quality of the shooting picture transmitted by the shooting device.
Example two
Fig. 2a is a flowchart of a bandwidth adjustment method of a photographing device according to a second embodiment of the present invention, where the process of selecting a candidate photographing device from the candidate photographing devices to send an overlapping photographing picture cropping command is further embodied in a specific case that the photographing device of the target area meets the bandwidth adjustment condition based on the above embodiment.
Correspondingly, as shown in fig. 2a, the technical solution of the embodiment of the present invention specifically includes the following steps:
s210, judging whether the shooting device in the target area meets the packet loss condition, if so, executing S220, otherwise, returning to executing S210.
In the embodiment of the present invention, whether the photographing device in the target area meets the packet loss condition may be implemented by a detection module, where the detection module may be deployed in a photographing device management server, a computer device for viewing a photographing picture of the photographing device, or a storage server for storing video data.
S220, judging whether the sum of the transmission bandwidths required by the shooting devices meets the transmission bandwidth condition, if so, executing S230, otherwise, returning to executing S210.
The transmission bandwidth required by each shooting device may be calculated according to the preset code stream size of the shooting device, or may be reported by each shooting device according to the specific service condition of video data transmission, which is not limited in this embodiment.
In this embodiment, the current link is taken as a whole, and whether the bandwidth is limited is determined. Alternatively, for each link of the current link, the bottleneck of the bandwidth limitation and the use condition of the current bandwidth can be determined, and for each photographing device corresponding to the link of the bandwidth limitation, the candidate photographing device with the overlapped photographing picture is determined.
Optionally, when a certain shooting device has a multi-channel on-demand condition, that is, when video data of the shooting device needs to be transmitted for multiple times, bandwidths of all channels of video data of the shooting device need to be accumulated, and a transmission bandwidth required by the shooting device is determined.
S230, determining shooting picture information of the shooting device in the target area.
The method comprises the steps that shooting picture information of each shooting device is preset, and when the shooting device in a target area meets the bandwidth adjustment condition, the shooting picture information of each shooting device is acquired.
Specifically, the photographing devices connected to the switch may be uniformly registered in the photographing device management server, and photographing screen information of each photographing device may be configured by the photographing device management server.
S240, determining candidate shooting devices with overlapped shooting pictures according to shooting picture information of the shooting devices.
S250, among the candidate shooting devices corresponding to the same overlapped shooting picture, a target shooting device for cutting out the overlapped shooting picture is determined.
In the embodiment of the invention, in order to ensure that the shot images of the target area remain intact after the overlapped shot images of the target shooting device are cut, it is necessary to ensure that the overlapped shot images of at least one candidate shooting device among the candidate shooting devices corresponding to the same overlapped shot image are not cut.
Accordingly, S250 may further include:
s251, evaluation values of the candidate shooting devices are respectively calculated according to at least one item of attribute information of the candidate shooting devices with overlapped shooting pictures and influence coefficients of the attribute information.
The attribute information may include an image resolution, an amount of motion, a priority, and the like of the photographing apparatus, and an influence coefficient of the attribute information may be set in advance.
Image resolution refers to the resolution of an image captured by a camera, and the amount of motion is used to represent the complexity of a moving scene in the image or video captured by the camera. For example, the moving object detection may be performed on an image or video captured by the capturing device through an object detection algorithm, the object moving area may be identified, and the amount of motion may be determined according to the object moving area. For example, the amount of motion may be calculated based on the pixel size of the target motion area and the pixel size of the image captured by the capturing device, but the present embodiment is not limited to the manner in which the motion area is detected and the manner in which the motion amount is determined based on the motion area. The priority is used to indicate the importance of the photographing device, and for example, a higher priority may be set for photographing devices whose photographed screen includes a gate, and the like. The evaluation values of the candidate cameras having overlapping images are calculated, respectively, to thereby determine which candidate camera or cameras is/are subjected to cropping of the overlapping images.
S252, a target shooting device for cutting out the overlapped shooting picture is determined according to the evaluation value of each candidate shooting device corresponding to the same overlapped shooting picture.
Alternatively, determining the target photographing device to crop for the overlapping photographing picture from among the evaluation values of the candidate photographing devices corresponding to the same overlapping photographing picture may include: for each candidate image capturing device corresponding to the same overlapping image capturing frame, a target image capturing device for clipping the overlapping image capturing frame is selected in order of low evaluation value.
Specifically, it may be set that the lower the image resolution, the lower the evaluation value, the smaller the amount of motion, the lower the evaluation value, the lower the priority, and the lower the evaluation value. That is, the photographing devices having low image resolution, small motion amount, and low priority are preferentially selected to cut out the overlapping photographed pictures, so that the photographed picture quality of each photographing device is ensured to the maximum extent.
Illustratively, when there is an overlapping shot 1 for camera a and camera B, an overlapping shot 2 for camera B and camera C, and an overlapping shot 3 for camera D and camera E, and the evaluation values of the respective cameras increase in order from a to E. At this time, if the overlapping shot 1 needs to be cut, the area of the overlapping shot 1 in the shooting device a is selected for cutting, and the shooting device a is set as the target shooting device for the overlapping shot 1. Similarly, the image pickup device B is set as the target image pickup device for the superimposed image pickup screen 2, and the image pickup device D is set as the target image pickup device for the superimposed image pickup screen 3.
And S260, sending an overlapping shooting picture cutting instruction to at least one target shooting device.
In the embodiment of the invention, after the target shooting devices aiming at each overlapped shooting picture are selected, the target shooting devices meeting the conditions are determined according to different degrees of bandwidth limitation, so that the completeness of the shooting pictures of the shooting devices is maintained to the maximum extent on the premise of ensuring the bandwidth requirement.
Optionally, S260 may further include:
s261, calculating the regional code stream difference value according to the difference value between the sum of the bandwidths required by the shooting devices and the available bandwidth of the current link.
According to the code stream difference value and the area code stream difference value of each target shooting device, whether the bandwidth requirement of the target area can be met after the target shooting devices are subjected to overlapping shooting picture cutting can be judged.
S262, calculating the code stream difference value of each target shooting device according to the resolution of each target shooting device.
According to the resolution of each target shooting device and the video coding mode, the difference value between the size of the code stream of the target shooting device after cutting the overlapped shooting pictures and the size of the code stream before cutting can be calculated.
S263, judging whether the sum of the code stream difference values of the target shooting devices is smaller than the regional code stream difference value, if yes, executing S264, otherwise executing S265.
If the sum of the code stream difference values of all the target shooting devices is larger than the area code stream difference value, the method indicates that the bandwidth requirement of the target area cannot be met after the overlapped shooting pictures of all the target shooting devices are cut. At this time, it is necessary to newly identify the target imaging device that performs clipping for the overlapping imaging screen.
S264, the target shooting device for clipping the overlapped shooting pictures is determined again. S265 is performed.
Specifically, the re-determining the target capturing device for clipping the overlapping capturing images may include: for each candidate image capturing device corresponding to the same overlapping image capturing frame, a target image capturing device for clipping the overlapping image capturing frame is selected in order of high evaluation value.
That is, when the overlapping shot images of all the target shooting devices are cut, and the bandwidth requirement of the target area cannot be satisfied, the shooting devices having high image resolution, large motion amount, and high priority are preferentially selected to cut the overlapping shot images.
In the present embodiment, when the overlapping images of all the target cameras are cut and the bandwidth requirement of the target area cannot be satisfied, the target cameras are newly determined for all the overlapping images. And sequencing the current target shooting devices according to the evaluation values, and sequentially re-determining the target shooting devices for the corresponding overlapped shooting pictures of the target shooting devices according to the sequence from low to high of the evaluation values of the target shooting devices until the sum of the code stream difference values of the re-determined target shooting devices is smaller than the regional code stream difference value.
S265, determining the target shooting device meeting the condition according to the code stream difference value and the regional code stream difference value of each target shooting device.
Optionally, S265 may further include:
s2651, sorting the target cameras according to the evaluation values of the target cameras.
When the sum of the code stream difference values of the target shooting devices is smaller than the area code stream difference value, the overlapping shooting pictures of part of the target shooting devices are cut, and the bandwidth requirement of the target area can be met. Therefore, the target cameras are ranked according to the evaluation values, and whether the bandwidth requirement of the target area can be met after the overlapping shooting pictures of the target cameras are cut is sequentially judged according to the order from low to high of the evaluation values of the target cameras.
S2652, sequentially selecting target shooting devices, and taking the currently selected target shooting device as the target shooting device meeting the condition.
S2653, judging whether the sum of the code stream difference value of the currently selected target shooting device and the code stream difference value of the target shooting device before the currently selected target shooting device is larger than the regional code stream difference value, if yes, executing S270, otherwise, returning to executing S2652.
In the embodiment of the invention, the target shooting devices are sequentially selected according to the order of the evaluation values from low to high until the sum of the code stream difference values of the currently selected target shooting device and the previous target shooting device is larger than the regional code stream difference value. And sending a cutting instruction of the overlapped shooting pictures to each selected target shooting device, and cutting the overlapped shooting picture area.
S270, sending an overlapping shooting picture cutting instruction to a target shooting device meeting the conditions.
Fig. 2b provides a schematic view of cropping the overlapping shot of the target shooting device, as shown in fig. 2b, taking the resolution of 720P as an example, the coordinates of the lower left corner and the upper right corner of the original shot of the target shooting device are (0, 0) and (720, 576), respectively, and the coordinates of the lower left corner and the upper right corner of the shot after cropping the overlapping shot are (50, 40) and (690,520), respectively.
After the coordinate information of the shot pictures after clipping is determined, a clipping instruction of the overlapped shot pictures can be generated according to the coordinate information and sent to the target shooting device meeting the conditions. After receiving the overlapping shooting picture cutting instruction, the target shooting device meeting the conditions determines shooting picture adjusting parameters of the image sensor according to the coordinate information, so that the effect of shooting picture cutting is achieved.
In the embodiment of the invention, the overlapping area is adjusted to only reduce the shooting picture of the shooting device, the quality of the shooting picture is not affected, and the cut area can still be obtained through shooting by other shooting devices, so that compared with the mode of reducing the resolution of the shooting picture in the prior art, the quality of the shooting picture can be ensured under the condition of meeting the requirement of reducing the bandwidth.
According to the technical scheme of the embodiment, when the shooting devices in the target area meet the packet loss condition and the sum of transmission bandwidths required by the shooting devices meets the transmission bandwidth condition, shooting picture information of the shooting devices in the target area is acquired, candidate shooting devices with overlapped shooting pictures are determined according to the shooting picture information, evaluation values of the candidate shooting devices are calculated, target shooting devices for cutting the overlapped shooting pictures are determined according to the evaluation values for the candidate shooting devices corresponding to the same overlapped shooting picture, at least one target shooting device is selected according to a code stream difference value of the target shooting devices in the target shooting devices corresponding to the overlapped shooting pictures, and an overlapped shooting picture cutting instruction is sent to the target shooting devices so as to instruct the target shooting devices to cut the overlapped shooting pictures, and the transmission bandwidths are reduced. The bandwidth adjusting method solves the problems that in the prior art, the details of an image picture can be reduced, the definition of the picture is reduced, and the quality of the image is reduced, and reduces the transmission bandwidth of a shooting device while ensuring the quality of the shooting picture transmitted by the shooting device.
Example III
Fig. 3 is a schematic structural diagram of a bandwidth adjusting device of a photographing device according to a third embodiment of the present invention, where the device includes: the shot screen information determination module 310, the candidate shooting device determination module 320, and the overlapping shot screen cropping instruction transmission module 330. Wherein:
a shot image information determining module 310, configured to determine shot image information of the shooting device in the target area if the shooting device in the target area satisfies the bandwidth adjustment condition;
a candidate shooting device determining module 320, configured to determine, according to shooting picture information of the shooting devices, candidate shooting devices with overlapping shooting pictures;
and the overlapping shot picture cropping instruction sending module 330 is configured to send an overlapping shot picture cropping instruction to at least one candidate shooting device, and instruct the candidate shooting device to crop the overlapping shot picture, so as to adjust the transmission bandwidth of the candidate shooting device.
According to the technical scheme of the embodiment, when the shooting devices in the target area meet the bandwidth adjustment condition, shooting picture information of the shooting devices in the target area is obtained, candidate shooting devices with overlapped shooting pictures are determined according to the shooting picture information, at least one candidate shooting device is selected, and an overlapped shooting picture cutting instruction is sent to the at least one candidate shooting device so as to instruct the candidate shooting devices to cut the overlapped shooting pictures, and therefore transmission bandwidth is reduced. The bandwidth adjusting method solves the problems that in the prior art, the details of an image picture can be reduced, the definition of the picture is reduced, and the quality of the image is reduced, and reduces the transmission bandwidth of a shooting device while ensuring the quality of the shooting picture transmitted by the shooting device.
On the basis of the above embodiment, the shot screen information determining module 310 includes:
and the bandwidth adjustment condition judging unit is used for determining that the shooting device in the target area meets the bandwidth adjustment condition if the shooting device in the target area meets the packet loss condition and the sum of the transmission bandwidths required by the shooting devices meets the transmission bandwidth condition.
On the basis of the above embodiment, the overlapping shot clipping instruction transmission module 330 includes:
a target photographing device determining unit configured to determine, among the candidate photographing devices corresponding to the same overlapping photographing picture, a target photographing device that performs clipping for the overlapping photographing picture;
and the overlapping shooting picture cropping instruction sending unit is used for sending an overlapping shooting picture cropping instruction to at least one target shooting device.
On the basis of the above embodiment, the overlapping shot picture cropping instruction transmitting unit includes:
the regional code stream difference value calculating subunit is used for calculating the regional code stream difference value according to the difference value between the sum of bandwidths required by the shooting devices and the available bandwidth of the current link;
a code stream difference value calculating subunit, configured to calculate a code stream difference value of each target shooting device according to the resolution of each target shooting device;
and the overlapping shooting picture cutting instruction sending subunit is used for determining the target shooting devices meeting the conditions according to the code stream difference value and the area code stream difference value of each target shooting device and sending the overlapping shooting picture cutting instruction to the target shooting devices meeting the conditions.
On the basis of the above-described embodiments, the object photographing device determining unit includes:
an evaluation value calculation subunit, configured to calculate, according to at least one item of attribute information of each candidate image capturing device having overlapping image capturing frames and an influence coefficient of the attribute information, an evaluation value of each candidate image capturing device;
and a target imaging device determination subunit configured to determine, from the evaluation values of the candidate imaging devices corresponding to the same overlapping imaging frame, a target imaging device for cropping the overlapping imaging frame.
On the basis of the above embodiment, the overlapping shooting picture cropping instruction transmitting subunit is specifically configured to:
sorting the target photographing devices according to the evaluation values of the target photographing devices;
and sequentially selecting target shooting devices, taking the currently selected target shooting device as the target shooting device meeting the condition until the sum of the code stream difference value of the currently selected target shooting device and the code stream difference value of the target shooting device before the currently selected target shooting device is larger than the regional code stream difference value.
On the basis of the above embodiment, the overlapping shooting picture cropping instruction transmitting subunit is specifically configured to:
if the sum of the code stream difference values of the target shooting devices is smaller than the regional code stream difference value, the target shooting devices for cutting the overlapped shooting pictures are determined again;
and determining the target shooting device meeting the condition according to the code stream difference value and the area code stream difference value of the re-determined target shooting device.
The bandwidth adjusting device of the photographing device provided by the embodiment of the invention can execute the bandwidth adjusting method of the photographing device provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the executing method.
Example IV
Fig. 4 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention, and as shown in fig. 4, the computer device includes a processor 70, a memory 71, an input device 72 and an output device 73; the number of processors 70 in the computer device may be one or more, one processor 70 being taken as an example in fig. 4; the processor 70, memory 71, input means 72 and output means 73 in the computer device may be connected by a bus or other means, in fig. 4 by way of example.
The memory 71 is a computer-readable storage medium that can be used to store a software program, a computer-executable program, and modules, such as modules corresponding to the bandwidth adjustment method of the photographing apparatus in the embodiment of the invention (for example, the photographing picture information determination module 310, the candidate photographing apparatus determination module 320, and the overlapping photographing picture cropping instruction transmission module 330 in the bandwidth adjustment apparatus of the photographing apparatus). The processor 70 executes various functional applications of the computer device and data processing by executing software programs, instructions, and modules stored in the memory 71, that is, implements the bandwidth adjustment method of the photographing apparatus described above. The method comprises the following steps:
if the shooting device of the target area meets the bandwidth adjustment condition, shooting picture information of the shooting device in the target area is determined;
according to the shooting picture information of the shooting device, determining a candidate shooting device with overlapped shooting pictures;
and sending an overlapped shooting picture cutting instruction to at least one candidate shooting device, and instructing the candidate shooting device to cut the overlapped shooting pictures so as to adjust the transmission bandwidth of the candidate shooting device.
The memory 71 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, at least one application program required for functions; the storage data area may store data created according to the use of the terminal, etc. In addition, memory 71 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 71 may further include memory remotely located relative to processor 70, which may be connected to the computer device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input device 72 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the computer device. The output means 73 may comprise a display device such as a display screen.
Example five
A fifth embodiment of the present invention also provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are for performing a bandwidth adjustment method of a photographing apparatus, the method comprising:
if the shooting device of the target area meets the bandwidth adjustment condition, shooting picture information of the shooting device in the target area is determined;
according to the shooting picture information of the shooting device, determining a candidate shooting device with overlapped shooting pictures;
and sending an overlapped shooting picture cutting instruction to at least one candidate shooting device, and instructing the candidate shooting device to cut the overlapped shooting pictures so as to adjust the transmission bandwidth of the candidate shooting device.
Of course, the storage medium containing the computer executable instructions provided in the embodiments of the present invention is not limited to the above-described method operations, and may also perform the related operations in the bandwidth adjustment method of the photographing device provided in any embodiment of the present invention.
From the above description of embodiments, it will be clear to a person skilled in the art that the present invention may be implemented by means of software and necessary general purpose hardware, but of course also by means of hardware, although in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a FLASH Memory (FLASH), a hard disk or an optical disk of a computer, etc., and include several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments of the present invention.
It should be noted that, in the embodiment of the bandwidth adjusting apparatus of the photographing apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the present invention.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (7)
1. A bandwidth adjustment method for a photographing apparatus, comprising:
if the shooting device of the target area meets the bandwidth adjustment condition, shooting picture information of the shooting device in the target area is determined;
determining that the photographing device of the target area meets the bandwidth adjustment condition includes: if the shooting devices in the target area are determined to meet the packet loss condition and the sum of the transmission bandwidths required by the shooting devices meets the transmission bandwidth condition, determining that the shooting devices in the target area meet the bandwidth adjustment condition;
wherein, shooting device in the target area satisfies packet loss condition includes: the shooting devices in the target area have packet loss events, and the sum of transmission bandwidths required by all the shooting devices meets the transmission bandwidth condition, and the method comprises the following steps: the sum of the transmission bandwidths required by the shooting devices is larger than the available bandwidth of the current link;
according to the shooting picture information of the shooting device, determining a candidate shooting device with overlapped shooting pictures;
transmitting an overlapping shot picture cropping instruction to at least one candidate shooting device, instructing the candidate shooting device to crop overlapping shot pictures to adjust a transmission bandwidth of the candidate shooting device, comprising:
among the candidate photographing devices corresponding to the same overlapping photographing picture, a target photographing device for cutting out the overlapping photographing picture is determined;
transmitting an overlapping shot picture cropping instruction to at least one target shooting device, comprising:
calculating the difference value of the regional code stream according to the difference value between the sum of the bandwidths required by the shooting devices and the available bandwidth of the current link;
calculating the code stream difference value of each target shooting device according to the resolution ratio of each target shooting device;
and determining the target shooting devices meeting the conditions according to the code stream difference values of the target shooting devices and the regional code stream difference values, and sending an overlapping shooting picture cutting instruction to the target shooting devices meeting the conditions.
2. The method according to claim 1, wherein the step of determining, among the candidate photographing devices corresponding to the same overlapping photographing screen, the target photographing device that performs clipping for the overlapping photographing screen, includes:
calculating the evaluation value of each candidate shooting device according to at least one item of attribute information of each candidate shooting device with overlapped shooting pictures and the influence coefficient of the attribute information;
the target imaging device for cutting out the overlapping imaging screen is specified from the evaluation values of the candidate imaging devices corresponding to the same overlapping imaging screen.
3. The method of claim 2, wherein determining the target cameras satisfying the condition based on the code stream difference value and the area code stream difference value of each target camera comprises:
sorting the target photographing devices according to the evaluation values of the target photographing devices;
and sequentially selecting target shooting devices, taking the currently selected target shooting device as the target shooting device meeting the condition until the sum of the code stream difference value of the currently selected target shooting device and the code stream difference value of the target shooting device before the currently selected target shooting device is larger than the regional code stream difference value.
4. The method of claim 2, wherein determining the target cameras satisfying the condition based on the code stream difference value and the area code stream difference value of each target camera further comprises:
if the sum of the code stream difference values of the target shooting devices is smaller than the regional code stream difference value, the target shooting devices for cutting the overlapped shooting pictures are determined again;
and determining the target shooting device meeting the condition according to the code stream difference value and the area code stream difference value of the re-determined target shooting device.
5. A bandwidth adjusting apparatus of a photographing apparatus, comprising:
the shooting picture information determining module is used for determining shooting picture information of the shooting device in the target area if the shooting device in the target area meets the bandwidth adjustment condition;
a shot picture information determination module comprising:
a bandwidth adjustment condition judging unit, configured to determine that the photographing device in the target area meets a bandwidth adjustment condition if it is determined that the photographing device in the target area meets a packet loss condition and the sum of transmission bandwidths required by the photographing devices meets a transmission bandwidth condition;
wherein, shooting device in the target area satisfies packet loss condition includes: the shooting devices in the target area have packet loss events, and the sum of transmission bandwidths required by all the shooting devices meets the transmission bandwidth condition, and the method comprises the following steps: the sum of the transmission bandwidths required by the shooting devices is larger than the available bandwidth of the current link;
a candidate shooting device determining module, configured to determine, according to shooting picture information of the shooting devices, candidate shooting devices with overlapping shooting pictures;
the overlapping shooting picture cutting instruction sending module is used for sending an overlapping shooting picture cutting instruction to at least one candidate shooting device and instructing the candidate shooting device to cut the overlapping shooting picture so as to adjust the transmission bandwidth of the candidate shooting device;
the overlapping shooting picture cutting instruction sending module comprises:
a target photographing device determining unit configured to determine, among the candidate photographing devices corresponding to the same overlapping photographing picture, a target photographing device that performs clipping for the overlapping photographing picture;
the overlapping shooting picture cutting instruction sending unit is used for sending an overlapping shooting picture cutting instruction to at least one target shooting device;
an overlapping shot picture cropping instruction transmitting unit includes:
the regional code stream difference value calculating subunit is used for calculating the regional code stream difference value according to the difference value between the sum of bandwidths required by the shooting devices and the available bandwidth of the current link;
a code stream difference value calculating subunit, configured to calculate a code stream difference value of each target shooting device according to the resolution of each target shooting device;
and the overlapping shooting picture cutting instruction sending subunit is used for determining the target shooting devices meeting the conditions according to the code stream difference value and the area code stream difference value of each target shooting device and sending the overlapping shooting picture cutting instruction to the target shooting devices meeting the conditions.
6. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements a method for bandwidth adjustment of a camera according to any of claims 1-4 when executing the program.
7. A storage medium containing computer executable instructions which, when executed by a computer processor, are for performing the bandwidth adjustment method of a camera as claimed in any one of claims 1-4.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111318050.0A CN114125275B (en) | 2021-11-09 | 2021-11-09 | Bandwidth adjustment method and device for shooting device, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111318050.0A CN114125275B (en) | 2021-11-09 | 2021-11-09 | Bandwidth adjustment method and device for shooting device, computer equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114125275A CN114125275A (en) | 2022-03-01 |
CN114125275B true CN114125275B (en) | 2024-02-23 |
Family
ID=80377662
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111318050.0A Active CN114125275B (en) | 2021-11-09 | 2021-11-09 | Bandwidth adjustment method and device for shooting device, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114125275B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004194187A (en) * | 2002-12-13 | 2004-07-08 | Canon Inc | Image transmission device, image receiver, and image-transmitting/receiving system |
DE102016218123A1 (en) * | 2016-09-21 | 2018-03-22 | Bayerische Motoren Werke Aktiengesellschaft | Method for image processing in a means of transportation |
CN108289197A (en) * | 2017-12-29 | 2018-07-17 | 深圳市朗诚科技股份有限公司 | Buoy 4G wireless video monitorings monitoring method and system |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190028721A1 (en) * | 2014-11-18 | 2019-01-24 | Elwha Llc | Imaging device system with edge processing |
-
2021
- 2021-11-09 CN CN202111318050.0A patent/CN114125275B/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004194187A (en) * | 2002-12-13 | 2004-07-08 | Canon Inc | Image transmission device, image receiver, and image-transmitting/receiving system |
DE102016218123A1 (en) * | 2016-09-21 | 2018-03-22 | Bayerische Motoren Werke Aktiengesellschaft | Method for image processing in a means of transportation |
CN108289197A (en) * | 2017-12-29 | 2018-07-17 | 深圳市朗诚科技股份有限公司 | Buoy 4G wireless video monitorings monitoring method and system |
Also Published As
Publication number | Publication date |
---|---|
CN114125275A (en) | 2022-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3300017B1 (en) | Method and apparatus for processing wide angle image | |
US8305448B2 (en) | Selective privacy protection for imaged matter | |
US11089214B2 (en) | Generating output video from video streams | |
US9253411B2 (en) | Image processing apparatus, image processing method and image communication system | |
US20080313683A1 (en) | Moving image communication device, moving image communication system and semiconductor integrated circuit used for communication of moving image | |
US20060152605A1 (en) | Image processing apparatus, image processing method, and program | |
CN113068001B (en) | Data processing method, device, equipment and medium based on cascade camera | |
JP2014222825A (en) | Video processing apparatus and video processing method | |
JP2018137567A (en) | Video transmitter and video receiver | |
CN108600675B (en) | Channel path number expansion method, device, network video recorder and storage medium | |
US20220199120A1 (en) | Image processing device, image processing method, and image processing program | |
US20120268605A1 (en) | Image display device | |
US20190349616A1 (en) | Method and device for transmitting video | |
CN114125275B (en) | Bandwidth adjustment method and device for shooting device, computer equipment and storage medium | |
WO2021078269A1 (en) | Image processing method and apparatus, aerial camera and storage medium | |
KR101612312B1 (en) | DATA processing improvement device and method thereof | |
EP3468188A1 (en) | Method and system for encoding video streams | |
US20140327781A1 (en) | Method for video surveillance, a related system, a related surveillance server, and a related surveillance camera | |
CN112492261A (en) | Tracking shooting method and device and monitoring system | |
CN111836020B (en) | Code stream transmission method and device in monitoring system and storage medium | |
KR101583598B1 (en) | Camera, service server, system and method for processing high-resolution image | |
JP4329429B2 (en) | Image transfer apparatus, image transfer method, and image transfer program | |
US20160149787A1 (en) | Data transmission system, data transmission monitoring method, and computer-readable medium | |
CN114143471A (en) | Image processing method, system, mobile terminal and computer readable storage medium | |
US20140161199A1 (en) | Method and apparatus for processing video image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |