CN118042299A - Live video acquisition frame rate adjustment method, system, equipment and storage medium - Google Patents
Live video acquisition frame rate adjustment method, system, equipment and storage medium Download PDFInfo
- Publication number
- CN118042299A CN118042299A CN202410293910.7A CN202410293910A CN118042299A CN 118042299 A CN118042299 A CN 118042299A CN 202410293910 A CN202410293910 A CN 202410293910A CN 118042299 A CN118042299 A CN 118042299A
- Authority
- CN
- China
- Prior art keywords
- brightness
- image
- frame rate
- video
- live video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 238000001514 detection method Methods 0.000 claims description 47
- 238000012545 processing Methods 0.000 claims description 17
- 238000010606 normalization Methods 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 238000009499 grossing Methods 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 21
- 238000010438 heat treatment Methods 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 12
- 230000008859 change Effects 0.000 description 9
- 238000011156 evaluation Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 239000002699 waste material Substances 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000011895 specific detection Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The embodiment of the application discloses a live video acquisition frame rate adjustment method, a live video acquisition frame rate adjustment system, live video acquisition frame rate adjustment equipment and a storage medium. According to the technical scheme provided by the embodiment of the application, the image brightness value of the video image collected by the camera module in a history mode is obtained by detecting the brightness of the video image; detecting the brightness state of the current live video based on the image brightness value; and under the condition that the current live video is detected to be in the set brightness state, reducing the acquisition frame rate of the video image acquisition by the camera module. By adopting the technical means, the brightness state of the collected live video image is detected, the collection frame rate of the live video is adjusted when the brightness state is set, the accurate adjustment of the frame rate of the live video image is ensured, the problems of high power consumption, heating and the like of equipment caused by high image frame rate are avoided, the live video effect is improved, and the live video experience of a user is optimized.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to a live video acquisition frame rate adjustment method, a live video acquisition frame rate adjustment system, live video acquisition frame rate adjustment equipment and a storage medium.
Background
At present, in a live video scene, a main broadcasting end needs to continuously acquire video images, and a large amount of video frame data needs to be subjected to special effects and coding treatment, so that the energy consumption of equipment at the main broadcasting end is overlarge, the heating problem of the equipment occurs, and the live video application is slow to run. For this reason, the purpose of reducing power consumption is generally achieved by reducing the frame rate of video images when special effect processing and encoding transmission are performed.
But simply reduce the frame rate of video image in special effect processing and encoding sending process, can't accurately carry out video frame rate adjustment, because video image can't adjust to reasonable minimum, still have the too high problem of equipment consumption, lower image frame rate also can influence live video display effect simultaneously, and then lead to the video live effect relatively poor.
Disclosure of Invention
The embodiment of the application provides a live video acquisition frame rate adjustment method, a system, equipment and a storage medium, which can adaptively adjust the live video image acquisition frame rate and solve the problem of setting errors of the live video image frame rate.
In a first aspect, an embodiment of the present application provides a method for adjusting a frame rate of live video acquisition, including:
Acquiring an image brightness value of a video image collected by a camera module in a history way, wherein the image brightness value is obtained by carrying out brightness detection on the video image in advance;
detecting the brightness state of the current live video based on the image brightness value;
and under the condition that the current live video is detected to be in the set brightness state, reducing the acquisition frame rate of the video image acquisition by the camera module.
In a second aspect, an embodiment of the present application provides a live video acquisition frame rate adjustment system, including:
the brightness detection module is configured to acquire an image brightness value of the video image collected by the camera module in a history way, wherein the image brightness value is obtained by carrying out brightness detection on the video image in advance;
the state detection module is configured to detect the brightness state of the current live video based on the image brightness value;
and the adjusting module is configured to reduce the acquisition frame rate of the camera module for acquiring video images under the condition that the current live video is detected to be in a set brightness state.
In a third aspect, an embodiment of the present application provides a live video capturing frame rate adjustment apparatus, including:
a memory and one or more processors;
a memory configured to store one or more programs;
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the live video capture frame rate adjustment method as in the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium storing computer-executable instructions that, when executed by a computer processor, are configured to perform a live video capture frame rate adjustment method as in the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product comprising instructions which, when executed on a computer or processor, cause the computer or processor to perform the live video capture frame rate adjustment method as in the first aspect.
According to the embodiment of the application, the image brightness value of the video image collected by the camera module in a history way is obtained, and the image brightness value is obtained by carrying out brightness detection on the video image; detecting the brightness state of the current live video based on the image brightness value; and under the condition that the current live video is detected to be in the set brightness state, reducing the acquisition frame rate of the video image acquisition by the camera module. By adopting the technical means, the brightness state of the collected live video image is detected, the collection frame rate of the live video is adjusted when the brightness state is set, the accurate adjustment of the frame rate of the live video image is ensured, the problems of high power consumption, heating and the like of equipment caused by high image frame rate are avoided, the live video effect is improved, and the live video experience of a user is optimized.
Drawings
Fig. 1 is a flowchart of a live video acquisition frame rate adjustment method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of the logic processing of a frame controller in an embodiment of the application;
FIG. 3 is a flow chart of frame rate adjustment and brightness smoothing adjustment in an embodiment of the application;
FIG. 4 is a flow chart of frame rate adjustment based on coding capability assessment in an embodiment of the present application;
fig. 5 is a schematic structural diagram of a live video acquisition frame rate adjustment system according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a live video capturing frame rate adjustment device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the following detailed description of specific embodiments of the present application is given with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the matters related to the present application are shown in the accompanying drawings. Before discussing exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart depicts operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently, or at the same time. Furthermore, the order of the operations may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figures. The processes may correspond to methods, functions, procedures, subroutines, and the like.
The application provides a live video acquisition frame rate adjustment method, which aims to accurately adjust the acquisition frame rate of live video based on the brightness state by detecting the brightness state of an acquired live video image so as to avoid the problems of high power consumption, heating and the like of equipment caused by high image frame rate and improve the live video effect.
In a live broadcast scene, since the anchor terminal needs to continuously collect images and perform special effects and coding processing on a large amount of video frame data, the anchor terminal can often obviously feel the phenomena of electric quantity reduction, heating of a mobile phone, slowing down of live broadcast application operation and the like after a period of time of broadcasting. For this reason, the purpose of reducing power consumption is generally achieved by reducing the frame rate of video images when special effect processing and encoding transmission are performed. The scheme can solve the problems of overlarge power consumption and heating to a certain extent, but does not consider that the camera module is a module with quite large power consumption ratio, and the minimum power consumption can not be achieved by reducing special effect processing and coding frame rate alone. In addition, when the content of the live broadcast picture changes greatly, reducing the frame rate may cause the situation of flickering/blocking of the picture, and the like, which affects the live broadcast viewing experience. Based on the method, the live video acquisition frame rate adjustment method is provided, so that the live video acquisition frame rate adjustment is accurately performed, and the problem of setting errors of the live video image frame rate is solved.
Examples:
Fig. 1 shows a flowchart of a live video acquisition frame rate adjustment method provided by an embodiment of the present application, where the live video acquisition frame rate adjustment method provided by the embodiment of the present application may be implemented by a live video acquisition frame rate adjustment device, where the live video acquisition frame rate adjustment device may be implemented by software and/or hardware, and the live video acquisition frame rate adjustment device may be configured by two or more physical entities or may be configured by one physical entity. In general, the live video acquisition frame rate adjustment device may be a hosting device in a live scene such as a mobile phone, a tablet, a computer, etc.
The following description takes a main body of a live video acquisition frame rate adjustment method as an example.
Referring to fig. 1, the method for adjusting the frame rate of live video acquisition specifically includes:
S110, acquiring an image brightness value of a video image collected by the camera module in a history mode, wherein the image brightness value is obtained by carrying out brightness detection on the video image in advance.
When the live video acquisition frame rate is adjusted, the video image frame rate is adjusted from the acquisition source (namely the anchor side camera module) of the live video image, so that special effect processing data and coding data volume can be reduced, and the power consumption of the camera is reduced. And carrying out brightness detection on the video image acquired by the camera module so as to adaptively adjust the frame rate of the video image acquisition according to the brightness detection result. It will be appreciated that for the case of low brightness live video, a higher video frame rate results in a waste of frame rate. In addition, since live pictures in the live broadcasting process have differences due to live broadcasting activities, the video brightness of the live broadcasting pictures can be fluctuated, and therefore, when the live broadcasting video brightness is continuously in a stable state, the higher video frame rate can also cause frame rate waste. Therefore, the brightness of the live video is accurately detected, so that the video frame rate is accurately adjusted according to the brightness value of the video image.
Referring to fig. 2, the anchor uses a frame controller module to perform acquisition frame rate adjustment control of the camera module. The camera module acquires video images and outputs frames to the frame controller, the frame controller receives the video images from the camera, and brightness detection is carried out on the video images so as to adjust the frame rate of the camera acquisition according to the brightness detection result. And then output video image frame data to a downstream special effect processing and encoding module, and simultaneously output two camera control events, namely reducing the frame rate/improving the frame rate, wherein the frame rate collected by the camera module can reach the balance of power consumption and fluency experience in the continuous adjustment process. Therefore, the live broadcast effect of the anchor terminal is optimized through accurate acquisition frame rate adjustment.
Wherein, carry out luminance detection to video image, include:
Determining a luminance component of each pixel based on YUV data of the video image;
and determining each pixel block of the video image segmented by the set pixel step length, and calculating an average value according to the pixel component of the central pixel of each pixel block to be used as an image brightness value of the video image.
When the brightness detection of the video image is carried out, the three components of the YUV data respectively represent brightness/color/saturation by acquiring the YUV data of the video image, so that the brightness value of each pixel in the video image can be obtained by extracting the brightness components. And then the brightness average value is obtained through the brightness values of all the pixels, and the brightness average value can be used as the image brightness value of the video image.
Alternatively, since adjacent pixels generally have small differences in luminance, it is unnecessary to calculate a luminance value for each pixel. By introducing a pixel step size, the video image is divided into a plurality of pixel blocks according to a set pixel step size, each pixel block taking the center pixel luminance as the luminance of the pixel block. For example, when the pixel step size is 4, the brightness of the block is represented by the brightness of the center position pixel of 4*4. And then traversing all 4*4 pixel blocks to obtain the brightness sum, and dividing the brightness sum by the number of the pixel blocks to obtain the fast average brightness, namely the image brightness value of the video image.
Based on the video image brightness value detection method, brightness detection is carried out on the video image collected by the camera module each time to determine the image brightness value. When the acquisition frame rate of the camera module is adjusted in the follow-up process, the brightness state of the current live video can be analyzed only by acquiring the image brightness value of the video image historically acquired by the camera module, and then the acquisition frame rate is adjusted.
S120, detecting the brightness state of the current live video based on the image brightness value.
Further, based on the obtained image brightness value, the application mainly performs over-darkness detection and brightness change detection of the image brightness value when brightness state detection is performed. And further, under the condition that the detected image brightness value is too dark or the variation of the image brightness value is stable, the image brightness value is determined to be in a set brightness state, and the acquisition frame rate of the camera needs to be reduced so as to avoid the waste of the frame rate.
Referring to fig. 3, for over-dark detection of an image brightness value, brightness state detection of a current live video based on the image brightness value includes:
Extracting the image brightness values of the video images of the first set number of historic images, and comparing the image brightness values one by one to set brightness threshold values;
and under the condition that the image brightness values of the historical first set number of video images are smaller than the set brightness threshold value, determining that the current live video is in the set brightness state.
Since the value of the current live picture content is low when the picture brightness is too dark, the anchor may interact with the audience mainly through audio data, and at this time, the picture frame rate can be reduced appropriately to reduce power consumption and bandwidth. Based on this, by acquiring the image brightness values of the historical continuous 30-frame video images (i.e., the first set number), when the image brightness values of the continuous 30-frame video images are all lower than the set brightness threshold (e.g., 40 lm), it is determined that the current live video is in the set brightness state. I.e. too dark, it is necessary to apply for a reduced acquisition frame rate to the frame controller. Similarly, if the live video is already in the low frame rate mode and the image brightness value of the continuous 30-frame video image is not lower than 40, the original frame rate can be automatically switched back, and the live video effect is ensured.
In the actual over-dark detection process, whether the live video is in a set brightness state can also be determined by calculating the average value of the image brightness values of the historical continuous 30-frame video images according to the comparison result of the average value of the image brightness values and the corresponding threshold value. The specific brightness darkness detection mode is not fixed and limited in the application, and is not repeated here.
On the other hand, for brightness change detection of an image brightness value, brightness state detection of a current live video based on the image brightness value includes:
Determining first brightness differences of two adjacent video images one by one based on the image brightness values of the video images of the second set number;
And under the condition that each determined first brightness difference is smaller than the set brightness difference threshold value, determining that the current live video is in the set brightness state.
The live broadcast picture brightness is different due to the movement of the live broadcast in the live broadcast process, and the situation that the live broadcast picture brightness change is small indicates that the live broadcast is not in the live broadcast picture at the moment, and the live broadcast can interact with audiences mainly through audio data, so that the picture frame rate can be properly reduced to reduce the power consumption and the bandwidth. Based on this, by acquiring image luminance values of historic consecutive 30-frame video images (i.e., a second set number), an image luminance value difference of two adjacent video images among the consecutive 30-frame video images is calculated, defined as a first luminance difference. When the first brightness differences obtained by calculation of the continuous 30 frames of video images are all lower than the set brightness difference threshold value (such as 0.01 lm), the current live video is determined to be in the set brightness state. The brightness conversion of the current live video is stable, and the acquisition frame rate needs to be reduced by applying to a frame controller.
In the actual brightness change detection process, the average value of brightness differences can also be calculated by calculating the image brightness value difference of two adjacent video images in 30 continuous historical video images based on the image brightness value difference. And further determining whether the live video is in a set brightness state according to the comparison result of the image brightness value difference average value and the corresponding brightness difference threshold value. The specific brightness change detection mode is not limited by the application, and is not repeated here.
And S130, under the condition that the current live video is detected to be in a set brightness state, reducing the acquisition frame rate of video image acquisition by the camera module.
Finally, under the condition that the current live video is in the set brightness state based on the brightness state detection, the acquisition frame rate of the video image can be adaptively reduced, so that resources such as equipment power consumption and bandwidth are saved. When the acquisition frame rate of the camera module is reduced, the video frame rate is automatically selected downwards according to a supported frame rate interval list of the equipment, and each time the frame rate is reduced, the next frame rate interval is automatically adjusted. According to the actual adjustment requirement, a mapping table of the image brightness value and the acquisition frame rate can be constructed, and when the video frame rate is reduced, the acquisition frame rate mapped can be found directly according to the image brightness value of the video image of the current frame so as to adjust the acquisition frame rate of the camera module.
Alternatively, the brightness state detection may also include detection of a full black picture, i.e. when the picture brightness is determined to be full black by the image brightness value of the historically acquired video image, the video acquisition frame rate may be reduced to the basic frame rate value. The present application does not limit the specific detection of the set brightness state, and is not repeated here.
The processing data volume can be reduced from the video image acquisition source by adjusting the acquisition frame rate of the camera module, the special effect processing data and the coding data volume can be reduced, the power consumption of the camera is reduced, and the effects of lower power consumption and less heating are achieved.
Optionally, after brightness detection is performed on the video image, the method further includes:
normalizing the image brightness values of the video images with the historical third set quantity;
Determining a second brightness difference between the current frame video image and the previous frame video image after normalization processing;
And under the condition that the second brightness difference exceeds the set brightness jump threshold value, carrying out brightness smooth adjustment on the video image of the current frame.
Because the application adjusts the acquisition frame rate of the camera module, the system can correspondingly adjust the exposure parameters of the camera module, and at the moment, due to the change of the exposure time and other parameters, some bright and dark jumps of the live video picture can be correspondingly caused, so that the brightness jump detection of the live video is required.
Referring to fig. 3, by acquiring the image luminance values of the video images of the last 50 frames (third set number), taking the maximum luminance thereof as the normalization denominator, performing luminance normalization processing on the video image of the previous frame and the current frame, and then calculating the luminance difference between the two frames, defining the second luminance difference (normalized current luminance-normalized previous frame luminance). If the second brightness difference is larger than the preset brightness jump threshold (e.g. 0.1 lm), judging that brightness jump exists in the current frame, and needing brightness smooth adjustment.
The brightness smooth adjustment for the video image of the current frame comprises the following steps:
predicting the normalized image brightness value of the next frame of video image based on the normalized image brightness value of the current frame of video image and the normalized image brightness value of the previous frame of video image;
Calculating a brightness adjustment value of the current frame video image according to the normalized image brightness value of the current frame video image, the normalized image brightness value of the previous frame video image and the normalized image brightness value of the next frame video image;
And adjusting the image brightness value of the video image of the current frame based on the brightness adjustment value.
According to the second-order Bessel formula, assuming that the previous frame is P0 (t 0, lux 0), the current frame is P1 (t 1, lux 1), wherein t0 and t1 are acquisition times, lux0 and lux1 are corresponding brightness values, and then the next frame of video image P2 (t 2, lux 2) can be predicted according to the previous two frames P0 and P1 as extension lines. Substituting the second order Bessel:
B(t)＝(1-t)2lux0+2t(1-t)lux1+t2lux2
the desired brightness adjustment value B (t) is obtained, where t is the current frame time t1. Based on the determined brightness adjustment value, brightness smooth adjustment can be performed on the current frame to avoid brightness jump.
Optionally, the brightness jump processing mode can also adopt modes of moving average, exponential weighted average, kalman filtering and the like for processing, and the smooth transition of brightness can be realized by predicting the next frame of video image and combining a second-order Bessel formula.
Optionally, when the acquisition frame rate is adjusted, the method further comprises the following steps:
acquiring an acquisition frame rate and a coding frame rate of a coding module;
Reducing the acquisition frame rate under the condition that the continuous first set duration detects that the acquisition frame rate exceeds the set frame rate threshold of the coding frame rate;
and under the condition that the continuous second set duration detects that the acquisition frame rate and the coding frame rate are in a set leveling state, the acquisition frame rate is adjusted.
Referring to fig. 2, the coding capacity evaluation of the coding module is performed by recalling the coding frame rate of the coding module, and when the coding capacity evaluation algorithm detects that the current coding capacity is insufficient, the frame rate needs to be reduced at the moment so as to save calculation power and reduce power consumption; when the encoding capability evaluation algorithm detects that the current encoding capability is excessive, the frame rate needs to be increased.
Specifically, referring to fig. 4, the encoding capability evaluation mainly includes an encoding capability excess evaluation and an encoding capability deficiency evaluation, and functions to adjust the frame rate load since video image acquisition is a source of video frame data. The coding frame rate change is mainly influenced by the coding capacity of the machine and the output of the upstream frame rate, and when the acquisition frame rate is higher than the coding frame rate, the acquisition frame is often excessive; the encoded frame rate is equal to the acquisition frame rate for a long time, which means insufficient acquisition capability. Therefore, the acquisition frame rate and the coding frame rate should be kept within a reasonable gap, for example, when the acquisition frame rate-coding frame rate is greater than a set frame rate threshold (such as 3 fps) for one minute, it may be determined that the coding capacity is insufficient, and then the frame controller may be applied to reduce the acquisition frame rate; when the acquisition frame rate-encoding frame rate is equal to 0 or the gap lasts for one minute within the set difference range, it may be determined that the encoding capacity is excessive, at which time the frame controller may be applied for increasing the acquisition frame rate.
Therefore, by automatically evaluating the coding capability and the picture brightness change, the frame rate is reduced when the coding capability is insufficient or the picture brightness is low and the picture change is small, so that the effect of reducing the live power consumption is achieved. The brightness jump in the live broadcast process can be reduced and the live broadcast experience can be optimized by detecting the brightness jump and smoothly adjusting the brightness of the picture.
The method comprises the steps that image brightness values of video images collected by a camera module in a history mode are obtained, and the image brightness values are obtained by detecting the brightness of the video images; detecting the brightness state of the current live video based on the image brightness value; and under the condition that the current live video is detected to be in the set brightness state, reducing the acquisition frame rate of the video image acquisition by the camera module. By adopting the technical means, the brightness state of the collected live video image is detected, the collection frame rate of the live video is adjusted when the brightness state is set, the accurate adjustment of the frame rate of the live video image is ensured, the problems of high power consumption, heating and the like of equipment caused by high image frame rate are avoided, the live video effect is improved, and the live video experience of a user is optimized.
On the basis of the above embodiment, fig. 5 is a schematic structural diagram of a live video acquisition frame rate adjustment system provided by the present application. Referring to fig. 5, the live video acquisition frame rate adjustment system provided in this embodiment specifically includes: a brightness detection module 21, a state detection module 22 and an adjustment module 23.
Wherein, the brightness detection module 21 is configured to obtain the image brightness value of the video image collected by the camera module in history, and the image brightness value is obtained by performing brightness detection on the video image in advance;
The state detection module 22 is configured to perform brightness state detection of the current live video based on the image brightness value;
The adjustment module 23 is configured to reduce an acquisition frame rate of video image acquisition by the camera module in case that the current live video is detected to be in a set brightness state.
Specifically, the brightness detection for the video image includes:
Determining a luminance component of each pixel based on YUV data of the video image;
and determining each pixel block of the video image segmented by the set pixel step length, and calculating an average value according to the pixel component of the central pixel of each pixel block to be used as an image brightness value of the video image.
Specifically, the brightness state detection of the current live video based on the image brightness value comprises the following steps:
comparing the image brightness values of the video images of the first set number of historic images one by one to set brightness threshold values;
and under the condition that the image brightness values of the historical first set number of video images are smaller than the set brightness threshold value, determining that the current live video is in the set brightness state.
Specifically, the brightness state detection of the current live video based on the image brightness value comprises the following steps:
Determining first brightness differences of two adjacent video images one by one based on the image brightness values of the video images of the second set number;
And under the condition that each determined first brightness difference is smaller than the set brightness difference threshold value, determining that the current live video is in the set brightness state.
Specifically, after brightness detection is performed on the video image, the method further includes:
normalizing the image brightness values of the video images with the historical third set quantity;
Determining a second brightness difference between the current frame video image and the previous frame video image after normalization processing;
And under the condition that the second brightness difference exceeds the set brightness jump threshold value, carrying out brightness smooth adjustment on the video image of the current frame.
The brightness smooth adjustment for the video image of the current frame comprises the following steps:
predicting the normalized image brightness value of the next frame of video image based on the normalized image brightness value of the current frame of video image and the normalized image brightness value of the previous frame of video image;
Calculating a brightness adjustment value of the current frame video image according to the normalized image brightness value of the current frame video image, the normalized image brightness value of the previous frame video image and the normalized image brightness value of the next frame video image;
And adjusting the image brightness value of the video image of the current frame based on the brightness adjustment value.
Furthermore, the method further comprises:
acquiring an acquisition frame rate and a coding frame rate of a coding module;
Reducing the acquisition frame rate under the condition that the continuous first set duration detects that the acquisition frame rate exceeds the set frame rate threshold of the coding frame rate;
and under the condition that the continuous second set duration detects that the acquisition frame rate and the coding frame rate are in a set leveling state, the acquisition frame rate is adjusted.
The method comprises the steps that image brightness values of video images collected by a camera module in a history mode are obtained, and the image brightness values are obtained by detecting the brightness of the video images; detecting the brightness state of the current live video based on the image brightness value; and under the condition that the current live video is detected to be in the set brightness state, reducing the acquisition frame rate of the video image acquisition by the camera module. By adopting the technical means, the brightness state of the collected live video image is detected, the collection frame rate of the live video is adjusted when the brightness state is set, the accurate adjustment of the frame rate of the live video image is ensured, the problems of high power consumption, heating and the like of equipment caused by high image frame rate are avoided, the live video effect is improved, and the live video experience of a user is optimized.
The live video acquisition frame rate adjustment system provided by the embodiment of the application can be configured to execute the live video acquisition frame rate adjustment method provided by the embodiment of the application, and has corresponding functions and beneficial effects.
On the basis of the actual embodiment, the embodiment of the application also provides a live video acquisition frame rate adjustment device, referring to fig. 6, which includes: processor 31, memory 32, communication module 33, input device 34 and output device 35. The memory is used as a computer readable storage medium and can be configured to store a software program, a computer executable program and a module, and the program instructions/modules (for example, a brightness detection module, a state detection module and an adjustment module in a live video acquisition frame rate adjustment system) corresponding to the live video acquisition frame rate adjustment method according to any embodiment of the present application. The communication module is configured to perform data transmission. The processor executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory, namely, the live video acquisition frame rate adjustment method is realized. The input means may be configured to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the device. The output means may comprise a display device such as a display screen. The live video acquisition frame rate adjustment device provided by the embodiment can be configured to execute the live video acquisition frame rate adjustment method provided by the embodiment, and has corresponding functions and beneficial effects.
On the basis of the above embodiments, the present application further provides a computer-readable storage medium storing computer-executable instructions, which when executed by a computer processor are configured to perform a live video capture frame rate adjustment method, and the storage medium may be any of various types of memory devices or storage devices. Of course, the computer-readable storage medium provided by the embodiment of the present application is not limited to the live video capturing frame rate adjustment method described above, and may also perform the related operations in the live video capturing frame rate adjustment method provided by any embodiment of the present application.
On the basis of the above embodiments, the embodiments of the present application further provide a computer program product, where the technical solution of the present application is essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product, and the computer program product is stored in a storage medium, and includes several instructions to cause a computer device, a mobile terminal or a processor therein to execute all or part of the steps of the live video acquisition frame rate adjustment method according to the embodiments of the present application.
Claims (11)
1. The method for adjusting the frame rate of live video acquisition is characterized by comprising the following steps of:
Acquiring an image brightness value of a video image collected by a camera module in a history way, wherein the image brightness value is obtained by carrying out brightness detection on the video image in advance;
detecting the brightness state of the current live video based on the image brightness value;
And under the condition that the current live video is detected to be in a set brightness state, reducing the acquisition frame rate of the camera module for acquiring video images.
2. The method for adjusting the frame rate of live video capturing according to claim 1, wherein the detecting the brightness state of the current live video based on the image brightness value comprises:
extracting the image brightness values of the video images of a first set number of historic images, and comparing and setting brightness threshold values one by one;
And under the condition that the image brightness values of the first set number of historical video images are smaller than a set brightness threshold value, determining that the current live video is in a set brightness state.
3. The method for adjusting the frame rate of live video capturing according to claim 1, wherein the detecting the brightness state of the current live video based on the image brightness value comprises:
determining first brightness differences of two adjacent video images one by one based on the image brightness values of the video images of the second set number of historic;
And under the condition that each determined first brightness difference is smaller than a set brightness difference threshold value, determining that the current live video is in a set brightness state.
4. The method of claim 1, further comprising, after brightness detection of the video image:
Normalizing the image brightness values of the video images with a third set number of historic images;
Determining a second brightness difference between the video image of the current frame and the video image of the previous frame after normalization processing;
And under the condition that the second brightness difference exceeds a set brightness jump threshold value, carrying out brightness smooth adjustment on the video image of the current frame.
5. The method of claim 4, wherein the performing brightness smoothing adjustment on the video image of the current frame comprises:
predicting the normalized image brightness value of the video image of the next frame based on the normalized image brightness value of the video image of the current frame and the normalized image brightness value of the video image of the previous frame;
calculating a brightness adjustment value of the video image of the current frame according to the normalized image brightness value of the video image of the current frame, the normalized image brightness value of the video image of the previous frame and the normalized image brightness value of the video image of the next frame;
and adjusting the image brightness value of the video image of the current frame based on the brightness adjustment value.
6. The method for adjusting a frame rate of live video capture as in any one of claims 1-5, wherein the detecting brightness of the video image comprises:
Determining a luminance component of each pixel based on YUV data of the video image;
And determining each pixel block of the video image segmented by the set pixel step length, and calculating an average value according to the pixel component of the central pixel of each pixel block to serve as an image brightness value of the video image.
7. The live video capture frame rate adjustment method of claim 1, further comprising:
acquiring the acquisition frame rate and the coding frame rate of a coding module;
Reducing the acquisition frame rate when the continuous first set duration detects that the acquisition frame rate exceeds the coding frame rate set frame rate threshold;
And under the condition that the continuous second set duration detects that the acquisition frame rate and the coding frame rate are in a set leveling state, the acquisition frame rate is adjusted to be high.
8. A live video acquisition frame rate adjustment system, comprising:
The brightness detection module is configured to acquire an image brightness value of a video image collected by the camera module in a history mode, wherein the image brightness value is obtained by carrying out brightness detection on the video image in advance;
the state detection module is configured to detect the brightness state of the current live video based on the image brightness value;
And the adjusting module is configured to reduce the acquisition frame rate of the camera module for acquiring video images under the condition that the current live video is detected to be in a set brightness state.
9. A live video acquisition frame rate adjustment device, comprising:
a memory and one or more processors;
The memory is configured to store one or more programs;
The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the live video capture frame rate adjustment method of any of claims 1-7.
10. A computer readable storage medium storing computer executable instructions which, when executed by a computer processor, are configured to perform the live video acquisition frame rate adjustment method of any one of claims 1 to 7.
11. A computer program product comprising instructions which, when executed on a computer or processor, cause the computer or processor to perform the live video acquisition frame rate adjustment method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410293910.7A CN118042299A (en) | 2024-03-14 | 2024-03-14 | Live video acquisition frame rate adjustment method, system, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410293910.7A CN118042299A (en) | 2024-03-14 | 2024-03-14 | Live video acquisition frame rate adjustment method, system, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118042299A true CN118042299A (en) | 2024-05-14 |
Family
ID=91000638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410293910.7A Pending CN118042299A (en) | 2024-03-14 | 2024-03-14 | Live video acquisition frame rate adjustment method, system, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118042299A (en) |
-
2024
- 2024-03-14 CN CN202410293910.7A patent/CN118042299A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10878543B2 (en) | Group management method, terminal, and storage medium | |
| WO2021244341A1 (en) | Picture coding method and apparatus, electronic device and computer readable storage medium | |
| EP3454564B1 (en) | Method for achieving television theater mode, device, equipment and storage medium | |
| US9294687B2 (en) | Robust automatic exposure control using embedded data | |
| WO2021068598A1 (en) | Encoding method and device for screen sharing, and storage medium and electronic equipment | |
| US10003765B2 (en) | System and method for brightening video image regions to compensate for backlighting | |
| US20120188403A1 (en) | Flash band processing circuit, method of processing flash band, imaging apparatus, and imaging processing method | |
| WO2022199348A1 (en) | Video encoding method and apparatus, video encoding device, and storage medium | |
| CN112584149A (en) | Method and system for content adaptive noise reduction for video coding | |
| CN113055742B (en) | Video display method, device, terminal and storage medium | |
| CN111182352B (en) | Adaptive code stream control device and method for video playing | |
| CN114827662B (en) | Video resolution adaptive adjustment method, device, equipment and storage medium | |
| CN112637476A (en) | Video recording method, device, terminal and computer readable storage medium | |
| CN113163128A (en) | Image exposure method and electronic device | |
| US20030227972A1 (en) | Apparatus and method for coding moving image | |
| CN104702964A (en) | Image processing method and device | |
| US20220124896A1 (en) | Determining a light effect based on an average color after a detected transition in content | |
| CN118042299A (en) | Live video acquisition frame rate adjustment method, system, equipment and storage medium | |
| CN114913471B (en) | Image processing method, device and readable storage medium | |
| CN116132644A (en) | Automatic color saturation adjustment method and device and related equipment | |
| CN111263079B (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| CN112328145A (en) | Image display method, device, equipment and computer readable storage medium | |
| CN114584834B (en) | Video quality optimization method, device, equipment and storage medium | |
| CN112085002A (en) | Portrait segmentation method, portrait segmentation device, storage medium and electronic equipment | |
| CN113132703B (en) | Image processing method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |