WO2020168967A1 - 图像采集方法、电子设备和计算机可读存储介质 - Google Patents
图像采集方法、电子设备和计算机可读存储介质 Download PDFInfo
- Publication number
- WO2020168967A1 WO2020168967A1 PCT/CN2020/075005 CN2020075005W WO2020168967A1 WO 2020168967 A1 WO2020168967 A1 WO 2020168967A1 CN 2020075005 W CN2020075005 W CN 2020075005W WO 2020168967 A1 WO2020168967 A1 WO 2020168967A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- exposure parameters
- camera
- exposure
- frame
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 238000004458 analytical method Methods 0.000 claims abstract description 53
- 238000007499 fusion processing Methods 0.000 claims abstract description 11
- 238000004590 computer program Methods 0.000 claims description 17
- 238000005375 photometry Methods 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 3
- 238000004364 calculation method Methods 0.000 claims description 2
- 238000012545 processing Methods 0.000 description 25
- 238000010586 diagram Methods 0.000 description 14
- 230000004927 fusion Effects 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000003384 imaging method Methods 0.000 description 5
- 238000003705 background correction Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000010191 image analysis Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000000872 buffer Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/72—Combination of two or more compensation controls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/741—Circuitry for compensating brightness variation in the scene by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
Definitions
- This application relates to the field of imaging technology, and in particular to an image acquisition method, electronic equipment and computer-readable storage medium.
- the camera can acquire multiple images with multiple preset exposure parameters, so as to synthesize HDR (High-Dynamic Range, high dynamic range) images according to the multiple images.
- HDR High-Dynamic Range, high dynamic range
- an image acquisition method electronic device, and computer-readable storage medium are provided.
- An image acquisition method including:
- An electronic device includes a memory and a processor, and a computer program is stored in the memory.
- the processor executes the following operations:
- the image acquisition method, electronic equipment, and computer-readable storage medium provided by the embodiments of the present application can obtain the exposure parameters of the images used for fusion according to the analysis of the multi-frame images collected by the first camera, and the second camera collects the images according to the exposure parameters After fusion, the quality of the collected images can be improved.
- Fig. 1 is a schematic diagram of an application environment of an image acquisition method in one or more embodiments.
- Fig. 2 is a flowchart of an image acquisition method in one or more embodiments.
- Fig. 3 is a flowchart of collecting at least two frames of first images in one or more embodiments.
- Fig. 4 is a flowchart of collecting at least two frames of first images in one or more embodiments.
- FIG. 5 is a flowchart of determining the second exposure parameter according to the first image in one or more embodiments.
- Fig. 6 is a flowchart of determining the second exposure parameter according to the first image in one or more embodiments.
- Fig. 7 is a two-dimensional distribution diagram of the brightness of a frame of the first image in one or more embodiments.
- FIG. 8 is a schematic diagram of the amount of image information corresponding to each first exposure parameter in one or more embodiments.
- Fig. 9 is a flowchart of an image acquisition method in one or more embodiments.
- Fig. 10 is a flowchart of an image acquisition method in one or more embodiments.
- Fig. 11 is a structural block diagram of an image acquisition device according to one or more embodiments.
- Fig. 12 is a schematic diagram of the internal structure of an electronic device in one or more embodiments.
- Fig. 13 is a schematic diagram of an image processing circuit in one or more embodiments.
- first the terms “first”, “second”, etc. used in this application can be used herein to describe various elements, but these elements are not limited by these terms. These terms are only used to distinguish the first element from another element.
- the first camera may be referred to as the second camera, and similarly, the second camera may be referred to as the first camera. Both the first camera and the second camera are cameras, but they are not the same camera.
- Fig. 1 is a schematic diagram of an application environment of an image acquisition method in an embodiment.
- the application environment includes an electronic device 110.
- the electronic device 110 can collect at least two corresponding first images with at least two different first exposure parameters through the first camera, perform content analysis on each first image, and perform content analysis on each frame of the first image, and according to the obtained content analysis result and at least two different At least two second exposure parameters are determined by the first exposure parameter, and at least two second exposure parameters are used for image acquisition through the second camera to obtain at least two corresponding second images, and at least two second images are fused , Get the target image.
- the above electronic device 110 may not be limited to various mobile phones, computers, portable devices, and the like.
- FIG. 2 is a flowchart of an image acquisition method in an embodiment. As shown in FIG. 2, the image acquisition method includes operation 202 to operation 208.
- At least two corresponding frames of first images are acquired by the first camera with at least two different first exposure parameters.
- the electronic device includes a first camera and a second camera.
- the first camera and the second camera are arranged on the same side of the electronic device and can be used to collect images containing the same photographed object.
- the first camera and the second camera may not be limited to any one or two of a color camera, a black and white camera, a wide-angle camera, and a telephoto camera.
- Exposure parameters include exposure time. Exposure time is the time interval from opening to closing of the shutter when the camera is collecting images.
- the exposure parameters also include camera gain, etc. Generally, when the exposure time is small, a higher camera gain can be used, and when the exposure time is longer, a smaller camera gain can be used. The camera gain.
- the electronic device can preset multiple different first exposure parameters according to actual application requirements, and the number and specific values of the exposure parameters are not limited here.
- the multi-frame images collected by the camera according to the at least two different first exposure parameters may contain information of the bright area and the dark area of the shot scene.
- the different first exposure parameters may be that the exposure time is 0.001s, 0.002s, 0.01s, 0.05s, 0.1s, etc., and is not limited thereto.
- the electronic device may acquire at least two frames of first images corresponding to at least two frames of first images through the first camera with at least two different first exposure parameters, and each first exposure parameter corresponds to one frame of first images. Wherein, at least two frames of the first image obtained by the electronic device have the same or approximately the same captured scene, and the amount of image information contained is different.
- Operation 204 Perform content analysis on each frame of the first image, and determine at least two second exposure parameters according to the obtained content analysis result and the at least two different first exposure parameters.
- the content analysis of the image may include, but is not limited to, analyzing the brightness information, color information, image complexity, information distribution, etc. of the image.
- the number of second exposure parameters can be preset according to actual application requirements, and is not limited here.
- the electronic device may preset the number of second exposure parameters as 2, 3, 4, etc.
- the number of second exposure parameters is less than or equal to the number of first exposure parameters.
- At least two frames of images collected according to at least two exposure parameters contain the most information about the real scene being shot, and at least two frames of images collected according to at least two exposure parameters can be fused and processed to reflect the real visual effect of the scene being shot.
- the number of second exposure parameters can also be determined according to the content analysis result of the first image. For example, when it is determined according to the content analysis result of each frame of the first image that only two second exposure parameters are needed to obtain all the information of the real shot scene, the number of second exposure parameters may be two.
- the electronic device can perform content analysis on each frame of the first image, so as to obtain the content analysis result of each frame of the first image, that is, each first exposure parameter. According to the content analysis result, it is determined that the real shot scene can be obtained. At least two second exposure parameters of all information. Specifically, the electronic device analyzes the content of each frame of the first image, and can obtain the distribution of image information under different exposure parameters. Combined with the brightness distribution information of each frame of the first image, the electronic device can determine that it can obtain the true At least two second exposure parameters of all information of the shot scene.
- the electronic device adopts at least two different first exposure parameters such as the exposure time respectively 0.005s, 0.01s, 0.04s, 0.08s, 0.1s
- the first image corresponding to the lower exposure time ie 0.005s
- the black light bulb is displayed as black in the first image due to insufficient light input , Can not reflect the details of the black bulb.
- the first image corresponding to a higher exposure time such as 0.1s can contain the image information of the black bulb, and the white bulb will be displayed as white, which cannot reflect the details of the white bulb Therefore, the electronic device can perform content analysis on each frame of the first image, and determine at least two second exposure parameters that can obtain all the information of the light strip according to the content analysis result and the at least two different first exposure parameters.
- image acquisition is performed by the second camera with at least two second exposure parameters to obtain at least two corresponding second images.
- the electronic device After the electronic device obtains at least two second exposure parameters by analyzing at least two frames of the first image collected by the first camera, it can use the second camera to perform image collection with at least two second exposure parameters to obtain the corresponding at least two second frames. image.
- the number of second images is the same as the number of second exposure parameters, that is, each second exposure parameter corresponds to one frame of the second image.
- the electronic device may control the second camera to perform image capture with at least two second exposure parameters when receiving the image capture instruction. At this time, the electronic device may perform image capture according to the latest at least two second exposure parameters. , Get at least two corresponding second images.
- At least two frames of second images are fused to obtain a target image.
- Fusion processing refers to the operation of generating a final image from multiple images according to certain rules.
- the electronic device may perform fusion processing on the obtained at least two frames of second images to obtain the target image.
- the target image contains all the information of the shot scene and can reflect the real visual effect of the shot scene.
- the electronic device may process each frame of the second image through a tone mapping algorithm, or a method based on contrast or gradient threshold, etc., so as to obtain a fused target image.
- the electronic device can also perform alignment processing on at least two frames of the second image before the fusion processing, which can avoid ghosting and improve the quality of the image.
- the electronic device can provide a thumbnail of the target image on the camera preview interface; it can also display the target image on the display screen of the electronic device for the user to preview, and can also provide saving and editing on the image preview interface , Share and other options for users to do further operations.
- At least two frames of first images corresponding to at least two frames of the first image are collected by the first camera with at least two different first exposure parameters, and the content of each frame of the first image is analyzed, according to the obtained content
- the analysis result and the at least two different first exposure parameters determine at least two second exposure parameters.
- the second camera uses the at least two second exposure parameters to collect images to obtain at least two corresponding second images.
- the second image of the frame is fused to obtain the target image. Therefore, it is possible to avoid the problem of inaccurate fusion images caused by the use of unified exposure parameters to collect images.
- the multi-frame image collected by the first camera is analyzed to obtain the exposure parameters of the fused image, and the second camera is based on the exposure
- the parameters are collected after the image is fused, that is, the exposure parameters of the image used for fusion can be determined according to the current shooting scene, which can improve the quality of the image.
- the use of two cameras for processing separately can avoid affecting the work of the second camera and ensure the normal use of the second camera.
- the second camera is the main camera of the electronic device, that is, the image collected by the electronic device through the second camera is usually used for preview and displayed on the display screen of the electronic device.
- the electronic device may start the second camera of the electronic device to collect an image and display it on the display screen of the electronic device when receiving the camera startup instruction, and at the same time execute the first camera to collect at least the corresponding at least the different first exposure parameters.
- Two frames of first images, content analysis is performed on each frame of the first image, and operations for determining at least two second exposure parameters according to the content analysis results. Therefore, when the electronic device receives the image acquisition instruction, it can use the second camera to perform image acquisition with at least two second cameras to obtain at least two corresponding second images.
- the electronic device may also collect at least two frames of first images corresponding to different first exposure parameters through the first camera when receiving the image capture instruction, perform content analysis on each frame of the first image, and analyze according to the content. As a result, it is determined that the operation of at least two second exposure parameters can reduce the power consumption of the electronic device.
- the multiple frames of images collected by the first camera are analyzed to obtain the exposure parameters of the images used for fusion, and the second camera collects the images according to the exposure parameters and then performs the fusion, that is, the second camera collects the images for preview while determining the exposure parameters by the first camera
- the exposure parameters of the images to be fused can avoid affecting the image preview effect of the second camera, and ensure the normal display of the preview interface.
- the electronic device before the electronic device collects at least two frames of the first image through the first camera, it may further include: collecting a preview image through the second camera; judging whether the preview image is a high-light ratio image according to the brightness distribution information of the preview image; When it is determined that the preview image is a high light ratio image, the operation of collecting at least two frames of the first image through the first camera is performed.
- the preview image refers to the image collected by the camera that can be displayed on the display screen of the electronic device in real time.
- the electronic device may collect the preview image through the second camera, so as to determine whether the preview image is a high light ratio image according to the brightness distribution information of the preview image.
- the light ratio refers to the ratio of light received by the dark side to the bright side of the subject.
- a high-light ratio image refers to an image with a certain difference in the light received by the dark side and the bright side.
- the electronic device can determine whether the preview image is a high light ratio image according to the brightness distribution information of the preview image.
- the electronic device determines that the preview image is a high-light ratio image; the electronic device can also establish a brightness distribution histogram of the preview image, and when determining according to the brightness distribution histogram When the number of pixels distributed on both sides of the histogram in the preview image reaches a preset number, it is determined that the preview image is a high-light ratio image.
- the electronic device may perform the operation of collecting at least two frames of the first image through the first camera when it is determined that the preview image collected by the second camera is a high light ratio image. That is, when the electronic device determines that the current shooting scene is a high-light ratio scene, the first image is collected by the first camera with multiple different first exposure parameters, and multiple second exposure parameters are determined according to the content analysis result of the first image , And through the second camera with the second exposure parameters to collect the corresponding second image for synthesis, the synthesized target image can truly reflect the information of the photographed object, improve the accuracy of the target image, and realize the HDR function of intelligently turning on the camera .
- Fig. 3 is a flowchart of collecting at least two frames of first images in an embodiment. As shown in FIG. 3, in one embodiment, the process of collecting at least two corresponding first images with at least two different first exposure parameters by the first camera includes:
- the electronic device is preset with at least two different first exposure parameters, and the electronic device can acquire at least two preset first exposure parameters when the camera is started.
- the first image is acquired in the order from low to high according to the first exposure parameter through the first camera.
- the order of the first exposure parameter from low to high is the order of the exposure time included in the first exposure parameter from low to high.
- the electronic device may first set the exposure time of the first camera to 0.02s to collect the first frame Then set the exposure time of the first camera to 0.05s to collect the first image of the second frame, and then set the exposure time of the first camera to 0.08s to collect the first image of the third frame.
- each time a frame of the first image is captured by the first camera it is detected whether the target brightness value corresponding to the captured first image exceeds the preset brightness value.
- the preset brightness value can be set according to actual application requirements. Specifically, the preset brightness value is greater than or equal to the brightness value when the image is overexposed.
- the electronic device may determine the target brightness value according to at least one of an average photometry value, a center photometry value, and a spot photometry value corresponding to the first image.
- the average metering value is the average value of the brightness of the pixel points included in the first image.
- the central metering value is determined according to the brightness value of the pixel in the image central area of the first image.
- the spot metering value is determined by the brightness value of the composition center point or focus point of the first image.
- the electronic device may detect whether the target brightness value corresponding to the collected first image exceeds the preset brightness value every time a frame of the first image is collected by the first camera.
- the electronic device When the target brightness value of the collected first image exceeds the preset brightness value, the electronic device ends the image collection operation of the first camera.
- the electronic device may also directly complete the image capturing operation of the first camera according to at least two preset first exposure parameters, that is, not detecting the brightness of the captured first image.
- the first image is captured by the first camera according to the first exposure parameter from low to high.
- the first camera captures a frame of the first image
- the image capturing operation of the first camera is ended, that is, the image capturing operation can be ended when the captured first image is overexposed,
- the collection efficiency of the first image can be improved.
- the efficiency of image analysis can be improved.
- Fig. 4 is a flowchart of collecting at least two frames of first images in another embodiment.
- the process of collecting at least two corresponding first images with at least two different first exposure parameters through the first camera includes:
- a preset first exposure parameter is acquired.
- the preset first exposure parameter can be set according to actual application requirements. Specifically, the image collected by the electronic device according to the preset first exposure parameter is an image with lower brightness.
- the first camera is controlled to collect a frame of the first image with the first exposure parameter.
- the electronic device controls the first camera to collect a frame of the first image with the first exposure parameter.
- the first exposure parameter is adjusted according to the first image corresponding to the first exposure parameter to obtain the first target exposure parameter.
- the electronic device may adjust the first exposure parameter according to the first image to determine the first target exposure parameter when the target brightness value of the collected first image is lower than the preset brightness value. Specifically, the electronic device may adjust the first exposure parameter according to at least one of the target brightness value, image information amount, brightness distribution information, and color distribution information of the first image to obtain the first target exposure parameter.
- the electronic device can preset brightness intervals corresponding to different exposure parameters, when the target brightness value of the first image corresponding to the first exposure parameter is lower than the minimum value of the corresponding brightness interval , Increase the first exposure parameter by the first difference, when the target brightness value of the first image is greater than the maximum value of the corresponding brightness interval, increase the first exposure parameter by the second difference, when the target brightness of the first image
- the first exposure parameter is increased by a third difference, where the first difference is greater than the third difference, and the third difference is greater than the second difference.
- the obtained first target exposure parameter is used as the first exposure parameter, and the operation of collecting a frame of the first image with the first exposure parameter through the first camera is returned to execute.
- the electronic device may use the adjusted first target exposure parameter as the first exposure parameter, so as to cyclically perform the operation of collecting a frame of the first image with the first exposure parameter.
- the electronic device ends the image capturing operation of the first camera and no longer adjusts the first exposure parameter.
- the first exposure parameter is adjusted according to the captured first image to obtain the first target exposure parameter, and then the first target exposure parameter is used as the first exposure parameter to capture the first image, that is, Collecting at least two frames of the first image with at least two different exposure parameters in a loop until the target brightness value of the collected first image exceeds the preset brightness value, which can improve the accuracy of the first image.
- Fig. 5 is a flowchart of determining the second exposure parameter according to the first image in an embodiment.
- the provided image acquisition method performs content analysis on each frame of the first image, and determines at least two first images according to the obtained content analysis result and at least two different first exposure parameters.
- the process of two exposure parameters includes:
- the amount of image information corresponding to each frame of the first image is calculated to obtain the amount of image information corresponding to each first exposure parameter.
- the amount of image information is the total amount of information provided by the image. Specifically, the amount of image information reflects the complexity of the image.
- Each frame of the first image collected by the electronic device has a corresponding first exposure parameter. Therefore, the electronic device calculates the amount of image information corresponding to each frame of the first image to obtain the amount of image information corresponding to each first exposure parameter. .
- the electronic device may calculate the image information amount using a calculation formula corresponding to the image entropy.
- the electronic device may calculate the image information amount of the first image by integrating invalid information and the like contained in the first image.
- a one-dimensional distribution map corresponding to the brightness information contained in the first image of each frame is established.
- the one-dimensional distribution map corresponding to the brightness information is the brightness distribution histogram corresponding to the first image.
- the brightness distribution histogram the number of pixels corresponding to different brightness values in the first image can be determined.
- the electronic device can also determine whether the first image is an underexposed, accurately exposed, or overexposed image according to the brightness distribution histogram.
- At least two second exposure parameters are determined from the at least two first exposure parameters based on the amount of image information corresponding to each first exposure parameter and the one-dimensional distribution map.
- the electronic device determines at least two second exposure parameters based on the amount of image information corresponding to each first exposure parameter and the one-dimensional distribution map corresponding to each frame of the first image. Specifically, the electronic device determines at least two second exposure parameters according to each first exposure parameter.
- the amount of image information and the corresponding one-dimensional distribution map can calculate the information distribution of the photographed object in different brightness intervals, so as to determine the at least two second exposures containing the most information of the photographed object from the at least two first exposure parameters Parameter, the second image captured according to the at least two second exposure parameters contains the most information about the object being photographed.
- the amount of image information corresponding to each first exposure parameter is obtained, and a one-dimensional distribution map corresponding to the brightness information contained in the first image of each frame is established, based on each first image.
- the amount of image information corresponding to the exposure parameters and the one-dimensional distribution map determine at least two second exposure parameters, so that at least two frames of second images collected according to the at least two second exposure parameters contain the most information of the photographed object.
- Fig. 6 is a flowchart of determining the second exposure parameter according to the first image in another embodiment.
- the provided image acquisition method performs content analysis on each frame of the first image, and determines at least two first images according to the obtained content analysis result and at least two different first exposure parameters.
- the process of two exposure parameters includes:
- the amount of image information corresponding to each frame of the first image is calculated to obtain the amount of image information corresponding to each first exposure parameter.
- a two-dimensional distribution map of image content contained in each frame of the first image is established, where the image content includes at least one of brightness, color, and complexity of the image.
- the electronic device establishes a two-dimensional distribution map of the image content contained in each frame of the first image, and the position and size of the distribution of the image content in the first image can be determined according to the established two-dimensional distribution map.
- the image content includes at least one of brightness, color, and complexity of the image. In some embodiments, the image content may also be saturation, color temperature, etc., which are not limited here.
- the electronic device can establish a three-dimensional coordinate system with the center of the image as the origin, the plane where the image is located as the XY plane, and the brightness information of the image as the Z axis. Dimensional distribution map, the electronic device can clarify the spatial distribution of brightness information in the first image.
- At least two second exposure parameters are determined from the at least two first exposure parameters based on the image information amount and the two-dimensional distribution map corresponding to each first exposure parameter.
- the electronic device determines at least two second exposure parameters based on the amount of image information corresponding to the different first exposure parameters and the two-dimensional distribution map of the image content corresponding to each frame of the first image. Specifically, the electronic device may determine the at least two second exposure parameters according to the first exposure parameters.
- the corresponding image information amount and the two-dimensional distribution map of the image content of the first image determine the distribution of the image information in the first image. For example, in the two-dimensional color distribution map of the first image, the less image information is distributed in a region with a single color, the more image information is distributed in a region with rich colors.
- the electronic device can compare the increment of the difference information between different first images according to the information distribution of each frame of the first image, so that based on the increment comparison of the difference information between the different first images, the electronic device can Among the at least two first exposure parameters, at least two second exposure parameters containing the most information of the photographed object are determined.
- the electronic device may perform an incremental comparison of the difference information between adjacent first images, and may also divide the first image according to the first exposure parameter to determine the difference information between the first images classified into the same set The increment.
- the amount of image information corresponding to each frame of the first image is obtained, and a two-dimensional distribution map of the image content contained in each frame of image is established, based on the corresponding to each first exposure parameter
- the image information amount and the two-dimensional distribution map determine at least two second exposure parameters.
- the at least two second exposure parameters used to generate the HDR image can be determined according to the spatial distribution of the image information amount in the first image. Second, the accuracy of the exposure parameters and the quality of the target image.
- Fig. 7 is a two-dimensional distribution diagram of the brightness of a first image frame in an embodiment.
- the XY axis of the coordinate system is the plane where the image is located, and the Z axis is the brightness value of the pixel. From the two-dimensional distribution diagram, it can be known that the middle area of the first image is the brightest, so the middle area gradually goes around Darkened, it can be determined according to the two-dimensional distribution map that the information content of the first image is mainly distributed in the transition area between the middle area and the surrounding area of the first image.
- FIG. 8 is a schematic diagram of the image information amount corresponding to each first exposure parameter in an embodiment.
- the horizontal axis is the first exposure parameter corresponding to the first image
- the vertical axis is the image information amount contained in the first image corresponding to the first exposure parameter. Integrating the image information amount of the first image and the two-dimensional distribution map of the image content can determine the distribution of the image information amount in the first image. In this way, the difference information can be incrementally compared for different first images, so as to determine the at least two second exposure parameters that contain the most information of the photographed object.
- Fig. 9 is a flowchart of an image acquisition method in an embodiment. As shown in FIG. 9, in one embodiment, the provided image acquisition method includes:
- Operation 902 Acquire corresponding at least two frames of first images with at least two different first exposure parameters through the first camera.
- operation 904 content analysis is performed on each frame of the first image, and at least two second exposure parameters are determined according to the obtained content analysis result and the at least two different first exposure parameters.
- Operation 906 Obtain a preview image collected by the second camera, and detect a target object contained in the preview image.
- the electronic device can recognize the target object contained in the preview image through feature information matching, target detection algorithm, and the like.
- At least two second exposure parameters are adjusted based on the amount of image information corresponding to the target object in each frame of the first image.
- the amount of image information corresponding to the target object is the amount of image information contained in the corresponding area of the target object in the first image.
- the electronic device can calculate the amount of image information corresponding to the target object in each frame of the first image. The larger the amount of image information corresponding to the target object, the clearer the imaging of the target object and the better the shooting effect.
- the electronic device adjusts at least two second exposure parameters based on the amount of image information corresponding to the target object in each frame of the first image. Specifically, the electronic device can obtain the first image corresponding to the first image with the largest amount of image information corresponding to the target object. An exposure parameter, at least two second exposure parameters are adjusted according to the first exposure parameter.
- the electronic device may appropriately increase the second exposure parameter, and when the at least two second exposure parameters are higher than the first exposure parameter For one exposure parameter, the electronic device can lower the second exposure parameter; the electronic device can also control the difference between at least one second exposure parameter and the first exposure parameter within a preset range, etc., which is not limited to this.
- image acquisition is performed by the second camera using the adjusted at least two second exposure parameters to obtain at least two corresponding second images.
- the electronic device After the electronic device adjusts at least two second exposure parameters based on the amount of image information corresponding to the target object in each frame of the first image, the adjusted at least two second exposure parameters can be obtained, and the electronic device can pass the second The camera uses the adjusted at least two second exposure parameters to collect images to obtain at least two corresponding second images.
- At least two frames of second images are fused to obtain a target image.
- the target object contained in the preview image is obtained, and the second exposure parameter is adjusted according to the amount of image information corresponding to the target object in the first image of each frame, so that the second exposure parameter can be collected according to the adjusted second exposure
- the imaging of the target object in the second image is clearer, which can meet the shooting requirements of the target object, and improve the accuracy of image collection and the quality of the synthesized target image.
- Fig. 10 is a flowchart of an image acquisition method in an embodiment. As shown in FIG. 10, in one embodiment, the specific operations for implementing the image acquisition method are as follows:
- a preview image is collected through the second camera.
- the electronic device determines whether the preview image is a high light ratio image. Specifically, the electronic device determines whether the preview image is a highlight image according to the brightness distribution information of the preview image. When the preview image is a high-light ratio image, proceed to operation 1006, and when the preview image is not a high-light ratio image, return to operation 1002.
- Operation 1006 Acquire corresponding at least two frames of first images with at least two different first exposure parameters through the first camera.
- the electronic device may acquire at least two different preset first exposure parameters, and acquire the first image through the first camera according to the first exposure parameter from low to high.
- the electronic device may also obtain the preset first exposure parameter, control the first camera to collect a frame of the first image with the first exposure parameter, and adjust the first exposure parameter according to the first image corresponding to the first exposure parameter , Obtain the first target exposure parameter, use the obtained first target exposure parameter as the first exposure parameter, and return to perform the operation of collecting a frame of the first image with the first exposure parameter through the first camera.
- operation 1010 it is detected whether the target brightness value of the collected first image exceeds a preset brightness value.
- the electronic device can detect whether the target brightness value corresponding to the captured first image exceeds the preset brightness value every time a frame of the first image is captured by the first camera, and when the target brightness value of the captured first image exceeds the preset brightness value When the brightness value is set, the image capturing operation of the first camera is ended, and operation 1012 is entered.
- Operation 1012 Obtain a content analysis result of each frame of the first image, and determine at least two second exposure parameters based on the content analysis result and the at least two first exposure parameters.
- the electronic device can analyze the content of the first image every time a frame of the first image is collected. After the image collection operation of the first camera is finished, the electronic device can obtain the content analysis result of each frame of the first image, according to the The content analysis result and the at least two first exposure parameters determine at least two second exposure parameters.
- the electronic device can calculate the amount of image information corresponding to each frame of the first image to obtain the amount of image information corresponding to each first exposure parameter; establish a two-dimensional distribution map of the image content contained in each frame of the first image, Wherein, the image content includes at least one of the brightness, color, and complexity of the image; at least two second exposure parameters are determined based on the image information amount corresponding to each first exposure parameter and the two-dimensional distribution map. 2. Exposure parameters.
- the electronic device can also calculate the amount of image information corresponding to each frame of the first image to obtain the amount of image information corresponding to each first exposure parameter; establish a one-dimensional distribution corresponding to the brightness information contained in each frame of the first image Figure; at least two second exposure parameters are determined from at least two first exposure parameters based on the amount of image information corresponding to each first exposure parameter and a one-dimensional distribution map.
- the electronic device may detect the target object contained in the preview image, and adjust at least two second exposure parameters based on the amount of image information corresponding to the target object in each frame of the first image.
- At least two corresponding second images of at least two frames are acquired by the first camera with at least two second exposure parameters.
- the electronic device may collect at least two frames of corresponding second images with the latest at least two second exposure parameters when receiving the image collection instruction.
- the obtained at least two frames of second images are fused to obtain a target image.
- Fig. 11 is a structural block diagram of an image acquisition device according to an embodiment.
- the image acquisition device includes a first acquisition module 1102, a parameter determination module 1104, a second acquisition module 1106, and a processing module 1108, where:
- the first acquisition module 1102 is configured to acquire at least two corresponding first images with at least two different first exposure parameters through the first camera;
- the parameter determination module 1104 is configured to perform content analysis on each frame of the first image, and determine at least two second exposure parameters according to the obtained content analysis result and at least two different first exposure parameters;
- the second acquisition module 1106 is configured to perform image acquisition with at least two second exposure parameters through the second camera to obtain at least two corresponding second images;
- the processing module 1108 is configured to perform fusion processing on at least two frames of second images to obtain a target image.
- the image acquisition device provided by the embodiment of the present application is used to acquire at least two corresponding first images with at least two different first exposure parameters through a first camera, and perform content analysis on each first image according to the content analysis
- the result and the at least two different first exposure parameters determine at least two second exposure parameters
- the second camera uses the at least two second exposure parameters to perform image collection to obtain at least two corresponding second images.
- the second image undergoes fusion processing to obtain the target image. Since the exposure parameters of the images used for fusion can be obtained by analyzing the multiple frames of images collected by the first camera, the second camera collects the images according to the exposure parameters and then performs fusion, which can improve the quality of the collected images.
- the parameter determination module 1104 may also be used to calculate the image information amount corresponding to each frame of the first image, to obtain the image information amount corresponding to each first exposure parameter; to establish the image information contained in each frame of the first image A two-dimensional distribution map of the content, where the image content includes at least one of the brightness, color, and complexity of the image; based on the amount of image information corresponding to each first exposure parameter and the two-dimensional distribution map from at least two first exposures At least two second exposure parameters are determined among the parameters.
- the parameter determination module 1104 may also be used to obtain the preview image collected by the second camera; detect the target object contained in the preview image; and based on the amount of image information corresponding to the target object in each frame of the first image, to at least Two second exposure parameters are adjusted.
- the second acquisition module 1106 may also be used for image acquisition through the second camera with the adjusted at least two second exposure parameters to obtain at least two corresponding second images.
- the parameter determination module 1104 may also be used to calculate the image information amount corresponding to each frame of the first image, to obtain the image information amount corresponding to each first exposure parameter; to establish the brightness contained in each frame of the first image A one-dimensional distribution map corresponding to the information; at least two second exposure parameters are determined from the at least two first exposure parameters based on the amount of image information corresponding to each first exposure parameter and the one-dimensional distribution map.
- the first collection module 1102 can also be used to collect the preview image through the second camera; determine whether the preview image is a high-light ratio image according to the brightness distribution information of the preview image; when it is determined that the preview image is a high-light ratio image, then At least two corresponding first images are collected by the first camera with at least two different first exposure parameters.
- the first acquisition module 1102 may also be used to acquire at least two different preset first exposure parameters; acquire the first image according to the first exposure parameter from low to high through the first camera; Each time the first camera captures a frame of the first image, it detects whether the target brightness value corresponding to the captured first image exceeds the preset brightness value; when the target brightness value of the captured first image exceeds the preset brightness value, The image acquisition operation of the first camera is ended.
- the target brightness value can be determined according to at least one of the average photometry value, the center photometry value, and the spot photometry value corresponding to the first image.
- the first acquisition module 1102 can also be used to acquire preset first exposure parameters; control the first camera to acquire a frame of the first image with the first exposure parameters; when the first image corresponds to the first exposure parameter When the target brightness value of is lower than the preset brightness value, the first exposure parameter is adjusted according to the first image corresponding to the first exposure parameter to obtain the first target exposure parameter; the obtained first target exposure parameter is used as the first exposure parameter , And return to perform the operation of capturing a frame of the first image with the first exposure parameter through the first camera; when the target brightness value of the first image corresponding to the first exposure parameter exceeds the preset brightness value, the image capturing operation of the first camera is ended .
- the image acquisition device can be divided into different modules as needed to complete all or part of the functions of the above-mentioned image acquisition device.
- Fig. 12 is a schematic diagram of the internal structure of an electronic device in an embodiment.
- the electronic device includes a processor and a memory connected through a system bus.
- the processor is used to provide computing and control capabilities to support the operation of the entire electronic device.
- the memory may include a non-volatile storage medium and internal memory.
- the non-volatile storage medium stores an operating system and a computer program.
- the computer program can be executed by the processor to implement an image acquisition method provided in the following embodiments.
- the internal memory provides a cached operating environment for the operating system computer program in the non-volatile storage medium.
- the electronic device can be a mobile phone, a tablet computer or a personal digital assistant or a wearable device.
- each module in the image acquisition device provided in the embodiment of the present application may be in the form of a computer program.
- the computer program can be run on a terminal or server.
- the program module composed of the computer program can be stored in the memory of the terminal or server.
- the embodiment of the application also provides an electronic device.
- the above-mentioned electronic equipment includes an image processing circuit, which can be implemented by hardware and/or software components, and can include various processing units that define an ISP (Image Signal Processing, image signal processing) pipeline.
- Fig. 13 is a schematic diagram of an image processing circuit in an embodiment. As shown in FIG. 13, for ease of description, only various aspects of the image processing technology related to the embodiments of the present application are shown.
- the image processing circuit includes a first ISP processor 1330, a second ISP processor 1340, and a control logic 1350.
- the first camera 1310 includes one or more first lenses 1313 and a first image sensor 1314.
- the first image sensor 1314 may include a color filter array (such as a Bayer filter).
- the first image sensor 1314 may acquire the light intensity and wavelength information captured by each imaging pixel of the first image sensor 1314, and provide information that can be obtained by the first ISP.
- the second camera 1320 includes one or more second lenses 1322 and a second image sensor 1324.
- the second image sensor 1324 may include a color filter array (such as a Bayer filter).
- the second image sensor 1324 may acquire the light intensity and wavelength information captured by each imaging pixel of the second image sensor 1324, and provide information that can be used by the second ISP.
- the first image collected by the first camera 1310 is transmitted to the first ISP processor 1330 for processing.
- the statistical data of the first image (such as the brightness of the image, the contrast value of the image) , The color of the image, etc.) are sent to the control logic 1350, and the control logic 1350 can determine the control parameters of the first camera 1310 according to the statistical data, so that the first camera 1310 can perform operations such as auto focus and auto exposure according to the control parameters.
- the first image can be stored in the image memory 1360 after being processed by the first ISP processor 1330, and the first ISP processor 1330 can also read the image stored in the image memory 1360 for processing.
- the first image can be directly sent to the display 1370 for display after being processed by the ISP processor 1330, and the display 1370 can also read the image in the image memory 1360 for display.
- the first ISP processor 1330 processes image data pixel by pixel in multiple formats.
- each image pixel may have a bit depth of 13, 10, 13, or 14 bits, and the first ISP processor 1330 may perform one or more image processing operations on the image data and collect statistical information about the image data.
- the image processing operations can be performed with the same or different bit depth accuracy.
- the image memory 1360 may be a part of a memory device, a storage device, or an independent dedicated memory in an electronic device, and may include DMA (Direct Memory Access, direct memory access) features.
- DMA Direct Memory Access, direct memory access
- the first ISP processor 1330 may perform one or more image processing operations, such as time-domain filtering.
- the processed image data can be sent to the image memory 1360 for additional processing before being displayed.
- the first ISP processor 1330 receives processed data from the image memory 1360, and performs image data processing in the RGB and YCbCr color spaces on the processed data.
- the image data processed by the first ISP processor 1330 may be output to the display 1370 for viewing by the user and/or further processed by a graphics engine or GPU (Graphics Processing Unit, graphics processor).
- the output of the first ISP processor 1330 can also be sent to the image memory 1360, and the display 1370 can read image data from the image memory 1360.
- the image memory 1360 may be configured to implement one or more frame buffers.
- the statistical data determined by the first ISP processor 1330 may be sent to the control logic 1350.
- the statistical data may include first image sensor 1314 statistical information such as automatic exposure, automatic white balance, automatic focus, flicker detection, black level compensation, and shading correction of the first lens 1313.
- the control logic 1350 may include a processor and/or a microcontroller that executes one or more routines (such as firmware). The one or more routines may determine the control parameters and the first camera 1310 of the first camera 1310 based on the received statistical data. A control parameter of the ISP processor 1330.
- control parameters of the first camera 1310 may include gain, integration time of exposure control, anti-shake parameters, flash control parameters, first lens 1313 control parameters (such as focal length for focusing or zooming), or a combination of these parameters.
- the ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (for example, during RGB processing), and first lens 1313 shading correction parameters.
- the second image captured by the second camera 1320 is transmitted to the second ISP processor 1340 for processing.
- the statistical data of the second image (such as image brightness, image The contrast value of the image, the color of the image, etc.) are sent to the control logic 1350, and the control logic 1350 can determine the control parameters of the second camera 1320 according to the statistical data, so that the second camera 1320 can perform automatic focusing, automatic exposure and other operations according to the control parameters .
- the second image can be stored in the image memory 1360 after being processed by the second ISP processor 1340, and the second ISP processor 1340 can also read the image stored in the image memory 1360 for processing.
- the second image can be directly sent to the display 1370 for display after being processed by the ISP processor 1340, and the display 1370 can also read the image in the image memory 1360 for display.
- the second camera 1320 and the second ISP processor 1340 may also implement the processing procedures described by the first camera 1310 and the first ISP processor 1330.
- the image processing circuit provided according to the embodiment of the present application can implement the above-mentioned image acquisition method.
- the embodiment of the present application also provides a computer-readable storage medium.
- a computer program product containing instructions that, when run on a computer, causes the computer to execute an image acquisition method.
- Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
- Volatile memory may include random access memory (RAM), which acts as external cache memory.
- RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous Link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
- SRAM static RAM
- DRAM dynamic RAM
- SDRAM synchronous DRAM
- DDR SDRAM double data rate SDRAM
- ESDRAM enhanced SDRAM
- SLDRAM synchronous Link (Synchlink) DRAM
- Rambus direct RAM
- DRAM direct memory bus dynamic RAM
- RDRAM memory bus dynamic RAM
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
一种图像采集方法,包括:通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像,对每一帧第一图像进行内容分析,根据内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数,通过第二摄像头以至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像,将至少两帧第二图像进行融合处理,得到目标图像。
Description
相关申请的交叉引用
本申请要求于2019年02月18日提交中国专利局、申请号为2019101197024、发明名称为“图像采集方法、装置、电子设备和计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及影像技术领域,特别是涉及一种图像采集方法、电子设备和计算机可读存储介质。
由于人眼所能看到的亮度范围远大于显示屏和摄像头所提供的亮度范围,导致人眼观测的被拍摄物体的亮度与摄像头采集的图像的亮度存在较大的差异。目前,在图像采集过程中,摄像头可以预设的多个曝光参数来采集多张图像,以根据多张图像合成HDR(High-Dynamic Range,高动态范围)图像。然而,传统方法中合成的HDR图像存在质量较低的问题。
发明内容
根据本申请的各种实施例,提供一种图像采集方法、电子设备和计算机可读存储介质。
一种图像采集方法,包括:
通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像;
对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和所述至少两个不同的第一曝光参数确定至少两个第二曝光参数;
通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像;及
将所述至少两帧第二图像进行融合处理,得到目标图像。
一种电子设备,包括存储器及处理器,所述存储器中储存有计算机程序,所述计算机程序被所述处理器执行时,使得所述处理器执行如下操作:
通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像;
对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和所述至少两个不同的第一曝光参数确定至少两个第二曝光参数;
通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像;及
将所述至少两帧第二图像进行融合处理,得到目标图像。
一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现如下操作:
通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像;
对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和所述至少两个不同的第一曝光参数确定至少两个第二曝光参数;
通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像;及
将所述至少两帧第二图像进行融合处理,得到目标图像。
本申请实施例提供的图像采集方法、电子设备和计算机可读存储介质,可以根据第一摄像头的采集多帧图像分析得到用于融合的图像的曝光参数,由第二摄像头根据该曝光参数采集图像后进行融合,可以提高采集的图像质量。
本申请的一个或多个实施例的细节在下面的附图和描述中提出。本发明的其它特征、目的和优点将从说明书、附图以及权利要求书变得明显。
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为一个或多个实施例中图像采集方法的应用环境示意图。
图2为一个或多个实施例中图像采集方法的流程图。
图3为一个或多个实施例中采集至少两帧第一图像的流程图。
图4为一个或多个实施例中采集至少两帧第一图像的流程图。
图5为一个或多个实施例中根据第一图像确定第二曝光参数的流程图。
图6为一个或多个实施例中根据第一图像确定第二曝光参数的流程图。
图7为一个或多个实施例中一帧第一图像的亮度的二维分布图。
图8为一个或多个实施例中每一个第一曝光参数对应的图像信息量的示意图。
图9为一个或多个实施例中图像采集方法的流程图。
图10为一个或多个实施例中图像采集方法的流程图。
图11为一个或多个实施例的图像采集装置的结构框图。
图12为一个或多个实施例中电子设备的内部结构示意图。
图13为一个或多个实施例中图像处理电路的示意图。
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。
可以理解,本申请所使用的术语“第一”、“第二”等可在本文中用于描述各种元件,但这些元件不受这些术语限制。这些术语仅用于将第一个元件与另一个元件区分。举例来说,在不脱离本申请的范围的情况下,可以将第一摄像头称为第二摄像头,且类似地,可将第二摄像头称为第一摄像头。第一摄像头和第二摄像头两者都是摄像头,但其不是同一摄像头。
图1为一个实施例中图像采集方法的应用环境示意图。如图1所示,该应用环境包括电子设备110。电子设备110可以通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像,对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数,通过第二摄像头以至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像,将至少两帧第二图像进行融合处理,得到目标图像。可以理解的是,上述电子设备110可以不限于是各种手机、电脑、可携带设备等。
图2为一个实施例中图像采集方法的流程图。如图2所示,图像采集方法包括操作 202至操作208。
操作202,通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像。
电子设备中包含第一摄像头和第二摄像头。第一摄像头和第二摄像头设于电子设备的同一侧,可用于采集包含相同的被拍摄物体的图像。具体地,第一摄像头和第二摄像头可以不限于是彩色摄像头、黑白摄像头、广角摄像头、长焦摄像头中的任意一种或两种。曝光参数包括曝光时间。曝光时间是摄像头在采集图像时,快门从打开到关闭的时间间隔。可选地,在一些实施例中,曝光参数还包括摄像头增益等,通常,在曝光时间较小的情况下,可以采用较高的摄像头增益,在曝光时间较大的情况下,可以采用较小的摄像头增益。
电子设备可以根据实际应用需求预设的多个不同的第一曝光参数,在此对曝光参数的数量和具体的数值不做限定。摄像头根据该至少两个不同的第一曝光参数采集的多帧图像可以包含有被拍摄场景的亮区和暗区的信息。例如,不同的第一曝光参数可以是曝光时间为0.001s、0.002s、0.01s、0.05s、0.1s等,不限于此。电子设备可以通过第一摄像头以至少两个不同的第一曝光参数采集得到对应至少两帧第一图像,每一个第一曝光参数对应一帧第一图像。其中,电子设备得到的至少两帧第一图像的被拍摄场景相同或近似相同,包含的图像信息量不同。
操作204,对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数。
图像的内容分析可以包括但不限于是对图像的亮度信息、色彩信息、图像复杂度、信息分布等进行分析。第二曝光参数的数量可以根据实际应用需求预先设定,在此不做限定。例如,电子设备可以预设第二曝光参数的数量为2个、3个或4个等。通常,第二曝光参数的数量小于或等于第一曝光参数的数量。根据至少两个曝光参数采集的至少两帧图像包含了真实的被拍摄场景的信息最多,根据至少两个曝光参数采集的至少两帧图像融合处理后的图像可以反映真实的被拍摄场景的视觉效果。可选地,第二曝光参数的数量也可以根据第一图像的内容分析结果来确定。例如,当根据每一帧第一图像的内容分析结果确定只需要两个第二曝光参数就能够获取到真实的被拍摄场景的全部信息时,则第二曝光参数的数量可以为2个。
电子设备可以对每一帧第一图像进行内容分析,从而得到每一帧第一图像也即每一个第一曝光参数对应的内容分析结果,根据内容分析结果确定能够获取到真实的被拍摄场景的全部信息的至少两个第二曝光参数。具体地,电子设备对每一帧第一图像进行内容分析,可以得到在不同的曝光参数下图像信息的分布情况,结合每一帧第一图像的亮度分布信息,电子设备可以确定能够获取到真实被拍摄场景的全部信息的至少两个第二曝光参数。例如,当拍摄场景为一组从黑色到白色递增分布的灯带时,电子设备采用至少两个不同的第一曝光参数如曝光时间分别为0.005s、0.01s、0.04s、0.08s、0.1s采集得到对应的多帧第一图像中,在较低的曝光时间即0.005s对应的第一图像中可以包含有白色灯泡对应的图像信息,而黑色灯泡由于进光量不足在第一图像展示为黑色,无法体现出黑色灯泡的细节,在较高的曝光时间如0.1s对应的第一图像中则可以包含有黑色灯泡的图像信息,而白色灯泡则将展示为白色,无法体现出白色灯泡的细节,从而电子设备可以对每一帧第一图像进行内容分析,根据内容分析结果及至少两个不同的第一曝光参数确定能够获得灯带的全部信息的至少两个第二曝光参数。
操作206,通过第二摄像头以至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
电子设备通过第一摄像头采集的至少两帧第一图像分析得到至少两个第二曝光参数后,可以通过第二摄像头以至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。第二图像的数量与第二曝光参数的数量相同,即每一个第二曝光参数对应一帧第 二图像。
可选地,电子设备可以在接收到图像采集指令时,控制第二摄像头以至少两个第二曝光参数进行图像采集,此时,电子设备可以根据最新的至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
操作208,将至少两帧第二图像进行融合处理,得到目标图像。
融合处理是指将多张图像按照一定规则生成最终的图像的操作。电子设备可以将得到的至少两帧第二图像进行融合处理,得到目标图像。目标图像包含了被拍摄场景的全部信息,可以反映被拍摄场景真实的视觉效果。具体地,电子设备可以通过色调映射算法、或基于对比度或者梯度阈的方法等对每一帧第二图像进行处理,从而获得融合后的目标图像。可选地,电子设备还可以在融合处理之前,将至少两帧第二图像进行对齐处理,可以避免出现鬼影现象,提高图像的质量。
可选地,电子设备得到目标图像后,可以在摄像头预览界面提供目标图像的缩略图;也可以将目标图像展示在电子设备的显示屏上供用户预览,还可以在图像预览界面提供保存、编辑、分享等选项供用户做进一步的操作。
本申请提供的实施例,通过第一摄像头以第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像,对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数,通过第二摄像头以至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像,将至少两帧第二图像进行融合处理,得到目标图像。从而可以避免采用的统一的曝光参数来采集图像而造成融合得到的图像不准确的问题,由第一摄像头采集的多帧图像分析得到用于融合的图像的曝光参数,由第二摄像头根据该曝光参数采集图像后进行融合,即可以根据当前的拍摄场景来确定用于融合的图像的曝光参数,可以提高图像的质量。并且,采用两个摄像头分别进行处理,可以避免对第二摄像头的工作造成影响,保证了第二摄像头的正常使用。
在一个实施例中,第二摄像头为电子设备的主摄像头,即电子设备通过第二摄像头采集的图像通常用于预览,展示在电子设备的显示屏上。具体地,电子设备可以在接收到摄像头的启动指令时,启动电子设备的第二摄像头采集图像并展示在电子设备的显示屏上,同时执行通过第一摄像头采集不同的第一曝光参数对应的至少两帧第一图像,对每一帧第一图像进行内容分析,根据内容分析结果确定至少两个第二曝光参数的操作。从而,当电子设备接收到图像采集指令时,可以通过第二摄像头以至少两个第二摄像头进行图像采集,得到对应的至少两帧第二图像。可选地,电子设备也可以在接收到图像采集指令时执行通过第一摄像头采集不同的第一曝光参数对应的至少两帧第一图像,对每一帧第一图像进行内容分析,根据内容分析结果确定至少两个第二曝光参数的操作,可以降低电子设备的功耗。
由第一摄像头采集的多帧图像分析得到用于融合的图像的曝光参数,由第二摄像头根据该曝光参数采集图像后进行融合,即在第二摄像头采集图像进行预览的同时通过第一摄像头确定用于融合的图像的曝光参数,可以避免对第二摄像头的图像预览效果造成影响,保证了预览界面的正常展示。
在一个实施例中,电子设备通过第一摄像头采集至少两帧第一图像之前,还可以包括:通过第二摄像头采集预览图像;根据预览图像的亮度分布信息判断预览图像是否为高光比图像;当确定预览图像为高光比图像时,则执行通过第一摄像头采集至少两帧第一图像的操作。
预览图像是指摄像头采集的可实时展示于电子设备显示屏的图像。电子设备可以通过第二摄像头采集预览图像,从而根据预览图像的亮度分布信息判断预览图像是否为高光比图像。光比是指被拍摄物体的暗面与亮面的受光比例。高光比图像是指图像中按暗面和亮面的受光存在一定差异的图像。电子设备根据预览图像的亮度分布信息可以判断预览图 像是否为高光比图像。可选地,电子设备在预览图像中存在亮度值差异较大的像素点时则确定该预览图像为高光比图像;电子设备也可以建立预览图像的亮度分布直方图,当根据亮度分布直方图确定预览图像中存在分布于直方图两侧的像素点的数量达到预设数量时,则确定该预览图像为高光比图像等。
电子设备可以在确定第二摄像头采集的预览图像为高光比图像时,执行通过第一摄像头采集至少两帧第一图像的操作。即电子设备可以在确定当前的拍摄场景为高光比场景时,则通过第一摄像头以多个不同的第一曝光参数采集第一图像,根据第一图像的内容分析结果确定多个第二曝光参数,并通过第二摄像头以第二曝光参数采集对应的第二图像进行合成,合成的目标图像可以真实的反映被拍摄物体的信息,提高了目标图像的准确性,并实现智能开启摄像头的HDR功能。
图3为一个实施例中采集至少两帧第一图像的流程图。如图3所示,在一个实施例中,通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像的过程包括:
操作302,获取预设的至少两个不同的第一曝光参数。
具体地,电子设备预设有至少两个不同的第一曝光参数,电子设备可以在摄像头启动时获取预设的至少两个不同的第一曝光参数。
操作304,通过第一摄像头根据第一曝光参数从低到高的顺序采集第一图像。
第一曝光参数从低到高的顺序也即第一曝光参数中包含的曝光时间从低到高的顺序。例如,当电子设备预设的多个第一曝光参数中曝光时间分别为0.02s、0.05s、0.08s,则电子设备可以先将第一摄像头的曝光时间设定为0.02s采集第一帧第一图像,接着将第一摄像头的曝光时间设定为0.05s采集第二帧第一图像,接着将第一摄像头的曝光时间设定为0.08s采集第三帧第一图像。
操作306,在第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值。
预设亮度值可以根据实际应用需求进行设定。具体地,预设亮度值为大于或等于图像曝光过度时的亮度值。可选地,电子设备可以根据第一图像对应的平均测光值、中心测光值和点测光值中的至少一种确定目标亮度值。平均测光值为第一图像中包含的像素点的亮度的平均值。中心测光值是根据第一图像的图像中心区域中像素点的亮度值确定的。点测光值是以第一图像的构图中心点或对焦点等的亮度值确定的。
电子设备可以在第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值。
操作308,当采集到的第一图像的目标亮度值超过预设亮度值时,则结束第一摄像头的图像采集操作。
当采集到的第一图像的目标亮度值超过预设亮度值时,则电子设备结束第一摄像头的图像采集操作。可选地,在一些实施例中,电子设备也可以直接根据预设的至少两个第一曝光参数完成第一摄像头的图像采集操作,即不对采集到的第一图像的亮度进行检测。
通过第一摄像头根据第一曝光参数从低到高的顺序采集第一图像,在第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值,当采集到的第一图像的目标亮度值超过预设亮度值时,则结束第一摄像头的图像采集操作,即可以在采集的第一图像的曝光过度时结束本次图像采集操作,可以提高第一图像的采集效率。并且,为进一步对第一图像分析操作剔除了无效的图像,可以提高图像分析的效率。
图4为另一个实施例中采集至少两帧第一图像的流程图。如图4所示,在一个实施例中,通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像的过程包括:
操作402,获取预设的第一曝光参数。
预设的第一曝光参数可以根据实际应用需求进行设定。具体地,电子设备根据预设的第一曝光参数采集的图像为亮度较低的图像。
操作404,控制第一摄像头以第一曝光参数采集一帧第一图像。
具体地,电子设备控制第一摄像头以第一曝光参数采集一帧第一图像。
操作406,当第一曝光参数对应的第一图像的目标亮度值低于预设亮度值时,根据第一曝光参数对应的第一图像对第一曝光参数进行调整,得到第一目标曝光参数。
电子设备可以在采集到的第一图像的目标亮度值低于预设亮度值时,根据该第一图像对第一曝光参数进行调整以确定第一目标曝光参数。具体地,电子设备可以根据第一图像的目标亮度值、图像信息量、亮度分布信息和色彩分布信息等中的至少一种对第一曝光参数进行调整,从而得到第一目标曝光参数。以根据第一图像的目标亮度值进行调整为例,电子设备可以预设不同曝光参数对应的亮度区间,当第一曝光参数对应的第一图像的目标亮度值低于对应的亮度区间的最小值,以第一差值增加该第一曝光参数,当第一图像的目标亮度值大于对应的亮度区间的最大值时,则以第二差值增加该第一曝光参数,当第一图像的目标亮度值在该亮度区间时,则以第三差值增加该第一曝光参数,其中,第一差值大于第三差值、第三差值大于第二差值。
操作408,将得到的第一目标曝光参数作为第一曝光参数,并返回执行通过第一摄像头以第一曝光参数采集一帧第一图像的操作。
具体地,电子设备可以将调整后得到的第一目标曝光参数作为第一曝光参数,从而循环执行以第一曝光参数采集一帧第一图像的操作。
操作410,当第一曝光参数对应的第一图像的目标亮度值超过预设亮度值时,结束第一摄像头的图像采集操作。
当第一曝光参数对应的第一图像的目标亮度值超过预设亮度值时,则电子设备结束第一摄像头的图像采集操作,不再对该第一曝光参数进行调整。
通过在第一摄像头采集第一图像时,根据采集的第一图像对第一曝光参数进行调整得到第一目标曝光参数,再将第一目标曝光参数作为第一曝光参数采集第一图像,即可以循环以不同的至少两个曝光参数来采集至少两帧第一图像,直至采集的第一图像的目标亮度值超过预设亮度值,可以提高第一图像的准确性。
图5为一个实施例中根据第一图像确定第二曝光参数的流程图。如图5所示,在一个实施例中,提供的图像采集方法中对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数的过程包括:
操作502,计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量。
图像信息量为图像所提供的信息总量。具体地,图像信息量反映了图像的复杂程度。电子设备采集的每一帧第一图像都有对应的第一曝光参数,因此,电子设备计算每一帧第一图像对应的图像信息量,即可以得到每一个第一曝光参数对应的图像信息量。具体地,电子设备可以以图像熵对应的计算公式来计算图像信息量,可选地,电子设备综合第一图像中包含的无效信息等来计算第一图像的图像信息量。
操作504,建立每一帧第一图像包含的亮度信息对应的一维分布图。
亮度信息对应的一维分布图即为第一图像对应的亮度分布直方图。根据亮度分布直方图可以确定第一图像中不同亮度值对应的像素点的数量。通过第一图像的亮度分布直方图,电子设备也可以根据亮度分布直方图确定第一图像为曝光不足、准确曝光、还是曝光过度的图像。
操作506,基于每一个第一曝光参数对应的图像信息量及一维分布图从至少两个第一曝光参数中确定至少两个第二曝光参数。
电子设备基于每一个第一曝光参数对应的图像信息量及每一帧第一图像对应的一维分布图确定至少两个第二曝光参数,具体地,电子设备根据每一个第一曝光参数对应的图像信息量和对应的一维分布图可以推算出被拍摄物体在不同亮度区间上的信息分布,从而从至少两个第一曝光参数中确定包含被拍摄物体的信息最多的至少两个第二曝光参数,根据该至少两个第二曝光参数拍摄得到的第二图像包含的被拍摄物体的信息最多。
通过计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量,建立每一帧第一图像包含的亮度信息对应的一维分布图,基于每一个第一曝光参数对应的图像信息量及一维分布图确定至少两个第二曝光参数,从而根据该至少两个第二曝光参数采集的至少两帧第二图像包含了被拍摄物体的最多信息。
图6为另一个实施例中根据第一图像确定第二曝光参数的流程图。如图6所示,在一个实施例中,提供的图像采集方法中对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数的过程包括:
操作602,计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量。
操作604,建立每一帧第一图像包含的图像内容的二维分布图,其中,图像内容包括图像的亮度、色彩、复杂度中的至少一种。
电子设备建立每一帧第一图像包含的图像内容的二维分布图,根据建立的二维分布图可以确定图像内容在第一图像的分布的位置和大小。其中,图像内容包括图像的亮度、色彩、复杂度中的至少一种,在一些实施例中,图像内容还可以是饱和度、色温等,在此不做限定。以建立第一图像的亮度的二维分布图为例进行说明,电子设备可以以图像的中心作为原点、图像所在平面作为XY平面、图像的亮度信息作为Z轴建立三维坐标系,则根据该二维分布图,电子设备可以明确亮度信息在第一图像中的空间分布情况。
操作606,基于每一个第一曝光参数对应的图像信息量及二维分布图从至少两个第一曝光参数中确定至少两个第二曝光参数。
电子设备基于不同的第一曝光参数对应的图像信息量及每一帧第一图像对应的图像内容的二维分布图确定至少两个第二曝光参数,具体地,电子设备可以根据第一曝光参数对应的图像信息量及第一图像的图像内容的二维分布图确定图像信息在第一图像中的分布情况。举例来说,第一图像的色彩的二维分布图中色彩单一的区域分布的图像信息越少,色彩丰富的区域分布的图像信息则越多。进而电子设备可以根据每一帧第一图像的信息分布情况对比不同的第一图像之间差异信息的增量,从而基于不同的第一图像之间的差异信息的增量对比,电子设备可以从至少两个第一曝光参数中确定包含被拍摄物体的信息最多的至少两个第二曝光参数。可选地,电子设备可以对相邻的第一图像进行差异信息的增量对比,还可以根据第一曝光参数对第一图像进行划分,确定划分到同一集合的第一图像之间的差异信息的增量。
通过计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量,建立每一帧图像包含的图像内容的二维分布图,基于每一个第一曝光参数对应的图像信息量及二维分布图确定至少两个第二曝光参数,可以根据图像信息量在第一图像的空间分布情况来确定用于生成HDR图像的至少两个第二曝光参数,可以提高第二曝光参数的准确性与目标图像的质量。
图7为一个实施例中一帧第一图像的亮度的二维分布图。如图7所示,坐标系的XY轴为图像所在的平面,Z轴为像素点的亮度值,从该二维分布图可以得知第一图像的中间区域最亮,从而中间区域向四周逐渐变暗,则根据该二维分布图可以确定第一图像的信息量主要分布在第一图像的中间区域与四周之间的过渡区域。
图8为一个实施例中每一个第一曝光参数对应的图像信息量的示意图。如图8所示,横轴为第一图像对应的第一曝光参数,竖轴为第一曝光参数对应的第一图像包含的图像信 息量。综合第一图像的图像信息量和图像内容的二维分布图可以确定图像信息量在第一图像中的分布情况。由此可以对不同的第一图像进行差异信息的增量对比,从而确定包含有最多的被拍摄物体的信息的至少两个第二曝光参数。
图9为一个实施例中图像采集方法的流程图。如图9所示,在一个实施例中,提供的图像采集方法包括:
操作902,通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像。
操作904,对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数。
操作906,获取第二摄像头采集的预览图像,检测预览图像中包含的目标物体。
具体地,电子设备可以通过特征信息匹配、目标检测算法等识别预览图像中包含的目标物体。
操作908,基于每一帧第一图像中目标物体对应的图像信息量,对至少两个第二曝光参数进行调整。
目标物体对应的图像信息量即目标物体在第一图像中的对应区域所包含的图像信息量。电子设备可以计算每一帧第一图像的目标物体对应的图像信息量。目标物体对应的图像信息量越大,则说明目标物体的成像更加清晰,拍摄效果越好。电子设备基于每一帧第一图像中目标物体对应的图像信息量对至少两个第二曝光参数进行调整,具体地,电子设备可以获取目标物体对应的图像信息量最多的第一图像对应的第一曝光参数,根据该第一曝光参数对至少两个第二曝光参数进行调整。可选地,当至少两个第二曝光参数中存在低于该第一曝光参数时,电子设备可以将该第二曝光参数适当调高,当至少两个第二曝光参数中存在高于该第一曝光参数时,电子设备可以将第二曝光参数调低;电子设备也可以控制至少一个第二曝光参数与该第一曝光参数的差值在预设范围内等,不限于此。
操作910,通过第二摄像头以调整后的至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
电子设备基于每一帧第一图像中目标物体对应的图像信息量,对至少两个第二曝光参数进行调整后,可以得到调整后的至少两个第二曝光参数,则电子设备可以通过第二摄像头以调整后的至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
操作912,将至少两帧第二图像进行融合处理,得到目标图像。
通过对预览图像进行检测,得到预览图像中包含的目标物体,根据每一帧第一图像中目标物体对应的图像信息量对第二曝光参数进行调整,可以使得根据调整后的第二曝光参数采集的第二图像中目标物体成像更加清晰,可以满足目标物体的拍摄需求,提高图像采集的准确性与合成的目标图像的质量。
图10为一个实施例中图像采集方法的流程图。如图10所示,在一个实施例中,实现该图像采集方法的具体操作如下:
操作1002,通过第二摄像头采集预览图像。
操作1004,判断预览图像是否为高光比图像。具体地,电子设备根据所述预览图像的亮度分布信息判断所述预览图像是否为高光比图像。当预览图像为高光比图像时,则进入操作1006,当预览图像不是高光比图像时,则返回操作1002。
操作1006,通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像。可选地,电子设备可以获取预设的至少两个不同的第一曝光参数,通过第一摄像头根据第一曝光参数从低到高的顺序采集第一图像。
可选地,电子设备也可以获取预设的第一曝光参数,控制第一摄像头以第一曝光参数采集一帧第一图像,根据第一曝光参数对应的第一图像对第一曝光参数进行调整,得到第一目标曝光参数,将得到的第一目标曝光参数作为第一曝光参数,并返回执行通过第一 摄像头以第一曝光参数采集一帧第一图像的操作。
操作1008,对采集到的每一帧第一图像包含的图像内容进行分析。
操作1010,检测采集到的第一图像的目标亮度值是否超过预设亮度值。电子设备可以在第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值,当采集到的第一图像的目标亮度值超过预设亮度值时,则结束第一摄像头的图像采集操作,进入操作1012。
操作1012,获取每一帧第一图像的内容分析结果,根据该内容分析结果与至少两个第一曝光参数确定至少两个第二曝光参数。电子设备可以在每采集一帧第一图像时,对第一图像的内容进行分析,在结束第一摄像头的图像采集操作后,电子设备可以获取每一帧第一图像的内容分析结果,根据该内容分析结果与至少两个第一曝光参数确定至少两个第二曝光参数。
可选地,电子设备可以计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量;建立每一帧第一图像包含的图像内容的二维分布图,其中,图像内容包括图像的亮度、色彩、复杂度中的至少一种;基于每一个第一曝光参数对应的图像信息量及二维分布图从至少两个第一曝光参数中确定至少两个第二曝光参数。
可选地,电子设备也可以计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量;建立每一帧第一图像包含的亮度信息对应的一维分布图;基于每一个第一曝光参数对应的图像信息量及一维分布图从至少两个第一曝光参数中确定至少两个第二曝光参数。
可选地,电子设备可以检测预览图像中包含的目标物体,基于每一帧第一图像中目标物体对应的图像信息量,对至少两个第二曝光参数进行调整。
操作1014,通过第一摄像头以至少两个第二曝光参数采集对应的至少两帧第二图像。可选地,电子设备可以在接收到图像采集指令时,以最新的至少两个第二曝光参数采集对应的至少两帧第二图像。
操作1016,将获得的至少两帧第二图像进行融合处理,得到目标图像。
应该理解的是,虽然图2-6、9、10的流程图中的各个操作按照箭头的指示依次显示,但是这些操作并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些操作的执行并没有严格的顺序限制,这些操作可以以其它的顺序执行。而且,图2-6、9、10中的至少一部分操作可以包括多个子操作或者多个阶段,这些子操作或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,这些子操作或者阶段的执行顺序也不必然是依次进行,而是可以与其它操作或者其它操作的子操作或者阶段的至少一部分轮流或者交替地执行。
图11为一个实施例的图像采集装置的结构框图。如图11所示,该图像采集装置包括第一采集模块1102、参数确定模块1104、第二采集模块1106、处理模块1108,其中:
第一采集模块1102,用于通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像;
参数确定模块1104,用于对每一帧第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数;
第二采集模块1106,用于通过第二摄像头以至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像;
处理模块1108,用于将至少两帧第二图像进行融合处理,得到目标图像。
本申请实施例提供的图像采集装置,用于通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像,对每一帧第一图像进行内容分析,根据内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数,通过第二摄像头以至少两个 第二曝光参数进行图像采集,得到对应的至少两帧第二图像,将至少两帧第二图像进行融合处理,得到目标图像。由于可以根据第一摄像头的采集多帧图像分析得到用于融合的图像的曝光参数,由第二摄像头根据该曝光参数采集图像后进行融合,可以提高采集的图像质量。
在一个实施例中,参数确定模块1104还可以用于计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量;建立每一帧第一图像包含的图像内容的二维分布图,其中,图像内容包括图像的亮度、色彩、复杂度中的至少一种;基于每一个第一曝光参数对应的图像信息量及二维分布图从至少两个第一曝光参数中确定至少两个第二曝光参数。
在一个实施例中,参数确定模块1104还可以用于获取第二摄像头采集的预览图像;检测预览图像中包含的目标物体;基于每一帧第一图像中目标物体对应的图像信息量,对至少两个第二曝光参数进行调整。第二采集模块1106还可以用于通过第二摄像头以调整后的至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
在一个实施例中,参数确定模块1104还可以用于计算每一帧第一图像对应的图像信息量,得到每一个第一曝光参数对应的图像信息量;建立每一帧第一图像包含的亮度信息对应的一维分布图;基于每一个第一曝光参数对应的图像信息量及一维分布图从至少两个第一曝光参数中确定至少两个第二曝光参数。
在一个实施例中,第一采集模块1102还可以用于通过第二摄像头采集预览图像;根据预览图像的亮度分布信息判断预览图像是否为高光比图像;当确定预览图像为高光比图像时,则通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像。
在一个实施例中,第一采集模块1102还可以用于获取预设的至少两个不同的第一曝光参数;通过第一摄像头根据第一曝光参数从低到高的顺序采集第一图像;在第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值;当采集到的第一图像的目标亮度值超过预设亮度值时,则结束第一摄像头的图像采集操作。其中,目标亮度值可以根据第一图像对应的平均测光值、中心测光值和点测光值中的至少一种确定。
在一个实施例中,第一采集模块1102还可以用于获取预设的第一曝光参数;控制第一摄像头以第一曝光参数采集一帧第一图像;当第一曝光参数对应的第一图像的目标亮度值低于预设亮度值时,根据第一曝光参数对应的第一图像对第一曝光参数进行调整,得到第一目标曝光参数;将得到的第一目标曝光参数作为第一曝光参数,并返回执行通过第一摄像头以第一曝光参数采集一帧第一图像操作;当第一曝光参数对应的第一图像的目标亮度值超过预设亮度值时,结束第一摄像头的图像采集操作。
上述图像采集装置中各个模块的划分仅用于举例说明,在其他实施例中,可将图像采集装置按照需要划分为不同的模块,以完成上述图像采集装置的全部或部分功能。
图12为一个实施例中电子设备的内部结构示意图。如图12所示,该电子设备包括通过***总线连接的处理器和存储器。其中,该处理器用于提供计算和控制能力,支撑整个电子设备的运行。存储器可包括非易失性存储介质及内存储器。非易失性存储介质存储有操作***和计算机程序。该计算机程序可被处理器所执行,以用于实现以下各个实施例所提供的一种图像采集方法。内存储器为非易失性存储介质中的操作***计算机程序提供高速缓存的运行环境。该电子设备可以是手机、平板电脑或者个人数字助理或穿戴式设备等。
本申请实施例中提供的图像采集装置中的各个模块的实现可为计算机程序的形式。该计算机程序可在终端或服务器上运行。该计算机程序构成的程序模块可存储在终端或服务器的存储器上。该计算机程序被处理器执行时,实现本申请实施例中所描述方法的操作。
本申请实施例还提供一种电子设备。上述电子设备中包括图像处理电路,图像处理电 路可以利用硬件和/或软件组件实现,可包括定义ISP(Image Signal Processing,图像信号处理)管线的各种处理单元。图13为一个实施例中图像处理电路的示意图。如图13所示,为便于说明,仅示出与本申请实施例相关的图像处理技术的各个方面。
如图13所示,图像处理电路包括第一ISP处理器1330、第二ISP处理器1340和控制逻辑器1350。第一摄像头1310包括一个或多个第一透镜1313和第一图像传感器1314。第一图像传感器1314可包括色彩滤镜阵列(如Bayer滤镜),第一图像传感器1314可获取用第一图像传感器1314的每个成像像素捕捉的光强度和波长信息,并提供可由第一ISP处理器1330处理的一组图像数据。第二摄像头1320包括一个或多个第二透镜1322和第二图像传感器1324。第二图像传感器1324可包括色彩滤镜阵列(如Bayer滤镜),第二图像传感器1324可获取用第二图像传感器1324的每个成像像素捕捉的光强度和波长信息,并提供可由第二ISP处理器1340处理的一组图像数据。
第一摄像头1310采集的第一图像传输给第一ISP处理器1330进行处理,第一ISP处理器1330处理第一图像后,可将第一图像的统计数据(如图像的亮度、图像的反差值、图像的颜色等)发送给控制逻辑器1350,控制逻辑器1350可根据统计数据确定第一摄像头1310的控制参数,从而第一摄像头1310可根据控制参数进行自动对焦、自动曝光等操作。第一图像经过第一ISP处理器1330进行处理后可存储至图像存储器1360中,第一ISP处理器1330也可以读取图像存储器1360中存储的图像以对进行处理。另外,第一图像经过ISP处理器1330进行处理后可直接发送至显示器1370进行显示,显示器1370也可以读取图像存储器1360中的图像以进行显示。
其中,第一ISP处理器1330按多种格式逐个像素地处理图像数据。例如,每个图像像素可具有13、10、13或14比特的位深度,第一ISP处理器1330可对图像数据进行一个或多个图像处理操作、收集关于图像数据的统计信息。其中,图像处理操作可按相同或不同的位深度精度进行。
图像存储器1360可为存储器装置的一部分、存储设备、或电子设备内的独立的专用存储器,并可包括DMA(Direct Memory Access,直接直接存储器存取)特征。
当接收到来自第一图像传感器1314接口时,第一ISP处理器1330可进行一个或多个图像处理操作,如时域滤波。处理后的图像数据可发送给图像存储器1360,以便在被显示之前进行另外的处理。第一ISP处理器1330从图像存储器1360接收处理数据,并对所述处理数据进行RGB和YCbCr颜色空间中的图像数据处理。第一ISP处理器1330处理后的图像数据可输出给显示器1370,以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit,图形处理器)进一步处理。此外,第一ISP处理器1330的输出还可发送给图像存储器1360,且显示器1370可从图像存储器1360读取图像数据。在一个实施例中,图像存储器1360可被配置为实现一个或多个帧缓冲器。
第一ISP处理器1330确定的统计数据可发送给控制逻辑器1350。例如,统计数据可包括自动曝光、自动白平衡、自动聚焦、闪烁检测、黑电平补偿、第一透镜1313阴影校正等第一图像传感器1314统计信息。控制逻辑器1350可包括执行一个或多个例程(如固件)的处理器和/或微控制器,一个或多个例程可根据接收的统计数据,确定第一摄像头1310的控制参数及第一ISP处理器1330的控制参数。例如,第一摄像头1310的控制参数可包括增益、曝光控制的积分时间、防抖参数、闪光控制参数、第一透镜1313控制参数(例如聚焦或变焦用焦距)、或这些参数的组合等。ISP控制参数可包括用于自动白平衡和颜色调整(例如,在RGB处理期间)的增益水平和色彩校正矩阵,以及第一透镜1313阴影校正参数。
同样地,第二摄像头1320采集的第二图像传输给第二ISP处理器1340进行处理,第二ISP处理器1340处理第一图像后,可将第二图像的统计数据(如图像的亮度、图像的 反差值、图像的颜色等)发送给控制逻辑器1350,控制逻辑器1350可根据统计数据确定第二摄像头1320的控制参数,从而第二摄像头1320可根据控制参数进行自动对焦、自动曝光等操作。第二图像经过第二ISP处理器1340进行处理后可存储至图像存储器1360中,第二ISP处理器1340也可以读取图像存储器1360中存储的图像以对进行处理。另外,第二图像经过ISP处理器1340进行处理后可直接发送至显示器1370进行显示,显示器1370也可以读取图像存储器1360中的图像以进行显示。第二摄像头1320和第二ISP处理器1340也可以实现如第一摄像头1310和第一ISP处理器1330所描述的处理过程。
根据本申请实施例提供的图像处理电路可以实现上述图像采集方法。
本申请实施例还提供了一种计算机可读存储介质。一个或多个包含计算机可执行指令的非易失性计算机可读存储介质,当所述计算机可执行指令被一个或多个处理器执行时,使得所述处理器执行图像采集方法的操作。
一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行图像采集方法。
本申请实施例所使用的对存储器、存储、数据库或其它介质的任何引用可包括非易失性和/或易失性存储器。合适的非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM),它用作外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDR SDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)。
以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。
Claims (20)
- 一种图像采集方法,包括:通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像;对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的所述第一曝光参数确定至少两个第二曝光参数;通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像;及将所述至少两帧第二图像进行融合处理,得到目标图像。
- 根据权利要求1所述的方法,其特征在于,所述对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数,包括:计算每一帧所述第一图像对应的图像信息量,得到每一个所述第一曝光参数对应的图像信息量;建立每一帧所述第一图像包含的图像内容的二维分布图,其中,所述图像内容包括图像的亮度、色彩、复杂度中的至少一种;及基于每一个所述第一曝光参数对应的图像信息量及二维分布图从至少两个所述第一曝光参数中确定所述至少两个第二曝光参数。
- 根据权利要求2所述的方法,其特征在于,所述基于每一个所述第一曝光参数对应的图像信息量及二维分布图从至少两个所述第一曝光参数中确定所述至少两个第二曝光参数之后,还包括:获取所述第二摄像头采集的预览图像,检测所述预览图像中包含的目标物体;及基于每一帧所述第一图像中所述目标物体对应的图像信息量,对所述至少两个第二曝光参数进行调整;所述通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像,包括:通过第二摄像头以调整后的所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
- 根据权利要求3所述的方法,其特征在于,所述基于每一帧所述第一图像中所述目标物体对应的图像信息量,对所述至少两个第二曝光参数进行调整,包括:基于每一帧所述第一图像中所述目标物体对应的图像信息量,获取所述目标物体对应的图像信息量最多的第一图像;根据获取的第一图像对应的第一曝光参数,对所述至少两个第二曝光参数进行调整。
- 根据权利要求1所述的方法,其特征在于,所述对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的所述第一曝光参数确定至少两个第二曝光参数,包括:计算每一帧所述第一图像对应的图像信息量,得到每一个所述第一曝光参数对应的图像信息量;建立每一帧所述第一图像包含的亮度信息对应的一维分布图;及基于每一个所述第一曝光参数对应的图像信息量及一维分布图从至少两个所述第一曝光参数中确定所述至少两个第二曝光参数。
- 根据权利要求1所述的方法,其特征在于,所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像之前,还包括:通过所述第二摄像头采集预览图像;根据所述预览图像的亮度分布信息判断所述预览图像是否为高光比图像;及当确定所述预览图像为高光比图像时,则执行所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像的操作。
- 根据权利要求1所述的方法,其特征在于,所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像,包括:获取预设的至少两个不同的第一曝光参数;通过所述第一摄像头根据所述第一曝光参数从低到高的顺序采集第一图像;在所述第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值;及当采集到的第一图像的目标亮度值超过所述预设亮度值时,则结束所述第一摄像头的图像采集操作。
- 根据权利要求7所述的方法,其特征在于,所述检测采集到的第一图像对应的目标亮度值是否超过预设亮度值之前,包括:根据所述第一图像对应的平均测光值、中心测光值和点测光值中的至少一种确定所述目标亮度值。
- 根据权利要求1所述的方法,其特征在于,所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像,包括:获取预设的第一曝光参数;控制所述第一摄像头以第一曝光参数采集一帧第一图像;当所述第一曝光参数对应的第一图像的目标亮度值低于预设亮度值时,根据所述第一曝光参数对应的第一图像对所述第一曝光参数进行调整,得到第一目标曝光参数;将得到的第一目标曝光参数作为第一曝光参数,并返回执行所述通过所述第一摄像头以第一曝光参数采集一帧第一图像操作;及当所述第一曝光参数对应的第一图像的目标亮度值超过所述预设亮度值时,结束所述第一摄像头的图像采集操作。
- 根据权利要求1所述的方法,其特征在于,还包括:当接收到摄像头启动指令时,启动第二摄像头采集图像并展示于显示屏,同时执行所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像的操作。
- 一种电子设备,包括存储器及处理器,所述存储器中储存有计算机程序,所述计算机程序被所述处理器执行时,使得所述处理器执行如下操作:通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像;对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的所述第一曝光参数确定至少两个第二曝光参数;通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像;及将所述至少两帧第二图像进行融合处理,得到目标图像。
- 根据权利要求11所述的电子设备,其特征在于,所述处理器执行所述对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的第一曝光参数确定至少两个第二曝光参数时,还执行如下操作:计算每一帧所述第一图像对应的图像信息量,得到每一个所述第一曝光参数对应的图像信息量;建立每一帧所述第一图像包含的图像内容的二维分布图,其中,所述图像内容包括图像的亮度、色彩、复杂度中的至少一种;及基于每一个所述第一曝光参数对应的图像信息量及二维分布图从至少两个所述第一曝光参数中确定所述至少两个第二曝光参数。
- 根据权利要求12所述的电子设备,其特征在于,所述处理器执行所述基于每一 个所述第一曝光参数对应的图像信息量及二维分布图从至少两个所述第一曝光参数中确定所述至少两个第二曝光参数之后,还执行如下操作:获取所述第二摄像头采集的预览图像,检测所述预览图像中包含的目标物体;及基于每一帧所述第一图像中所述目标物体对应的图像信息量,对所述至少两个第二曝光参数进行调整;所述处理器执行所述通过第二摄像头以所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像时,还执行如下操作:通过第二摄像头以调整后的所述至少两个第二曝光参数进行图像采集,得到对应的至少两帧第二图像。
- 根据权利要求13所述的电子设备,其特征在于,所述处理器执行所述基于每一帧所述第一图像中所述目标物体对应的图像信息量,对所述至少两个第二曝光参数进行调整时,还执行如下操作:基于每一帧所述第一图像中所述目标物体对应的图像信息量,获取所述目标物体对应的图像信息量最多的第一图像;根据获取的第一图像对应的第一曝光参数,对所述至少两个第二曝光参数进行调整。
- 根据权利要求11所述的电子设备,其特征在于,所述处理器执行所述对每一帧所述第一图像进行内容分析,根据得到的内容分析结果和至少两个不同的所述第一曝光参数确定至少两个第二曝光参数时,还执行如下操作:计算每一帧所述第一图像对应的图像信息量,得到每一个所述第一曝光参数对应的图像信息量;建立每一帧所述第一图像包含的亮度信息对应的一维分布图;及基于每一个所述第一曝光参数对应的图像信息量及一维分布图从至少两个所述第一曝光参数中确定所述至少两个第二曝光参数。
- 根据权利要求11所述的电子设备,其特征在于,所述处理器执行所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像之前,还执行如下操作:通过所述第二摄像头采集预览图像;根据所述预览图像的亮度分布信息判断所述预览图像是否为高光比图像;及当确定所述预览图像为高光比图像时,则执行所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像的操作。
- 根据权利要求11所述的电子设备,其特征在于,所述处理器执行所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像时,还执行如下操作:获取预设的至少两个不同的第一曝光参数;通过所述第一摄像头根据所述第一曝光参数从低到高的顺序采集第一图像;在所述第一摄像头每采集到一帧第一图像时,检测采集到的第一图像对应的目标亮度值是否超过预设亮度值;及当采集到的第一图像的目标亮度值超过所述预设亮度值时,则结束所述第一摄像头的图像采集操作。
- 根据权利要求17所述的电子设备,其特征在于,所述处理器执行所述检测采集到的第一图像对应的目标亮度值是否超过预设亮度值之前,还执行如下操作:根据所述第一图像对应的平均测光值、中心测光值和点测光值中的至少一种确定所述目标亮度值。
- 根据权利要求11所述的电子设备,其特征在于,所述处理器执行所述通过第一摄像头以至少两个不同的第一曝光参数采集对应的至少两帧第一图像时,还执行如下操 作:获取预设的第一曝光参数;控制所述第一摄像头以第一曝光参数采集一帧第一图像;当所述第一曝光参数对应的第一图像的目标亮度值低于预设亮度值时,根据所述第一曝光参数对应的第一图像对所述第一曝光参数进行调整,得到第一目标曝光参数;将得到的第一目标曝光参数作为第一曝光参数,并返回执行所述通过所述第一摄像头以第一曝光参数采集一帧第一图像操作;及当所述第一曝光参数对应的第一图像的目标亮度值超过所述预设亮度值时,结束所述第一摄像头的图像采集操作。
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至10中任一项所述的方法的操作。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP20758663.7A EP3896955A4 (en) | 2019-02-18 | 2020-02-13 | IMAGE CAPTURE METHOD, ELECTRONIC DEVICE AND COMPUTER READABLE STORAGE MEDIUM |
US17/373,729 US11431915B2 (en) | 2019-02-18 | 2021-07-12 | Image acquisition method, electronic device, and non-transitory computer readable storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910119702.4A CN109862269B (zh) | 2019-02-18 | 2019-02-18 | 图像采集方法、装置、电子设备和计算机可读存储介质 |
CN201910119702.4 | 2019-02-18 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/373,729 Continuation US11431915B2 (en) | 2019-02-18 | 2021-07-12 | Image acquisition method, electronic device, and non-transitory computer readable storage medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020168967A1 true WO2020168967A1 (zh) | 2020-08-27 |
Family
ID=66898084
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/075005 WO2020168967A1 (zh) | 2019-02-18 | 2020-02-13 | 图像采集方法、电子设备和计算机可读存储介质 |
Country Status (4)
Country | Link |
---|---|
US (1) | US11431915B2 (zh) |
EP (1) | EP3896955A4 (zh) |
CN (1) | CN109862269B (zh) |
WO (1) | WO2020168967A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114862735A (zh) * | 2022-05-23 | 2022-08-05 | Oppo广东移动通信有限公司 | 图像处理方法、装置、电子设备和计算机可读存储介质 |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109862269B (zh) | 2019-02-18 | 2020-07-31 | Oppo广东移动通信有限公司 | 图像采集方法、装置、电子设备和计算机可读存储介质 |
CN110290323B (zh) * | 2019-06-28 | 2021-09-07 | Oppo广东移动通信有限公司 | 图像处理方法、装置、电子设备和计算机可读存储介质 |
CN113129241B (zh) * | 2019-12-31 | 2023-02-07 | RealMe重庆移动通信有限公司 | 图像处理方法及装置、计算机可读介质、电子设备 |
CN115314628B (zh) * | 2021-05-08 | 2024-03-01 | 杭州海康威视数字技术股份有限公司 | 一种成像方法、***及摄像机 |
CN113630558B (zh) * | 2021-07-13 | 2022-11-29 | 荣耀终端有限公司 | 一种摄像曝光方法及电子设备 |
CN115334252B (zh) * | 2022-10-14 | 2023-02-03 | 深圳比特微电子科技有限公司 | 一种图像处理方法、装置和可读存储介质 |
CN116033285A (zh) * | 2022-12-27 | 2023-04-28 | 芯原微电子(上海)股份有限公司 | 调试参数确定方法、装置、电子设备及存储介质 |
CN116723419B (zh) * | 2023-07-03 | 2024-03-22 | 北京拙河科技有限公司 | 一种用于十亿级高精度相机的采集速度优化方法及装置 |
CN117640926B (zh) * | 2024-01-26 | 2024-04-26 | 杭州宇泛智能科技有限公司 | 摄像头isp成像质量自动测试***和方法 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107395998A (zh) * | 2017-08-24 | 2017-11-24 | 维沃移动通信有限公司 | 一种图像拍摄方法及移动终端 |
CN108234880A (zh) * | 2018-02-02 | 2018-06-29 | 成都西纬科技有限公司 | 一种图像增强方法和装置 |
CN108337445A (zh) * | 2018-03-26 | 2018-07-27 | 华为技术有限公司 | 拍照方法、相关设备及计算机存储介质 |
CN108337446A (zh) * | 2018-04-12 | 2018-07-27 | Oppo广东移动通信有限公司 | 基于双摄像头的高动态范围图像获取方法、装置及设备 |
CN108769542A (zh) * | 2018-05-30 | 2018-11-06 | 北京图森未来科技有限公司 | 一种曝光参数确定方法、装置和可读介质 |
US20190052802A1 (en) * | 2017-08-11 | 2019-02-14 | Chiun Mai Communication Systems, Inc. | Electronic device and image capture control method |
CN109862269A (zh) * | 2019-02-18 | 2019-06-07 | Oppo广东移动通信有限公司 | 图像采集方法、装置、电子设备和计算机可读存储介质 |
CN110049240A (zh) * | 2019-04-03 | 2019-07-23 | Oppo广东移动通信有限公司 | 摄像头控制方法、装置、电子设备和计算机可读存储介质 |
CN110225248A (zh) * | 2019-05-29 | 2019-09-10 | Oppo广东移动通信有限公司 | 图像采集方法和装置、电子设备、计算机可读存储介质 |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102081275B (zh) * | 2010-12-24 | 2012-07-25 | 中国科学院长春光学精密机械与物理研究所 | 一种基于数字图像的经纬仪全自动实时调光方法 |
US9578224B2 (en) * | 2012-09-10 | 2017-02-21 | Nvidia Corporation | System and method for enhanced monoimaging |
US20150036020A1 (en) * | 2013-08-05 | 2015-02-05 | Nvidia Corporation | Method for sharing original photos along with final processed image |
WO2015081562A1 (zh) * | 2013-12-06 | 2015-06-11 | 华为终端有限公司 | 一种终端及图像处理方法、图像采集方法 |
CN103702015B (zh) * | 2013-12-20 | 2017-04-12 | 华南理工大学 | 一种近红外条件下人脸图像采集***的曝光控制方法 |
US9438868B2 (en) * | 2014-02-13 | 2016-09-06 | Semiconductor Components Industries, Llc | Adaptive image sensor systems and methods |
CN104301622B (zh) * | 2014-09-30 | 2017-07-25 | 上海微小卫星工程中心 | 一种天基空间目标成像曝光时间自适应控制方法及装置 |
US20160227100A1 (en) * | 2015-01-29 | 2016-08-04 | Qualcomm Incorporated | Dual camera systems and methods for rapid 3a convergence and high dynamic range exposure metering |
US9894285B1 (en) * | 2015-10-01 | 2018-02-13 | Hrl Laboratories, Llc | Real-time auto exposure adjustment of camera using contrast entropy |
US9800928B2 (en) * | 2016-02-26 | 2017-10-24 | The Nielsen Company (Us), Llc | Methods and apparatus to utilize minimum cross entropy to calculate granular data of a region based on another region for media audience measurement |
CN108156369B (zh) | 2017-12-06 | 2020-03-13 | Oppo广东移动通信有限公司 | 图像处理方法和装置 |
-
2019
- 2019-02-18 CN CN201910119702.4A patent/CN109862269B/zh active Active
-
2020
- 2020-02-13 EP EP20758663.7A patent/EP3896955A4/en not_active Withdrawn
- 2020-02-13 WO PCT/CN2020/075005 patent/WO2020168967A1/zh unknown
-
2021
- 2021-07-12 US US17/373,729 patent/US11431915B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190052802A1 (en) * | 2017-08-11 | 2019-02-14 | Chiun Mai Communication Systems, Inc. | Electronic device and image capture control method |
CN107395998A (zh) * | 2017-08-24 | 2017-11-24 | 维沃移动通信有限公司 | 一种图像拍摄方法及移动终端 |
CN108234880A (zh) * | 2018-02-02 | 2018-06-29 | 成都西纬科技有限公司 | 一种图像增强方法和装置 |
CN108337445A (zh) * | 2018-03-26 | 2018-07-27 | 华为技术有限公司 | 拍照方法、相关设备及计算机存储介质 |
CN108337446A (zh) * | 2018-04-12 | 2018-07-27 | Oppo广东移动通信有限公司 | 基于双摄像头的高动态范围图像获取方法、装置及设备 |
CN108769542A (zh) * | 2018-05-30 | 2018-11-06 | 北京图森未来科技有限公司 | 一种曝光参数确定方法、装置和可读介质 |
CN109862269A (zh) * | 2019-02-18 | 2019-06-07 | Oppo广东移动通信有限公司 | 图像采集方法、装置、电子设备和计算机可读存储介质 |
CN110049240A (zh) * | 2019-04-03 | 2019-07-23 | Oppo广东移动通信有限公司 | 摄像头控制方法、装置、电子设备和计算机可读存储介质 |
CN110225248A (zh) * | 2019-05-29 | 2019-09-10 | Oppo广东移动通信有限公司 | 图像采集方法和装置、电子设备、计算机可读存储介质 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3896955A4 * |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114862735A (zh) * | 2022-05-23 | 2022-08-05 | Oppo广东移动通信有限公司 | 图像处理方法、装置、电子设备和计算机可读存储介质 |
Also Published As
Publication number | Publication date |
---|---|
US20210344826A1 (en) | 2021-11-04 |
CN109862269B (zh) | 2020-07-31 |
EP3896955A1 (en) | 2021-10-20 |
EP3896955A4 (en) | 2022-03-09 |
CN109862269A (zh) | 2019-06-07 |
US11431915B2 (en) | 2022-08-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020168967A1 (zh) | 图像采集方法、电子设备和计算机可读存储介质 | |
CN110225248B (zh) | 图像采集方法和装置、电子设备、计算机可读存储介质 | |
JP7371081B2 (ja) | 夜景撮影方法、装置、電子機器および記憶媒体 | |
CN107948519B (zh) | 图像处理方法、装置及设备 | |
CN109089047B (zh) | 控制对焦的方法和装置、存储介质、电子设备 | |
CN110072052B (zh) | 基于多帧图像的图像处理方法、装置、电子设备 | |
CN108055452B (zh) | 图像处理方法、装置及设备 | |
US10805508B2 (en) | Image processing method, and device | |
CN112087580B (zh) | 图像采集方法和装置、电子设备、计算机可读存储介质 | |
CN110213494B (zh) | 拍摄方法和装置、电子设备、计算机可读存储介质 | |
CN110290323B (zh) | 图像处理方法、装置、电子设备和计算机可读存储介质 | |
WO2020244374A1 (zh) | 高动态范围hdr图像生成方法和装置、电子设备、计算机可读存储介质 | |
CN110049240B (zh) | 摄像头控制方法、装置、电子设备和计算机可读存储介质 | |
CN110213498B (zh) | 图像生成方法和装置、电子设备、计算机可读存储介质 | |
CN110430370B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
CN112004029B (zh) | 曝光处理方法、装置、电子设备、计算机可读存储介质 | |
CN110636227B (zh) | 高动态范围hdr图像合成方法及集成该方法的高速相机 | |
CN112019734B (zh) | 图像采集方法、装置、电子设备和计算机可读存储介质 | |
CN110290325B (zh) | 图像处理方法、装置、存储介质及电子设备 | |
CN110177212B (zh) | 图像处理方法和装置、电子设备、计算机可读存储介质 | |
CN112087571A (zh) | 图像采集方法和装置、电子设备、计算机可读存储介质 | |
CN110266966A (zh) | 图像生成方法和装置、电子设备、计算机可读存储介质 | |
CN110392211B (zh) | 图像处理方法和装置、电子设备、计算机可读存储介质 | |
CN115278069A (zh) | 图像处理方法及装置、计算机可读存储介质、终端 | |
CN108600631B (zh) | 图像处理方法、装置、计算机可读存储介质和电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20758663 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020758663 Country of ref document: EP Effective date: 20210716 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |