CN109788207A - Image composition method, device, electronic equipment and readable storage medium storing program for executing - Google Patents
Image composition method, device, electronic equipment and readable storage medium storing program for executing Download PDFInfo
- Publication number
- CN109788207A CN109788207A CN201910094208.7A CN201910094208A CN109788207A CN 109788207 A CN109788207 A CN 109788207A CN 201910094208 A CN201910094208 A CN 201910094208A CN 109788207 A CN109788207 A CN 109788207A
- Authority
- CN
- China
- Prior art keywords
- image
- exposure
- original image
- frame
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Studio Devices (AREA)
Abstract
The application proposes a kind of image composition method, device, electronic equipment and readable storage medium storing program for executing, wherein method includes: to acquire multiframe original image frame by frame under light compensating lamp open state by controlling imaging sensor;Wherein, multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down the brightness of target area, short exposed images, middle exposure image and long exposure image adjusted are synthesized, composograph is obtained.This method passes through in the case where photographed scene is very dark, multiframe original image is acquired in the state of opening light compensating lamp, it solves in the related technology in night scene scene capture, the technical issues of acquisition multiple image leads to fuzzy pictures is exposed using long, the shooting details of short distance dark space object is improved simultaneously, and then improves whole image quality.
Description
Technical field
This application involves technical field of imaging more particularly to a kind of image composition method, device, electronic equipment and readable deposit
Storage media.
Background technique
With the continuous development of intelligent terminal technology, the use of mobile terminal device (such as smart phone, tablet computer)
It is more more and more universal.Most mobile terminal devices are all built-in with camera, and with the enhancing of mobile terminal processing capacity
And the development of camera technology, the performance of built-in camera is stronger and stronger, and the quality for shooting image is also higher and higher.It is mobile
Terminal device to people it is daily take pictures bring convenient while, requirement of the people to the picture quality of shooting is also increasingly
It is high.
Especially under night scene photographed scene, in order to enable prospect can blur-free imaging, often using longer duration carry out
Exposure, still, the image collected when the time for exposure is too long, it is possible that making shooting picture due to shake etc.
Fuzzy situation.
Summary of the invention
The application proposes a kind of image composition method, device, electronic equipment and readable storage medium storing program for executing, by environment bright
Spend under very dark photographed scene, open light compensating lamp and light filling is carried out to prospect, to shorten exposure time, solve in the related technology,
When night scene scene capture, exposed the technical issues of acquisition multiple image leads to fuzzy pictures using long, meanwhile, it improves closely
The shooting details of dark space object, and then improve whole image quality.
The application one side embodiment proposes a kind of image composition method, comprising:
Control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, the multiframe is former
Beginning image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;
To the long exposure image in the multiframe original image, identify that brightness is greater than the target area of setting luminance threshold;
Turn down the brightness of the target area;
The short exposed images, the middle exposure image and long exposure image adjusted are synthesized, synthesized
Image.
The image composition method of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor
Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases
Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down
Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area
Picture.This method is solved by acquiring multiframe original image in the state of opening light compensating lamp in the case where photographed scene is very dark
In the related technology in night scene scene capture, exposed the technical issues of acquisition multiple image leads to fuzzy pictures using long, meanwhile,
The shooting details of short distance dark space object is improved, and then improves whole image quality.
The application another aspect embodiment proposes a kind of image synthesizer, comprising:
Control module acquires multiframe original image for controlling imaging sensor frame by frame under light compensating lamp open state;Its
In, the multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;
Identification module, for identifying that brightness is greater than setting luminance threshold to the long exposure image in the multiframe original image
The target area of value;
Module is adjusted, for turning down the brightness of the target area;
Synthesis module, for carrying out the short exposed images, the middle exposure image and long exposure image adjusted
Synthesis, obtains composograph.
The image synthesizer of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor
Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases
Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down
Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area
Picture.This method is solved by acquiring multiframe original image in the state of opening light compensating lamp in the case where photographed scene is very dark
In the related technology in night scene scene capture, exposed the technical issues of acquisition multiple image leads to fuzzy pictures using long, meanwhile,
The shooting details of short distance dark space object is improved, and then improves whole image quality.
The another aspect embodiment of the application proposes a kind of electronic equipment, comprising: memory, processor and is stored in storage
On device and the computer program that can run on a processor, when the processor executes described program, such as above-described embodiment is realized
The image composition method.
The another aspect embodiment of the application proposes a kind of computer readable storage medium, is stored thereon with computer journey
Sequence, which is characterized in that the image composition method as described in above-described embodiment is realized when the program is executed by processor.
The additional aspect of the application and advantage will be set forth in part in the description, and will partially become from the following description
It obtains obviously, or recognized by the practice of the application.
Detailed description of the invention
The application is above-mentioned and/or additional aspect and advantage will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, in which:
Fig. 1 is a kind of flow diagram of image composition method provided by the embodiment of the present application;
Fig. 2 is a kind of imaging example figure of photographed scene provided by the embodiment of the present application;
Fig. 3 is the flow diagram of another image composition method provided by the embodiments of the present application.
Fig. 4 is a kind of method flow schematic diagram of determining original image target light exposure amount provided by the embodiments of the present application;
Fig. 5 is a kind of structural schematic diagram of image synthesizer provided by the embodiment of the present application;
Fig. 6 is the structural schematic diagram of a kind of electronic equipment provided by the embodiment of the present application.
Fig. 7 is the module diagram of the image processing circuit of the application certain embodiments.
Specific embodiment
Embodiments herein is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the application, and should not be understood as the limitation to the application.
Below with reference to the accompanying drawings the image composition method and device of the embodiment of the present application are described.
Fig. 1 is a kind of flow diagram of image composition method provided by the embodiment of the present application.
The embodiment of the present application is configured in image synthesizer for example, image synthesis dress with the image composition method
Setting can be applied in any electronic equipment with shooting function, wherein electronic equipment, can be smart phone, plate electricity
Brain, personal digital assistant, wearable device etc. have the hardware device of various operating systems, imaging device.
As shown in Figure 1, the image composition method the following steps are included:
Step 101, control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, more
Frame original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases.
Wherein, original image refers to the almost untreated mistake directly obtained from CCD image sensor or CMOS
Image, for example, original image of RAW format contained more image detail in original image, by original image
Acquisition and processing obtain image, the details of brightness and dark portion in image can be made apparent, imaging can be improved
Quality.
In the embodiment of the present application, due to the environmental factors such as light intensity in photographed scene and testee Facing material,
Structure, degree of roughness are distributed different influences, so that the picture quality that shooting obtains is bad, therefore, the electricity with shooting function
Sub- equipment needs to acquire multiframe original image when shooting image, compound imaging is used for, to improve image quality.Wherein, multiframe
Original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases.
It should be noted that exposure, refers to the degree that the sensor devices of imaging device are irradiated by light.Sensor devices connect
The light received is more, and exposure is higher, and the image of shooting is brighter;The light that sensor devices receive is fewer, and exposure is smaller, claps
The image taken the photograph is darker.
In the embodiment of the present application, the electronic equipment with shooting function is when acquiring multiframe original image, electronic equipment meeting
Notify whether user is same to be intended to acquire image in the state of unlatching light compensating lamp.In the very dark night scene scene of light, for example, environment
When brightness is less than 5lux, after electronic equipment detects the operation of unlatching light compensating lamp of user's triggering, and then image sensing is controlled
Device acquires multiframe original image in the state that light compensating lamp is opened, using different exposures.
As alternatively possible scene, in certain occasions for not allowing to open light compensating lamp shooting, electronic equipment will not be visited
The operation for measuring the unlatching light compensating lamp of user's triggering, is adopted in the state that light compensating lamp is closed at this time, it may be necessary to control imaging sensor
Collect multiframe original image.
In the embodiment of the present application, electronic equipment may include visible light image sensor, can be based in electronic equipment
Visible light image sensor acquires multiframe original image.Specifically, it is seen that optical image sensor may include visible image capturing head,
Visible image capturing head can be captured to be imaged by the visible light of imaging object reflection.
As alternatively possible situation, in the embodiment of the present application, electronic equipment can also include that structure light image senses
Device can acquire multiframe original image based on the structure light image sensor in electronic equipment.Optionally, structure light image senses
Device may include color-changing lamp and Laser video camera head.Pulse width modulates (Pulse Width Modulation, abbreviation PWM) can
Structure light is issued to modulate color-changing lamp, structure light exposes to imaging object, and Laser video camera head can capture anti-by imaging object
The structure light penetrated is imaged, and the corresponding structure light image of imaging object is obtained.
Step 102, to the long exposure image in multiframe original image, identify that brightness is greater than the target area of setting luminance threshold
Domain.
Wherein, luminance threshold is to preset brightness value.
In the embodiment of the present application, since the multiframe original image of acquisition is electronic equipment control imaging sensor in light compensating lamp
Acquired frame by frame under open state, thus occur in the image collected the brightness of far and near scape by light compensating lamp light filling effect not
Together, the case where partial region will appear overexposure, so that there is unnatural phenomenon in the image of synthesis.
Step 103, the brightness of target area is turned down.
Therefore, in the embodiment of the present application, to the long exposure image in the multiframe original image of acquisition, pass through identification image
Brightness value, and then identify highlight regions of the brightness greater than preset luminance threshold, i.e., the aforementioned target area referred to, with
Reduce the brightness of target area.Wherein, the brightness of image is substantially the brightness of each pixel in image, the brightness value of pixel
Between 0 to 255, the pixel intensity close to 255 is higher, and the brightness close to 0 is lower.When the brightness value of pixel is 0, the picture of image
Vegetarian refreshments is black, and when the brightness value of pixel is 255, pixel is most bright, for white.
As an example, if preset luminance threshold is 180, by carrying out brightness knowledge to long exposure image
Not, it is all larger than 180 region or when average brightness value is greater than 180 region, and then turns down and identify when recognizing brightness value
Target area brightness.
Step 104, short exposed images, middle exposure image and long exposure image adjusted are synthesized, is synthesized
Image.
In the embodiment of the present application, electronic equipment is controlled into the short exposure that imaging sensor collects under light filling open state
Light image, middle exposure image and long exposure image adjusted, subregion is weighted synthesis and obtains composograph.
It should be noted that in order to compare the overall brightness of composograph naturally, length exposes during image synthesis
The weight of target area in light image, less than the weight of corresponding region in short exposed images and middle exposure image.
Further, when in the very dark brightness degree of ambient brightness, each frame original image of shooting there may be noise,
At this time, it may be necessary to which the multiframe original image obtained to shooting carries out synthesis noise reduction process, and then obtain the figure after synthesis noise reduction process
Picture.
As an example, referring to fig. 2, Far Left picture is the quilt under the very dark photographed scene of environmental light brightness in Fig. 2
Shooting picture;Intermediate image is the image that is shot by imaging device in the state of not opening light compensating lamp;Right image is
In the state of opening light compensating lamp, the image that is shot by imaging device.It can be observed by Fig. 2, opening light compensating lamp
The image shot under state improves the shooting details of short distance dark space object, and then improves whole image quality.
The image composition method of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor
Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases
Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down
Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area
Picture.This method is solved by acquiring multiframe original image in the state of opening light compensating lamp in the case where photographed scene is very dark
In the related technology in night scene scene capture, the technical issues of acquisition multiple image leads to fuzzy pictures is exposed using long, thus
The shooting details of short distance dark space object is improved, and then improves whole image quality.
As a kind of possible implementation, referring to Fig. 3, the method for obtaining multiframe original image in a step 101, specifically
The following steps are included:
Step 201, preview image is obtained.
Specifically, after imaging device detects the operation for opening camera that user triggers, imaging device can passed through
Obtain the preview screen of present filming scene.
Step 202, the brightness for judging preview image and/or picture light are corresponded to than whether being less than corresponding threshold value if being less than
Threshold value, then execute open light compensating lamp the step of, if be not less than corresponding threshold value, be not turned on light compensating lamp.
Wherein, threshold value, the brightness for referring to preset preview image and/or picture light are than the maximum value that should meet.It draws
Face light ratio, refers to the light ratio of the dark face of object and bright face in preview image.
In the embodiment of the present application, the brightness of the image of the display interface preview by determining imaging device and/or picture light
Than whether being less than corresponding threshold value, and then determine whether to open light compensating lamp.
As a kind of possible scene, the brightness of the image of the display interface preview of determining imaging device is less than corresponding
When threshold value, and then determines and open light compensating lamp.
As alternatively possible scene, the picture light ratio of the image of the display interface preview of determining imaging device is less than
When corresponding threshold value, and then determines and open light compensating lamp.
As alternatively possible scene, the brightness of the image of the display interface preview of determining imaging device and picture light
When than being respectively less than corresponding threshold value, and then determines and open light compensating lamp.
Step 203, under light compensating lamp open state, light is surveyed with the target light exposure amount of each frame original image of determination.
Wherein, light exposure refers to that the sensor devices in imaging device receive the number of light, light exposure in exposure time
It is related with aperture, exposure time and sensitivity.Wherein, aperture i.e. clear aperture, light passes through in the decision unit time
Quantity;Exposure time refers to time of the light by camera lens;Sensitivity, also known as ISO value are the spirits for measuring egative film for light
The index of quick degree, for indicating the film speed of photosensitive element, the more high photosensitive energy for just illustrating the sensitive component of ISO numerical value
Power is stronger.
It should be noted that when the sensitivity of imaging device is lower, need to expose the longer time with reach with it is photosensitive
Identical imaging effect when spending higher.Certainly, in order to reduce the time for exposure, using relatively high sensitivity would generally introduce compared with
More noise, to will lead to picture quality reduction.Therefore, under night scene scene, preferable noise suppression effect in order to obtain,
Wish that lower sensitivity, such as 100ISO or 200ISO etc. is arranged, simultaneously as the aperture of the electronic equipments such as mobile phone is usually adopted
With fixed value, to need to correspondingly increase exposure time, i.e. shutter duration.
Specifically, the preview image of present filming scene is obtained by imaging device, it is further to be surveyed by sensor devices
The environmental light brightness in each region of preview image is measured, and then in the brightness of preview image and/or picture light ratio less than corresponding
When threshold value, in the state of opening light compensating lamp, the target light exposure amount of each frame original image is determined by measuring environmental light brightness.
Step 204, it according to the target light exposure amount of each frame original image and each preset sensitivity of frame original image, determines each
The exposure time of frame original image.
In the embodiment of the present application, as a kind of possible implementation, when each preset sensitivity of frame original image is identical
When, each preset sensitivity of frame original image can be determined according to the environmental light brightness of photographed scene.In photographed scene light ratio
In the case where darker, sensitivity is improved, the speed of shutter can be made to accelerate, to reduce float.
As alternatively possible implementation, when each preset sensitivity of frame original image is identical, can according at
As the degree of jitter of equipment, each preset sensitivity of frame original image is determined.
Specifically, in order to determine degree of jitter, displacement letter can be acquired according to the displacement sensor being arranged in imaging device
Breath, in turn, according to the displacement information of collected imaging device, determines the degree of jitter of imaging device.When trembling for imaging device
When traverse degree is greater than or equal to dithering threshold, determine that each preset sensitivity value of frame image to be collected is in present filming scene
First photosensitive value;When the degree of jitter of imaging device is less than dithering threshold, each frame original image in present filming scene is determined
Preset sensitivity value is the second photosensitive value.Wherein, dithering threshold is preset default for determining in imaging device
The jitter value of sensitivity value.
Wherein, the first photosensitive value is greater than the second photosensitive value, and the first photosensitive value is the presupposition multiple of the second photosensitive value, presets again
Several values is more than or equal to 2.As a kind of possible implementation, in order to obtain lower noise, the second photosensitive value can be
The minimum sensitivity of imaging device, the i.e. value of the second photosensitive value are 100ISO, and correspondingly, the value range of the first photosensitive value can
Think 200,400,800 or higher.
Since light exposure is equal to sensitivity multiplied by exposure time, in the embodiment of the present application, according to each frame original image
Target light exposure amount and each preset sensitivity of frame original image, can determine the exposure time of each frame original image.
As an example, if the target light exposure amount for surveying the frame image to be collected that light determines is 800, the frame determined
The preset sensitivity of original image is 400ISO, and the exposure time for acquiring the frame original image at this time is then 2s.By the method,
It can determine the exposure time of each frame original image.
Step 205, if the exposure time of an at least frame original image is greater than setting maximum time limit, according to maximum time limit, more
The exposure time of a new at least frame original image.
As a kind of possible implementation, in the embodiment of the present application, the exposure time upper limit of each frame original image can be with
It is determined according to the degree of jitter of imaging device.
Specifically, in order to determine degree of jitter, displacement letter can be acquired according to the displacement sensor being arranged in imaging device
Breath, in turn, according to the displacement information of collected imaging device, determines the degree of jitter of imaging device.When trembling for imaging device
When traverse degree is greater than or equal to dithering threshold, determine that the exposure time upper limit of each frame original image in present filming scene is first
Exposure time;When the degree of jitter of imaging device is less than dithering threshold, determine that each frame original image exposes in present filming scene
Light maximum time limit is the second exposure time.Wherein, dithering threshold, in imaging device it is preset for determine preset it is photosensitive
Spend the jitter value of value.
Wherein, the value range of maximum time limit is 4.5s to 5.5s.
In the embodiment of the present application, when the exposure time of at least frame image to be collected is greater than the exposure time upper limit, at this point, will
The exposure time of at least frame image to be collected is set as maximum time limit.In turn, according to the mesh of at least frame image to be collected
The relationship between light exposure and maximum time limit and light exposure and sensitivity and exposure time is marked, updating this, at least a frame waits adopting
Collect the sensitivity of image.And then according to the exposure time upper limit, the exposure time of at least frame image to be collected is updated.
It is understood that if the corresponding exposure time of at least frame image to be collected is greater than preset maximum time limit,
It may cause whole shooting duration of video to extend, aggravate the degree of jitter of imaging device, so that in the image finally taken
It is likely to occur since ghost caused by shaking and image obviously obscure;If the corresponding exposure time of image to be collected is less than preset
Duration lower limit, then may cause that the noise in image is excessive to be difficult to eliminate.
Therefore, after determining the corresponding exposure time of each frame original image, can by each exposure time with it is preset
Whether duration range compares, to judge the corresponding exposure time of each frame original image within the scope of preset duration.Wherein, it exposes
The value range of maximum time limit is 4.5s to 5.5s, and duration lower limit is greater than or equal to 10ms.When a certain frame image to be collected is corresponding
Exposure time be less than setting exposure time lower limit when, which is set as duration lower limit
Minimum value, i.e. 10ms;It is when the corresponding exposure time of a certain frame image to be collected is greater than the exposure time upper limit, the frame is original
The corresponding exposure time of image is set as the maximum value of maximum time limit, i.e. 5.5s.
The frame is waited adopting if the exposure time of certain frame original image is greater than maximum time limit as a kind of possible situation
Collection image exposure time be updated to maximum time limit, further, determine updated exposure time and update before exposure when
Ratio between length, remaining each frame original image for being greater than or equal to duration lower limit to exposure time update remaining according to ratio
The sensitivity or exposure time of each frame original image.
As alternatively possible scene, when the exposure time of original image is less than duration lower limit, by the exposure time
It is set as the minimum value of exposure time lower limit, due to the product that light exposure is sensitivity and exposure time, and then according to corresponding
Target light exposure amount and exposure time lower limit, update the sensitivity or exposure time of remaining each frame original image.
In the embodiment of the present application, if the exposure time of an at least frame original image is less than setting duration lower limit, by the exposure
Duration is set as the minimum value of exposure time lower limit, the ratio between exposure time before determining updated exposure time and updating
Value, the sensitivity product before ratio and remaining each frame original image are updated, as remaining each updated sense of frame original image
Luminosity.Exposure time product before ratio and remaining each frame original image can also being updated, as remaining each frame original image
Updated exposure time.
As an example it is assumed that the exposure time for setting a certain frame original image is less than duration lower limit, by exposure time value
The ratio between exposure time for the minimum value of duration lower limit, i.e. 10ms, and then before determining updated exposure time and updating
Value, and accordingly update the sensitivity value or exposure time of remaining each frame original image.Such as: according to the brightness of present filming scene
Information determines that current exposure value is EV0.When the exposure value of image to be collected is EV+2, then exposure time and sensitivity are divided
Not Wei 8ms and 100ISO, due to exposure time be 8ms when be less than duration lower limit 10ms, then be by the exposure time value of EV+2
10ms, ISO value are determined as 8/10*100ISO, as 80ISO.It is carried out as a result, by the exposure time to frame image to be collected
It updates, while guaranteeing light exposure, improves brightness of image, avoiding time for exposure too long caused overexposure causes image to lose
Very.
Step 206, according to the exposure time and sensitivity of each frame original image, control is exposed to imaging sensor,
To collect multiframe original image frame by frame.
In the embodiment of the present application, imaging device can according to the exposure time and sensitivity of determining each frame original image,
Control is exposed to imaging sensor and obtains each frame original image.
As a kind of possible implementation, referring to fig. 4, step 203 can with the following steps are included:
Step 301, according to the image content of preview screen, determination belongs to night scene scene.
In the embodiment of the present application, the preview screen of present filming scene can be obtained by imaging device, is worked as determination
Whether preceding photographed scene belongs to night scene scene.
Specifically, due to ambient brightness value difference under different scenes, preview screen content is not also identical, according to current shooting
The ambient brightness value in the image content of scene preview picture and each region, judges whether present filming scene belongs to night scene field
Scape.
For example, the image content of preview screen includes each area of night sky perhaps night scene lamp source etc. or preview screen
Ambient brightness value meets the Luminance Distribution characteristic of image under night scene environment in domain, that is, can determine that present filming scene belongs to night scene field
Scape.
Step 302, whether include face according to the degree of jitter of imaging device and/or preview screen, identify applicable night
Scape mode.
In the embodiment of the present application, the displacement sensor that can be arranged by imaging device, collects imaging device and exists
Displacement information in shooting process, and then the current degree of jitter of imaging device is determined according to the displacement information of acquisition.As a result, may be used
Judge that user is that imaging device is fixed on foot prop to shoot or by hand-held by the degree of jitter of imaging device
Mode shooting.In turn, the degree of jitter current according to imaging device, the applicable night scene mode of identification present filming scene.Wherein,
Night scene mode uses foot prop mode or hand-held mode.
As an example, can by obtaining current gyroscope (Gyro-sensor) information of electronic equipment, determine at
As the current degree of jitter of equipment.
Wherein, gyroscope is called angular-rate sensor, can measure rotational angular velocity when physical quantity deflection, inclination.?
In imaging device, gyroscope can be very good the movement of measurement rotation, deflection, judge user's so as to Accurate Analysis
Actual act.The gyroscope information (gyro information) of electronic equipment may include imaging device three dimension sides in three dimensions
Upward motion information, three dimensions of three-dimensional space can be expressed as three X-axis, Y-axis, Z axis directions, wherein X-axis, Y
Axis, Z axis are vertical relation two-by-two.
As a result, in the embodiment of the present application, gyro information that can be current according to electronic equipment determines that imaging device is current
Degree of jitter.The absolute value of the gyro movement of electronic equipment in three directions is bigger, then the degree of jitter of imaging device is bigger.
Specifically, the absolute value threshold value of gyro movement in three directions can be preset, and current in three directions according to what is got
On gyro movement the sum of absolute value, the relationship with preset threshold value determines the current degree of jitter of imaging device.
As an example it is assumed that preset threshold value is first threshold A, second threshold B, third threshold value C, and A < B < C is currently obtained
The sum of absolute value for the movement of gyro in three directions got is S.If S < A, it is determined that the current degree of jitter of imaging device
For " non-jitter ";If A < S < B, it can determine that the current degree of jitter of imaging device is " slight jitter ";If B < S < C, can
To determine the current degree of jitter of imaging device for " small shake ";If S > C, the current degree of jitter of imaging device can be determined
For " big shake ".
It should be noted that the example above is exemplary only, the limitation to the application cannot be considered as.In actual use,
Can the quantity of preset threshold and each threshold value according to actual needs specific value, and the pass according to gyro information and each threshold value
System presets the mapping relations of gyro information and imaging device degree of jitter.
It whether can include face by determining the preview screen of imaging device as alternatively possible implementation, into
And identify the applicable night scene mode of present filming scene.
In the embodiment of the present application, whether preview screen includes that face can be determined by face recognition technology.Face is known
Other technology is to compare face visual signature information by analysis to carry out identity identification, it belongs to biometrics identification technology, is pair
The biological characteristic of organism (generally refering in particular to people) itself is individual to distinguish organism.Currently, face recognition technology has been supplied in crowd
In multi-field, for example, digital camera face auto-focusing and the fast gate technique of smiling face;Enterprise, house safety and management;Gate inhibition system
System;Shooting and monitoring system etc..
It should be noted that the survey optical module of imaging device can be automatically with people when detecting that preview screen includes face
Survey light is carried out based on face region, and benchmark light exposure is determined according to the photometry result of human face region.However, in night scene scene,
The illuminance of human face region is usually lower, so as to cause determining benchmark light exposure, exposes with the benchmark determined when not including face
Light quantity if still acquiring excessive overexposure frame when comprising face, is easy to cause human face region overexposure, to lead compared to higher
Cause the imaging effect of acquisition image poor.Therefore, for identical degree of jitter, in preview screen comprising face with do not include people
It is compared when face, the night scene mode of use is not identical.
Step 303, according to night scene mode, the exposure bias value of each frame original image setting is determined.
Wherein, preset exposure bias value refers to the preset exposure of environmental light brightness according to present filming scene
It is worth (Exposure Value, EV).In the initial definition of exposure value, exposure value does not imply that an accurate numerical value, but
Refer to " all camera apertures and the combination of exposure time that unified light exposure can be provided ".Sensitivity, aperture and exposure time
It has been determined that the light exposure of camera, different parameter combinations can produce equal light exposure, i.e. the EV value of these various combinations is
It is the same, for example, combine in the identical situation of sensitivity using the aperture of 1/125 second exposure time and f11, and use 1/
The combination of 250 second time for exposure and f8 shutter, the light exposure of acquisition be it is identical, i.e., EV value is identical.
As a kind of possible implementation, the degree of jitter of imaging device is different, is applicable in the night scene of present filming scene
Mode is not also identical, accordingly, it is determined that each preset exposure bias value of frame original image gone out is not also identical.In the embodiment of the present application
In, the mapping relations between the degree of jitter of imaging device and exposure bias value can be preset, according to the shake of imaging device
Degree determines current each preset exposure bias value of frame original image.
For example, when can be " non-jitter " by the degree of jitter of imaging device, the corresponding exposure compensating of each frame original image
The EV value range of value is preset as -6~2, and the difference between adjacent EV value is 0.5;It is " light by the degree of jitter of imaging device
The EV value range of micro- shake ", the corresponding exposure bias value of each frame original image is preset as -5~1, and between adjacent EV value
Difference is 1, etc..
As alternatively possible way of realization, whether the preview screen for detecting imaging device includes face, preview screen
In comprising face with do not include face when, the night scene mode for being applicable in present filming scene is not identical, and each frame thereby determined that is original
The preset exposure bias value of image is not also identical.
Whether identical degree of jitter can be wrapped according in preview screen as alternatively possible implementation
Containing face, determine each frame original image using different exposure bias values.Therefore, it for identical degree of jitter, can correspond to
In multiple exposure bias values.For example, the degree of jitter of imaging device is " slight jitter ", each preset exposure of frame original image is mended
Repaying value has comprising face and without two kinds of situations of face.
In night scene mode, when in original image including face, the intensity of illumination of human face region is usually lower, to lead
Determining benchmark light exposure is caused, it is higher compared with the benchmark light exposure determined when not including face, if when comprising face still
Excessive overexposure frame is acquired, then is easy to cause human face region overexposure, the imaging effect so as to cause acquisition image is poor, corresponds to
Exposure compensation mode need that there is lower exposure compensating range.Therefore, it for identical degree of jitter, is wrapped in preview screen
Containing face compared with when not including face, determined the current degree of jitter of imaging device and preview screen whether include
After face, that is, it can determine that the preset exposure bias value being consistent with current actual conditions.
Step 304, according to the luminance information of preview image, benchmark light exposure is determined.
Specifically, the preview image of present filming scene is obtained by imaging device, it is further to be surveyed by sensor devices
The environmental light brightness in each region of preview image is measured, and then according to the luminance information of preview image, determines benchmark light exposure.Its
In, in the case where aperture is fixed, benchmark light exposure can specifically include benchmark exposure time and benchmark sensitivity.
In the embodiment of the present application, benchmark light exposure refers to the current shooting field by survey to preview image light acquisition
The luminance information of scape, the light exposure adaptable with present filming scene luminance information that be determining.The value of benchmark light exposure can
To be the product between benchmark sensitivity and benchmark exposure time.
Wherein, benchmark sensitivity, can be the degree of jitter current according to imaging device, determining with current shake journey
The adaptable sensitivity of degree can also be the sensitivity obtained by surveying light, be not construed as limiting in the present embodiment to this.It is understood that
, since light exposure and sensitivity influence whether whole shooting duration of video, when shooting duration of video is too long, may result in hand-held racket
The degree of jitter aggravation of imaging device when taking the photograph, to influence picture quality.Therefore, in the shake journey current according to imaging device
Degree when determining benchmark sensitivity, should make shooting duration of video control in suitable range.
Step 305, the exposure bias value set according to benchmark light exposure and each frame original image, determines each frame original image
Target light exposure amount.
It specifically,, can when the size of aperture is fixed since light exposure is related with aperture, exposure time and sensitivity
According to benchmark light exposure and benchmark sensitivity, benchmark exposure time is determined.It is EV0 by benchmark exposure time, according to each frame
The preset exposure bias value of original image, it may be determined that the target light exposure amount of each frame original image.
As an example, if the luminance information for the preview image that imaging device is obtained according to measurement, determines that each frame is former
The benchmark light exposure of beginning image is 400, and benchmark sensitivity ISO value is 100 at this time, then benchmark exposure time is 4s.If each frame
The preset exposure bias value of original image is EV+1, it may be determined that target light exposure amount at this time is 800.Wherein, the exposure of EV+1
Light compensation, which refers to, increases by one grade of exposure relative to the corresponding light exposure of imaging device photometric data, i.e. actual exposure amount is to survey light number
According to twice of corresponding light exposure.
It in the embodiment of the present application, can be pre- by the determining corresponding EV value of benchmark light exposure when presetting exposure bias value
It is set as 0, EV+1 and refers to one grade of exposure of increase, is i.e. light exposure is 2 times of benchmark light exposure, and EV+2 refers to two grades of exposures of increase, i.e.,
Light exposure is 4 times of benchmark light exposure, and EV-1 refers to one grade of exposure of reduction, i.e. light exposure is 0.5 times etc. of benchmark light exposure.
For example, if the original image quantity of imaging sensor acquisition is 7 frames, corresponding default exposure bias value EV
Value can be [+1 ,+1 ,+1 ,+1,0, -3, -6].Wherein, the frame that exposure bias value is EV+1 is preset, can solve noise problem,
Time domain noise reduction is carried out by the higher frame of brightness ratio, inhibits noise while promoting dark portion details;Default exposure bias value is
The frame of EV-6, retains the details of highlight area at the problem of can solve bloom overexposure;Default exposure bias value is EV0 and EV-3
Frame, then can be used for keeping bloom to the transition between dark space, keep the effect of preferable light and shade transition.
The image composition method of the embodiment of the present application, by surveying light with the target light exposure amount of each frame original image of determination, root
According to the target light exposure amount and each preset sensitivity of frame original image of each frame original image, when determining the exposure of each frame original image
It is long, if the exposure time of an at least frame original image is greater than maximum time limit, according to maximum time limit, update an at least frame original image
Exposure time be exposed control finally according to the exposure time and sensitivity of each frame original image.Pass through basis as a result,
The degree of jitter of imaging device, it is determined that the exposure time of each frame original image, and then an at least frame is updated according to maximum time limit
The exposure time of original image is exposed control finally according to the exposure time and sensitivity of updated each frame original image
System, obtains each frame original image, not only improves the dynamic range and overall brightness that image is shot under night scene screening-mode, but also
The noise in shooting image is effectively inhibited, the quality of night scene shooting image is improved, improves user experience.
In order to realize above-described embodiment, the application also proposes a kind of image synthesizer.
Fig. 5 is a kind of structural schematic diagram of image synthesizer provided by the embodiments of the present application.
As shown in figure 5, the image synthesizer 100 include: control module 110, identification module 120, adjustment module 130 with
And synthesis module 140.
Control module 110 acquires multiframe original image for controlling imaging sensor frame by frame under light compensating lamp open state;
Wherein, multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases.
Identification module 120, for identifying that brightness is greater than setting luminance threshold to the long exposure image in multiframe original image
Target area.
Module 130 is adjusted, for turning down the brightness of target area.
Synthesis module 140, for short exposed images, middle exposure image and long exposure image adjusted to be synthesized,
Obtain composograph.
Further, in a kind of possible implementation of the embodiment of the present application, referring to Fig. 5, embodiment shown in Fig. 4
On the basis of, which can also include:
Module 150 is obtained, user obtains preview image.
Determining module 160, brightness and/or picture light ratio for determining preview image are less than corresponding threshold value.
As a kind of possible implementation, control module 110 is specifically used under light compensating lamp open state, survey light with
The target light exposure amount for determining each frame original image, it is preset according to the target light exposure amount of each frame original image and each frame original image
Sensitivity determines the exposure time of each frame original image, according to the exposure time and sensitivity of each frame original image, passes to image
Sensor is exposed control, to collect multiframe original image frame by frame.
As a kind of possible implementation, control module 110, if an at least frame original image can also be specifically used for
Exposure time is greater than setting maximum time limit, according to maximum time limit, updates the exposure time of an at least frame original image;Maximum time limit
Value range is 4.5s to 5.5s.
As a kind of possible implementation, control module 110, if an at least frame original image can also be specifically used for
Exposure time is less than setting duration lower limit, and according to duration lower limit, it is original less than each frame of setting duration lower limit to update exposure time
The exposure time of image;Duration lower limit is greater than or equal to 10ms;In turn, the exposure before determining updated exposure time and updating
Ratio between duration, remaining each frame original image for being greater than or equal to duration lower limit to exposure time update it according to ratio
The sensitivity or exposure time of remaining each frame original image.
As alternatively possible implementation, control module 110 can also include:
First processing units, for the sensitivity product before updating ratio and remaining each frame original image, as remaining
Each updated sensitivity of frame original image.
Alternatively, for the exposure time product before updating ratio and remaining each frame original image, it is former as remaining each frame
Exposure time after beginning image update.
As alternatively possible implementation, control module 110 can also include:
Acquiring unit, for obtaining preview screen.
First determination unit, for the image content according to preview screen, determination belongs to night scene scene.
Recognition unit, whether for including face according to the degree of jitter and/or preview screen of imaging device, identification is applicable in
Night scene mode.
Second determination unit, for determining the exposure bias value of each frame original image setting according to night scene mode.
Third determination unit determines benchmark light exposure for the luminance information according to preview image.
4th determination unit determines each for the exposure bias value according to benchmark light exposure and the setting of each frame original image
The target light exposure amount of frame original image.
As alternatively possible implementation, synthesis module 140 is specifically used for short exposed images, middle exposure image
With long exposure image adjusted, subregion is weighted synthesis and obtains composograph;
Wherein, in long exposure image target area weight, be less than corresponding region in short exposed images and middle exposure image
Weight.
It should be noted that the aforementioned image for being also applied for the embodiment to the explanation of image composition method embodiment
Synthesizer, details are not described herein again.
The image synthesizer of the embodiment of the present application is adopted under light compensating lamp open state frame by frame by controlling imaging sensor
Collect multiframe original image;Wherein, multiframe original image includes short exposed images, middle exposure image and the length that exposure sequence increases
Exposure image;To the long exposure image in multiframe original image, identifies that brightness is greater than the target area of setting luminance threshold, turn down
Short exposed images, middle exposure image and long exposure image adjusted are synthesized, obtain composite diagram by the brightness of target area
Picture.
In order to realize above-described embodiment, the application also proposes a kind of electronic equipment, including memory, processor and is stored in
On memory and the computer program that can run on a processor, when the processor executes described program, such as above-mentioned reality is realized
Apply image composition method described in example.
Referring to Fig. 6, the application also provides another electronic equipment 200.Electronic equipment 200 includes memory 50 and processing
Device 60.Computer-readable instruction is stored in memory 50.When computer-readable instruction is stored by 50 execution, so that processor
60 execute the exposal control method of any of the above-described embodiment.
Fig. 6 is the schematic diagram of internal structure of electronic equipment 200 in one embodiment.The electronic equipment 200 includes passing through to be
Processor 60, the memory 50 (for example, non-volatile memory medium), built-in storage 82,83 and of display screen of bus 81 of uniting connection
Input unit 84.Wherein, the memory 50 of electronic equipment 200 is stored with operating system and computer-readable instruction.The computer
Readable instruction can be executed by processor 60, to realize the exposal control method of the application embodiment.The processor 60 is for mentioning
For calculating and control ability, the operation of entire electronic equipment 200 is supported.The built-in storage 50 of electronic equipment 200 is memory 52
In computer-readable instruction operation provide environment.The display screen 83 of electronic equipment 200 can be liquid crystal display or electricity
Sub- ink display screen etc., input unit 84 can be the touch layer covered on display screen 83, be also possible to 200 shell of electronic equipment
Key, trace ball or the Trackpad of upper setting, are also possible to external keyboard, Trackpad or mouse etc..The electronic equipment 200 can
Be mobile phone, tablet computer, laptop, personal digital assistant or wearable device (such as Intelligent bracelet, smartwatch,
Intelligent helmet, intelligent glasses) etc..It will be understood by those skilled in the art that structure shown in Fig. 6, only with the application side
The schematic diagram of the relevant part-structure of case does not constitute the restriction for the electronic equipment 200 being applied thereon to application scheme,
Specific electronic equipment 200 may include perhaps combining certain components than more or fewer components as shown in the figure or having
Different component layouts.
Referring to Fig. 7, including image processing circuit 90, image processing circuit in the electronic equipment 200 of the embodiment of the present application
90 can be realized using hardware and or software component, including define ISP (Image Signal Processing, at picture signal
Reason) pipeline various processing units.Fig. 7 is the schematic diagram of image processing circuit 90 in one embodiment.As shown in fig. 7, for just
In explanation, the various aspects of image processing techniques relevant to the embodiment of the present application are only shown.
As shown in fig. 7, image processing circuit 90 includes ISP processor 91 (ISP processor 91 can be processor 60) and controls
Logic device 92 processed.The image data that camera 93 captures is handled by ISP processor 91 first, and ISP processor 91 is to image data
It is analyzed to capture the image statistics for the one or more control parameters that can be used for determining camera 93.Camera 93 can
Including one or more lens 932 and imaging sensor 934.Imaging sensor 934 may include colour filter array (such as Bayer
Filter), imaging sensor 934 can obtain the luminous intensity and wavelength information that each imaging pixel captures, and provide and can be handled by ISP
One group of raw image data of the processing of device 91.Sensor 94 (such as gyroscope) can be based on 94 interface type of sensor the figure of acquisition
As the parameter (such as stabilization parameter) of processing is supplied to ISP processor 91.94 interface of sensor can be SMIA (Standard
Mobile Imaging Architecture, Standard Mobile Imager framework) interface, other serial or parallel camera interfaces or
The combination of above-mentioned interface.
In addition, raw image data can also be sent to sensor 94 by imaging sensor 934, sensor 94 can be based on sensing
Raw image data is supplied to ISP processor 91 or sensor 94 and arrives raw image data storage by 94 interface type of device
In video memory 95.
ISP processor 91 handles raw image data pixel by pixel in various formats.For example, each image pixel can have
There is the bit depth of 8,10,12 or 14 bits, ISP processor 91 can carry out one or more image procossing behaviour to raw image data
Make, statistical information of the collection about image data.Wherein, image processing operations can by identical or different bit depth precision into
Row.
ISP processor 91 can also receive image data from video memory 95.For example, 94 interface of sensor is by original image
Data are sent to video memory 95, and the raw image data in video memory 95 is available to ISP processor 91 for place
Reason.Video memory 95 can be independent special in memory 50, a part of memory 50, storage equipment or electronic equipment
It with memory, and may include DMA (Direct Memory Access, direct direct memory access (DMA)) feature.
When receiving the original from 934 interface of imaging sensor or from 94 interface of sensor or from video memory 95
When beginning image data, ISP processor 91 can carry out one or more image processing operations, such as time-domain filtering.Treated image
Data can be transmitted to video memory 95, to carry out other processing before shown.ISP processor 91 is stored from image
Device 95 receives processing data, and carries out at the image data in original domain and in RGB and YCbCr color space to processing data
Reason.Treated that image data may be output to display 97 (display 97 may include display screen 83) for ISP processor 91, for
Family is watched and/or is further processed by graphics engine or GPU (Graphics Processing Unit, graphics processor).This
Outside, the output of ISP processor 91 also can be transmitted to video memory 95, and display 97 can read image from video memory 95
Data.In one embodiment, video memory 95 can be configured to realize one or more frame buffers.In addition, ISP is handled
The output of device 91 can be transmitted to encoder/decoder 96, so as to encoding/decoding image data.The image data of coding can be protected
It deposits, and is decompressed before being shown in 97 equipment of display.Encoder/decoder 96 can be real by CPU or GPU or coprocessor
It is existing.
The statistical data that ISP processor 91 determines, which can be transmitted, gives control logic device Unit 92.For example, statistical data may include
The imaging sensors such as automatic exposure, automatic white balance, automatic focusing, flicker detection, black level compensation, 932 shadow correction of lens
934 statistical informations.Control logic device 92 may include the processing element and/or microcontroller for executing one or more routines (such as firmware)
Device, one or more routines can statistical data based on the received, determine the control parameter of camera 93 and the control of ISP processor 91
Parameter processed.For example, the control parameter of camera 93 may include 94 control parameter of sensor (such as the integral of gain, spectrum assignment
Time, stabilization parameter etc.), camera flash control parameter, 932 control parameter of lens (such as focus or zoom focal length) or
The combination of these parameters.ISP control parameter may include for automatic white balance and color adjustment (for example, during RGB processing)
932 shadow correction parameter of gain level and color correction matrix and lens.
The following are realize image composition method with image processing techniques in Fig. 7:
Control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, multiframe original graph
Short exposed images, middle exposure image and long exposure image as including the increase of exposure sequence;
To the long exposure image in multiframe original image, identify that brightness is greater than the target area of setting luminance threshold;
Turn down the brightness of target area;
Short exposed images, middle exposure image and long exposure image adjusted are synthesized, composograph is obtained.
In order to realize above-described embodiment, the application also proposes a kind of computer readable storage medium, is stored thereon with calculating
Machine program, which is characterized in that the image composition method as described in above-described embodiment is realized when the program is executed by processor.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is contained at least one embodiment or example of the application.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiment or examples.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present application, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing custom logic function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the application includes other realization, wherein can not press shown or discussed suitable
Sequence, including according to related function by it is basic simultaneously in the way of or in the opposite order, Lai Zhihang function, this should be by the application
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system, including the system of processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium ", which can be, any may include, stores, communicates, propagates or pass
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium include the following: there is the electricity of one or more wirings
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can then be edited, be interpreted or when necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the application can be realized with hardware, software, firmware or their combination.Above-mentioned
In embodiment, software that multiple steps or method can be executed in memory and by suitable instruction execution system with storage
Or firmware is realized.Such as, if realized with hardware in another embodiment, following skill well known in the art can be used
Any one of art or their combination are realized: have for data-signal is realized the logic gates of logic function from
Logic circuit is dissipated, the specific integrated circuit with suitable combinational logic gate circuit, programmable gate array (PGA), scene can compile
Journey gate array (FPGA) etc..
Those skilled in the art are understood that realize all or part of step that above-described embodiment method carries
It suddenly is that relevant hardware can be instructed to complete by program, the program can store in a kind of computer-readable storage medium
In matter, which when being executed, includes the steps that one or a combination set of embodiment of the method.
It, can also be in addition, can integrate in a processing module in each functional unit in each embodiment of the application
It is that each unit physically exists alone, can also be integrated in two or more units in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized and when sold or used as an independent product in the form of software function module, also can store in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..Although having been shown and retouching above
Embodiments herein is stated, it is to be understood that above-described embodiment is exemplary, and should not be understood as the limit to the application
System, those skilled in the art can be changed above-described embodiment, modify, replace and become within the scope of application
Type.
Claims (11)
1. a kind of image composition method, which is characterized in that the described method comprises the following steps:
Control imaging sensor acquires multiframe original image frame by frame under light compensating lamp open state;Wherein, the multiframe original graph
Short exposed images, middle exposure image and long exposure image as including the increase of exposure sequence;
To the long exposure image in the multiframe original image, identify that brightness is greater than the target area of setting luminance threshold;
Turn down the brightness of the target area;
The short exposed images, the middle exposure image and long exposure image adjusted are synthesized, composograph is obtained.
2. image composition method according to claim 1, which is characterized in that the control imaging sensor is opened in light compensating lamp
It opens before acquiring multiframe original image under state frame by frame, further includes:
Obtain preview image;
The brightness and/or picture light ratio for determining the preview image are less than corresponding threshold value.
3. image composition method according to claim 1, which is characterized in that the control imaging sensor is opened in light compensating lamp
It opens and acquires multiframe original image under state frame by frame, comprising:
Under the light compensating lamp open state, light is surveyed with the target light exposure amount of each frame original image of determination;
According to the target light exposure amount of each frame original image and each preset sensitivity of frame original image, each frame original image is determined
Exposure time;
According to the exposure time and sensitivity of each frame original image, control is exposed to described image sensor, to adopt frame by frame
Collection obtains the multiframe original image.
4. image composition method according to claim 3, which is characterized in that described to be exposed according to the target of each frame original image
Light quantity and each preset sensitivity of frame original image, after the exposure time for determining each frame original image, further includes:
If the exposure time of an at least frame original image is greater than setting maximum time limit, according to the maximum time limit, update is described extremely
The exposure time of a few frame original image;The maximum time limit value range is 4.5s to 5.5s.
5. image composition method according to claim 3, which is characterized in that described to be exposed according to the target of each frame original image
Light quantity and each preset sensitivity of frame original image, after the exposure time for determining each frame original image, further includes:
If the exposure time of an at least frame original image is less than setting duration lower limit, according to the duration lower limit, when updating exposure
The exposure time of the long each frame original image for being less than setting duration lower limit;The duration lower limit is greater than or equal to 10ms;
The ratio between exposure time before determining updated exposure time and updating;
It is greater than or equal to remaining each frame original image of the duration lower limit to exposure time, according to the ratio, described in update
The sensitivity or exposure time of remaining each frame original image.
6. image composition method according to claim 5, which is characterized in that it is described according to the ratio, update it is described its
The sensitivity or exposure time of remaining each frame original image, comprising:
Sensitivity product before the ratio and remaining described each frame original image are updated, as remaining described each frame original graph
As updated sensitivity;
Alternatively, the exposure time product before the ratio and remaining described each frame original image are updated, remaining is each as described
The updated exposure time of frame original image.
7. image composition method according to claim 3, which is characterized in that the survey light is with each frame original image of determination
Target light exposure amount, comprising:
Obtain preview screen;
According to the image content of the preview screen, determination belongs to night scene scene;
Whether include face according to the degree of jitter of imaging device and/or the preview screen, identifies applicable night scene mode;
According to the night scene mode, the exposure bias value of each frame original image setting is determined;
According to the luminance information of preview image, benchmark light exposure is determined;
According to the exposure bias value that the benchmark light exposure and each frame original image are set, determine that the target of each frame original image exposes
Light quantity.
8. image composition method according to claim 1-7, which is characterized in that described by the short exposure figure
Picture, the middle exposure image and long exposure image adjusted are synthesized, and composograph is obtained, comprising:
To the short exposed images, the middle exposure image and long exposure image adjusted, subregion, which is weighted, to be synthesized
To the composograph;
Wherein, the weight of target area described in the long exposure image is less than the short exposed images and the middle exposure diagram
The weight of corresponding region as in.
9. a kind of image synthesizer, which is characterized in that described device includes:
Control module acquires multiframe original image for controlling imaging sensor frame by frame under light compensating lamp open state;Wherein, institute
Stating multiframe original image includes short exposed images, middle exposure image and the long exposure image that exposure sequence increases;
Identification module, for identifying that brightness is greater than setting luminance threshold to the long exposure image in the multiframe original image
Target area;
Module is adjusted, for turning down the brightness of the target area;
Synthesis module, for the short exposed images, the middle exposure image and long exposure image adjusted to be synthesized,
Obtain composograph.
10. a kind of electronic equipment characterized by comprising memory, processor and storage are on a memory and can be in processor
The computer program of upper operation when the processor executes described program, realizes such as image described in any one of claims 1-8
Synthetic method.
11. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
Such as image composition method described in any one of claims 1-8 is realized when execution.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910094208.7A CN109788207B (en) | 2019-01-30 | 2019-01-30 | Image synthesis method and device, electronic equipment and readable storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910094208.7A CN109788207B (en) | 2019-01-30 | 2019-01-30 | Image synthesis method and device, electronic equipment and readable storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN109788207A true CN109788207A (en) | 2019-05-21 |
CN109788207B CN109788207B (en) | 2021-03-23 |
Family
ID=66503814
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910094208.7A Active CN109788207B (en) | 2019-01-30 | 2019-01-30 | Image synthesis method and device, electronic equipment and readable storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109788207B (en) |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108156392A (en) * | 2017-12-28 | 2018-06-12 | 努比亚技术有限公司 | A kind of image pickup method, terminal and computer readable storage medium |
CN110661972A (en) * | 2019-09-27 | 2020-01-07 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
CN111064898A (en) * | 2019-12-02 | 2020-04-24 | 联想(北京)有限公司 | Image shooting method and device, equipment and storage medium |
CN111405205A (en) * | 2020-03-24 | 2020-07-10 | 维沃移动通信有限公司 | Image processing method and electronic device |
CN112235512A (en) * | 2020-09-16 | 2021-01-15 | 浙江大华技术股份有限公司 | Image exposure parameter adjusting method, equipment and device |
CN112367458A (en) * | 2020-09-18 | 2021-02-12 | 格科微电子(上海)有限公司 | HDR image generation method and device, storage medium and image processing device |
CN112907701A (en) * | 2019-11-19 | 2021-06-04 | 杭州海康威视数字技术股份有限公司 | Method and device for acquiring image, computer equipment and storage medium |
CN113038026A (en) * | 2021-03-01 | 2021-06-25 | 维沃移动通信有限公司 | Image processing method and electronic device |
CN114095666A (en) * | 2021-08-12 | 2022-02-25 | 荣耀终端有限公司 | Photographing method, electronic device and computer-readable storage medium |
CN115412678A (en) * | 2022-10-20 | 2022-11-29 | 荣耀终端有限公司 | Exposure processing method and device and electronic equipment |
CN115802133A (en) * | 2021-09-10 | 2023-03-14 | Oppo广东移动通信有限公司 | Camera module, electronic equipment, image acquisition method and device and storage medium |
CN116437222A (en) * | 2021-12-29 | 2023-07-14 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN116452475A (en) * | 2022-01-10 | 2023-07-18 | 荣耀终端有限公司 | Image processing method and related device |
CN117278864A (en) * | 2023-11-15 | 2023-12-22 | 荣耀终端有限公司 | Image capturing method, electronic device, and storage medium |
CN117499779A (en) * | 2023-12-27 | 2024-02-02 | 荣耀终端有限公司 | Image preview method, device and storage medium |
CN117710265A (en) * | 2022-01-25 | 2024-03-15 | 荣耀终端有限公司 | Image processing method and related device |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140016001A1 (en) * | 2012-07-10 | 2014-01-16 | Canon Kabushiki Kaisha | Image-pickup apparatus, control method for the same, and non-transitory computer-readable storage medium |
US20170048442A1 (en) * | 2010-07-05 | 2017-02-16 | Apple Inc. | Operating a device to capture high dynamic range images |
CN108683862A (en) * | 2018-08-13 | 2018-10-19 | Oppo广东移动通信有限公司 | Image formation control method, device, electronic equipment and computer readable storage medium |
CN108900782A (en) * | 2018-08-22 | 2018-11-27 | Oppo广东移动通信有限公司 | Exposal control method, device and electronic equipment |
CN108965729A (en) * | 2018-08-13 | 2018-12-07 | Oppo广东移动通信有限公司 | Control method, device, electronic equipment and computer readable storage medium |
CN109194855A (en) * | 2018-09-20 | 2019-01-11 | Oppo广东移动通信有限公司 | Imaging method, device and electronic equipment |
CN109218613A (en) * | 2018-09-18 | 2019-01-15 | Oppo广东移动通信有限公司 | High dynamic-range image synthesis method, device, terminal device and storage medium |
CN109218628A (en) * | 2018-09-20 | 2019-01-15 | Oppo广东移动通信有限公司 | Image processing method, device, electronic equipment and storage medium |
-
2019
- 2019-01-30 CN CN201910094208.7A patent/CN109788207B/en active Active
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170048442A1 (en) * | 2010-07-05 | 2017-02-16 | Apple Inc. | Operating a device to capture high dynamic range images |
US20140016001A1 (en) * | 2012-07-10 | 2014-01-16 | Canon Kabushiki Kaisha | Image-pickup apparatus, control method for the same, and non-transitory computer-readable storage medium |
CN108683862A (en) * | 2018-08-13 | 2018-10-19 | Oppo广东移动通信有限公司 | Image formation control method, device, electronic equipment and computer readable storage medium |
CN108965729A (en) * | 2018-08-13 | 2018-12-07 | Oppo广东移动通信有限公司 | Control method, device, electronic equipment and computer readable storage medium |
CN108900782A (en) * | 2018-08-22 | 2018-11-27 | Oppo广东移动通信有限公司 | Exposal control method, device and electronic equipment |
CN109218613A (en) * | 2018-09-18 | 2019-01-15 | Oppo广东移动通信有限公司 | High dynamic-range image synthesis method, device, terminal device and storage medium |
CN109194855A (en) * | 2018-09-20 | 2019-01-11 | Oppo广东移动通信有限公司 | Imaging method, device and electronic equipment |
CN109218628A (en) * | 2018-09-20 | 2019-01-15 | Oppo广东移动通信有限公司 | Image processing method, device, electronic equipment and storage medium |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108156392A (en) * | 2017-12-28 | 2018-06-12 | 努比亚技术有限公司 | A kind of image pickup method, terminal and computer readable storage medium |
CN110661972A (en) * | 2019-09-27 | 2020-01-07 | 维沃移动通信有限公司 | Image processing method, image processing apparatus, electronic device, and medium |
US11678066B2 (en) | 2019-09-27 | 2023-06-13 | Vivo Mobile Communication Co., Ltd. | Image processing method, electronic device and medium |
CN112907701A (en) * | 2019-11-19 | 2021-06-04 | 杭州海康威视数字技术股份有限公司 | Method and device for acquiring image, computer equipment and storage medium |
CN111064898A (en) * | 2019-12-02 | 2020-04-24 | 联想(北京)有限公司 | Image shooting method and device, equipment and storage medium |
CN111064898B (en) * | 2019-12-02 | 2021-07-16 | 联想(北京)有限公司 | Image shooting method and device, equipment and storage medium |
CN111405205A (en) * | 2020-03-24 | 2020-07-10 | 维沃移动通信有限公司 | Image processing method and electronic device |
CN112235512A (en) * | 2020-09-16 | 2021-01-15 | 浙江大华技术股份有限公司 | Image exposure parameter adjusting method, equipment and device |
CN112367458A (en) * | 2020-09-18 | 2021-02-12 | 格科微电子(上海)有限公司 | HDR image generation method and device, storage medium and image processing device |
CN112367458B (en) * | 2020-09-18 | 2022-04-22 | 格科微电子(上海)有限公司 | HDR image generation method and device, storage medium and image processing device |
CN113038026A (en) * | 2021-03-01 | 2021-06-25 | 维沃移动通信有限公司 | Image processing method and electronic device |
CN113038026B (en) * | 2021-03-01 | 2023-07-25 | 维沃移动通信有限公司 | Image processing method and electronic device |
WO2023015991A1 (en) * | 2021-08-12 | 2023-02-16 | 荣耀终端有限公司 | Photography method, electronic device, and computer readable storage medium |
CN114095666A (en) * | 2021-08-12 | 2022-02-25 | 荣耀终端有限公司 | Photographing method, electronic device and computer-readable storage medium |
CN114095666B (en) * | 2021-08-12 | 2023-09-22 | 荣耀终端有限公司 | Photographing method, electronic device, and computer-readable storage medium |
CN115802133A (en) * | 2021-09-10 | 2023-03-14 | Oppo广东移动通信有限公司 | Camera module, electronic equipment, image acquisition method and device and storage medium |
CN116437222B (en) * | 2021-12-29 | 2024-04-19 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN116437222A (en) * | 2021-12-29 | 2023-07-14 | 荣耀终端有限公司 | Image processing method and electronic equipment |
CN116452475A (en) * | 2022-01-10 | 2023-07-18 | 荣耀终端有限公司 | Image processing method and related device |
CN116452475B (en) * | 2022-01-10 | 2024-05-31 | 荣耀终端有限公司 | Image processing method and related device |
CN117710265A (en) * | 2022-01-25 | 2024-03-15 | 荣耀终端有限公司 | Image processing method and related device |
CN115412678A (en) * | 2022-10-20 | 2022-11-29 | 荣耀终端有限公司 | Exposure processing method and device and electronic equipment |
CN117278864A (en) * | 2023-11-15 | 2023-12-22 | 荣耀终端有限公司 | Image capturing method, electronic device, and storage medium |
CN117278864B (en) * | 2023-11-15 | 2024-04-05 | 荣耀终端有限公司 | Image capturing method, electronic device, and storage medium |
CN117499779B (en) * | 2023-12-27 | 2024-05-10 | 荣耀终端有限公司 | Image preview method, device and storage medium |
CN117499779A (en) * | 2023-12-27 | 2024-02-02 | 荣耀终端有限公司 | Image preview method, device and storage medium |
Also Published As
Publication number | Publication date |
---|---|
CN109788207B (en) | 2021-03-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN109788207A (en) | Image composition method, device, electronic equipment and readable storage medium storing program for executing | |
CN110072051B (en) | Image processing method and device based on multi-frame images | |
CN108900782B (en) | Exposure control method, exposure control device and electronic equipment | |
CN110072052B (en) | Image processing method and device based on multi-frame image and electronic equipment | |
CN109005366B (en) | Night scene shooting processing method and device for camera module, electronic equipment and storage medium | |
CN109068067A (en) | Exposal control method, device and electronic equipment | |
CN109040609A (en) | Exposal control method, device and electronic equipment | |
CN108683862B (en) | Imaging control method, imaging control device, electronic equipment and computer-readable storage medium | |
CN110290289B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
CN110248106B (en) | Image noise reduction method and device, electronic equipment and storage medium | |
CN110166708B (en) | Night scene image processing method and device, electronic equipment and storage medium | |
CN109068058A (en) | Filming control method, device and electronic equipment under super night scene mode | |
CN109005364A (en) | Image formation control method, device, electronic equipment and computer readable storage medium | |
CN109005369A (en) | Exposal control method, device, electronic equipment and computer readable storage medium | |
CN108989700A (en) | Image formation control method, device, electronic equipment and computer readable storage medium | |
CN109756681A (en) | Image composition method, device, electronic equipment and readable storage medium storing program for executing | |
CN109005361A (en) | Control method, device, imaging device, electronic equipment and readable storage medium storing program for executing | |
CN110166707B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
CN108833804A (en) | Imaging method, device and electronic equipment | |
CN109151333B (en) | Exposure control method, exposure control device and electronic equipment | |
CN109756680A (en) | Image composition method, device, electronic equipment and readable storage medium storing program for executing | |
CN110191291A (en) | Image processing method and device based on multiple image | |
CN109348088A (en) | Image denoising method, device, electronic equipment and computer readable storage medium | |
CN110062159A (en) | Image processing method, device, electronic equipment based on multiple image | |
CN108833802A (en) | Exposal control method, device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |