CN109218621A - Image processing method, device, storage medium and mobile terminal - Google Patents
Image processing method, device, storage medium and mobile terminal Download PDFInfo
- Publication number
- CN109218621A CN109218621A CN201811237687.5A CN201811237687A CN109218621A CN 109218621 A CN109218621 A CN 109218621A CN 201811237687 A CN201811237687 A CN 201811237687A CN 109218621 A CN109218621 A CN 109218621A
- Authority
- CN
- China
- Prior art keywords
- picture
- frame
- picture frame
- flasher
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 26
- 230000004927 fusion Effects 0.000 claims abstract description 21
- 238000012544 monitoring process Methods 0.000 claims abstract description 19
- 238000000034 method Methods 0.000 claims abstract description 17
- 241001417501 Lobotidae Species 0.000 claims description 154
- 238000001514 detection method Methods 0.000 claims description 27
- 238000004422 calculation algorithm Methods 0.000 claims description 18
- 238000012545 processing Methods 0.000 claims description 18
- 238000010801 machine learning Methods 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 8
- 238000002372 labelling Methods 0.000 claims description 7
- 238000002156 mixing Methods 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 12
- 230000002093 peripheral effect Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 5
- 238000012549 training Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 210000003205 muscle Anatomy 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000018199 S phase Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000003066 decision tree Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000000155 melt Substances 0.000 description 2
- 238000003062 neural network model Methods 0.000 description 2
- 238000007637 random forest analysis Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 229910052754 neon Inorganic materials 0.000 description 1
- GKAOGPIIYCISHV-UHFFFAOYSA-N neon atom Chemical compound [Ne] GKAOGPIIYCISHV-UHFFFAOYSA-N 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 210000000697 sensory organ Anatomy 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/743—Bracketing, i.e. taking a series of images with varying exposure conditions
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the present application discloses image processing method, device, storage medium and mobile terminal.This method comprises: when monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture；The first picture frame and the second picture frame are determined from least two picture frame；Wherein, the first image frame includes the picture frame shot when the flasher is lighted, and second picture frame includes the picture frame shot when the flasher extinguishes；The first image frame and second picture frame are merged, target image frame is obtained.The embodiment of the present application is by using above-mentioned technical proposal, the picture frame when picture frame and flasher that can be accurately obtained when flasher is lighted extinguish, and pass through the desired target image of the available user of fusion to two class picture frames, but also the quality of shooting image can be effectively improved to avoid the spatial texture in the shooting picture as caused by flasher.
Description
Technical field
The invention relates to technical field of image processing more particularly to a kind of image processing method, device, storage Jie
Matter and mobile terminal.
Background technique
Currently, camera function has become the standard configuration of most mobile terminals, user can be by portable mobile whole
Quickly and easily realize photographing operation in end.
When user is taken pictures using mobile terminal, if there is the light source of flashing in shooting picture, often due to light
Source flicker frequency, which causes to shoot, has not erasable texture in image, cause shooting picture quality poor.Therefore, shooting is improved
The quality of image becomes most important.
Summary of the invention
The embodiment of the present application provides a kind of image processing method, device, storage medium and mobile terminal, can effectively improve
Shoot the quality of image.
In a first aspect, the embodiment of the present application provides a kind of image processing method, comprising:
When monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture；
The first picture frame and the second picture frame are determined from least two picture frame；Wherein, the first image frame
The picture frame shot when lighting including the flasher, second picture frame include that the flasher is shot when extinguishing
Picture frame；
The first image frame and second picture frame are merged, target image frame is obtained.
Second aspect, the embodiment of the present application provide a kind of image processing apparatus, comprising:
Picture frame shooting module, for when monitoring to be continuously shot at least in shooting preview picture there are when flasher
Two picture frames；
Picture frame determining module, for determining the first picture frame and the second picture frame from least two picture frame；
Wherein, the first image frame includes the picture frame shot when the flasher is lighted, and second picture frame includes described
The picture frame that flasher is shot when extinguishing；
Picture frame Fusion Module obtains target for merging to the first image frame and second picture frame
Picture frame.
The third aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey
Sequence realizes the image processing method as described in the embodiment of the present application when the program is executed by processor.
Fourth aspect, the embodiment of the present application provide a kind of mobile terminal, including memory, processor and are stored in storage
It can realize on device and when the computer program of processor operation, the processor execute the computer program as the application is real
Apply image processing method described in example.
The image procossing scheme provided in the embodiment of the present application, when monitoring that there are flashers in shooting preview picture
When, at least two picture frames are continuously shot, and the first picture frame and the second picture frame are determined from least two picture frames,
In, the first picture frame includes the picture frame shot when flasher is lighted, and the second picture frame includes shooting when flasher extinguishes
Picture frame, then the first picture frame and the second picture frame are merged, obtain target image frame.By using above-mentioned technology
Scheme, when there are when flasher, in such a way that multiple image is shot, sudden strain of a muscle can be accurately obtained in shooting preview picture
Picture frame when picture frame and flasher when bright light source igniting extinguish, and it is available by the fusion to two class picture frames
The desired target image of user, but also can be to avoid the spatial texture in the shooting picture as caused by flasher, it can
Effectively improve the quality of shooting image.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of image processing method provided by the embodiments of the present application；
Fig. 2 is the flow diagram of another image processing method provided by the embodiments of the present application；
Fig. 3 is the flow diagram of another image processing method provided by the embodiments of the present application；
Fig. 4 is a kind of structural block diagram of image processing apparatus provided by the embodiments of the present application；
Fig. 5 is a kind of structural schematic diagram of mobile terminal provided by the embodiments of the present application；
Fig. 6 is the structural schematic diagram of another mobile terminal provided by the embodiments of the present application.
Specific embodiment
Further illustrate the technical solution of the application below with reference to the accompanying drawings and specific embodiments.It is understood that
It is that specific embodiment described herein is used only for explaining the application, rather than the restriction to the application.It further needs exist for illustrating
, part relevant to the application is illustrated only for ease of description, in attached drawing rather than entire infrastructure.
It should be mentioned that some exemplary embodiments are described as before exemplary embodiment is discussed in greater detail
The processing or method described as flow chart.Although each step is described as the processing of sequence by flow chart, many of these
Step can be implemented concurrently, concomitantly or simultaneously.In addition, the sequence of each step can be rearranged.When its operation
The processing can be terminated when completion, it is also possible to have the additional step being not included in attached drawing.The processing can be with
Corresponding to method, function, regulation, subroutine, subprogram etc..
Fig. 1 is a kind of flow diagram of image processing method provided by the embodiments of the present application, and this method can be by image
Processing unit executes, and wherein the device can be implemented by software and/or hardware, and can generally integrate in the terminal.Such as Fig. 1 institute
Show, this method comprises:
Step 101, when monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture.
Illustratively, the mobile terminal in the embodiment of the present application may include that mobile phone, tablet computer and video camera etc. have
The mobile device of camera function.
In the embodiment of the present application, when user needs to take pictures, the shooting function of mobile terminal is opened, is such as opened mobile whole
Camera applications in end obtain the image in shooting preview interface, i.e. shooting preview picture into shooting preview interface.It can be with
Understand, shooting preview picture may include that user wants the content (such as personage, landscape) of shooting in shooting preview interface
The image of presentation.
In the embodiment of the present application, flasher can be understood as the time is in light source that is quick, repeating variation, usually
Flasher can be lighted and extinguish incessantly, so that flasher is constantly beated and unstable.For example, flasher can be with
It can also include the flashers such as ornament lamp of neon light, roadside trees including the flashers such as screen or projection.It needs to illustrate
, the embodiment of the present application to the specific category of flasher without limitation.The flicker frequency of flasher is different, human eye
It is different to the sensitivity of light source scintillation.In general, flicker frequency, in 50Hz or less, human eye can perceive the sudden strain of a muscle of flasher
It is bright, and human eye is most sensitive to the flasher that flicker frequency is 8.8Hz.Meanwhile the flasher that can be detected by human eye
Maximum flicker frequency (critical flicker frequency) is not fixed and invariable, but changes with the light intensity that flasher issues,
Constantly increase as light intensity increases critical flicker frequency, after being gradually reduced after light intensity reaches maximum, critical frequency also accordingly subtracts
It is small.Typically for the flashing for the fluorescent lamp that flicker frequency is 100Hz, human eye is imperceptible.But no matter flasher
Flicker frequency it is much, if there are flashers in shooting picture, be often easy to cause in shooting picture generate can not erase
Texture information.Therefore, when monitoring to be continuously shot in shooting picture there are when flasher with certain time for exposure
At least two picture frames.Optionally, the flicker frequency of flasher is bigger, and the time for exposure is shorter, to make shooting as far as possible at least
Picture frame when picture frame and flasher when can light comprising flasher in two picture frames extinguish.
Optionally, when monitoring in shooting preview picture to wrap there are when flasher, being continuously shot at least two picture frames
It includes: obtaining shooting preview picture, and obtain the fuzziness of the shooting preview picture；When the fuzziness is greater than preset threshold
When, flasher detection is carried out to the shooting preview picture；When detecting that there are flashers in the shooting preview picture
When, it is continuously shot at least two picture frames.The advantages of this arrangement are as follows can accurately and rapidly judge that shooting preview is drawn
It whether there is flasher in face.
Illustratively, when, there are when flasher, due to the flashing of flasher, usually movement is whole in shooting preview picture
End can capture flasher and extinguish moment or by extinguishing to the shooting preview picture for lighting moment by being illuminated to, at this point, by
Switch in the light on and off of flasher, shooting preview picture is not usually to be apparent, and therefore, obtains the fuzzy of shooting preview picture
Degree.Wherein it is possible to evaluate the fuzziness of shooting preview picture based on image histogram concentration degree, it is also based on step edge
Width measures the fuzziness of shooting preview picture, it should be noted that the embodiment of the present application obscures shooting preview picture
The method of determination of degree is without limitation.Optionally, when fuzziness is greater than preset threshold, it may be determined that detect in shooting preview picture
There are flashers.It optionally, can be true in order to further accurately judge that with the presence or absence of flasher in shooting preview picture
When determining the fuzziness of shooting preview picture greater than preset threshold, flasher detection further is carried out to shooting preview picture, is kept away
Exempt from as mobile terminal shake or reference object movement caused by shooting preview picture it is unintelligible when, in shooting preview picture
With the presence or absence of the erroneous judgement operation of flasher.Optionally, if the brightness of continuous at least two field pictures is believed in shooting preview picture
Breath changes, then monitors that there are flashers in the shooting preview picture.It is understood that if shooting preview picture
In there are flashers, it will usually because the light on and off of flasher switch, cause the luminance information of shooting preview picture different, such as
Corresponding shooting preview picture is usually brighter when flasher is lighted, and corresponding shooting preview picture is logical when flasher extinguishing
It is often darker, therefore, when the luminance information of at least two field pictures in shooting preview picture changes or shooting preview picture
In at least the brightness of two field pictures difference be greater than threshold luminance threshold value when, it may be determined that there are scintillation lights in shooting preview picture
Source.
Step 102 determines the first picture frame and the second picture frame from least two picture frame.
Wherein, the first image frame includes the picture frame shot when the flasher is lighted, second picture frame
The picture frame shot when extinguishing including the flasher.
It in the embodiment of the present application, may include shooting when flasher is lighted at least two picture frames being continuously shot
Picture frame (namely the flasher of shooting be in the picture frame of illuminating state), the picture frame that when flasher extinguishing shoots
(namely the flasher of shooting is in the picture frame of OFF state), bat when flasher switches to OFF state by illuminating state
Take the photograph picture frame (namely shooting flasher switched to by illuminating state OFF state moment picture frame) and flashing
Picture frame that light source is shot when switching to illuminating state by OFF state (namely the flasher of shooting is switched to by OFF state
At least one of the picture frame of the moment of illuminating state).
Illustratively, from least two picture frames being continuously shot, the first figure shot when flasher is lighted is determined
The second picture frame shot when extinguishing as frame and flasher.Optionally, the first figure is determined from least two picture frame
As frame and the second picture frame, comprising: show at least two picture frame according to predetermined manner；According to user to display
At least two picture frame selection result, the first picture frame and the second image are determined from least two picture frame
Frame.Illustratively, at least two picture frames are shown in the form of thumbnail or list, and be presented to the user, user
It can be selected to determine the first picture frame and the second picture frame from least two picture frame according to the first sense organ of human eye.Its
In, due to the picture frame shot when the first picture frame lights for flasher, image is brighter, user can by clearly, it is brighter
Image selection is determined as the first picture frame；Second picture frame is the picture frame shot when flasher extinguishes, dark images, user
Clearly, darker image selection can be determined as the second picture frame.The advantages of this arrangement are as follows can be simply and rapidly
It determines the first picture frame and the second picture frame, and can be good at meeting user demand.
Optionally, at least two picture frame can be also input in picture frame detection model, is detected according to picture frame
The output result of model determines the first picture frame and the second picture frame, wherein picture frame detection model includes based on to scintillation light
Rule study, the training that image when image and flasher when source point is bright extinguish is presented generate.Optionally, it can also count respectively
Calculate the clarity and brightness of each picture frame at least two picture frame, clarity can be greater than default clarity threshold and
The picture frame that brightness is greater than predetermined luminance threshold value is determined as the first picture frame, and clarity is greater than default clarity threshold and brightness
Picture frame less than predetermined luminance threshold value is determined as the second picture frame.
It should be noted that the embodiment of the present application is to the first picture frame determining from least two picture frames and the second image
The mode of frame is without limitation.In addition, the quantity and the second image of the first picture frame determined from least two picture frame
The quantity of frame may be the same or different, and the embodiment of the present application does not limit the quantity of the first picture frame and the second picture frame
It is fixed.
Step 103 merges the first image frame and second picture frame, obtains target image frame.
In the embodiment of the present application, shooting when the first picture frame and flasher shot when lighting to flasher extinguishes
The second picture frame merged, generate target image frame.It wherein, is association to the fusion of the first picture frame and the second picture frame
Image with the first picture frame and the second picture frame using Same Scene (the same photographed scene comprising the flasher) is believed
Breath, output do not have the target image frame because of the high quality of picture texture caused by the presence of flasher.
Optionally, the first image frame and second picture frame are merged, obtain target image frame, comprising:
The first image frame and second picture frame are melted based on Pixel-level blending algorithm and/or feature-based fusion algorithm
It closes, generates target image frame.In the embodiment of the present application, based on Pixel-level blending algorithm to the first picture frame and the second picture frame
It is merged, obtained target image frame can be effectively retained more detailed information, especially for including more texture informations
Or the reference object of marginal information.First picture frame and second picture frame are melted based on feature-based fusion algorithm
When conjunction, common image feature information is extracted from the first picture frame and the second picture frame, respectively as the first picture frame and
Then the area-of-interest of two picture frames carries out feature letter to the area-of-interest in the first picture frame and the second picture frame respectively
Breath analysis, processing and integration, to obtain fused target image.Based on feature-based fusion algorithm to the first picture frame and
In the target image frame that two picture frames merge, the characteristic information for the area-of-interest for including is more, when to fused mesh
When logo image frame carries out target identification, identification accuracy is higher than the accuracy to the first picture frame and the second picture frame.
The image processing method provided in the embodiment of the present application, when monitoring that there are flashers in shooting preview picture
When, at least two picture frames are continuously shot, and the first picture frame and the second picture frame are determined from least two picture frames,
In, the first picture frame includes the picture frame shot when flasher is lighted, and the second picture frame includes shooting when flasher extinguishes
Picture frame, then the first picture frame and the second picture frame are merged, obtain target image frame.By using above-mentioned technology
Scheme, when there are when flasher, in such a way that multiple image is shot, sudden strain of a muscle can be accurately obtained in shooting preview picture
Picture frame when picture frame and flasher when bright light source igniting extinguish, and it is available by the fusion to two class picture frames
The desired target image of user, but also can be to avoid the spatial texture in the shooting picture as caused by flasher, it can
Effectively improve the quality of shooting image.
Fig. 2 is the flow diagram of image processing method provided by the embodiments of the present application, and this method comprises the following steps:
Step 201, when monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture.
At least two picture frame is input in picture frame detection model trained in advance by step 202.
In the embodiment of the present application, picture frame detection model can be understood as after inputting at least two picture frame,
Quickly determine the figure shot when the picture frame shot when flasher is lighted at least two picture frames and flasher extinguish
As the learning model of frame.Picture frame detection model may include neural network model, decision-tree model and Random Forest model etc.
Any one in machine learning model.Picture frame detection model can be to be flashed in the picture frame and picture frame in sample database
Light source is in illuminating state or flasher is in the status information of OFF state and is trained generation.
Step 203, according to the output of described image frame detection model as a result, determining at least two picture frame
One picture frame and the second picture frame.
Wherein, the first image frame includes the picture frame shot when the flasher is lighted, second picture frame
The picture frame shot when extinguishing including the flasher.
At least two picture frames that step 201 is continuously shot are input in picture frame detection model, and picture frame detects mould
Type analyzes each picture frame at least two picture frame, and determines at least two picture frames according to output result
In the first picture frame and the second picture frame.Illustratively, the image for being will can be marked in output result in output result
The picture frame that frame is shot when lighting as the first picture frame namely flasher will mark the picture frame for being to make in output result
The picture frame shot when extinguishing for the second picture frame namely flasher.
Optional, there are before flasher in monitoring shooting preview picture, further includes: obtains sample image
Frame, wherein the sample image frame includes the figure shot when the picture frame shot when flasher is lighted and flasher extinguish
As frame；The image status information of the sample image frame is denoted as to the sample labeling of the sample image frame, wherein described image
Status information includes that flasher is lighted and flasher extinguishing；It is right according to the sample image frame and corresponding sample labeling
Default machine learning model is trained, and generates described image frame detection model.The advantages of this arrangement are as follows can mention significantly
Height determines the accuracy of the first picture frame and the second picture frame from least two picture frame.
In the embodiment of the present application, sample image frame is obtained, wherein when the sample image frame includes that flasher is lighted
The picture frame that the picture frame and flasher of shooting are shot when extinguishing.Illustratively, a variety of different flashers be can control
In illuminating state, 3000 images are then shot within the scope of pre-determined distance by the camera of mobile terminal, as flashing
The picture frame shot when light source igniting, and flasher is lighted into the image status information as this 3000 picture frames；In addition,
It controls a variety of different flashers and is in OFF state, then clapped within the scope of pre-determined distance by the camera of mobile terminal
2000 images are taken the photograph, the picture frame shot when extinguishing as flasher, and flasher is extinguished and is used as this 2000 images
The image status information of frame.
Sample image frame is marked according to image status information (flasher is lighted to be extinguished with flasher), that is, is marked
The corresponding image status information of sample image frame is remembered, such as the sample image frame flag that flasher is lighted is 1, by scintillation light
The sample image frame flag that source is extinguished is 0, and using the sample image frame after label as the training sample of picture frame detection model
Collection.Default machine learning model is trained using training sample set (namely sample image frame and corresponding sample labeling),
Generate picture frame detection model.Wherein, default machine learning model may include neural network model or model-naive Bayesian
Etc. machine learning models.It is of course also possible to be that the machine learning algorithm based on setting is trained training sample set, figure is generated
As frame detection model.Wherein, the machine learning algorithm of setting may include the machine learning algorithms such as decision tree or random forest.
Step 204, based on Pixel-level blending algorithm and/or feature-based fusion algorithm to the first image frame and described the
Two picture frames are merged, and target image frame is generated.
Image processing method provided by the embodiments of the present application, when monitoring in shooting preview picture there are when flasher,
At least two picture frames are continuously shot, and at least two picture frames are input in picture frame detection model trained in advance, root
According to the output of picture frame detection model as a result, determining the first picture frame and the second picture frame at least two picture frames, wherein
First picture frame includes the picture frame shot when flasher is lighted, and the second picture frame includes the figure shot when flasher extinguishes
As frame, it is then based on Pixel-level blending algorithm and/or feature-based fusion algorithm melts the first picture frame and the second picture frame
It closes, obtains target image frame.By using above-mentioned technical proposal, can accurately and rapidly determine when flasher is lighted
The second picture frame when first picture frame and flasher extinguish, and pass through fusion available user's phase to two class picture frames
The target image of prestige, but also can effectively be mentioned to avoid the spatial texture in the shooting picture as caused by flasher
The quality of height shooting image.
Fig. 3 is the flow diagram of image processing method provided by the embodiments of the present application, and this method comprises the following steps:
Step 301 obtains shooting preview picture, and obtains the fuzziness of the shooting preview picture.
Illustratively, the fuzziness that shooting preview picture can be evaluated based on image histogram concentration degree, can be with base
The fuzziness of shooting preview picture is measured in step edge width.
Step 302 judges whether the fuzziness is greater than preset threshold, if so, thening follow the steps 303, otherwise returns and holds
Row step 301.
Step 303 carries out flasher detection to the shooting preview picture.
Illustratively, it when carrying out flasher detection to shooting preview picture, can determine whether at least two in shooting preview picture
Whether the luminance information of frame image changes, when luminance information changes, it may be determined that exists in shooting preview picture and dodges
Bright light source.Or judge at least whether the difference of the brightness of two field pictures is greater than threshold luminance threshold value in shooting preview picture, when
When the difference is greater than predetermined luminance threshold value, it may be determined that there are flashers in shooting preview picture.
Step 304, when detecting in the shooting preview picture there are when flasher, be continuously shot at least two images
Frame.
Step 305 shows at least two picture frame according to predetermined manner.
Step 306, according to user to the selection result of at least two picture frame of display, from least two figure
As determining the first picture frame and the second picture frame in frame.
Wherein, the first image frame includes the picture frame shot when the flasher is lighted, second picture frame
The picture frame shot when extinguishing including the flasher；
Step 307 merges the first image frame and second picture frame, obtains target image frame.
Image processing method provided by the embodiments of the present application obtains shooting preview picture, and works as the mould of shooting preview picture
When paste degree is greater than preset threshold, flasher detection is carried out to shooting preview picture, is existed when detecting in shooting preview picture
When flasher, at least two picture frames are continuously shot, and at least two picture frames are shown according to predetermined manner, according to
User determines the first picture frame and the second figure to the selection result of at least two picture frames of display from least two picture frames
As frame, it is then based on Pixel-level blending algorithm and/or feature-based fusion algorithm melts the first picture frame and the second picture frame
It closes, obtains target image frame.By using above-mentioned technical proposal, shooting preview picture not only can be quickly and accurately judged
In whether include flasher, when simply and rapidly can also determine that flasher is lighted according to the intuitive selection of user
The second picture frame when first picture frame and flasher extinguish, and pass through fusion available user's phase to two class picture frames
The target image of prestige, but also can effectively be mentioned to avoid the spatial texture in the shooting picture as caused by flasher
The quality of height shooting image.
Fig. 4 is the structural block diagram of image processing apparatus provided by the embodiments of the present application, which can be by software and/or hardware
It realizes, is typically integrated in mobile terminal, the quality of shooting image can be improved by executing image processing method.Such as Fig. 4 institute
Show, which includes:
Picture frame shooting module 401, for when monitor in shooting preview picture there are when flasher, be continuously shot to
Few two picture frames；
Picture frame determining module 402, for determining the first picture frame and the second image from least two picture frame
Frame；Wherein, the first image frame includes the picture frame shot when the flasher is lighted, and second picture frame includes institute
State the picture frame shot when flasher extinguishes；
Picture frame Fusion Module 403 obtains mesh for merging to the first image frame and second picture frame
Logo image frame.
The image processing apparatus provided in the embodiment of the present application, when monitoring that there are flashers in shooting preview picture
When, at least two picture frames are continuously shot, and the first picture frame and the second picture frame are determined from least two picture frames,
In, the first picture frame includes the picture frame shot when flasher is lighted, and the second picture frame includes shooting when flasher extinguishes
Picture frame, then the first picture frame and the second picture frame are merged, obtain target image frame.By using above-mentioned technology
Scheme, when there are when flasher, in such a way that multiple image is shot, sudden strain of a muscle can be accurately obtained in shooting preview picture
Picture frame when picture frame and flasher when bright light source igniting extinguish, and it is available by the fusion to two class picture frames
The desired target image of user, but also can be to avoid the spatial texture in the shooting picture as caused by flasher, it can
Effectively improve the quality of shooting image.
Optionally, described image frame determining module, is used for:
At least two picture frame is input in picture frame detection model trained in advance；
According to the output of described image frame detection model as a result, determining the first picture frame at least two picture frame
With the second picture frame.
Optionally, the device further include:
Sample image frame obtains module, for, there are before flasher, obtaining sample in monitoring shooting preview picture
This picture frame, wherein the sample image frame includes bat when the picture frame shot when flasher is lighted and flasher extinguish
The picture frame taken the photograph；
Sample labeling module, for the image status information of the sample image frame to be denoted as to the sample of the sample image frame
This label, wherein described image status information includes that flasher is lighted and flasher extinguishing；
Model training module is used for according to the sample image frame and corresponding sample labeling, to default machine learning mould
Type is trained, and generates described image frame detection model.
Optionally, described image frame determining module, is used for:
At least two picture frame is shown according to predetermined manner；
According to user to the selection result of at least two picture frame of display, from least two picture frame really
Fixed first picture frame and the second picture frame.
Optionally, described image frame shooting module, is used for:
Shooting preview picture is obtained, and obtains the fuzziness of the shooting preview picture；
When the fuzziness is greater than preset threshold, flasher detection is carried out to the shooting preview picture；
When detecting in the shooting preview picture there are when flasher, it is continuously shot at least two picture frames.
It is optionally, described to monitor that there are flashers in shooting preview picture, comprising:
If the luminance information of continuous at least two field pictures changes in shooting preview picture, the shooting is monitored
There are flashers in preview screen.
Optionally, described image frame Fusion Module, is used for:
Based on Pixel-level blending algorithm and/or feature-based fusion algorithm to the first image frame and second picture frame
It is merged, generates target image frame.
The embodiment of the present application also provides a kind of storage medium comprising computer executable instructions, and the computer is executable
Instruction is used to execute image processing method when being executed by computer processor, this method comprises:
When monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture；
The first picture frame and the second picture frame are determined from least two picture frame；Wherein, the first image frame
The picture frame shot when lighting including the flasher, second picture frame include that the flasher is shot when extinguishing
Picture frame；
The first image frame and second picture frame are merged, target image frame is obtained.
Storage medium --- any various types of memory devices or storage equipment.Term " storage medium " is intended to wrap
It includes: install medium, such as CD-ROM, floppy disk or magnetic tape equipment；Computer system memory or random access memory, such as
DRAM, DDRRAM, SRAM, EDORAM, blue Bath (Rambus) RAM etc.；Nonvolatile memory, such as flash memory, magnetic medium (example
Such as hard disk or optical storage)；Register or the memory component of other similar types etc..Storage medium can further include other types
Memory or combinations thereof.In addition, storage medium can be located at program in the first computer system being wherein performed, or
It can be located in different second computer systems, second computer system is connected to the first meter by network (such as internet)
Calculation machine system.Second computer system can provide program instruction to the first computer for executing.Term " storage medium " can
To include two or more that may reside in different location (such as in the different computer systems by network connection)
Storage medium.Storage medium can store the program instruction that can be performed by one or more processors and (such as be implemented as counting
Calculation machine program).
Certainly, a kind of storage medium comprising computer executable instructions, computer provided by the embodiment of the present application
Image provided by the application any embodiment can also be performed in the image processing operations that executable instruction is not limited to the described above
Relevant operation in processing method.
The embodiment of the present application provides a kind of mobile terminal, and figure provided by the embodiments of the present application can be integrated in the mobile terminal
As processing unit.Fig. 5 is a kind of structural schematic diagram of mobile terminal provided by the embodiments of the present application.Mobile terminal 500 can wrap
Include: memory 501, processor 502 and storage on a memory and can processor operation computer program, the processor
502 realize the image processing method as described in the embodiment of the present application when executing the computer program.
Mobile terminal provided by the embodiments of the present application, when, there are when flasher, passing through multiframe figure in shooting preview picture
The picture frame when mode of picture shooting, the picture frame that can be accurately obtained when flasher is lighted and flasher extinguish,
And by the desired target image of the available user of fusion to two class picture frames, but also can be to avoid due to flasher
Caused by spatial texture in shooting picture, the quality of shooting image can be effectively improved.
Fig. 6 is the structural schematic diagram of another mobile terminal provided by the embodiments of the present application, which may include:
Shell (not shown), memory 601, central processing unit (central processing unit, CPU) 602 (are also known as located
Manage device, hereinafter referred to as CPU), circuit board (not shown) and power circuit (not shown).The circuit board is placed in institute
State the space interior that shell surrounds；The CPU602 and the memory 601 are arranged on the circuit board；The power supply electricity
Road, for each circuit or the device power supply for the mobile terminal；The memory 601, for storing executable program generation
Code；The CPU602 is run and the executable journey by reading the executable program code stored in the memory 601
The corresponding computer program of sequence code, to perform the steps of
When monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture；
The first picture frame and the second picture frame are determined from least two picture frame；Wherein, the first image frame
The picture frame shot when lighting including the flasher, second picture frame include that the flasher is shot when extinguishing
Picture frame；
The first image frame and second picture frame are merged, target image frame is obtained.
The mobile terminal further include: Peripheral Interface 603, RF (Radio Frequency, radio frequency) circuit 605, audio-frequency electric
Road 606, loudspeaker 611, power management chip 608, input/output (I/O) subsystem 609, other input/control devicess 610,
Touch screen 612, other input/control devicess 610 and outside port 604, these components pass through one or more communication bus
Or signal wire 607 communicates.
It should be understood that illustrating the example that mobile terminal 600 is only mobile terminal, and mobile terminal 600
It can have than shown in the drawings more or less component, can combine two or more components, or can be with
It is configured with different components.Various parts shown in the drawings can include one or more signal processings and/or dedicated
It is realized in the combination of hardware, software or hardware and software including integrated circuit.
Below just the mobile terminal provided in this embodiment for image procossing be described in detail, the mobile terminal with
For mobile phone.
Memory 601, the memory 601 can be accessed by CPU602, Peripheral Interface 603 etc., and the memory 601 can
It can also include nonvolatile memory to include high-speed random access memory, such as one or more disk memory,
Flush memory device or other volatile solid-state parts.
The peripheral hardware that outputs and inputs of equipment can be connected to CPU602 and deposited by Peripheral Interface 603, the Peripheral Interface 603
Reservoir 601.
I/O subsystem 609, the I/O subsystem 609 can be by the input/output peripherals in equipment, such as touch screen 612
With other input/control devicess 610, it is connected to Peripheral Interface 603.I/O subsystem 609 may include 6091 He of display controller
For controlling one or more input controllers 6092 of other input/control devicess 610.Wherein, one or more input controls
Device 6092 processed receives electric signal from other input/control devicess 610 or sends electric signal to other input/control devicess 610,
Other input/control devicess 610 may include physical button (push button, rocker buttons etc.), dial, slide switch, behaviour
Vertical pole clicks idler wheel.It is worth noting that input controller 6092 can with it is following any one connect: keyboard, infrared port,
The indicating equipment of USB interface and such as mouse.
Touch screen 612, the touch screen 612 are the input interface and output interface between customer mobile terminal and user,
Visual output is shown to user, visual output may include figure, text, icon, video etc..
Display controller 6091 in I/O subsystem 609 receives electric signal from touch screen 612 or sends out to touch screen 612
Electric signals.Touch screen 612 detects the contact on touch screen, and the contact that display controller 6091 will test is converted to and is shown
The interaction of user interface object on touch screen 612, i.e. realization human-computer interaction, the user interface being shown on touch screen 612
Object can be the icon of running game, the icon for being networked to corresponding network etc..It is worth noting that equipment can also include light
Mouse, light mouse are the extensions for the touch sensitive surface for not showing the touch sensitive surface visually exported, or formed by touch screen.
RF circuit 605 is mainly used for establishing the communication of mobile phone Yu wireless network (i.e. network side), realizes mobile phone and wireless network
The data receiver of network and transmission.Such as transmitting-receiving short message, Email etc..Specifically, RF circuit 605 receives and sends RF letter
Number, RF signal is also referred to as electromagnetic signal, and RF circuit 605 converts electrical signals to electromagnetic signal or electromagnetic signal is converted to telecommunications
Number, and communicated by the electromagnetic signal with communication network and other equipment.RF circuit 605 may include for executing
The known circuit of these functions comprising but it is not limited to antenna system, RF transceiver, one or more amplifiers, tuner, one
A or multiple oscillators, digital signal processor, CODEC (COder-DECoder, coder) chipset, user identifier mould
Block (Subscriber Identity Module, SIM) etc..
Voicefrequency circuit 606 is mainly used for receiving audio data from Peripheral Interface 603, which is converted to telecommunications
Number, and the electric signal is sent to loudspeaker 611.
Loudspeaker 611 is reduced to sound for mobile phone to be passed through RF circuit 605 from the received voice signal of wireless network
And the sound is played to user.
Power management chip 608, the hardware for being connected by CPU602, I/O subsystem and Peripheral Interface are powered
And power management.
The application, which can be performed, in image processing apparatus, storage medium and the mobile terminal provided in above-described embodiment arbitrarily implements
Image processing method provided by example has and executes the corresponding functional module of this method and beneficial effect.Not in above-described embodiment
In detailed description technical detail, reference can be made to image processing method provided by the application any embodiment.
Note that above are only the preferred embodiment and institute's application technology principle of the application.It will be appreciated by those skilled in the art that
The application is not limited to specific embodiment described here, be able to carry out for a person skilled in the art it is various it is apparent variation,
The protection scope readjusted and substituted without departing from the application.Therefore, although being carried out by above embodiments to the application
It is described in further detail, but the application is not limited only to above embodiments, in the case where not departing from the application design, also
It may include more other equivalent embodiments, and scope of the present application is determined by the scope of the appended claims.
Claims (10)
1. a kind of image processing method characterized by comprising
When monitoring to be continuously shot at least two picture frames there are when flasher in shooting preview picture；
The first picture frame and the second picture frame are determined from least two picture frame；Wherein, the first image frame includes
The picture frame that the flasher is shot when lighting, second picture frame include the image shot when the flasher extinguishes
Frame；
The first image frame and second picture frame are merged, target image frame is obtained.
2. the method according to claim 1, wherein determining the first picture frame from least two picture frame
With the second picture frame, comprising:
At least two picture frame is input in picture frame detection model trained in advance；
According to the output of described image frame detection model as a result, determining the first picture frame at least two picture frame and the
Two picture frames.
3. according to the method described in claim 2, it is characterized in that, in monitoring shooting preview picture there are flasher it
Before, further includes:
Obtain sample image frame, wherein the sample image frame includes the picture frame shot when flasher is lighted and scintillation light
The picture frame that source is shot when extinguishing；
The image status information of the sample image frame is denoted as to the sample labeling of the sample image frame, wherein described image
Status information includes that flasher is lighted and flasher extinguishing；
According to the sample image frame and corresponding sample labeling, default machine learning model is trained, generates the figure
As frame detection model.
4. the method according to claim 1, wherein determining the first picture frame from least two picture frame
With the second picture frame, comprising:
At least two picture frame is shown according to predetermined manner；
According to user to the selection result of at least two picture frame of display, the is determined from least two picture frame
One picture frame and the second picture frame.
5. the method according to claim 1, wherein when monitoring that there are flashers in shooting preview picture
When, it is continuously shot at least two picture frames, comprising:
Shooting preview picture is obtained, and obtains the fuzziness of the shooting preview picture；
When the fuzziness is greater than preset threshold, flasher detection is carried out to the shooting preview picture；
When detecting in the shooting preview picture there are when flasher, it is continuously shot at least two picture frames.
6. the method according to claim 1, wherein described monitor that there are scintillation lights in shooting preview picture
Source, comprising:
If the luminance information of continuous at least two field pictures changes in shooting preview picture, the shooting preview is monitored
There are flashers in picture.
7. -6 any method according to claim 1, which is characterized in that the first image frame and second image
Frame is merged, and target image frame is obtained, comprising:
The first image frame and second picture frame are carried out based on Pixel-level blending algorithm and/or feature-based fusion algorithm
Fusion generates target image frame.
8. a kind of image processing apparatus characterized by comprising
Picture frame shooting module, for when monitoring to be continuously shot at least two there are when flasher in shooting preview picture
Picture frame；
Picture frame determining module, for determining the first picture frame and the second picture frame from least two picture frame；Wherein,
The first image frame includes the picture frame shot when the flasher is lighted, and second picture frame includes the scintillation light
The picture frame that source is shot when extinguishing；
Picture frame Fusion Module obtains target image for merging to the first image frame and second picture frame
Frame.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor
The image processing method as described in any in claim 1-7 is realized when row.
10. a kind of mobile terminal, which is characterized in that including memory, processor and storage are on a memory and can be in processor
The computer program of operation, the processor realize figure as claimed in claim 1 when executing the computer program
As processing method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811237687.5A CN109218621B (en) | 2018-10-23 | 2018-10-23 | Image processing method, device, storage medium and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811237687.5A CN109218621B (en) | 2018-10-23 | 2018-10-23 | Image processing method, device, storage medium and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109218621A true CN109218621A (en) | 2019-01-15 |
| CN109218621B CN109218621B (en) | 2021-03-12 |
Family
ID=64981425
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811237687.5A Active CN109218621B (en) | 2018-10-23 | 2018-10-23 | Image processing method, device, storage medium and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218621B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110248110A (en) * | 2019-06-28 | 2019-09-17 | Oppo广东移动通信有限公司 | Acquisition parameters setting method, setting device, terminal device and readable storage medium storing program for executing |
| CN111866383A (en) * | 2020-07-13 | 2020-10-30 | Oppo广东移动通信有限公司 | Image processing method, terminal and storage medium |
| CN112131414A (en) * | 2020-09-23 | 2020-12-25 | 北京百度网讯科技有限公司 | Signal lamp image labeling method and device, electronic equipment and road side equipment |
| CN112565595A (en) * | 2020-11-25 | 2021-03-26 | 西安闻泰电子科技有限公司 | Image jitter eliminating method, device, electronic equipment and storage medium |
| CN113271406A (en) * | 2020-02-14 | 2021-08-17 | 逐点有限公司 | Method and system for image processing with multiple image sources |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101394483A (en) * | 2007-09-19 | 2009-03-25 | 奥林巴斯映像株式会社 | Image capturing device and control method therefor |
| CN102356631A (en) * | 2010-01-29 | 2012-02-15 | 索尼公司 | Image processing device, signal processing device, and program |
| CN104103053A (en) * | 2013-11-25 | 2014-10-15 | 北京华科创智健康科技股份有限公司 | Electronic endoscope image enhancement method and device |
| CN105659583A (en) * | 2013-12-04 | 2016-06-08 | 索尼公司 | Image processing device, image processing method, electronic apparatus, and program |
| CN105704352A (en) * | 2014-12-12 | 2016-06-22 | Smk株式会社 | imaging device |
| CN105847705A (en) * | 2016-04-07 | 2016-08-10 | 广东欧珀移动通信有限公司 | Method and device for adjusting camera exposure time |
| CN105911799A (en) * | 2016-05-18 | 2016-08-31 | 广州科易光电技术有限公司 | Rail transit contact network monitoring and light supplementing system and method |
| US20180077388A1 (en) * | 2015-04-09 | 2018-03-15 | Sony Corporation | Imaging device, imaging method, electronic apparatus, and onboard electronic apparatus |
-
2018
- 2018-10-23 CN CN201811237687.5A patent/CN109218621B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101394483A (en) * | 2007-09-19 | 2009-03-25 | 奥林巴斯映像株式会社 | Image capturing device and control method therefor |
| CN102356631A (en) * | 2010-01-29 | 2012-02-15 | 索尼公司 | Image processing device, signal processing device, and program |
| CN104103053A (en) * | 2013-11-25 | 2014-10-15 | 北京华科创智健康科技股份有限公司 | Electronic endoscope image enhancement method and device |
| CN105659583A (en) * | 2013-12-04 | 2016-06-08 | 索尼公司 | Image processing device, image processing method, electronic apparatus, and program |
| CN105704352A (en) * | 2014-12-12 | 2016-06-22 | Smk株式会社 | imaging device |
| US20180077388A1 (en) * | 2015-04-09 | 2018-03-15 | Sony Corporation | Imaging device, imaging method, electronic apparatus, and onboard electronic apparatus |
| CN105847705A (en) * | 2016-04-07 | 2016-08-10 | 广东欧珀移动通信有限公司 | Method and device for adjusting camera exposure time |
| CN105911799A (en) * | 2016-05-18 | 2016-08-31 | 广州科易光电技术有限公司 | Rail transit contact network monitoring and light supplementing system and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110248110A (en) * | 2019-06-28 | 2019-09-17 | Oppo广东移动通信有限公司 | Acquisition parameters setting method, setting device, terminal device and readable storage medium storing program for executing |
| CN113271406A (en) * | 2020-02-14 | 2021-08-17 | 逐点有限公司 | Method and system for image processing with multiple image sources |
| CN113271406B (en) * | 2020-02-14 | 2023-12-08 | 逐点有限公司 | Method and system for image processing with multiple image sources |
| CN111866383A (en) * | 2020-07-13 | 2020-10-30 | Oppo广东移动通信有限公司 | Image processing method, terminal and storage medium |
| CN112131414A (en) * | 2020-09-23 | 2020-12-25 | 北京百度网讯科技有限公司 | Signal lamp image labeling method and device, electronic equipment and road side equipment |
| CN112565595A (en) * | 2020-11-25 | 2021-03-26 | 西安闻泰电子科技有限公司 | Image jitter eliminating method, device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109218621B (en) | 2021-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109120863A (en) | Image pickup method, device, storage medium and mobile terminal | |
| CN109218621A (en) | Image processing method, device, storage medium and mobile terminal | |
| CN108986199B (en) | Virtual model processing method and device, electronic equipment and storage medium | |
| CN108712606B (en) | Reminding method, device, storage medium and mobile terminal | |
| CN112767285B (en) | Image processing method and device, electronic device and storage medium | |
| CN108566516B (en) | Image processing method, device, storage medium and mobile terminal | |
| CN111480333B (en) | Light supplementing photographing method, mobile terminal and computer readable storage medium | |
| CN109951595A (en) | Intelligence adjusts method, apparatus, storage medium and the mobile terminal of screen intensity | |
| CN109685746A (en) | Brightness of image method of adjustment, device, storage medium and terminal | |
| CN107409171A (en) | Use the flicker detection of semiconductor light source | |
| CN110246110B (en) | Image evaluation method, device and storage medium | |
| CN109741281A (en) | Image processing method, device, storage medium and terminal | |
| CN108494996B (en) | Image processing method, device, storage medium and mobile terminal | |
| CN113596344B (en) | Shooting processing method, shooting processing device, electronic equipment and readable storage medium | |
| CN108881730A (en) | Image interfusion method, device, electronic equipment and computer readable storage medium | |
| CN107025441B (en) | Skin color detection method and device | |
| CN109729281A (en) | Image processing method, device, storage medium and terminal | |
| CN108551552A (en) | Image processing method, device, storage medium and mobile terminal | |
| CN108881875A (en) | Image white balancing treatment method, device, storage medium and terminal | |
| CN109544503B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN108765380A (en) | Image processing method, device, storage medium and mobile terminal | |
| CN112950525A (en) | Image detection method and device and electronic equipment | |
| CN108683845A (en) | Image processing method, device, storage medium and mobile terminal | |
| TW201533704A (en) | Image processing method and image processing device | |
| CN112153292A (en) | Shooting method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |