CN107566723B - A kind of image pickup method, mobile terminal and computer readable storage medium - Google Patents

Abstract

The present invention provides a kind of image pickup method, mobile terminal and computer readable storage mediums, are related to field of communication technology.Image pickup method, mobile terminal and computer readable storage medium provided in an embodiment of the present invention, one frame preview image of available camera acquisition, then the shooting main body in the preview image is determined, then the shooting main body can be based on, N images for controlling camera shooting different focal point, are then based on this N images, determine shooting body region, transitional region and background area, finally based on shooting body region, virtualization processing is carried out to transitional region and the background area.By determining that shooting body region, transitional region and background area are blurred in the embodiment of the present invention, wherein, what transitional region indicated is the part that can not determine shooting main body or shooting background, and then influence of the region division error to virtualization effect is avoided, improve the effect of image virtualization.

Description

A kind of image pickup method, mobile terminal and computer readable storage medium

Technical field

The present embodiments relate to fields of communication technology more particularly to a kind of image pickup method, mobile terminal and computer can Read storage medium.

Background technique

Currently, mobile terminal more becomes a part indispensable in people's life with the fast development of science and technology.With Family is often taken pictures using mobile terminal, and in order to bring the better usage experience of user, mobile terminal would generally be to shooting Image carry out virtualization processing, will be background blurring, shoot main body with prominent.

The prior art is first to obtain the depth of view information of image, then determines shooting body region and background according to depth of view information Region finally carries out virtualization processing to background area, still, realizes that the depth of view information for obtaining image needs for mobile terminal setting Multiple cameras cause to blur higher cost, while when determining shooting body region, being easy to appear and determining asking for inaccuracy The partial region for shooting main body is either divided by topic for example, the partial region of background area is determined as shooting main body Into background area, in this way, background area cannot be blurred completely, either, main body will be shot when will lead to virtualization Partial region virtualization, influence blur effect.

Summary of the invention

The embodiment of the present invention provides a kind of photographic method, mobile terminal and computer readable storage medium, existing to solve The virtualization of technology is at high cost and blurs the problem of error of region division influences virtualization effect.

In a first aspect, the embodiment of the invention provides a kind of image pickup method, it, should applied to the mobile terminal including camera Method includes:

Obtain a frame preview image of camera acquisition；

Determine the shooting main body in the preview image；

Based on the shooting main body, N images of camera shooting different focal point are controlled；

Based on the N images, shooting body region, transitional region and background area are determined；

Based on the shooting body region, virtualization processing is carried out to the transitional region and the background area；

Wherein, N is greater than or equal to 2.

Second aspect, the embodiment of the invention provides a kind of mobile terminal, which includes:

Module is obtained, for obtaining a frame preview image of camera acquisition；

First determining module, for determining the shooting main body in the preview image；

Shooting module, for being based on the shooting main body, N images of control camera shooting different focal point；

Second determining module, for determining shooting body region, transitional region and background area based on the N images；

Blurring module carries out the transitional region and the background area empty for being based on the shooting body region Change processing；

Wherein, N is greater than or equal to 2.

The third aspect the embodiment of the invention also provides a kind of mobile terminal, including processor, memory and is stored in institute The computer program that can be run on memory and on the processor is stated, when the computer program is executed by the processor It realizes such as the step of image pickup method provided by the invention.

Fourth aspect, the embodiment of the invention also provides a kind of readable storage medium storing program for executing, the instruction in the storage medium When being executed by the processor of electronic equipment, so that electronic equipment is able to carry out such as the step of image pickup method provided by the invention.

In embodiments of the present invention, a frame preview image of the available camera acquisition of mobile terminal, then determining should Shooting main body in preview image can then be based on the shooting main body, and the N of control camera shooting different focal point opens images, This N images are then based on, determine shooting body region, transitional region and background area, it is right finally based on shooting body region Transitional region and the background area carry out virtualization processing.In compared to the prior art, background area is marked off according to depth of view information Domain and shooting body region carry out the mode of virtualization processing, are not necessarily to be divided according to depth of view information in the embodiment of the present invention, this Sample, mobile terminal only need to configure single camera, save virtualization cost, while can determine whether out to clap in the embodiment of the present invention It takes the photograph body region, transitional region and background area to be blurred, wherein what transitional region indicated is that can not determine it is shooting master The part of body or shooting background is exactly to be easy the region accidentally divided, and then avoid region division error and imitate to virtualization The influence of fruit improves the effect of image virtualization.

The above description is only an overview of the technical scheme of the present invention, in order to better understand the technical means of the present invention, And it can be implemented in accordance with the contents of the specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, the followings are specific embodiments of the present invention.

Detailed description of the invention

By reading the following detailed description of the preferred embodiment, various other advantages and benefits are common for this field Technical staff will become clear.The drawings are only for the purpose of illustrating a preferred embodiment, and is not considered as to the present invention Limitation.And throughout the drawings, the same reference numbers will be used to refer to the same parts.In the accompanying drawings:

Fig. 1 is a kind of step flow chart of image pickup method provided in an embodiment of the present invention；

Fig. 2-1 is the step flow chart of another image pickup method provided in an embodiment of the present invention；

Fig. 2-2 is a kind of body profile schematic diagram provided in an embodiment of the present invention；

Fig. 2-3 is a kind of first alternative shooting body region provided in an embodiment of the present invention and the second alternative shooting body region The comparison diagram in domain；

Fig. 2-4 is the provided in an embodiment of the present invention another first alternative shooting body region and the second alternative shooting main body The comparison diagram in region；

Fig. 2-5 is a kind of virtualization schematic diagram provided in an embodiment of the present invention；

Fig. 3 is a kind of block diagram of mobile terminal provided in an embodiment of the present invention；

Fig. 4-1 is the block diagram of another mobile terminal provided in an embodiment of the present invention；

Fig. 4-2 is the provided in an embodiment of the present invention a kind of first block diagram for determining submodule；

Fig. 4-3 is the provided in an embodiment of the present invention a kind of second block diagram for determining submodule；

Fig. 5 is the block diagram of the mobile terminal of another embodiment of the present invention；

Fig. 6 is the structural schematic diagram of the mobile terminal of another embodiment of the present invention.

Specific embodiment

The exemplary embodiment that the present invention will be described in more detail below with reference to accompanying drawings.Although showing the present invention in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the present invention without should be by embodiments set forth here It is limited.It is to be able to thoroughly understand the present invention on the contrary, providing these embodiments, and can be by the scope of the present invention It is fully disclosed to those skilled in the art.

Fig. 1 is a kind of step flow chart of image pickup method provided in an embodiment of the present invention, as shown in Figure 1, this method can be with Include:

Step 101, the frame preview image for obtaining camera acquisition.

In embodiments of the present invention, user can use the mobile terminal including camera and shoot, exemplary, when with When the camera applications of mobile terminal are opened at family, user can acquire the picture in current environment by the camera of the mobile terminal Face, at this point, the collected picture of camera is preview image.Mobile terminal can be by obtaining the collected picture of camera To realize the frame preview image for obtaining camera acquisition.

Step 102 determines shooting main body in the preview image.

In embodiments of the present invention, user is when shooting, by that would generally include clapping in the picture of camera acquisition Main body and shooting background are taken the photograph, that is, is exactly, will include shooting main body and shooting background in preview image.Wherein, shooting main body is User wants part outstanding when shooting, and shooting main body can be people, animal or building etc..In practical application, in advance The shooting main body look in image can be one or more.

It is exemplary, it is assumed that Xiao Ming wants photo of the one small red station of shooting before a piece of forest, the preview graph obtained at this time As in, it is shown that small red picture of the station before forest, in the preview image it is small it is red be shooting main body, small red behind it is gloomy Woods is shooting background；Assuming that Xiao Ming wants photo of the one small red and small pornographic Web site of shooting before a piece of forest, obtain at this time In preview image, it is shown that picture of the small red and small pornographic Web site before forest, the small red and little Huang in the preview image is to clap Main body is taken the photograph, the small red and behind little Huang forest is shooting background.

Step 103 is based on the shooting main body, N images of control camera shooting different focal point.

In embodiments of the present invention, when focus refers to mobile terminal control camera shooting, the focus point of shooting picture. It is shot specifically, mobile terminal can control camera using each shooting main body as focus, also can control and take the photograph As head is shot by focus of shooting background, N images are obtained.

Wherein, N is integer more than or equal to 2, and the particular number of N can be to be determined by the number of shooting main body.Show Example, when in preview image including 1 shooting main body, mobile terminal can control camera and clap by focus of the shooting main body An image is taken the photograph, then shoots an image, and then available two images by focus of shooting background；When being wrapped in preview image When including 2 shooting main bodys, it is that focus shoots an image that mobile terminal, which can control camera to shoot main body 1, to shoot master Body 2 is that focus shoots an image, then shoots an image, and then available three images by focus of shooting background.

Step 104 opens images based on the N, determines shooting body region, transitional region and background area.

In embodiments of the present invention, mobile terminal can be opened in images based on this N, to shoot image of the main body as focus, It determines the first alternative shooting body region, then utilizes to shoot main body as the image of focus and using shooting background as focus Image determines the second alternative shooting body region, wherein alternative shooting body region indicates that there may be the areas of shooting main body Domain, the alternative body region that shoots may be not exclusively corresponding with shooting main body.For example, including alternatively complete in shooting body region It shoots except main body, it is also possible to it will include part shooting background, it is finally alternative based on the first alternative shooting body region and second Shooting body region determines shooting body region, transitional region and background area.

Wherein, what shooting body region indicated is the part for the shooting main body for including in the region, what transitional region indicated It is that can not determine that include is the part of shooting main body or shooting background, the region Zhong Bao that background area indicates in the region What is contained is the part of shooting background.

Step 105 is based on the shooting body region, carries out at virtualization to the transitional region and the background area Reason.

In the embodiment of the present invention, background area can be blurred completely, gradual change virtualization is carried out to transitional region.Due to It can not clearly be the region for shooting main body or shooting background that transitional region indicated, which is, that is, be exactly, and be possible in transitional region It is shooting background, it may be possible to shoot main body, it is also possible to both comprising shooting main body or including shooting background.If directly to mistake Region to be crossed to be blurred, the shooting main body that may result in transitional region is blurred, if do not blurred to transitional region, May result in the shooting background in transitional region cannot blur, and can all make image virtualization effect poor in this way.The present invention By carrying out gradual change virtualization to transitional region in embodiment, in this way, the shooting background in transitional region can be made to be blurred, Simultaneously as the effect of gradual change virtualization compares naturally, in this way it is also possible that the shooting main body in transitional region is shown naturally, phase It is blurred compared with the shooting body region for being accidentally divided into shooting background in the prior art, or is accidentally divided into shooting main body Shooting background do not blurred, and then lead to the situation of image virtualization effect difference, pass through in the embodiment of the present invention and determine to clap Body region, transitional region and background area are taken the photograph, the mode then blurred to transitional region and background area can mention The effect of hi-vision virtualization.

In conclusion a kind of image pickup method provided in an embodiment of the present invention, a frame preview of available camera acquisition Then image determines the shooting main body in the preview image, can then be based on the shooting main body, and control camera shooting is different The N of focus images are then based on this N images, determine shooting body region, transitional region and background area, are finally based on Body region is shot, virtualization processing is carried out to transitional region and the background area.In compared to the prior art, believed according to the depth of field Breath marks off background area and shoots the mode that body region carries out virtualization processing, without being believed according to the depth of field in the embodiment of the present invention Breath is divided, in this way, mobile terminal only needs to configure single camera, saves virtualization cost, while the present invention is implemented It can determine whether out that shooting body region, transitional region and background area is blurred in example, wherein what transitional region indicated is nothing Method determination is the part for shooting main body or shooting background, that is, is exactly, and is easy the region accidentally divided, and then avoids region and draw Error is divided to improve the effect of image virtualization to the influence of virtualization effect.

Fig. 2-1 is the step flow chart of another image pickup method provided in an embodiment of the present invention, as shown in Fig. 2-1, the party Method may include:

Step 201, the frame preview image for obtaining camera acquisition.

The implementation of this step is similar with the realization process of above-mentioned steps 101, and this will not be detailed here for the embodiment of the present invention.

Step 202 determines shooting main body in the preview image.

The implementation of this step is similar with the realization process of above-mentioned steps 102, and this will not be detailed here for the embodiment of the present invention.

Step 203 is based on the shooting main body, N images of control camera shooting different focal point.

Specifically, step 203 can pass through following sub-steps (1)~(2) Lai Shixian:

(1) control camera is shot using each shooting main body as focus, obtains N-1 the first images.

It is exemplary, it is artificial example to shoot main body, it is assumed that and there are two people, the two people are respectively " Zhang San " and " Li Si ", It is that focus is shot that so mobile terminal, which can control camera to have with " Zhang San ", obtains the first image a, is coke with " Li Si " Point is shot, and the first image b is obtained, so available two the first images in total.It wherein, is focus shooting with " Zhang San " The first image a in, " Zhang San " is clearest, and shooting background and " Li Si " are more fuzzy compared to " Zhang San "；It is coke with " Li Si " First image b electric " Li Si " of point shooting is clearest, and shooting background and " Zhang San " are more fuzzy compared to " Li Si ".Due to user When taking pictures, the face for the people that region is generally concentrated is paid close attention to, therefore, mobile terminal can be to the picture that camera is got Face carries out Face datection, if detecting face, shoots the first image by focus of the face.It, can using face as focus So that the face in the first obtained image is more prominent, user experience is improved.Specific Face datection mode can refer to Implementation in the prior art, this will not be repeated here for the embodiment of the present invention.

(2) control camera is shot using shooting background as focus according to the maximum focus value of the mobile terminal, Obtain second image.

It is exemplary, it is assumed that photographed scene is that " Zhang San " and " Li Si " stand before a piece of forest, shoot main body for " Zhang San " and " Li Si ", shooting background are " forest ", and the maximum focus value of mobile terminal is 5 millimeters (millimeter, mm), then mobile whole End can control camera using forest as focus, sets 5mm for focal length value and shoots, obtains the second image, wherein obtain The second image in, shooting background " forest " is clearest, shoot main body " Zhang San " and " Li Si " compared to shooting background " forest " It is more fuzzy.In the embodiment of the present invention, the second image is shot with the maximum focus value of mobile terminal, it is ensured that second obtained Readability in image as the shooting background of focus reaches maximum, and the fog-level for shooting main body reaches maximum, and then To optimal second image of effect.

Step 204 opens the first images according to the N-1, determines the first alternative shooting body region.

Specifically, step 204 can pass through following sub-steps (3)~(6) Lai Shixian:

(3) corresponding first preview image of each the first image is obtained, N-1 the first preview images are obtained.

Wherein, the characteristics of image of the first preview image and the first image is identical, in this way, user visually experience The content of one preview image and the first image be it is the same, still, the number of the data volume of the first preview image less than the first image According to amount.When specific acquisition, for the first image of each of first image, the timestamp in first image can be first obtained, Then data corresponding with the timestamp are obtained in the preview data stream of mobile terminal, and then it is corresponding to obtain first image First preview image, it is exemplary, it is assumed that have two the first images, this two first images are respectively the first image a and the second figure As b, then it is corresponding that the first image b can be obtained with the corresponding first preview image a1 of the available first image a of mobile terminal First preview image b1 obtains two the first preview images.Since the data volume of the first preview image is smaller, the present invention is real It applies by obtaining the first preview image identical with the first image characteristics of image in example, using the first preview image as operation pair As so that mobile terminal spends less system resource that the processing to the first image can be realized, in turn in subsequent processes Improve the response speed of system.

(4) characteristic point label is carried out to each first preview image.

It is exemplary, characteristic point mark can be carried out to the first preview image a1 and the first preview image b1 respectively in this step Note.When carrying out characteristic point label, it can use preset contour detecting algorithm and characteristic point carried out to each first preview image Label, the preset contour detecting algorithm can be based on Roberts operator, prewitt operator, sobel operator or La Pula The contour detecting algorithm of this operator, the embodiment of the present invention are not construed as limiting this.

Further, it can be determined in the preview image by carrying out characteristic point label to the first preview image by conduct The profile of the shooting main body of focus, for example, it is assumed that there are two shooting main bodys " Zhang San " and " Li Si ", first are pre- in photographed scene It is that focus is shot that the image a1 that lookes at, which is to shoot main body " Zhang San ", and the first preview image b1 is to shoot main body " Li Si " and be What focus was shot, then, by carrying out characteristic point label to the first preview image a1, it can determine that shooting main body " is opened Three " profile can determine the profile of shooting main body " Li Si " by marking to the first preview image b1 row characteristic point.Its In, characteristic point refers to that boundary's point for indicating feature locations, different feature locations can define the specific of different characteristic point Feature.

When carrying out characteristic point label using preset contour detecting algorithm, it can first define the preset contour detecting and calculate The characteristic point of different characteristic position in method, the contour detecting algorithm after then recycling definition carry out characteristic point label.It is defining When characteristic point, the location of the critical feature size of shot subject can be defined as characteristic point.It is to shoot main body For human body, for example, the characteristic point of crown position can be defined as human body highest point, the characteristic point of waist location can be defined as First Point, etc. at torso portion perimeter minimum.

In practical application, before carrying out characteristic point label, gray processing processing first can be carried out to the first preview image.Its In, gray processing processing is the process that color image is converted to gray level image, carries out the gray level image obtained after gray processing processing Also the distribution and feature of the entirety of entire image and the coloration of part and brightness degree are able to reflect.By the way that color image is turned It is changed to gray level image, the subsequent calculation amount being directed to when the first preview image is handled can be made to become less.

After obtaining gray level image, binary conversion treatment can also be carried out to the gray level image, that is, be exactly by the grayscale image The gray value of each pixel is set as 0 or 255 as in, and whole image is made to show apparent black and white effect.At binaryzation The binary image obtained after reason still is able to reflection image entirety and local feature.Due to the ash of pixel in binary image Angle value only has 0 or 255, and the rank of grey scale pixel value is few, thus data processing and decrement it is small, and then by the first preview graph As being handled again after being converted to binary image, processing operation can be made simpler.

(5) characteristic point marked in each first preview image is connected, obtains each first preview image In body profile.

It is exemplary, it is assumed that mark to have obtained 35 characteristic points by carrying out characteristic point to the first preview image a1, then can 35 characteristic points are sequentially connected with, the profile for shooting main body " Zhang San " in the first preview image a1 is obtained.Assuming that by One preview image b1 carries out characteristic point and marks to have obtained 30 characteristic points, then can be sequentially connected with 30 characteristic points, obtains The profile of main body " Li Si " is shot in first preview image b1.

(6) each body profile area encompassed is determined as the first alternative shooting body region.

It is exemplary, it is assumed that the profile area encompassed of shooting main body " Zhang San " is region Z1, shooting main body " Li Si " Profile area encompassed is region Z2, then region Z1 and region Z2 can be determined as to the first alternative shooting body region Domain.Fig. 2-2 is a kind of body profile schematic diagram provided in an embodiment of the present invention, and as shown in Fig. 2-2, a1 indicates the first preview graph Picture, b1 indicate the second preview image, and be taken in profile the area encompassed Z1, b1 of main body " Zhang San " main body that is taken in a1 The profile area encompassed Z2 of " Li Si " is the first alternative shooting body region.

Step 205 opens the first image and second images according to the N-1, determines the second alternative shooting body region.

Specifically, step 205 can pass through following sub-steps (7)~(11) Lai Shixian:

It (7), will be in first preview image for every first preview image in the N-1 the first preview images The region that clarity is greater than preset threshold is determined as comparing subregion, obtains N-1 comparison subregion.

It is exemplary, it is assumed that have two the first preview images, this two first preview images are respectively the first preview image a1 And the first preview image b1, in this step, the region that clarity in the first preview image a1 can be greater than preset threshold is true It is set to comparison subregion, the region that clarity in the first preview image b1 is greater than preset threshold is determined as to compare subregion, is obtained To two comparison subregions.

Specifically, the step of determining comparison subregion may include:

A1, the subregion that first preview image is divided into E F*F.

Preferably, the size of the subregion be length and width be 3 pixels length and, that is, the subregion table of F*F The pixel region being made of 3*3 pixel shown.Assuming that first preview image is made of 120X120 pixel, then right First preview image is divided, available 40 subregions being made of 3X3 pixel.

B1, according to the gray value of each pixel in the subregion of each F*F, calculate the subregion of each F*F Clarity.

In this step, the clarity of the subregion of each F*F can be calculated.It is exemplary, it is assumed that have obtained 40 by dividing The subregion of a F*F, then the clarity of the subregion of each F*F in the subregion of 40 F*F can be calculated separately.

Specifically, the gray value of the pixel and eight neighborhood territory pixels can be calculated to each pixel in the subregion of F*F Absolute value of the difference, and according to distance be weighted determine the F*F subregion clarity.Specifically, according to away from When from the clarity for determining the subregion of the F*F is weighted, it can be calculated according to following calculation formula:

Wherein, D indicates the clarity of the subregion of the F*F, and df indicates grey scale change amplitude, and dx indicates the distance between pixel Increment, MXN indicate area size, and M indicates the line number of the subregion of F*F, and N indicates the columns of the subregion of F*F.

The region that C1, the subregion that clarity is greater than to the F*F of preset threshold form is determined as comparing subregion.

In this step, which can be determines according to experiment.It is exemplary, it can first obtain multiple shootings Main body is clear and image that shooting background is fuzzy is as sample image；Then the shooting body region in each sample image is drawn It is divided into multiple subgraphs；Then the clarity average value that body region is shot in each sample image is calculated；Then it is more to calculate this The clarity average value of body region is shot in a sample image.It is exemplary, body region is shot in calculating sample image When clarity average value, the clarity of the corresponding each subgraph in the sample image region can be calculated, multiple clarity are obtained Then value calculates the clarity average value of shooting body region according to this multiple definition values.

When determining comparison subregion, the clarity of the subregion of each F*F and the preset threshold can be carried out Comparison.It is exemplary, it is assumed that the preset threshold is 7, then can be true greater than the region of the subregion composition of 7 F*F by clarity It is set to comparison subregion.Due to shooting that main body is clear in the first preview image and shooting background is fuzzy, it can be considered that by big Corresponding in the comparison subregion of the subregion composition of the F*F of preset threshold may be some shooting main body.

It is exemplary, the region that clarity in the first preview image a1 is greater than preset threshold can be determined as comparing subregion A11, by clarity in the first preview image b1 be greater than preset threshold region be determined as compare subregion b11, obtain two it is right Compare subregion.Wherein, it may be shooting main body " Zhang San ", the corresponding possibility of comparison subregion b11 that comparison subregion a11 is corresponding It is shooting main body " Li Si ".

(8) the N-1 comparison subregion is combined, obtains first area.

In this step, above-mentioned comparison subregion a11 and comparison subregion b11 can be determined as first area, i.e., just It is first area include all shooting main bodys " Zhang San " and " Li Si " in photographed scene.

(9) corresponding second preview image of second image is obtained.

Wherein, the characteristics of image of the second preview image and the second image is identical, in this way, user visually experience The content of two preview images and the second image be it is the same, still, the number of the data volume of the second preview image less than the second image According to amount.Specifically, the method for obtaining the second preview image in this step can be with reference to the realization process in above-mentioned steps, due to the The data volume of two preview images is smaller, therefore by obtaining and the second image characteristics of image identical second in the embodiment of the present invention Preview image, using the second preview image as operation object, so that mobile terminal spends less system in subsequent processes The processing to the second image can be realized in resource, and then improves the response speed of system.

(10) region that clarity in second preview image is less than preset threshold is determined as second area.

Specifically, the step of determining second area may include:

A2, the subregion that second preview image is divided into M N*N.

When dividing to the second preview image, division mode identical with the first preview image is divided can be used, The size of the subregion can be identical with the sub-district domain sizes in the first preview image, it is preferred that the size of the subregion can be with For length and width be 3 pixels length and, that is, the pixel region of the sub-district domain representation of N*N being made of 3*3 pixel Domain.Assuming that second preview image is made of 120X120 pixel, then being divided to second preview image, can obtain The subregion being made of to 40 3*3 pixel.

B2, according to the gray value of each pixel in the subregion of each N*N, calculate the subregion of each N*N Clarity.

It is exemplary, it is assumed that the subregion of 40 N*N have been obtained by dividing, then can calculate separately 40 N*N's The clarity of the subregion of each N*N in subregion.

Specifically, the process for calculating the clarity of the subregion of N*N can be with reference to the calculating process in above-mentioned steps, this hair This will not be repeated here for bright embodiment.

The region that C2, the subregion by clarity no more than the N*N of preset threshold form is determined as second area.

When determining second area, the clarity of the subregion of each N*N and the preset threshold can be carried out pair Than.It is exemplary, it is assumed that the preset threshold is 7, then can be true no more than the region of the subregion composition of 7 N*N by clarity It is set to second area.Due in the second preview image shoot main body " Zhang San " and " Li Si " obscure and shooting background is clear, It is considered that by the N*N no more than preset threshold the second area that forms of subregion it is corresponding may be shooting main body " Zhang San " " Li Si ".

(11) first area and the second area are subjected to area comparison, determine the second alternative shooting body region Domain.

It is exemplary, if the area of the first area is less than or equal to the area of the second area, by described first Region is determined as the second alternative shooting body region.For example, the area of first area is 100, the area of second area is 101, Since 100 less than 101, first area can be determined as to the second alternative shooting body region.

If the area of the first area is greater than the area of the second area, by the second area described first Corresponding region is determined as the second alternative shooting body region in region.For example, the area of first area is 100, second area Area be 97, since 100 are greater than 97, can be exactly by second area corresponding region in the first region, by the The region that area corresponding with second area is 97 in one region is determined as the second alternative shooting body region.

Since first area is to determine may to be the region for shooting main body based on multiple first images, second area be The possibility determined based on second image is to shoot the region of main body, by by first area and the secondth area in this step Domain carries out area comparison, to determine the second alternative shooting body region, in this way, alternatively shooting body region just has second obtained Maximum Possibility indicates the region where shooting main body.

Step 206, the area for being overlapped the described first alternative shooting body region with the described second alternative shooting body region Domain is determined as the shooting body region.

Exemplary, Fig. 2-3 is a kind of first alternative shooting body region provided in an embodiment of the present invention and the second alternative bat Take the photograph the comparison diagram of body region, in Fig. 2-3, being greater than the first alternative shooting body region with the second alternative shooting body region is Example.Wherein, bold portion indicates that the first profile for alternatively shooting body region, dotted portion indicate the second alternative shooting body region The profile in domain, it is visible in Fig. 2-3 since the first alternative shooting body region and the second alternative shooting body region partially overlap Dotted portion indicates the region that the two is not overlapped, and the alternative shooting body region of region X expression first and second that dot covers are standby The region that choosing shooting body region is overlapped, region X can be determined as shooting body region.Fig. 2-3 shows photographed scene In include two shooting main body scenes, therefore, it can be seen that shooting body region X by figure two shooting main bodys in dot Overlay area composition.

Described first alternative shooting body region is alternatively shot what body region was not overlapped with described second by step 207 Region is determined as the transitional region.

Exemplary, Fig. 2-4 is that the provided in an embodiment of the present invention another first alternative shooting body region and second are alternative The comparison diagram for shooting body region, the region between dotted line and solid line in Fig. 2-4 indicate first alternatively shooting body region and Region Y can be determined as transitional region by the region that the alternative shooting area of the second main body is not overlapped.

The overlapping region of the two, which can consider, only includes shooting main body, and the not heavy youngster river reach domain of the two may include shooting Background, therefore, by comparing the first alternative shooting body region and the second alternative shooting body region, to mark off The mode of body region and transitional region is shot, the part that can there will likely be shooting background distinguishes.

Step 208 opens the first image, the shooting body region and the transitional regions according to the N-1, determines target Image.

User is generally intended to obtain the figure that each shooting main body is prominent and is clearly demonstrated when taking pictures Picture, in the embodiment of the present invention, the first image is to be shot to obtain using each shooting main body as focus, the first image each in this way In be all the shooting main body clearly illustrated as focus, be not in first image focus other shooting main bodys it is clear Effect will be weaker, therefore when having in photographed scene multiple shooting main bodys, the embodiment of the present invention can be according to above-mentioned steps In obtain N-1 the first images, shooting body region and transitional region, determine target image.Specifically, can be from the N- In 1 the first image, randomly choose an image, replaced respectively using the shooting body region and the transitional region described in Body region and the transitional region corresponding region in selected image are shot, target image is obtained.By way of replacement, The target image finally obtained can be allowed to protrude and clearly show each shooting main body.

It is exemplary, it is assumed that there is shooting main body " Zhang San " and " Li Si " in photographed scene, then two obtained the first figures As in, wherein the first image a clearly illustrates shooting main body " Zhang San ", the first image b to shoot main body " Zhang San " as focus To shoot main body " Li Si " as focus, clearly illustrates and shoot main body " Li Si ", in the embodiment of the present invention, can be randomly selected First image a, the shooting body region and transitional region then obtained using above-mentioned steps are replaced in the first image in a Corresponding part obtains target image, since the content of shooting body region and transitional region is clearly shooting main body " Zhang San " " Li Si " is in this way, target image can protrude and clearly show shooting main body " Zhang San " and " Li Si ".

It should be noted that if being exactly only to have taken first figure there is only a shooting main body in photographed scene When picture, first image directly can be determined as target image, the process of replacement be omitted, and then can save and be implemented as This.It further,, can not also be with each shooting main body there are when multiple shooting main bodys in photographed scene in practical application It is shot for focus, but is shot at random using some shooting main body as focus, obtain first image to be located Reason can reduce the workload of image procossing in this way, reduce cost of implementation, and still, randomly choosing a shooting main body is focus, The mode for shooting first image, will lead to the accuracy rate of the first alternative shooting body region determined based on the first image compared with It is low.

Step 209, by the target image except it is described shooting body region and the transitional region in addition to all figures As region is determined as background area.

It is exemplary, it is assumed that the shooting body region in target image is expressed as the region X, and transitional region is the region Y, then can To be determined as background area for all image-regions in target image in addition to the region X and the region Y.

In the embodiment of the present invention, when determining shooting body region, transitional region and background area, without obtaining Depth of view information, therefore mobile terminal only needs to configure a camera, the image pickup method that can be provided through the embodiment of the present invention Image virtualization is carried out, the manufacturing cost of mobile terminal is saved.

Step 210 is based on the shooting body region, carries out at virtualization to the transitional region and the background area Reason.

Specifically, can be blurred to the background area in the target image, and according to far from the shooting The direction of body region blurs the transitional region in a manner of gradually reinforcing virtualization degree outward.

Fig. 2-5 is a kind of virtualization schematic diagram provided in an embodiment of the present invention, and the region X of figure orbicular spot covering indicates shooting master Body region, the region Y of oblique line covering indicate transitional region, and white region indicates background area.It, can when being blurred It is blurred completely with the background area to white, then according to the direction far from region X, that is, is exactly, in figure indicated by arrow Direction m gradual change virtualization carried out to region Y, it is specific when carry out gradual change virtualization, can be according to gradually reinforcing virtualization degree Mode carry out gradual change virtualization.

Alternatively, being blurred to the background area in the target image, and according to far from the shooting body region The direction in domain blurs the transitional region in a manner of gradually weakening virtualization degree outward.

It is exemplary, the white area in Fig. 2-5 can also be blurred completely, according to indicated by arrow in Fig. 2-5 Direction m carries out gradual change virtualization to transitional region Y, when specifically carrying out gradual change virtualization, can be according to gradually decrease virtualization journey The mode of degree carries out gradual change virtualization.In practical application, specific gradual change virtualization mode can be arranged according to the actual situation, this hair Bright embodiment is not construed as limiting this.

In conclusion another kind image pickup method provided in an embodiment of the present invention, a frame of available camera acquisition is pre- It lookes at image, then determines the shooting main body in the preview image, can then be based on the shooting main body, the shooting of control camera is not Confocal N images are then based on this N images, determine shooting body region, transitional region and background area, last base In shooting body region, gradual change virtualization is carried out to transitional region, complete virtualization processing is carried out to the background area.Due to transition It may include part shooting background in region and partially shoot main body, in present invention implementation in such a way that gradual change blurs, make Include in transitional region shooting background can be blurred, since the effect of gradual change virtualization compares naturally, therefore the second quilt Taking the photograph the shooting main part for including in subregion can also show naturally, and then improve the effect of image virtualization.

Fig. 3 is a kind of block diagram of mobile terminal provided in an embodiment of the present invention, as shown in figure 3, the mobile terminal 30 includes:

Module 301 is obtained, for obtaining a frame preview image of camera acquisition.

First determining module 302, for determining the shooting main body in the preview image.

Shooting module 303, for being based on the shooting main body, N images of control camera shooting different focal point.

Second determining module 304, for determining shooting body region, transitional region and background area based on the N images Domain.

Blurring module 305 carries out the transitional region and the background area for being based on the shooting body region Virtualization processing；Wherein, N is greater than or equal to 2.

In conclusion a kind of mobile terminal provided in an embodiment of the present invention, obtains the available camera acquisition of module One frame preview image, then the first determining module can determine the shooting main body in the preview image, then can be with shooting module It can be based on the shooting main body, N images of control camera shooting different focal point, then the second determining module can be based on this N images determine shooting body region, transitional region and background area, and last blurring module can be based on shooting body region, Virtualization processing is carried out to transitional region and the background area.In compared to the prior art, background is marked off according to depth of view information Region and shooting body region carry out the mode of virtualization processing, are not necessarily to be divided according to depth of view information in the embodiment of the present invention, In this way, mobile terminal only needs to configure single camera, virtualization cost is saved, while can determine whether out in the embodiment of the present invention Shooting body region, transitional region and background area are blurred, wherein what transitional region indicated is that can not determine it is shooting The part of main body or shooting background is exactly to be easy the region accidentally divided, and then avoid region division error to virtualization The influence of effect improves the effect of image virtualization.

Fig. 4-1 is the block diagram of another mobile terminal provided in an embodiment of the present invention, as shown in Fig. 4-1, the mobile terminal 40 include:

Module 401 is obtained, for obtaining a frame preview image of camera acquisition.

First determining module 402, for determining the shooting main body in the preview image.

Shooting module 403, for being based on the shooting main body, N images of control camera shooting different focal point.

Second determining module 404, for determining shooting body region, transitional region and background area based on the N images Domain.

Blurring module 405 carries out the transitional region and the background area for being based on the shooting body region Virtualization processing；Wherein, N is greater than or equal to 2.

Optionally, as shown in Fig. 4-1, above-mentioned shooting module 403, comprising:

First shooting module 4031 is shot using each shooting main body as focus for controlling camera, is obtained To N-1 the first images.

Second shooting module 4032, for controlling camera using shooting background as focus, according to the mobile terminal Maximum focus value is shot, and second image is obtained；Wherein, the number of the shooting main body is N-1.

Optionally, as shown in Fig. 4-1, above-mentioned second determining module 404, comprising:

First determines submodule 4041, for determining the first alternative shooting body region according to the N-1 the first images Domain.

Second determines submodule 4042, for determining that second is standby according to the N-1 the first images and second images Choosing shooting body region.

Third determines submodule 4043, for according to the described first alternative shooting body region and the second alternative shooting Body region determines the shooting body region and the transitional region.

4th determines submodule 4044, for according to the N-1 the first images, the shooting body region and the mistakes Region is crossed, determines target image.

5th determines submodule 4045, for will remove the shooting body region and the transition region in the target image All image-regions except domain are determined as background area.

Optionally, the above-mentioned 4th submodule 4044 is determined, comprising:

Replacement unit, for randomly choosing an image, utilizing the shooting main body from the N-1 the first images Region and the transitional region replace the shooting body region and the transitional region corresponding area in selected image respectively Domain obtains target image.

Optionally, Fig. 4-2 is the provided in an embodiment of the present invention a kind of first block diagram for determining submodule, as shown in the Fig. 4-2, First determines submodule 4041, comprising:

First acquisition unit 4041a obtains N-1 for obtaining corresponding first preview image of each the first image Open the first preview image；

Marking unit 4041b, for carrying out characteristic point label to each first preview image；

Connection unit 4041c, the characteristic point connection for will mark in each first preview image, obtains each institute State the body profile in the first preview image；

First determination unit 4041d, for each body profile area encompassed to be determined as the first alternative bat Take the photograph body region；

Wherein, first preview image is identical with the characteristics of image of the first image, first preview image Data volume is less than the data volume of the first image.

Optionally, Fig. 4-3 is the provided in an embodiment of the present invention a kind of second block diagram for determining submodule, as shown in the Fig. 4-2, Above-mentioned second determines submodule 4042, comprising:

Second determination unit 4042a, for opening every first preview image in the first preview image for the N-1, The region that clarity in first preview image is greater than preset threshold is determined as to compare subregion, obtains N-1 comparison Region；

Assembled unit 4042b obtains first area for combining the N-1 comparison subregion；

Second acquisition unit 4042c, for obtaining corresponding second preview image of second image；

Third determination unit 4042d, the region for clarity in second preview image to be less than preset threshold are true It is set to second area；

Comparison unit 4042e determines that second is standby for the first area and the second area to be carried out area comparison Choosing shooting body region；

Wherein, second preview image is identical as the characteristics of image of second image, second preview image Data volume is less than the data volume of second image.

Optionally, above-mentioned second determination unit 4042a, is used for:

First preview image is divided into the subregion of E F*F；

According to the gray value of each pixel in the subregion of each F*F, the clear of the subregion of each F*F is calculated Clear degree；

It is determined as the region that clarity is greater than the subregion composition of the F*F of preset threshold to compare subregion.

Optionally, above-mentioned third determination unit 4042d, is used for:

Second preview image is divided into the subregion of M N*N；

According to the gray value of each pixel in the subregion of each N*N, the clear of the subregion of each N*N is calculated Clear degree；

The region of subregion composition by clarity no more than the N*N of preset threshold is determined as second area.

Optionally, above-mentioned comparison unit 4042e, is used for:

If the area of the first area is less than or equal to the area of the second area, the first area is determined For the second alternative shooting body region；

If the area of the first area is greater than the area of the second area, by the second area described first Corresponding region is determined as the second alternative shooting body region in region.

Optionally, above-mentioned third determines submodule 4043, comprising:

4th determination unit, for alternatively shooting body region and the described second alternative shooting body region by described first The region of coincidence is determined as the shooting body region；

5th determination unit, for alternatively shooting body region and the described second alternative shooting body region by described first The region not being overlapped is determined as the transitional region.

Optionally, above-mentioned blurring module 405, is used for:

The background area in the target image is blurred, and according to the side far from the shooting body region To, to the transitional region by gradually outward reinforce virtualization degree in a manner of blur；

Alternatively, being blurred to the background area in the target image, and according to far from the shooting body region The direction in domain blurs the transitional region in a manner of gradually weakening virtualization degree outward.

In conclusion the mobile terminal that the embodiment of the present invention four provides, obtains the one of the available camera acquisition of module Frame preview image, then the first determining module can determine the shooting main body in the preview image, then can with shooting module To be based on the shooting main body, N images of control camera shooting different focal point, then the second determining module can be based on this N Image to be opened, determines shooting body region, transitional region and background area, last blurring module can be based on shooting body region, Gradual change virtualization is carried out to transitional region, complete virtualization processing is carried out to the background area.Due to that may be wrapped in transitional region It includes part shooting background and partially shoots main body, in present invention implementation in such a way that gradual change blurs, so that being wrapped in transitional region The shooting background contained can be blurred, since the effect of gradual change virtualization compares naturally, therefore including in the second subregion shot Shooting main part can also show naturally, and then improve image virtualization effect.

The embodiment of the present invention also provides a kind of mobile terminal, including processor, and memory is stored on the memory simultaneously The computer program that can be run on the processor, the computer program realize above-mentioned shooting when being executed by the processor Each process of embodiment of the method, and identical technical effect can be reached, to avoid repeating, which is not described herein again.

The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium Calculation machine program, the computer program realize each process of above-mentioned image pickup method embodiment when being executed by processor, and can reach To identical technical effect, to avoid repeating, which is not described herein again.Wherein, the computer readable storage medium, it is such as read-only Memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access Memory, abbreviation RAM), magnetic or disk etc..

Fig. 5 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 500 shown in fig. 5 includes: at least One processor 501, memory 502, at least one network interface 504, user interface 503 and camera 506.Mobile terminal Various components in 500 are coupled by bus system 505.It is understood that bus system 505 for realizing these components it Between connection communication.Bus system 505 further includes power bus, control bus and status signal in addition to including data/address bus Bus.But for the sake of clear explanation, various buses are all designated as bus system 505 in Fig. 5.

Wherein, user interface 503 may include display, keyboard or pointing device (for example, mouse, trace ball (trackball), touch-sensitive plate or flexible screen etc..

It is appreciated that the memory 502 in the embodiment of the present invention can be volatile memory or nonvolatile memory, It or may include both volatile and non-volatile memories.Wherein, nonvolatile memory can be read-only memory (Read- Only Memory, ROM), programmable read only memory (Programmable ROM, PROM), the read-only storage of erasable programmable Device (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM) or Flash memory.Volatile memory can be random access memory (Random Access Memory, RAM), be used as external high Speed caching.By exemplary but be not restricted explanation, the RAM of many forms is available, such as static random access memory (Static RAM, SRAM), dynamic random access memory (Dynamic RAM, DRAM), Synchronous Dynamic Random Access Memory (Synchronous DRAM, SDRAM), double data speed synchronous dynamic RAM (Double Data Rate SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links Dynamic random access memory (Synchlink DRAM, SLDRAM) and direct rambus random access memory (Direct Rambus RAM, DRRAM).The memory 502 of the system and method for description of the embodiment of the present invention is intended to include but is not limited to these With the memory of any other suitable type.

In some embodiments, memory 502 stores following element, executable modules or data structures, or Their subset of person or their superset: operating system 5021 and application program 5022.

Wherein, operating system 5021 include various system programs, such as ccf layer, core library layer, driving layer etc., are used for Realize various basic businesses and the hardware based task of processing.Application program 5022 includes various application programs, such as media Player (Media Player), browser (Browser) etc., for realizing various applied business.Realize the embodiment of the present invention The program of method may be embodied in application program 5022.

In embodiments of the present invention, by the program or instruction of calling memory 502 to store, specifically, can be application The program or instruction stored in program 5022, processor 501 are used to obtain a frame preview image of camera acquisition；Described in determination Shooting main body in preview image；Based on the shooting main body, N images of camera shooting different focal point are controlled；Based on institute N images are stated, determine shooting body region, transitional region and background area；Based on the shooting body region, to the transition Region and the background area carry out virtualization processing；Wherein, N is greater than or equal to 2.

The N images, etc. for the instruction shooting different focal point that camera 506 is used to be sent according to processor 501.

The method that the embodiments of the present invention disclose can be applied in processor 501, or be realized by processor 501. Processor 501 may be a kind of IC chip, the processing capacity with signal.During realization, the above method it is each Step can be completed by the integrated logic circuit of the hardware in processor 501 or the instruction of software form.Above-mentioned processing Device 501 can be general processor, digital signal processor (Digital Signal Processor, DSP), dedicated integrated electricity Road (Application Specific Integrated Circuit, ASIC), ready-made programmable gate array (Field Programmable Gate Array, FPGA) either other programmable logic device, discrete gate or transistor logic, Discrete hardware components.It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.It is general Processor can be microprocessor or the processor is also possible to any conventional processor etc..In conjunction with institute of the embodiment of the present invention The step of disclosed method, can be embodied directly in hardware decoding processor and execute completion, or with the hardware in decoding processor And software module combination executes completion.Software module can be located at random access memory, and flash memory, read-only memory may be programmed read-only In the storage medium of this fields such as memory or electrically erasable programmable memory, register maturation.The storage medium is located at The step of memory 502, processor 501 reads the information in memory 502, completes the above method in conjunction with its hardware.

It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware, Microcode or combinations thereof is realized.For hardware realization, processing unit be may be implemented in one or more specific integrated circuits (Application Specific Integrated Circuits, ASIC), digital signal processor (Digital Signal Processing, DSP), digital signal processing appts (DSP Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field-Programmable Gate Array, FPGA), general place It manages in device, controller, microcontroller, microprocessor, other electronic units for executing herein described function or combinations thereof.

For software implementations, can by execute the embodiment of the present invention described in function module (such as process, function etc.) come Realize technology described in the embodiment of the present invention.Software code is storable in memory and is executed by processor.Memory can With portion realizes in the processor or outside the processor.

Optionally, the processor 501 is also used to: control camera is clapped using each shooting main body as focus It takes the photograph, obtains N-1 the first images；Camera is controlled using shooting background as focus, according to the maximum focal length of the mobile terminal Value is shot, and second image is obtained；Wherein, the number of the shooting main body is N-1.

Optionally, the processor 501 is also used to: according to the N-1 the first images, determining the first alternative shooting main body Region；According to the N-1 the first images and second images, the second alternative shooting body region is determined；According to described One alternative shooting body region and the second alternative shooting body region, determine the shooting body region and the transition region Domain；According to the N-1 the first images, the shooting body region and the transitional regions, target image is determined；By the mesh All image-regions in logo image in addition to the shooting body region and the transitional region are determined as background area.

Optionally, the processor 501 is also used to: from the N-1 the first images, randomly choosing an image, benefit The shooting body region and the transitional region are replaced respectively selected with the shooting body region and the transitional region Corresponding region, obtains target image in image.

Optionally, the processor 501 is also used to: being obtained corresponding first preview image of each the first image, is obtained To N-1 the first preview images；Characteristic point label is carried out to each first preview image；By each first preview graph The characteristic point connection marked as in, obtains the body profile in each first preview image；By each body profile Area encompassed is determined as the first alternative shooting body region；Wherein, first preview image and the first image Characteristics of image is identical, and the data volume of first preview image is less than the data volume of the first image.

Optionally, the processor 501 is also used to: for every first preview in the N-1 the first preview images The region that clarity in first preview image is greater than preset threshold is determined as comparing subregion by image, and it is a right to obtain N-1 Compare subregion；The N-1 comparison subregion is combined, first area is obtained；Obtain second image corresponding second in advance Look at image；The region that clarity in second preview image is less than preset threshold is determined as second area；By described first Region and the second area carry out area comparison, determine the second alternative shooting body region；Wherein, second preview image Identical as the characteristics of image of second image, the data volume of second preview image is less than the data of second image Amount.

Optionally, the processor 501 is also used to: first preview image is divided into the subregion of E F*F；Root According to the gray value of each pixel in the subregion of each F*F, the clarity of the subregion of each F*F is calculated；It will be clear The region that clear degree is greater than the subregion composition of the F*F of preset threshold is determined as comparing subregion.

Optionally, the processor 501 is also used to: second preview image is divided into the subregion of M N*N；Root According to the gray value of each pixel in the subregion of each N*N, the clarity of the subregion of each N*N is calculated；It will be clear The region that clear degree is less than the subregion composition of the N*N of preset threshold is determined as second area.

Optionally, the processor 501 is also used to: if the area of the first area is less than or equal to the second area Area, then the first area is determined as the second alternative shooting body region；If the area of the first area is greater than institute The area of second area is stated, then corresponding region is determined as the second alternative shooting in the first area by the second area Body region.

Optionally, the processor 501 is also used to: by the described first alternative shooting body region and the described second alternative bat The region for taking the photograph body region coincidence is determined as the shooting body region；By the described first alternative shooting body region and described the The region that two alternative shooting body regions are not overlapped is determined as the transitional region.

Optionally, the processor 501 is also used to: the background area in the target image is blurred, and According to the direction far from the shooting body region, the transitional region is carried out in a manner of gradually reinforcing virtualization degree outward Virtualization；Alternatively, being blurred to the background area in the target image, and according to far from the shooting body region Direction blurs the transitional region in a manner of gradually weakening virtualization degree outward.

Mobile terminal 500 can be realized each process that mobile terminal is realized in previous embodiment, to avoid repeating, here It repeats no more.

In the embodiment of the present invention, a frame preview image of the available camera of mobile terminal 500 acquisition, then determining should Shooting main body in preview image can then be based on the shooting main body, and the N of control camera shooting different focal point opens images, This N images are then based on, determine shooting body region, transitional region and background area, it is right finally based on shooting body region Transitional region and the background area carry out virtualization processing.In compared to the prior art, background area is marked off according to depth of view information Domain and shooting body region carry out the mode of virtualization processing, are not necessarily to be divided according to depth of view information in the embodiment of the present invention, this Sample, mobile terminal only need to configure single camera, save virtualization cost, while can determine whether out to clap in the embodiment of the present invention It takes the photograph body region, transitional region and background area to be blurred, wherein what transitional region indicated is that can not determine it is shooting master The part of body or shooting background is exactly to be easy the region accidentally divided, and then avoid region division error and imitate to virtualization The influence of fruit improves the effect of image virtualization.

Fig. 6 is the structural schematic diagram of the mobile terminal of another embodiment of the present invention.

The mobile terminal includes: processor, memory and is stored on the memory and can be on the processor The step of computer program of operation, the computer program realizes above-mentioned image pickup method when being executed by the processor.

The mobile terminal further include: computer program is stored on readable storage medium storing program for executing, the computer program is located The step of reason device realizes above-mentioned image pickup method when executing.

Specifically, the mobile terminal 600 in Fig. 6 can be mobile phone, tablet computer, personal digital assistant (Personal Digital Assistant, PDA) or vehicle-mounted computer etc..

Mobile terminal 600 in Fig. 6 includes radio frequency (Radio Frequency, RF) circuit 610, memory 620, input Unit 630, display unit 640, processor 660, voicefrequency circuit 670, WLAN (Wireless Fidelity) module 680, power supply 690 and camera 6110.

Wherein, input unit 630 can be used for receiving the number or character information of user's input, and generation and mobile terminal The related signal input of 600 user setting and function control.Specifically, in the embodiment of the present invention, which can To include touch panel 631.Touch panel 631, collect user on it or nearby touch operation (such as user use hand The operation of any suitable object or attachment such as finger, stylus on touch panel 631), and driven according to preset formula Corresponding attachment device.Optionally, touch panel 631 may include both touch detecting apparatus and touch controller.Wherein, Touch detecting apparatus detects the touch orientation of user, and detects touch operation bring signal, transmits a signal to touch control Device；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives the processor 660, and order that processor 660 is sent can be received and executed.Furthermore, it is possible to use resistance-type, condenser type, infrared ray with And the multiple types such as surface acoustic wave realize touch panel 631.In addition to touch panel 631, input unit 630 can also include other Input equipment 632, other input equipments 632 can include but is not limited to physical keyboard, function key (such as volume control button, Switch key etc.), trace ball, mouse, one of operating stick etc. or a variety of.

Wherein, display unit 640 can be used for showing information input by user or be supplied to the information and movement of user The various menu interfaces of terminal 600.Display unit 640 may include display panel 641, optionally, can use LCD or organic hair The forms such as optical diode (Organic Light-Emitting Diode, OLED) configure display panel 641.

It should be noted that touch panel 631 can cover display panel 641, touch display screen is formed, when the touch display screen is examined After measuring touch operation on it or nearby, processor 660 is sent to determine the type of touch event, is followed by subsequent processing device 660 provide corresponding visual output according to the type of touch event in touch display screen.

Touch display screen includes Application Program Interface viewing area and common control viewing area.The Application Program Interface viewing area And arrangement mode of the common control viewing area does not limit, can be arranged above and below, left-right situs etc. can distinguish two it is aobvious Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with The interface elements such as the icon comprising at least one application program and/or widget desktop control.The Application Program Interface viewing area Or the empty interface not comprising any content.This commonly uses control viewing area for showing the higher control of utilization rate, for example, Application icons such as button, interface number, scroll bar, phone directory icon etc. are set.

The N images, etc. for the instruction shooting different focal point that camera 6110 is used to be sent according to processor 660.

Wherein processor 660 is the control centre of mobile terminal 600, utilizes various interfaces and connection whole mobile phone Various pieces, by running or executing the software program and/or module that are stored in first memory 621, and calling storage Data in second memory 622 execute the various functions and processing data of mobile terminal 600, thus to mobile terminal 600 Carry out integral monitoring.Optionally, processor 660 may include one or more processing units.

In embodiments of the present invention, by call store the first memory 621 in software program and/or module and/ Or the data in the second memory 622, processor 660 are used to obtain a frame preview image of camera acquisition；Described in determination Shooting main body in preview image；Based on the shooting main body, N images of camera shooting different focal point are controlled；Based on institute N images are stated, determine shooting body region, transitional region and background area；Based on the shooting body region, to the transition Region and the background area carry out virtualization processing；Wherein, N is greater than or equal to 2.

Optionally, the processor 660 is also used to: control camera is clapped using each shooting main body as focus It takes the photograph, obtains N-1 the first images；Camera is controlled using shooting background as focus, according to the maximum focal length of the mobile terminal Value is shot, and second image is obtained；Wherein, the number of the shooting main body is N-1.

Optionally, the processor 660 is also used to: according to the N-1 the first images, determining the first alternative shooting main body Region；According to the N-1 the first images and second images, the second alternative shooting body region is determined；According to described One alternative shooting body region and the second alternative shooting body region, determine the shooting body region and the transition region Domain；According to the N-1 the first images, the shooting body region and the transitional regions, target image is determined；By the mesh All image-regions in logo image in addition to the shooting body region and the transitional region are determined as background area.

Optionally, the processor 660 is also used to: from the N-1 the first images, randomly choosing an image, benefit The shooting body region and the transitional region are replaced respectively selected with the shooting body region and the transitional region Corresponding region, obtains target image in image.

Optionally, the processor 660 is also used to: being obtained corresponding first preview image of each the first image, is obtained To N-1 the first preview images；Characteristic point label is carried out to each first preview image；By each first preview graph The characteristic point connection marked as in, obtains the body profile in each first preview image；By each body profile Area encompassed is determined as the first alternative shooting body region；Wherein, first preview image and the first image Characteristics of image is identical, and the data volume of first preview image is less than the data volume of the first image.

Optionally, the processor 660 is also used to: for every first preview in the N-1 the first preview images The region that clarity in first preview image is greater than preset threshold is determined as comparing subregion by image, and it is a right to obtain N-1 Compare subregion；The N-1 comparison subregion is combined, first area is obtained；Obtain second image corresponding second in advance Look at image；The region that clarity in second preview image is less than preset threshold is determined as second area；By described first Region and the second area carry out area comparison, determine the second alternative shooting body region；Wherein, second preview image Identical as the characteristics of image of second image, the data volume of second preview image is less than the data of second image Amount.

Optionally, the processor 660 is also used to: first preview image is divided into the subregion of E F*F；Root According to the gray value of each pixel in the subregion of each F*F, the clarity of the subregion of each F*F is calculated；It will be clear The region that clear degree is greater than the subregion composition of the F*F of preset threshold is determined as comparing subregion.

Optionally, the processor 660 is also used to: second preview image is divided into the subregion of M N*N；Root According to the gray value of each pixel in the subregion of each N*N, the clarity of the subregion of each N*N is calculated；It will be clear The region that clear degree is less than the subregion composition of the N*N of preset threshold is determined as second area.

Optionally, the processor 660 is also used to: if the area of the first area is less than or equal to the second area Area, then the first area is determined as the second alternative shooting body region；If the area of the first area is greater than institute The area of second area is stated, then corresponding region is determined as the second alternative shooting in the first area by the second area Body region.

Optionally, the processor 660 is also used to: by the described first alternative shooting body region and the described second alternative bat The region for taking the photograph body region coincidence is determined as the shooting body region；By the described first alternative shooting body region and described the The region that two alternative shooting body regions are not overlapped is determined as the transitional region.

Optionally, the processor 660 is also used to: the background area in the target image is blurred, and According to the direction far from the shooting body region, the transitional region is carried out in a manner of gradually reinforcing virtualization degree outward Virtualization；Alternatively, being blurred to the background area in the target image, and according to far from the shooting body region Direction blurs the transitional region in a manner of gradually weakening virtualization degree outward.

As it can be seen that in the embodiment of the present invention, then a frame preview image of the available camera acquisition of mobile terminal determines Shooting main body in the preview image can then be based on the shooting main body, N figures of control camera shooting different focal point Picture is then based on this N images, determines shooting body region, transitional region and background area, finally based on shooting body region Domain carries out virtualization processing to transitional region and the background area.In compared to the prior art, back is marked off according to depth of view information Scene area and shooting body region carry out the mode of virtualization processing, are not necessarily to be drawn according to depth of view information in the embodiment of the present invention Point, in this way, mobile terminal only needs to configure single camera, virtualization cost is saved, while can be true in the embodiment of the present invention It makes shooting body region, transitional region and background area to be blurred, wherein what transitional region indicated is that can not determine to be The part for shooting main body or shooting background is exactly to be easy the region accidentally divided, and then avoid region division error pair The influence for blurring effect improves the effect of image virtualization.

For above-mentioned apparatus embodiment, since it is basically similar to the method embodiment, so be described relatively simple, The relevent part can refer to the partial explaination of embodiments of method.

All the embodiments in this specification are described in a progressive manner, the highlights of each of the examples are with The difference of other embodiments, the same or similar parts between the embodiments can be referred to each other.

It would have readily occurred to a person skilled in the art that: any combination application of above-mentioned each embodiment is all feasible, therefore Any combination between above-mentioned each embodiment is all embodiment of the present invention, but this specification exists as space is limited, This is not just detailed one by one.

Image pickup method is not inherently related to any particular computer, virtual system, or other device provided herein.Respectively Kind general-purpose system can also be used together with teachings based herein.As described above, it constructs with the present invention program's Structure required by system is obvious.In addition, the present invention is also not directed to any particular programming language.It should be understood that can With using various programming languages realize summary of the invention described herein, and the description that language-specific is done above be for Disclosure preferred forms of the invention.

In the instructions provided here, numerous specific details are set forth.It is to be appreciated, however, that implementation of the invention Example can be practiced without these specific details.In some instances, well known method, structure is not been shown in detail And technology, so as not to obscure the understanding of this specification.

Similarly, it should be understood that in order to simplify the present invention and help to understand one or more of the various inventive aspects, In Above in the description of exemplary embodiment of the present invention, each feature of the invention is grouped together into single implementation sometimes In example, figure or descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. required to protect Shield the present invention claims features more more than feature expressly recited in each claim.More precisely, such as right As claim reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows tool Thus claims of body embodiment are expressly incorporated in the specific embodiment, wherein each claim conduct itself Separate embodiments of the invention.

Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose It replaces.

In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention Within the scope of and form different embodiments.For example, in detail in the claims, embodiment claimed it is one of any Can in any combination mode come using.

Various component embodiments of the invention can be implemented in hardware, or to run on one or more processors Software module realize, or be implemented in a combination thereof.It will be understood by those of skill in the art that can be used in practice Microprocessor or digital signal processor (DSP) realize the identification side of background music in video according to an embodiment of the present invention The some or all functions of some or all components in method.The present invention is also implemented as described here for executing Method some or all device or device programs (for example, computer program and computer program product).This The program that the realization of sample is of the invention can store on a computer-readable medium, or can have one or more signal Form.Such signal can be downloaded from an internet website to obtain, and perhaps be provided on the carrier signal or with any other Form provides.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and ability Field technique personnel can be designed alternative embodiment without departing from the scope of the appended claims.In the claims, Any reference symbol between parentheses should not be configured to limitations on claims.Word "comprising" does not exclude the presence of not Element or step listed in the claims.Word "a" or "an" located in front of the element does not exclude the presence of multiple such Element.The present invention can be by means of including the hardware of several different elements and being come by means of properly programmed computer real It is existing.In the unit claims listing several devices, several in these devices can be through the same hardware branch To embody.The use of word first, second, and third does not indicate any sequence.These words can be explained and be run after fame Claim.

Claims (18)

1. a kind of image pickup method, applied to the mobile terminal including camera, which is characterized in that the described method includes:

Obtain a frame preview image of camera acquisition；

Determine the shooting main body in the preview image；

Based on the shooting main body, N images of camera shooting different focal point are controlled；

According to N-1 the first images in the N images, the first alternative shooting body region is determined；The N-1 the first figures It seem to be shot respectively using each shooting main body as focus；

For corresponding first preview image of every first image in the N-1 the first images, by first preview graph The region that clarity is greater than preset threshold as in is determined as comparing subregion, obtains N-1 comparison subregion；

The N-1 comparison subregion is combined, first area is obtained；

Obtain corresponding second preview image of the second image；Second image is shot using shooting background as focus；

The region that clarity in second preview image is less than preset threshold is determined as second area；

If the area of the first area is less than or equal to the area of the second area, the first area is determined as the Two alternative shooting body regions；Alternatively, if the area of the first area is greater than the area of the second area, by described the Two regions corresponding region in the first area is determined as the second alternative shooting body region；

The region that described first alternative shooting body region is overlapped with the described second alternative shooting body region, is determined as shooting Body region, and, the area that the described first alternative shooting body region is not overlapped with the described second alternative shooting body region Domain is determined as transitional region；

According to the N-1 the first images, the shooting body region and the transitional regions, target image is determined；

All image-regions in the target image in addition to the shooting body region and the transitional region are determined as Background area；

Based on the shooting body region, virtualization processing is carried out to the transitional region and the background area；

Wherein, N is greater than or equal to 2.

2. the method according to claim 1, wherein described be based on the shooting main body, control camera shooting The step of N of different focal point images, comprising:

Control camera is shot using each shooting main body as focus, obtains the N-1 the first images；

Camera is controlled using shooting background as focus, is shot according to the maximum focus value of the mobile terminal, obtains one The second image of Zhang Suoshu；

Wherein, the number of the shooting main body is N-1.

3. the method according to claim 1, wherein described lead according to the N-1 the first images, the shooting Body region and the transitional region, the step of determining target image, comprising:

From the N-1 the first images, an image is randomly choosed, the shooting body region and the transitional region are utilized The shooting body region and the transitional region corresponding region in selected image are replaced respectively, obtain target image.

4. the method according to claim 1, wherein N-1 first figures according in the N images Picture determined for first alternative the step of shooting body region, comprising:

Corresponding first preview image of each the first image is obtained, N-1 the first preview images are obtained；

Characteristic point label is carried out to each first preview image；

The characteristic point marked in each first preview image is connected, the main body in each first preview image is obtained Profile；

Each body profile area encompassed is determined as the first alternative shooting body region；

Wherein, first preview image is identical with the characteristics of image of the first image, the data of first preview image Amount is less than the data volume of the first image.

5. the method according to claim 1, wherein

Second preview image is identical as the characteristics of image of second image, and the data volume of second preview image is less than The data volume of second image.

6. the method according to claim 1, wherein described be greater than clarity in first preview image in advance If the region of threshold value is determined as the step of comparing subregion, comprising:

First preview image is divided into the subregion of E F*F；

According to the gray value of each pixel in the subregion of each F*F, the clear of the subregion of each F*F is calculated Degree；

It is determined as the region that clarity is greater than the subregion composition of the F*F of preset threshold to compare subregion.

7. the method according to claim 1, wherein described be less than clarity in second preview image in advance If the step of region of threshold value is determined as second area, comprising:

Second preview image is divided into the subregion of M N*N；

According to the gray value of each pixel in the subregion of each N*N, the clear of the subregion of each N*N is calculated Degree；

The region of subregion composition by clarity no more than the N*N of preset threshold is determined as second area.

8. the method according to claim 1, wherein described be based on the shooting body region, to the transition Region and the background area carry out the step of virtualization processing, comprising:

The background area in the target image is blurred, and according to far from it is described shooting body region direction, The transitional region is blurred in a manner of gradually reinforcing virtualization degree outward；

Alternatively, being blurred to the background area in the target image, and according to far from the shooting body region Direction blurs the transitional region in a manner of gradually weakening virtualization degree outward.

9. a kind of mobile terminal, including camera, which is characterized in that the mobile terminal further include:

Module is obtained, for obtaining a frame preview image of camera acquisition；

First determining module, for determining the shooting main body in the preview image；

Shooting module, for being based on the shooting main body, N images of control camera shooting different focal point；

Second determining module, for determining the first alternative shooting body region according to N-1 the first images in the N images Domain；The N-1 the first images are to shoot respectively using each shooting main body as focus；

For corresponding first preview image of every first image in the N-1 the first images, by first preview graph The region that clarity is greater than preset threshold as in is determined as comparing subregion, obtains N-1 comparison subregion；

The N-1 comparison subregion is combined, first area is obtained；

Obtain corresponding second preview image of the second image；Second image is shot using shooting background as focus；

The region that clarity in second preview image is less than preset threshold is determined as second area；

If the area of the first area is less than or equal to the area of the second area, the first area is determined as the Two alternative shooting body regions；Alternatively, if the area of the first area is greater than the area of the second area, by described the Two regions corresponding region in the first area is determined as the second alternative shooting body region；

The region that described first alternative shooting body region is overlapped with the described second alternative shooting body region, is determined as shooting Body region, and, the area that the described first alternative shooting body region is not overlapped with the described second alternative shooting body region Domain is determined as transitional region；

According to the N-1 the first images, the shooting body region and the transitional regions, target image is determined；

All image-regions in the target image in addition to the shooting body region and the transitional region are determined as Background area；

Blurring module carries out at virtualization the transitional region and the background area for being based on the shooting body region Reason；

Wherein, N is greater than or equal to 2.

10. mobile terminal according to claim 9, which is characterized in that the shooting module includes:

First shooting module is shot using each shooting main body as focus for controlling camera, obtains the N-1 Open the first image；

Second shooting module, for controlling camera using shooting background as focus, according to the maximum focal length of the mobile terminal Value is shot, and second image is obtained；

Wherein, the number of the shooting main body is N-1.

11. mobile terminal according to claim 9, which is characterized in that second determining module, comprising:

Replacement unit, for randomly choosing an image, utilizing the shooting body region from the N-1 the first images The shooting body region and the transitional region corresponding region in selected image are replaced respectively with the transitional region, are obtained To target image.

12. mobile terminal according to claim 9, which is characterized in that second determining module, comprising:

First acquisition unit obtains N-1 the first previews for obtaining corresponding first preview image of each the first image Image；

Marking unit, for carrying out characteristic point label to each first preview image；

Connection unit, the characteristic point connection for will mark in each first preview image, it is pre- to obtain each described first The body profile look in image；

First determination unit, for each body profile area encompassed to be determined as the first alternative shooting body region Domain；

Wherein, first preview image is identical with the characteristics of image of the first image, the data of first preview image Amount is less than the data volume of the first image.

13. mobile terminal according to claim 9, which is characterized in that second preview image and second image Characteristics of image it is identical, the data volume of second preview image is less than the data volume of second image.

14. mobile terminal according to claim 9, which is characterized in that second determining module is used for:

First preview image is divided into the subregion of E F*F；

According to the gray value of each pixel in the subregion of each F*F, the clear of the subregion of each F*F is calculated Degree；

It is determined as the region that clarity is greater than the subregion composition of the F*F of preset threshold to compare subregion.

15. mobile terminal according to claim 9, which is characterized in that second determining module is used for:

Second preview image is divided into the subregion of M N*N；

According to the gray value of each pixel in the subregion of each N*N, the clear of the subregion of each N*N is calculated Degree；

The region of subregion composition by clarity no more than the N*N of preset threshold is determined as second area.

16. mobile terminal according to claim 9, which is characterized in that the blurring module is used for:

The background area in the target image is blurred, and according to far from it is described shooting body region direction, The transitional region is blurred in a manner of gradually reinforcing virtualization degree outward；

Alternatively, being blurred to the background area in the target image, and according to far from the shooting body region Direction blurs the transitional region in a manner of gradually weakening virtualization degree outward.

17. a kind of mobile terminal, which is characterized in that including processor, memory and be stored on the memory and can be in institute The computer program run on processor is stated, such as claim 1 to 8 is realized when the computer program is executed by the processor Any one of described in image pickup method the step of.

18. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium Program realizes the step such as image pickup method described in any item of the claim 1 to 8 when the computer program is executed by processor Suddenly.