CN105072327A - Eye-closing-preventing person photographing method and device thereof - Google Patents

Eye-closing-preventing person photographing method and device thereof Download PDF

Info

Publication number
CN105072327A
CN105072327A CN201510416911.7A CN201510416911A CN105072327A CN 105072327 A CN105072327 A CN 105072327A CN 201510416911 A CN201510416911 A CN 201510416911A CN 105072327 A CN105072327 A CN 105072327A
Authority
CN
China
Prior art keywords
image
eyes
portrait
eye
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510416911.7A
Other languages
Chinese (zh)
Other versions
CN105072327B (en
Inventor
刘彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201510416911.7A priority Critical patent/CN105072327B/en
Publication of CN105072327A publication Critical patent/CN105072327A/en
Application granted granted Critical
Publication of CN105072327B publication Critical patent/CN105072327B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Processing (AREA)

Abstract

The invention relates to an eye-closing-preventing person photographing method and a device thereof. The device comprises a photographing unit, a detecting unit, a calling unit and a processing unit. The photographing unit is used for acquiring images to be confirmed. The detecting unit is used for acquiring a first image in the images to be confirmed and detecting the state of the eyes of all persons in the image. The calling unit is used for storing the first image and calling a later subsequent image if the eyes of at least one person are in the closed state. The processing unit is used for performing local processing on the closed eyes in the first image according to the subsequent image so that the eyes of all persons in the first image are open. Obviously, the eye-closing-preventing person photographing method and the device thereof can effectively prevent a picture in which the eyes of a person are closed, thereby greatly improving picture quality and improving a user experience.

Description

A kind of method and apparatus of portrait process of anti-eye closing
Technical field
The present invention relates to technical field of image processing, particularly relate to a kind of method and apparatus of portrait process of anti-eye closing.
Background technology
Along with mobile terminal, as the development of the shooting technology of mobile phone, increasing user uses mobile phone to play and autodynes or group's bat, and various U.S. face camera function also occurs thereupon.U.S. face camera function, by carrying out recognition of face to photographic images to be confirmed, then carries out the post-processing operation such as whitening, convergence, mill skin to face, realizes allowing confirming that the image taken seems that facial skin is more smooth, the visual effect of Bai Liang.U.S. face camera function almost becomes the essential function that female user is taken pictures now.But when many people one schooling ups are clapped, during souvenir of particularly travelling outdoors, be easy to just take the photo that some eyes are in closed-eye state, the quality not only large heavy discount of this photo, also more or less can have influence on the mood of playing of people.
Summary of the invention
The object of the invention is to the method and apparatus of the portrait process proposing a kind of anti-eye closing, can effectively avoid the eyes taking portrait to be in the photo of closed-eye state, greatly improve the quality of photo itself, optimizing user is experienced.
For reaching this object, the present invention by the following technical solutions:
First aspect, provides a kind of method of portrait process of anti-eye closing, comprising:
Obtaining and confirm shooting instruction, obtaining image to be confirmed by taking the interface of finding a view of portrait, described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process;
Obtain first image in described image to be confirmed, utilize Face datection algorithm to detect the state of the eyes of everyone picture in described first image;
If have at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image;
Detect the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image whether to open; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
Second aspect, provides a kind of device of portrait process of anti-eye closing, comprising:
Shooting unit, confirms shooting instruction for obtaining, and obtains image to be confirmed by taking the interface of finding a view of portrait, and described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process;
Detecting unit, for obtaining first image in described image to be confirmed, utilizes Face datection algorithm to detect the state of the eyes of everyone picture in described first image;
Transfer unit, if for having at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image;
Whether processing unit, open for detecting the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
Beneficial effect of the present invention is: a kind of method and apparatus of portrait process of anti-eye closing, comprises shooting unit, detecting unit, transfers unit and processing unit; Described shooting unit, confirms shooting instruction for obtaining, and obtains image to be confirmed by taking the interface of finding a view of portrait, and described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process; Described detecting unit, for obtaining first image in described image to be confirmed, utilizes Face datection algorithm to detect the state of the eyes of everyone picture in described first image; Describedly transfer unit, if for having at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image; Whether described processing unit, open for detecting the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.Visible, the method and apparatus of the portrait process of this anti-eye closing, can effectively avoid the eyes taking portrait to be in the photo of closed-eye state, greatly improves the quality of photo itself, and optimizing user is experienced.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme in the embodiment of the present invention, below the accompanying drawing used required in describing the embodiment of the present invention is briefly described, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the content of the embodiment of the present invention and these accompanying drawings.
Fig. 1 is the method flow diagram of method first embodiment of the portrait process of anti-eye closing provided by the invention.
Fig. 2 is the method flow diagram of method second embodiment of the portrait process of anti-eye closing provided by the invention.
Fig. 3 is the block diagram of device first embodiment of the portrait process of anti-eye closing provided by the invention.
Fig. 4 is the block diagram of device second embodiment of the portrait process of anti-eye closing provided by the invention.
Embodiment
The technical problem solved for making the present invention, the technical scheme of employing and the technique effect that reaches are clearly, be described in further detail below in conjunction with the technical scheme of accompanying drawing to the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those skilled in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Please refer to Fig. 1, it is the method flow diagram of method first embodiment of the portrait process of anti-eye closing provided by the invention.The method of the portrait process of the anti-eye closing of the embodiment of the present invention, can be applicable to the various intelligent terminal possessing camera function, as mobile phone, flat board, intelligent watch etc.
The method of the portrait process of this anti-eye closing, comprising:
Step S101, obtaining and confirm shooting instruction, obtaining image to be confirmed by taking the interface of finding a view of portrait, described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process.
The interface of finding a view of described shooting portrait is form or the display screen of the intelligent terminal possessing camera function.
Image, after digital image compression process, can make picture signal transmit in high quality, and is convenient to the retrieval of image, analysis, process and storage.
Step S102, first image obtained in described image to be confirmed, utilize Face datection algorithm to detect the state of the eyes of everyone picture in described first image.
When acquisition confirms shooting instruction, namely represent that the to be confirmed image of user to interface of finding a view at present is satisfied in the main, confirming shooting key by pressing, process being carried out to image to be confirmed and exports, forming final portrait picture.
Utilize Face datection algorithm to detect the process of the state of the eyes of everyone picture in described first image, be mainly divided into the detection of people face part, detect and eyes detection three parts based on the ocular of described people face part detection.
The detection of the characteristic point on Main Basis face is detected in people face part, before carrying out feature point detection, also needs to carry out feature point extraction and classification to facial image.Detect in face process, first facial image to be determined and face template are carried out template matches, if coupling, so projected to face subspace, determine whether face by the sub-face technology of feature.The sub-face technology of feature is from the angle of statistics, and find the basic element of facial image distribution, namely the characteristic vector of facial image sample set covariance matrix, characterizes facial image approx with this.These characteristic vectors are called eigenface (Eigenface).In fact, eigenface reflects and lies in the information of face sample set inside and the structural relation of face.The characteristic vector of the sample set covariance matrix of eyes, cheek, lower jaw is called eigen eyes, feature jaw and feature lip, is referred to as the sub-face of feature.The sub-face of feature opens into subspace in corresponding image space, is called sub-face space.Calculate the projector distance of test pattern window in sub-face space, if video in window meets threshold value comparison condition, then judge that it is face.The behaviour face part, region that this face is corresponding.
Ocular detects the result that the above-mentioned people face part of Main Basis is detected, and according to the image of the described people face part determined, utilizes the initial position of the ratio estimate nose in five, three front yard.Define two initial ranging rectangles, respectively to the approximate location growth residing for left and right two.Be starkly lower than the feature of face gray scale according to human eye gray scale, utilize search rectangular to find the edge of eye, and locate the center of pupil in eyeball, finally determine the ocular of people face part.
Eyes detection Main Basis eye feature value, as the testing result of pupil middle height, interpupillary distance or pupil gray value etc., is in eyes-open state to eyes or closed-eye state judges.
If step S103 has at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image.
Have at least the eyes of a portrait to be in closed-eye state if find, illustrate that picture quality to be confirmed is now lower, do not reach the requirement of user, need portrait process image to be confirmed being carried out to anti-eye closing.
Step S104, detect in described successive image and correspond to described first image eyes of being in the portrait of closed-eye state and whether open; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
Preferably, eye Local treatment is adopt the eye eye be in the successive image of eyes-open state to replace corresponding portrait in described first image to be in the eye of closed-eye state, under the prerequisite that face characteristic coincide substantially, the eye of eyes-open state is directly covered in the eye of closed-eye state.
The method of the portrait process of the dynamic anti-eye closing that the embodiment of the present invention provides, can effectively avoid the eyes taking portrait to be in the photo of closed-eye state, greatly improves the quality of photo itself, and optimizing user is experienced.
Please refer to Fig. 2, it is the method flow diagram of method second embodiment of the portrait process of anti-eye closing provided by the invention.The embodiment of the present invention, on the basis of first embodiment of the method for the portrait process of anti-eye closing, is done Local treatment to eye and is illustrated with the step of the state judging portrait eye.
The method of the portrait process of this anti-eye closing, comprising:
Step S201, startup camera function.
Start camera function, namely allow terminal enter the state of taking pictures, the interface of finding a view of shooting portrait starts to find a view.
Step S202, obtaining and confirm shooting instruction, obtaining image to be confirmed by taking the interface of finding a view of portrait, described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process.
Step S203, first image obtained in described image to be confirmed, utilize Face datection algorithm to detect the state of the eyes of everyone picture in described first image.
Preferably, the described state utilizing Face datection algorithm to detect the eyes of everyone picture in described first image, comprising:
Face datection algorithm is utilized to detect the eye feature value of everyone picture in described first image, the pupil middle height that described eye feature value comprises, interpupillary distance or pupil gray value;
When the pupil middle height of arbitrary portrait is less than or equal to preset height, then judge that the eyes of this portrait are in closed-eye state; When the pupil middle height of arbitrary portrait is greater than described preset height, then judge that the eyes of this portrait are in eyes-open state, or;
When the interpupillary distance of arbitrary portrait not detected, then judge that the eyes of this portrait are in closed-eye state; When the interpupillary distance of arbitrary portrait being detected, then judge that the eyes of this portrait are in eyes-open state, or;
When the pupil gray value of arbitrary portrait is less than or equal to default pupil gray value, then judge that the eyes of this portrait are in closed-eye state; When the pupil gray value of arbitrary portrait is greater than described default pupil gray value, then judge that the eyes of this portrait are in eyes-open state.
Eyeball refers to mid portion before eyeball, and this position is made up of cornea, iris and pupil.Pupil middle height is the center line height of circular pupil, interpupillary distance is distance between two pupils, pupil gray value is the color depth of pupil.
Preset height is that pre-set, when to be in normal eyes-open state corresponding to the eyes of the face size in image pupil middle height, and presetting pupil gray value is that pre-set, when to be in normal eyes-open state corresponding to the eyes of the face size in image pupil gray value.In actual application, according to the model of different terminals and configuration, preset height and default pupil gray value can be arranged.
If step S204a has at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image.
If the eyes of step S204b nobody picture are in closed-eye state, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
If the eyes of nobody's picture are in closed-eye state, then directly can state digital image compression process to image to be captured, to export.
It should be noted that, step S204a and step S204b does not have sequencing relation, and alternatively implements.
Step S205, in preset time period, detect in described successive image and correspond to described first image eyes of being in the portrait of closed-eye state and whether open.
Preferably, described preset time period is 2s.In 2s, the eye of portrait is not still opened, continue to be in closed-eye state, then can judge this be in order to build more lively shooting effect deliberately for it.Now directly can state digital image compression process to image to be captured, to export.
If step S206a opens, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image; The image eyes of everyone picture obtained after doing described Local treatment being in eyes-open state carries out digital image compression process, and the final portrait picture after described digital image compression process is shown in screen.
If step S206b does not open, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
Step S206a and step S206b allows the more intelligent and hommization of the process of the portrait process of the anti-eye closing of terminal, improves the satisfaction of user.It should be noted that, step S206a and step S206b does not have sequencing relation, and alternatively implements.
Preferably, described digital image compression is treated to the digital image compression process adopting JPEG encryption algorithm.
JPEG encryption algorithm is the canonical algorithm of Static Picture Compression.JPEG encryption algorithm must meet following requirement:
1, JPEG encryption algorithm is independent of the resolution of image.
2, there is the encoding rate lower than 1bit/ pixel, and image can be set up in five seconds, to meet requirement of real time.
3, can be undistorted when compression ratio is approximately 2 recover original image.
4, support order encoding and decoding and progressive encoding and decoding.
5, to the adaptive ability of various iconic element and data precision.
6, coding/decoding apparatus is simple and easy to realize.
The method of the portrait process of the anti-eye closing that the embodiment of the present invention provides, first by Face datection algorithm, detects the position of all faces and the eye state of correspondence in the interface of finding a view of shooting portrait in real time.When confirmation shooting key be pressed, send confirm shooting instruction after, before image to be confirmed does JPEG coding, get first image, and judge the state of portrait eyes in this first image, if there is eye to be in closed-eye state, then first first Image Saving is got off, do not do JPEG coding.Often open the eye state that image gives more sustained attention eye closing people below.By the time, when the eyes of people of closing one's eyes are in eyes-open state, according to the eyes of this people and the feature of face, to the eye closing people of first image, carry out corresponding eye Local treatment, make its eyes be in eyes-open state.If eye closing people continues to be in closed-eye state more than 2s, then do not carry out eye Local treatment, acquiescence specially wants to take the effect of eye closing, instead of because blink the photo taking eye closing caused.Finally first image through eye process is carried out JPEG coding, export final portrait picture.
The method of the portrait process of the anti-eye closing that the embodiment of the present invention provides, the state of human eye can be got by Face datection algorithm, then eye Local treatment is carried out to the portrait of closing one's eyes, the eyes-open state of portrait is synthesized on first image, eye closing portrait is made to be in eyes-open state, to take higher-quality portrait photo, effectively avoid the photo taking eye closing portrait.
The embodiment of the device of the portrait process of the anti-eye closing provided for the embodiment of the present invention below.The embodiment of the method for the embodiment of the device of the portrait process of anti-eye closing and the portrait process of above-mentioned anti-eye closing belongs to same design, the detail content of not detailed description in the embodiment of the device of the portrait process of anti-eye closing, can with reference to the embodiment of the method for the portrait process of above-mentioned anti-eye closing.
Please refer to Fig. 3, it is the block diagram of device first embodiment of the portrait process of anti-eye closing provided by the invention.
The device of the portrait process of this anti-eye closing, comprising:
Shooting unit, confirms shooting instruction for obtaining, and obtains image to be confirmed by taking the interface of finding a view of portrait, and described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process;
Detecting unit, for obtaining first image in described image to be confirmed, utilizes Face datection algorithm to detect the state of the eyes of everyone picture in described first image;
Transfer unit, if for having at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image;
Whether processing unit, open for detecting the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
The device of the portrait process of the anti-eye closing that the embodiment of the present invention provides, can effectively avoid the eyes taking portrait to be in the photo of closed-eye state, greatly improves the quality of photo itself, and optimizing user is experienced.
Please refer to Fig. 4, is the block diagram of device second embodiment of the portrait process of anti-eye closing provided by the invention.The embodiment of the present invention, on the basis of first embodiment of the device of the portrait process of anti-eye closing, adds display unit and start unit.
The device of the portrait process of this anti-eye closing, comprising:
Shooting unit, confirms shooting instruction for obtaining, and obtains image to be confirmed by taking the interface of finding a view of portrait, and described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process;
Detecting unit, for obtaining first image in described image to be confirmed, utilizes Face datection algorithm to detect the state of the eyes of everyone picture in described first image;
Transfer unit, if for having at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image;
Whether processing unit, open for detecting the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
Wherein, described processing unit, specifically for:
In preset time period, detect the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image and whether open;
If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image; The image eyes of everyone picture obtained after doing described Local treatment being in eyes-open state carries out digital image compression process, and the final portrait picture after described digital image compression process is shown in screen;
If do not open, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
Wherein, described digital image compression is treated to the digital image compression process adopting JPEG encryption algorithm.
Wherein, the device of the portrait process of described anti-eye closing also comprises display unit, described display unit, if be in closed-eye state for the eyes of nobody's picture, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
Wherein, the described state utilizing Face datection algorithm to detect the eyes of everyone picture in described first image, comprising:
Face datection algorithm is utilized to detect the eye feature value of everyone picture in described first image, the pupil middle height that described eye feature value comprises, interpupillary distance or pupil gray value;
When the pupil middle height of arbitrary portrait is less than or equal to preset height, then judge that the eyes of this portrait are in closed-eye state; When the pupil middle height of arbitrary portrait is greater than described preset height, then judge that the eyes of this portrait are in eyes-open state, or;
When the interpupillary distance of arbitrary portrait not detected, then judge that the eyes of this portrait are in closed-eye state; When the interpupillary distance of arbitrary portrait being detected, then judge that the eyes of this portrait are in eyes-open state, or;
When the pupil gray value of arbitrary portrait is less than or equal to default pupil gray value, then judge that the eyes of this portrait are in closed-eye state; When the pupil gray value of arbitrary portrait is greater than described default pupil gray value, then judge that the eyes of this portrait are in eyes-open state.
Wherein, the device of the portrait process of described anti-eye closing also comprises start unit, described start unit, for starting camera function.
The device of the portrait process of the anti-eye closing that the embodiment of the present invention provides, remarkable face detection algorithm can get the state of human eye, then eye Local treatment is carried out to the portrait of closing one's eyes, the eyes-open state of portrait is synthesized on first image, eye closing portrait is made to be in eyes-open state, to take higher-quality portrait photo, effectively avoid the photo taking eye closing portrait.
A method and apparatus for the portrait process of anti-eye closing, can effectively avoid the eyes taking portrait to be in the photo of closed-eye state, greatly improves the quality of photo itself, and optimizing user is experienced.
One of ordinary skill in the art will appreciate that all or part of step realizing above-described embodiment can have been come by hardware, the hardware that also can carry out instruction relevant by program completes, this program can be stored in a computer-readable recording medium, and storage medium can comprise memory, disk or CD etc.
Above content is only preferred embodiment of the present invention, and for those of ordinary skill in the art, according to thought of the present invention, all will change in specific embodiments and applications, this description should not be construed as limitation of the present invention.

Claims (12)

1. a method for the portrait process of anti-eye closing, is characterized in that, comprising:
Obtaining and confirm shooting instruction, obtaining image to be confirmed by taking the interface of finding a view of portrait, described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process;
Obtain first image in described image to be confirmed, utilize Face datection algorithm to detect the state of the eyes of everyone picture in described first image;
If have at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image;
Detect the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image whether to open; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
2. the method for the portrait process of anti-eye closing according to claim 1, is characterized in that, whether the eyes being in the portrait of closed-eye state corresponding to described first image in the described successive image of described detection are opened; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, to make everyone eyes of picture in described first image be in eyes-open state, comprising:
In preset time period, detect the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image and whether open;
If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image; The image eyes of everyone picture obtained after doing described Local treatment being in eyes-open state carries out digital image compression process, and the final portrait picture after described digital image compression process is shown in screen;
If do not open, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
3. the method for the portrait process of anti-eye closing according to claim 1 and 2, is characterized in that, described digital image compression is treated to the digital image compression process adopting JPEG encryption algorithm.
4. the method for the portrait process of anti-eye closing according to claim 1, is characterized in that, describedly utilizes after Face datection algorithm detects the state of the eyes of everyone picture in described first image, also comprises:
If the eyes of nobody's picture are in closed-eye state, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
5. the method for the portrait process of the anti-eye closing according to claim 1 or 4, is characterized in that, the described state utilizing Face datection algorithm to detect the eyes of everyone picture in described first image, comprising:
Face datection algorithm is utilized to detect the eye feature value of everyone picture in described first image, the pupil middle height that described eye feature value comprises, interpupillary distance or pupil gray value;
When the pupil middle height of arbitrary portrait is less than or equal to preset height, then judge that the eyes of this portrait are in closed-eye state; When the pupil middle height of arbitrary portrait is greater than described preset height, then judge that the eyes of this portrait are in eyes-open state, or;
When the interpupillary distance of arbitrary portrait not detected, then judge that the eyes of this portrait are in closed-eye state; When the interpupillary distance of arbitrary portrait being detected, then judge that the eyes of this portrait are in eyes-open state, or;
When the pupil gray value of arbitrary portrait is less than or equal to default pupil gray value, then judge that the eyes of this portrait are in closed-eye state; When the pupil gray value of arbitrary portrait is greater than described default pupil gray value, then judge that the eyes of this portrait are in eyes-open state.
6. the method for the portrait process of anti-eye closing according to claim 1, is characterized in that, described acquisition also comprises before confirming shooting instruction: start camera function.
7. a device for the portrait process of anti-eye closing, is characterized in that, comprising:
Shooting unit, confirms shooting instruction for obtaining, and obtains image to be confirmed by taking the interface of finding a view of portrait, and described image to be confirmed comprises the image that several that obtain continuously do not do digital image compression process;
Detecting unit, for obtaining first image in described image to be confirmed, utilizes Face datection algorithm to detect the state of the eyes of everyone picture in described first image;
Transfer unit, if for having at least the eyes of a portrait to be in closed-eye state, then preserve described first image, and transfer the successive image after described first image;
Whether processing unit, open for detecting the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image; If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image.
8. the device of the portrait process of anti-eye closing according to claim 7, is characterized in that, described processing unit, specifically for:
In preset time period, detect the eyes being in the portrait of closed-eye state corresponding to described first image in described successive image and whether open;
If open, then this successive image utilizing eyes-open state corresponding does Local treatment to the eye that described first image correspondence is in closed-eye state, is in eyes-open state to make everyone eyes of picture in described first image; The image eyes of everyone picture obtained after doing described Local treatment being in eyes-open state carries out digital image compression process, and the final portrait picture after described digital image compression process is shown in screen;
If do not open, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
9. the device of the portrait process of the anti-eye closing according to claim 7 or 8, is characterized in that, described digital image compression is treated to the digital image compression process adopting JPEG encryption algorithm.
10. the device of the portrait process of anti-eye closing according to claim 7, it is characterized in that, the device of the portrait process of described anti-eye closing also comprises display unit, described display unit, if be in closed-eye state for the eyes of nobody's picture, then digital image compression process is carried out to described first image, the final portrait picture after described digital image compression process is shown in screen.
The device of the portrait process of 11. anti-eye closings according to claim 7 or 10, is characterized in that, the described state utilizing Face datection algorithm to detect the eyes of everyone picture in described first image, comprising:
Face datection algorithm is utilized to detect the eye feature value of everyone picture in described first image, the pupil middle height that described eye feature value comprises, interpupillary distance or pupil gray value;
When the pupil middle height of arbitrary portrait is less than or equal to preset height, then judge that the eyes of this portrait are in closed-eye state; When the pupil middle height of arbitrary portrait is greater than described preset height, then judge that the eyes of this portrait are in eyes-open state, or;
When the interpupillary distance of arbitrary portrait not detected, then judge that the eyes of this portrait are in closed-eye state; When the interpupillary distance of arbitrary portrait being detected, then judge that the eyes of this portrait are in eyes-open state, or;
When the pupil gray value of arbitrary portrait is less than or equal to default pupil gray value, then judge that the eyes of this portrait are in closed-eye state; When the pupil gray value of arbitrary portrait is greater than described default pupil gray value, then judge that the eyes of this portrait are in eyes-open state.
The device of the portrait process of 12. anti-eye closings according to claim 7, is characterized in that, the device of the portrait process of described anti-eye closing also comprises start unit, described start unit, for starting camera function.
CN201510416911.7A 2015-07-15 2015-07-15 A kind of method and apparatus of the portrait processing of anti-eye closing Expired - Fee Related CN105072327B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510416911.7A CN105072327B (en) 2015-07-15 2015-07-15 A kind of method and apparatus of the portrait processing of anti-eye closing

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510416911.7A CN105072327B (en) 2015-07-15 2015-07-15 A kind of method and apparatus of the portrait processing of anti-eye closing

Publications (2)

Publication Number Publication Date
CN105072327A true CN105072327A (en) 2015-11-18
CN105072327B CN105072327B (en) 2018-05-25

Family

ID=54501596

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510416911.7A Expired - Fee Related CN105072327B (en) 2015-07-15 2015-07-15 A kind of method and apparatus of the portrait processing of anti-eye closing

Country Status (1)

Country Link
CN (1) CN105072327B (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105592249A (en) * 2015-12-23 2016-05-18 努比亚技术有限公司 Terminal and method of performing eyelid reconstruction on figures in photograph based on eyeprint identification
CN105827969A (en) * 2016-03-29 2016-08-03 乐视控股(北京)有限公司 Intelligent camera method and device, and mobile device
CN106250426A (en) * 2016-07-25 2016-12-21 深圳天珑无线科技有限公司 A kind of photo processing method and terminal
CN107292261A (en) * 2017-06-16 2017-10-24 深圳天珑无线科技有限公司 A kind of photographic method and its mobile terminal
CN107622483A (en) * 2017-09-15 2018-01-23 深圳市金立通信设备有限公司 A kind of image combining method and terminal
CN107743195A (en) * 2017-10-09 2018-02-27 惠州Tcl移动通信有限公司 A kind of photographic method, mobile terminal and storage medium
CN107833197A (en) * 2017-10-31 2018-03-23 广东欧珀移动通信有限公司 Method, apparatus, computer-readable recording medium and the electronic equipment of image procossing
CN107911608A (en) * 2017-11-30 2018-04-13 西安科锐盛创新科技有限公司 The method of anti-shooting of closing one's eyes
CN108022206A (en) * 2017-11-30 2018-05-11 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer-readable recording medium
CN108229443A (en) * 2018-02-08 2018-06-29 三星电子(中国)研发中心 A kind of photographic method and device of anti-eye closing
CN108234878A (en) * 2018-01-31 2018-06-29 广东欧珀移动通信有限公司 Image processing method, device and terminal
CN108259769A (en) * 2018-03-30 2018-07-06 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN108259766A (en) * 2018-03-29 2018-07-06 宁波大学 A kind of mobile intelligent terminal is taken pictures image pickup processing method
CN108462831A (en) * 2018-03-18 2018-08-28 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN109565541A (en) * 2016-07-29 2019-04-02 微软技术许可有限责任公司 Promote to capture digital picture
CN110717349A (en) * 2018-07-11 2020-01-21 深圳纬目信息技术有限公司 Table mat and state monitoring method

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101127076A (en) * 2007-09-27 2008-02-20 上海交通大学 Human eye state detection method based on cascade classification and hough circle transform
US20080101659A1 (en) * 2006-10-25 2008-05-01 Hammoud Riad I Eye closure recognition system and method
US20090110243A1 (en) * 2007-10-25 2009-04-30 Nikon Corporation Camera and image recording program product
CN101617339A (en) * 2007-02-15 2009-12-30 索尼株式会社 Image processing apparatus and image processing method
WO2010029922A1 (en) * 2008-09-12 2010-03-18 アイシン精機株式会社 Open/closed-eye judgment device, device for estimating degree of eye openness, and program
CN102193621A (en) * 2010-03-17 2011-09-21 三星电子(中国)研发中心 Vision-based interactive electronic equipment control system and control method thereof
CN103369248A (en) * 2013-07-20 2013-10-23 厦门美图移动科技有限公司 Method for photographing allowing closed eyes to be opened
CN103716539A (en) * 2013-12-16 2014-04-09 乐视致新电子科技(天津)有限公司 Photographing method and apparatus
CN104052908A (en) * 2013-03-15 2014-09-17 卡西欧计算机株式会社 Display device and display method
US20150098633A1 (en) * 2013-10-09 2015-04-09 Aisin Seiki Kabushiki Kaisha Face detection apparatus, face detection method, and program

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080101659A1 (en) * 2006-10-25 2008-05-01 Hammoud Riad I Eye closure recognition system and method
CN101617339A (en) * 2007-02-15 2009-12-30 索尼株式会社 Image processing apparatus and image processing method
CN101127076A (en) * 2007-09-27 2008-02-20 上海交通大学 Human eye state detection method based on cascade classification and hough circle transform
US20090110243A1 (en) * 2007-10-25 2009-04-30 Nikon Corporation Camera and image recording program product
WO2010029922A1 (en) * 2008-09-12 2010-03-18 アイシン精機株式会社 Open/closed-eye judgment device, device for estimating degree of eye openness, and program
JP2010067137A (en) * 2008-09-12 2010-03-25 Toyota Central R&D Labs Inc Device for determining open/closed eye, and device for estimating degree of eye opening
CN102150189A (en) * 2008-09-12 2011-08-10 爱信精机株式会社 Open-eye or closed-eye determination apparatus, degree of eye openness estimation apparatus and program
CN102193621A (en) * 2010-03-17 2011-09-21 三星电子(中国)研发中心 Vision-based interactive electronic equipment control system and control method thereof
CN104052908A (en) * 2013-03-15 2014-09-17 卡西欧计算机株式会社 Display device and display method
CN103369248A (en) * 2013-07-20 2013-10-23 厦门美图移动科技有限公司 Method for photographing allowing closed eyes to be opened
US20150098633A1 (en) * 2013-10-09 2015-04-09 Aisin Seiki Kabushiki Kaisha Face detection apparatus, face detection method, and program
CN103716539A (en) * 2013-12-16 2014-04-09 乐视致新电子科技(天津)有限公司 Photographing method and apparatus

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105592249B (en) * 2015-12-23 2018-12-21 努比亚技术有限公司 The terminal and method of eyelid reconstruction are carried out to personage in photo based on eyeprint identification
CN105592249A (en) * 2015-12-23 2016-05-18 努比亚技术有限公司 Terminal and method of performing eyelid reconstruction on figures in photograph based on eyeprint identification
CN105827969A (en) * 2016-03-29 2016-08-03 乐视控股(北京)有限公司 Intelligent camera method and device, and mobile device
CN106250426A (en) * 2016-07-25 2016-12-21 深圳天珑无线科技有限公司 A kind of photo processing method and terminal
CN109565541B (en) * 2016-07-29 2021-12-21 微软技术许可有限责任公司 Method, apparatus and system for facilitating capture of digital images
CN109565541A (en) * 2016-07-29 2019-04-02 微软技术许可有限责任公司 Promote to capture digital picture
CN107292261A (en) * 2017-06-16 2017-10-24 深圳天珑无线科技有限公司 A kind of photographic method and its mobile terminal
CN107622483A (en) * 2017-09-15 2018-01-23 深圳市金立通信设备有限公司 A kind of image combining method and terminal
CN107743195A (en) * 2017-10-09 2018-02-27 惠州Tcl移动通信有限公司 A kind of photographic method, mobile terminal and storage medium
CN107833197A (en) * 2017-10-31 2018-03-23 广东欧珀移动通信有限公司 Method, apparatus, computer-readable recording medium and the electronic equipment of image procossing
CN108022206A (en) * 2017-11-30 2018-05-11 广东欧珀移动通信有限公司 Image processing method, device, electronic equipment and computer-readable recording medium
CN107911608A (en) * 2017-11-30 2018-04-13 西安科锐盛创新科技有限公司 The method of anti-shooting of closing one's eyes
CN108234878A (en) * 2018-01-31 2018-06-29 广东欧珀移动通信有限公司 Image processing method, device and terminal
CN108229443A (en) * 2018-02-08 2018-06-29 三星电子(中国)研发中心 A kind of photographic method and device of anti-eye closing
CN108462831A (en) * 2018-03-18 2018-08-28 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN108462831B (en) * 2018-03-18 2020-09-08 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
CN108259766A (en) * 2018-03-29 2018-07-06 宁波大学 A kind of mobile intelligent terminal is taken pictures image pickup processing method
CN108259766B (en) * 2018-03-29 2020-05-19 宁波大学 Photographing and shooting processing method for mobile intelligent terminal
CN108259769A (en) * 2018-03-30 2018-07-06 广东欧珀移动通信有限公司 Image processing method, device, storage medium and electronic equipment
CN108259769B (en) * 2018-03-30 2020-08-14 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
CN110717349A (en) * 2018-07-11 2020-01-21 深圳纬目信息技术有限公司 Table mat and state monitoring method

Also Published As

Publication number Publication date
CN105072327B (en) 2018-05-25

Similar Documents

Publication Publication Date Title
CN105072327A (en) Eye-closing-preventing person photographing method and device thereof
TWI751161B (en) Terminal equipment, smart phone, authentication method and system based on face recognition
CN105975935B (en) A kind of face image processing process and device
CN106165391B (en) Enhanced image capture
US8031970B2 (en) Method of restoring closed-eye portrait photo
EP2634727B1 (en) Method and portable terminal for correcting gaze direction of user in image
CN103945121B (en) A kind of information processing method and electronic equipment
WO2016180224A1 (en) Method and device for processing image of person
US20170161553A1 (en) Method and electronic device for capturing photo
WO2013013615A1 (en) Control method based on winking feature extraction and shooting glasses based on same
CN102946516A (en) Mobile terminal and method for detecting blink action and realizing autodyne by mobile terminal
WO2015158087A1 (en) Method and apparatus for detecting health status of human eyes and mobile terminal
CN105808997B (en) A kind of control method and electronic equipment
CN107330370B (en) Forehead wrinkle action detection method and device and living body identification method and system
US11521473B2 (en) Audio/video electronic device
CN103294198A (en) Mobile terminal based human-computer interaction method and system
CN115599219B (en) Eye protection control method, system and equipment for display screen and storage medium
WO2017096861A1 (en) Method and device for taking photographs
CN108986019A (en) Method for regulating skin color and device, electronic equipment, machine readable storage medium
CN102999164A (en) E-book page turning control method and intelligent terminal
CN109600555A (en) A kind of focusing control method, system and photographing device
CN108513074B (en) Self-photographing control method and device and electronic equipment
CN112329727A (en) Living body detection method and device
US20130308829A1 (en) Still image extraction apparatus
CN106791407B (en) Self-timer control method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder

Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18

Patentee before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd.

CP01 Change in the name or title of a patent holder
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180525