CN115914821A

CN115914821A - Image processing method, device, equipment and medium for photographing multiple persons

Info

Publication number: CN115914821A
Application number: CN202211567042.4A
Authority: CN
Inventors: 李志水
Original assignee: Shenzhen Skyworth RGB Electronics Co Ltd
Current assignee: Shenzhen Skyworth RGB Electronics Co Ltd
Priority date: 2022-12-07
Filing date: 2022-12-07
Publication date: 2023-04-04

Abstract

The invention discloses an image processing method, an image processing device, image processing equipment and a storage medium for photographing a plurality of persons, wherein the method comprises the following steps: when a multi-person photographing instruction is detected, continuous image acquisition is carried out to obtain N basic images; carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye state of a human face; respectively determining the number of the human images of which the human face eye states are open in the N basic images; and selecting the target basic image with the largest number of the portraits from the N basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image. By adopting the technical scheme of the invention, the final picture with the best photographing effect can be quickly obtained in a multi-person photographing scene.

Description

Image processing method, device, equipment and medium for photographing by multiple persons

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to an image processing method, a photographing apparatus, and a storage medium for photographing multiple persons.

Background

Nowadays, users generally take images by using electronic devices (such as digital cameras, smart phones, etc.) with cameras, so as to record things happening around, scenes seen, etc. anytime and anywhere.

In a family photographing scene or a friend gathering scene, multiple persons are usually combined, and when the multiple persons are combined, even though a photographer prompts all persons to keep the expressions and then presses a photographing button, the expressions of the persons are not always kept, for example, sometimes the eyes of the persons are closed, and the persons are not expressed. Because the picture with ideal expression of all people is difficult to shoot in the scene of shooting by multiple people, repeated shooting is always needed, so that the shooting is long, and the picture satisfying all people is still difficult to shoot.

In summary, how to quickly obtain a final picture with the best photographing effect in a multi-person photographing scene is a technical problem that needs to be solved in the field.

Disclosure of Invention

The invention mainly aims to provide an image processing method, an image processing device, image processing equipment and a storage medium for multi-person photographing, and aims to quickly obtain a final picture with the best photographing effect in a multi-person photographing scene.

In order to achieve the above object, the present invention provides an image processing method for photographing multiple persons, where the image processing method for photographing multiple persons is applied to a photographing device, and the image processing method for photographing multiple persons includes:

when a multi-person photographing instruction is detected, continuous image acquisition is carried out to obtain N basic images;

carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye state of a human face;

respectively determining the number of the human images of which the human face eye states are open in the N basic images;

and selecting the target basic image with the largest number of the portraits from the N basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image.

Optionally, the image data further includes a number of faces, and after the step of determining the number of faces with the eye states of the faces being open in the N base images, the method further includes:

determining the number of the persons taking the pictures according to the number of the faces;

determining alternative basic images of which the number of the faces is equal to the number of the persons who take pictures in the N basic images;

and selecting the target basic image with the largest number of the portraits from the alternative basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image.

Optionally, the image data further includes a face-mouth state, and the step of performing image synthesis processing on the target base image as a reference image to obtain a target image includes:

taking the target basic image as a reference image, and judging that the eye state of the human face in the reference image is a closed state and/or the mouth state of the human face is an adjustable portrait in an expressionless state;

extracting a human face eye region image of which the human face eye state corresponding to the adjustable portrait is an open state from the basic image, and/or extracting a human face mouth region image of which the human face mouth state corresponding to the adjustable portrait is a smile state from the basic image;

and carrying out image synthesis processing on the basis of the human face eye region image and/or the human face mouth region image and the adjustable portrait in the reference image to obtain a target image.

Optionally, the method further comprises:

sequentially positioning the positions of human face eyeball in the N basic images, and establishing a coordinate system by taking the positions of the eyeball as an origin;

acquiring coordinates of eye region feature points in the coordinate system to calculate the aspect ratio of the eyes;

if the eye aspect ratio is smaller than a preset aspect ratio threshold value, determining that the eye state of the human face is a closed state;

and if the eye aspect ratio is larger than or equal to the aspect ratio threshold, determining that the eye state of the human face is in an open state.

Optionally, the method further comprises:

displaying text prompt information on a preset user interface to prompt the progress of the step of performing continuous image acquisition to obtain N basic images;

alternatively, the first and second electrodes may be,

and outputting voice prompt information through a preset loudspeaker to prompt the progress of the steps of performing continuous image acquisition to obtain the N basic images.

Optionally, after the step of performing consecutive image acquisitions to obtain N base images, the method further comprises:

displaying text prompt information on a preset user interface to prompt according to the progress of image processing;

after the step of performing image synthesis processing using the target base image as a reference map to obtain a target image, the method further includes:

and storing the target image and displaying text prompt information on a preset user interface to prompt a user to view the target image.

Optionally, before the step of performing successive image acquisitions to acquire N base images, the method further comprises:

acquiring the times N of image acquisition;

the step of performing successive image acquisitions to obtain N base images comprises:

and continuously acquiring images according to the times N through a preset image acquisition device so as to obtain N basic images.

In addition, to achieve the above object, the present invention further provides an image processing apparatus for photographing a plurality of persons, the image processing apparatus for photographing a plurality of persons comprising:

the image acquisition module is used for carrying out continuous image acquisition to obtain N basic images when a multi-person photographing instruction is detected;

the face recognition module is used for carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye state of the face;

the determining module is used for respectively determining the number of the human images of which the human face eye states are open in the N basic images;

and the image processing module is used for selecting the target basic image with the largest number of the portraits from the N basic images and carrying out image synthesis processing by taking the target basic image as a reference image so as to obtain a target image.

The image processing method for photographing multiple persons is realized when each functional module of the image processing device for photographing multiple persons runs.

In addition, to achieve the above object, the present invention also provides a terminal device, including: the image processing program for photographing multiple persons realizes the steps of the image processing method for photographing multiple persons as described above when the image processing program for photographing multiple persons is executed by the processor.

In addition, in order to achieve the above object, the present invention further provides a storage medium, where an image processing program for photographing multiple persons is stored, and when the image processing program for photographing multiple persons is executed by a processor, the steps of the image processing method for photographing multiple persons as described above are implemented.

The invention provides an image processing method, an image processing device, terminal equipment and a storage medium for multi-person photographing, wherein the image processing method for multi-person photographing comprises the following steps: when a multi-person photographing instruction is detected, continuous image acquisition is carried out to obtain N basic images; carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye state of a human face; respectively determining the number of the human images of which the human face eye states are open in the N basic images; and selecting the target basic image with the largest number of the portraits from the N basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image.

Compared with the traditional multi-person combination mode, the method comprises the steps of acquiring N basic images by continuous image acquisition through the photographing equipment when an instruction of photographing by multiple persons is detected, then respectively carrying out face recognition on the N basic images acquired by the image acquisition to acquire image data of each basic image, wherein the image data of each basic image comprises the eye state of the face, then respectively determining the number of the face in the N basic images, wherein the eye state of the face is in an open state, finally selecting the target basic image with the largest number of the face in the N basic images, and carrying out image synthesis processing by taking the target basic image as a reference image to acquire the target image.

Therefore, the method and the device realize that the picture of the multiple persons is obtained by acquiring the basic image and carrying out image synthesis processing on the basic image through image acquisition, and the final picture with the best photographing effect can be quickly obtained in the scene of the multiple persons by operating the technical scheme of image processing for the multiple persons photographing.

Drawings

Fig. 1 is a schematic diagram of a device structure of a hardware operating environment of a photographing device according to an embodiment of the present invention;

FIG. 2 is a schematic view illustrating an embodiment of an image processing method for photographing a plurality of persons according to the present invention;

FIG. 3 is a schematic diagram illustrating an aspect ratio change of an eye according to an embodiment of an image processing method for photographing a plurality of persons;

fig. 4 is a schematic functional block diagram of an image processing apparatus for photographing a plurality of persons according to an embodiment of the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be noted that all directional indicators (such as up, down, left, right, front, back \8230;) in the embodiments of the present invention are only used to explain the relative positional relationship between the components, the motion situation, etc. in a specific posture (as shown in the attached drawings), and if the specific posture is changed, the directional indicator is changed accordingly.

In the present invention, unless otherwise expressly stated or limited, the terms "connected," "secured," and the like are to be construed broadly, and for example, "secured" may be a fixed connection, a removable connection, or an integral part; can be mechanically or electrically connected; they may be directly connected or indirectly connected through intervening media, or they may be connected internally or in any other suitable relationship, unless expressly stated otherwise. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.

In addition, descriptions such as "first", "second", etc. in the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between the embodiments may be combined with each other, but must be based on the realization of the technical solutions by a person skilled in the art, and when the technical solutions are contradictory to each other or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.

The embodiment of the invention provides photographing equipment.

As shown in fig. 1, fig. 1 is a schematic device structure diagram of a hardware operating environment of a photographing device according to an embodiment of the present invention.

In the embodiment of the invention, the photographing device can be a smart phone device, a digital camera or any other device with a camera device supporting the photographing function.

As shown in fig. 1, in a hardware operating environment of the photographing apparatus, the photographing apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. The communication bus 1002 is used to implement connection communication among these components. The user interface 1003 may include a display screen (Di sp ay), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-vo l at i l e memory, such as a magnetic disk memory. The memory 1005 may alternatively be a storage device separate from the processor 1001 described previously.

Those skilled in the art will appreciate that the configuration of the photographing apparatus shown in fig. 1 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

As shown in fig. 1, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and an image processing program for photographing of a plurality of persons.

In the device shown in fig. 1, the network interface 1004 is mainly used for connecting a backend server and communicating data with the backend server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be configured to call an image processing program for photographing a plurality of persons stored in the memory 1005 and perform the following operations:

Optionally, the image data further includes the number of faces, and the processor 1001 may be further configured to call an image processing program for photographing by multiple persons stored in the memory 1005, and after the step of determining the number of faces in which the eye states of the faces in the N base images are open is performed, perform the following operations:

determining the number of people taking pictures according to the number of the faces;

determining alternative basic images of which the number of the faces is equal to the number of the photographed persons in the N basic images;

Optionally, the image data further includes a face and mouth state, and the processor 1001 may be further configured to call an image processing program for photographing multiple persons stored in the memory 1005, and perform the following operations:

taking the target basic image as a reference image, and judging the adjustable portrait of which the human face eye state is a closed state and/or the human face mouth state is an expressionless state in the reference image;

Alternatively, the processor 1001 may be further configured to call an image processing program for photographing multiple persons stored in the memory 1005, and perform the following operations:

acquiring coordinates of eye region characteristic points in the coordinate system to calculate the aspect ratio of the eyes;

alternatively, the first and second electrodes may be,

Optionally, the processor 1001 may be further configured to call an image processing program for photographing multiple persons stored in the memory 1005, and after performing the step of performing consecutive image capturing to obtain N basic images, further perform the following operations:

displaying text prompt information on a preset user interface to prompt the progress of image processing;

the processor 1001 may be further configured to call an image processing program for photographing multiple persons stored in the memory 1005, and after performing the step of performing image synthesis processing on the target base image as a reference map to obtain a target image, further perform the following operations:

Optionally, the processor 1001 may be further configured to call an image processing program for photographing multiple persons stored in the memory 1005, and before performing the step of performing consecutive image capturing to acquire N base images, further perform the following operations:

acquiring the times N of image acquisition;

the processor 1001 may also be configured to invoke an image processing program for photographing multiple persons stored in the memory 1005 and perform the following operations:

and continuously acquiring images according to the times N by a preset image acquisition device to obtain N basic images.

Based on the hardware structure, the overall concept of each embodiment of the image processing method for photographing by multiple persons is provided.

In the embodiment of the present invention, nowadays, users usually use electronic devices (such as digital cameras, smart phones, and the like) with cameras to capture images, thereby recording things happening around, scenes seen, and the like anytime and anywhere.

In a family photographing scene or a friend gathering scene, multiple persons are usually combined, and when the multiple persons are combined, even though a photographer prompts all persons to keep the expressions, and then presses a photographing button, the expressions of the persons are still not always kept, for example, sometimes the persons are in an eye closing state, and the persons are in a state without the expressions.

Since it is difficult to capture a picture with an ideal expression of all people in a multi-person photographing scene, and multiple times of retakes are always needed, which results in a long photographing time and still makes it difficult to capture a satisfactory photo of all people, how to achieve a fast obtaining of a final picture with a best photographing effect in a multi-person photographing scene is a technical problem to be solved in the field.

In order to solve the above problem, an embodiment of the present invention provides an image processing method, an apparatus, a terminal device and a storage medium for photographing multiple people, where the image processing method for photographing multiple people includes: when a multi-person photographing instruction is detected, continuous image acquisition is carried out to obtain N basic images; carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye states of the human faces; respectively determining the number of the human images of which the human face eye states are open in the N basic images; and selecting the target basic image with the largest number of the portraits from the N basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image.

Compared with the traditional multi-person combination mode, the method comprises the steps of carrying out continuous image acquisition to obtain N basic images when a photographing instruction of a plurality of persons is detected through photographing equipment, then carrying out face recognition on the N basic images obtained through image acquisition to obtain image data of each basic image, wherein the image data of each basic image comprises the eye state of the face, then respectively determining the number of the person images with the eye state of the face being in an open state in the N basic images according to the image data, finally selecting the target basic image with the largest number of the person images with the eye state of the face being in the open state from the N basic images, and carrying out image synthesis processing by taking the target basic image as a reference image to obtain the target image.

Therefore, the method and the device realize that the base image is obtained through image acquisition and the picture of the multiple persons is obtained through image synthesis processing on the base image, and the final picture with the best photographing effect can be quickly obtained in the scene of the multiple persons by operating the technical scheme of image processing of the multiple persons photographing.

Based on the above general concept of the image processing method for photographing multiple persons, embodiments of the image processing method for photographing multiple persons are provided.

Referring to fig. 2, fig. 2 is a flowchart illustrating a method for processing an image for photographing a plurality of persons according to a first embodiment of the present invention. It should be noted that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described may be performed in an order different from that shown or described herein.

In this embodiment, the image processing method for photographing a plurality of persons according to the present invention is applied to the photographing apparatus. It should be understood that, based on different design requirements of practical applications, the image processing method for multi-person photographing according to the present invention may also be specifically applied to other terminal devices in different feasible embodiments.

As shown in fig. 2, in this embodiment, the image processing method for photographing by multiple persons according to the present invention may include:

s10, when a multi-person photographing instruction is detected, carrying out continuous image acquisition to obtain N basic images;

in this embodiment, when the photographing device detects a multi-user photographing instruction, the photographing device immediately performs image acquisition for continuous photographing through a camera configured by the photographing device to acquire N basic images. The multi-person photographing instruction is triggered by pressing a physical key or a virtual key (an imaging virtual key displayed in a specific area on a display screen) of the photographing device by a user.

It should be noted that, in this embodiment, the acquisition interval duration for performing continuous image acquisition is preset by the photographing device, and may also be reset before executing the multi-user photographing instruction each time.

Optionally, in a possible embodiment, before the step of "performing continuous image capturing to obtain N basic images" in the step S10, the image processing method for photographing by multiple persons according to the present invention may further include:

step S50: acquiring the times N of image acquisition;

in this embodiment, before the photographing apparatus performs continuous image acquisition to obtain N basic images, the number of times N of image acquisition performed this time is obtained, where the number of times N may be a value newly input by a user through a preset user interface, or a value that has been input by the user when the user used a multi-user photographing instruction last time, or a value preset by the photographing apparatus system.

Based on the above step S50, in a possible embodiment, the step of "performing consecutive image acquisition to obtain N base images" in the above step S10 may include:

step S101: and continuously acquiring images according to the times N by a preset image acquisition device to obtain N basic images.

In this embodiment, when the photographing device receives a multi-user photographing instruction, the number N of times of image acquisition after the multi-user photographing instruction is triggered is obtained, and then the photographing device performs image acquisition operation of continuous photographing through a preset image acquisition device according to the obtained number N of times of image acquisition to obtain N basic images.

For example, assuming that before the photographing device performs continuous image acquisition, the number of times of image acquisition performed by the user through virtual key input is 10, and the acquisition interval duration of the continuous image acquisition is 5s, after the photographing device receives a multi-person photographing instruction, the photographing device performs continuous 10 times of photographing on a picture scene to be acquired through a camera configured to the photographing device within 5s, so that the photographing device obtains 10 basic images within 5 s.

Step S20: carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye state of a human face;

in this embodiment, after the photographing device performs continuous image acquisition to obtain N basic images, the photographing device performs face recognition on the N basic images respectively to obtain N image data corresponding to the N basic images, that is, each basic image corresponds to one image data. Wherein, each image data at least comprises the human face eye state of each human face.

For example, in this embodiment, the photographing apparatus obtains 5 base images through continuous image acquisition, and takes part in a total of 4 persons in a group photograph, then the photographing apparatus performs face recognition on the 5 base images to obtain respective image data of the 5 base images, and in a case that none of the faces in the base images is blocked, the image data of any one of the 5 base images includes the eye states of the faces of the 5 faces.

Step S30: respectively determining the number of the human images of which the human face eye states are open in the N basic images;

in this embodiment, after the photographing device performs the face recognition operation on the N basic images to obtain image data of the N basic images including the eye state of the human face, the photographing device further determines the number of the human images in the N basic images in which the eye state of the human face is open according to the image data.

It should be noted that, in this embodiment, each face participating in the group photo has two eye states, the number of the images determined by the photographing device is counted only when the eye states of the two eyes of the same face are simultaneously open, and the eye state of the face of any one eye of the same face is closed, or any one eye of the same face is blocked, which is not counted into the number of the images determined by the photographing device.

Step S40: and selecting the target basic image with the largest number of the portraits from the N basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image.

In the present embodiment, the photographing apparatus, after acquiring N pieces of image data of N base images, selects a target base image having the largest number of faces whose eye states of the faces are open among the N base images, and performs image synthesis processing using the target base image as a reference image to obtain a target image photographed by a plurality of persons.

Optionally, in a possible embodiment, in the step S20, the photographing apparatus performs face recognition on the N base images to obtain respective image data of the N base images, which includes a face mouth state in addition to the face eye state. Based on this, the step of "performing image synthesis processing using the target base image as a reference image to obtain a target image" in the above step S40 may include:

step S401: taking the target basic image as a reference image, and judging the adjustable portrait of which the human face eye state is a closed state and/or the human face mouth state is an expressionless state in the reference image;

in this embodiment, the photographing apparatus determines, using the target base image having the largest number of faces whose eye states are open as the reference image, that the eye states of the face are closed adjustable faces, that the mouth states of the face are expressionless adjustable faces, and that the eye states of the face are closed and that the mouth states of the face are expressionless adjustable faces in the reference image.

Step S402: extracting a human face eye region image of which the human face eye state corresponding to the adjustable portrait is an open state from the basic image, and/or extracting a human face mouth region image of which the human face mouth state corresponding to the adjustable portrait is a smile state from the basic image;

in this embodiment, the photographing device finds an adjustable portrait with a closed face and eye state and/or an expressionless face and mouth state in the reference image, and then determines, in the base image, a face and eye region image with an open face and eye state in a face corresponding to the adjustable portrait according to the image data, and/or determines, in the base image, a face and mouth region image with a smile face and mouth state in a face corresponding to the adjustable portrait according to the image data.

Illustratively, in a 7-person group scene, the photographing apparatus selects a target base image with the largest number of persons in an eye-open state from among 10 base images based on data information of eye states of the human face, the target base image has eyes of a person a not open and a person B not smiling, that is, the persons of the person a and the person B are adjustable persons in the target base image, the photographing apparatus finds an eye region image with eyes of the person a in an eye-open state and a mouth region image with mouth of the person B in a smile state from other base images, and extracts the eye region image of the person a and the mouth region image of the person B from the base images.

Step S403: and carrying out image synthesis processing on the basis of the human face eye region image and/or the human face mouth region image and the adjustable portrait in the reference image to obtain a target image.

In this embodiment, after finding the adjustable person image in the reference image and the facial eye region image and/or the facial mouth region image corresponding to the adjustable person image, the photographing apparatus adaptively synthesizes the facial eye region image and/or the facial mouth region image to the position of the adjustable person image in the reference image, and replaces the original eye region image in the eye closed state and/or the mouth region image in the non-expression state of the adjustable person image, so as to obtain the target image in which the facial eye state is open and the facial mouth state is smile.

In this embodiment, the photographing apparatus selects only one target base image as the reference map to perform the image synthesis processing, and selects the target base image having the best effect on the eye-open state and/or the best effect on the smile state as the reference map if the number of the human figures having the eye-open state of the human face in the N base images is the same.

Illustratively, in this embodiment, the reference image selected by the photographing apparatus is a 5-person combined image, where only the eyes of the person a are not open, the face position of the person a is located in the remaining base image, a face eye region image in which the eye state of the person a face is open is found from the base image, the face eye region image corresponding to the person a is extracted from the base image, and the extracted face eye region image is adaptively combined with the face of the person a in the reference image, so that the facial feature effects of the 5 persons combined in the target image are the best, that is, the face eye states of the 5 persons are all open and the face mouth state of the 5 persons is a smile state.

In addition, in a feasible embodiment, the photographing device performs image processing according to the cloud training model, and stores the processed target image in the local storage space of the photographing device.

The invention provides an image processing method for multi-person photographing, which comprises the steps that firstly, when a photographing device detects a multi-person photographing instruction, the photographing device immediately carries out image acquisition operation of continuous photographing through a camera configured by the photographing device to obtain N basic images. Then, the photographing device performs face recognition on the N basic images respectively to obtain N image data corresponding to the N basic images, that is, each basic image corresponds to one image data. Wherein, each image data at least comprises the human face eye state of each human face. Then, the photographing device further determines the number of the human images with the eye state of the human face being open in the N basic images according to the image data. Finally, the photographing device selects a target basic image with the largest number of human figures with the human face and eye state being open from the N basic images, and performs image synthesis processing by taking the target basic image as a reference image to obtain a target image photographed by multiple persons.

Therefore, compared with the traditional multi-person co-shooting mode, the image processing method for multi-person shooting provided by the invention realizes that the base image is obtained through image acquisition and the image synthesis processing is carried out on the base image to obtain the multi-person co-shooting image, and the final image with the best shooting effect can be quickly obtained in the multi-person shooting scene by operating the technical scheme for image processing of multi-person shooting.

Further, based on the above first embodiment of the image processing method for photographing by multiple persons of the present invention, a second embodiment of the image processing method for photographing by multiple persons of the present invention is provided.

In this embodiment, in step S20 of the first embodiment, the photographing apparatus performs face recognition on the N base images to obtain respective image data of the N base images, which includes the number of faces in addition to the above-mentioned eye states of the faces. Based on this, in the above step S30: after the number of the human images with the human face and eye states of the N basic images being opened is respectively determined, the image processing method for photographing multiple persons of the invention may further include:

step A10: determining the number of the persons taking the pictures according to the number of the faces;

in this embodiment, the image data of the N basic images obtained by the photographing device through performing face recognition on the N basic images includes the number of faces, wherein only five sense organs of a single face can be completely scanned by the photographing device and then counted by the number of faces, and the maximum value of the number of faces scanned by the photographing device in the N basic images is the determined number of persons to be photographed.

Step A20: determining alternative basic images of which the number of the faces is equal to the number of the persons who take pictures in the N basic images;

in this embodiment, after the photographing device obtains the respective face numbers of the N base images, it is determined that the number of faces in the N base images is equal to the number of persons to be photographed, and if the face numbers of the N base images obtained by performing face recognition on the N base images are the same, the N base images are all used as the alternative base images.

Based on the above steps a10 and a20, in one possible embodiment, the photographing apparatus in step S40 of the above first embodiment: selecting a target base image with the largest number of the portraits from the N base images, and performing image synthesis processing on the target base image as a reference image to obtain a target image, wherein the image synthesis processing may include:

step S404: and selecting the target basic image with the largest number of the portraits from the alternative basic images, and performing image synthesis processing by taking the target basic image as a reference image to obtain a target image.

In the present embodiment, the photographing apparatus selects, from candidate base images having a number of faces equal to the number of persons to be photographed, a target base image having the largest number of persons whose eye states of the faces are open, and performs image synthesis processing using the target base image as a reference image to obtain a target image for photographing by a plurality of persons, that is, selects, from N base images, a target base image having a full number of faces to be photographed and the largest number of persons whose eyes are open, as a reference image to perform image synthesis processing.

Therefore, in the embodiment, the method and the device for obtaining the picture of the multiple persons combined photograph can obtain the basic image through image acquisition and perform image synthesis processing on the basic image to obtain the picture of the multiple persons combined photograph, judge the number of persons to be photographed through face recognition, and quickly obtain the final picture with the best photographing effect in the scene of the multiple persons photographing by operating the technical scheme of image processing of the multiple persons photographing.

Further, based on the first embodiment and/or the second embodiment of the image processing method for photographing multiple persons according to the present invention, a third embodiment of the image processing method for photographing multiple persons according to the present invention is provided.

In this embodiment, the image processing method for photographing by multiple persons according to the present invention may further include:

step B10: sequentially positioning the positions of human face eyeball in the N basic images, and establishing a coordinate system by taking the positions of the eyeball as an origin;

in this embodiment, the photographing apparatus sequentially positions the positions of the human face eyeball in the N base images, and establishes a coordinate system with the positions of the positioned eyeball as an origin, as shown in fig. 3, in the case that the human face in the base images is not shielded, any one of the N base images can establish two coordinate systems with the positions of the eyeball as the origin.

Step B20: acquiring coordinates of eye region feature points in the coordinate system to calculate the aspect ratio of the eyes;

in this embodiment, the photographing apparatus obtains coordinates of feature points of the eye region based on a coordinate system established in the N base images, where the feature points of the eye region may include an inner point P1 of the eye, an inner point P2 of the upper eyelid of the eye, an outer point P3 of the upper eyelid of the eye, an outer point P4 of the eye, an outer point P5 of the lower eyelid of the eye, and an inner point P6 of the lower eyelid of the eye, and then the photographing apparatus may calculate the eye aspect ratio EAR according to the coordinates of the feature points of the eye region as shown below.

In the above formula for calculating the eye aspect ratio EAR, the numerator (| P2-P6| + | P3-P5 |) calculates the distance between the vertical eye coordinates, and the denominator 2 (| P1-P4 |) calculates the distance between the horizontal eye coordinates, because there is only one set of horizontal points but two sets of vertical points, the denominator is weighted appropriately.

Step B30: if the eye aspect ratio is smaller than a preset aspect ratio threshold value, determining that the eye state of the human face is a closed state;

and step B40: and if the eye aspect ratio is larger than or equal to the aspect ratio threshold, determining that the eye state of the human face is in an open state.

In this embodiment, the photographing apparatus determines the eye status of the human face according to the eye aspect ratio calculated by the eye region feature point coordinates, where the eye aspect ratio is approximately constant when the eyes are open, but rapidly decreases to approximately zero when the eyes blink, based on which the photographing apparatus may determine that the corresponding eye status of the human face is a closed status if the eye aspect ratio is smaller than a preset aspect ratio threshold, and similarly, the eye aspect ratio calculated by the photographing apparatus according to the eye region feature point coordinates is greater than or equal to the preset aspect ratio threshold, and determines that the corresponding eye status of the human face is an open status, where the preset aspect ratio threshold is a value preset by the photographing apparatus system.

In addition, in a possible embodiment, the photographing device sequentially locates the position of the mouth of the human face in the N basic images, and then calculates the width of the mouth and the opening height of the mouth. Under the expressionless state, the mouth width is minimum, under the smile state, no matter be tooth exposure or not tooth exposure, the mouth width all can grow, consequently preferentially think that the great smile index of mouth width is great, under the condition that the face mouth state in the judgement base image is the smile state, can further judge the open height of mouth, the open height of mouth is near predetermined mouth height threshold value, the smile effect is better, wherein, mouth height threshold value is the numerical value that equipment system of shooing preset.

In this embodiment, the photographing apparatus may be configured to combine the eye region image in which the eye state of the face of the co-photographer is the eye-open state and the mouth region image in which the mouth state of the face of the co-photographer is the smile state into the reference image through an image combining operation by determining the eye state and the mouth state of the face of each face acquired from the N base images, so that a final image with the best photographing effect can be obtained quickly in a scene where multiple persons are photographed.

Further, based on the above first, second and/or third embodiment of the image processing method for photographing multiple persons of the present invention, a fourth embodiment of the image processing method for photographing multiple persons of the present invention is proposed.

step C10: displaying text prompt information on a preset user interface to prompt the progress of the step of performing continuous image acquisition to obtain N basic images;

in this embodiment, when the photographing device detects that a multi-person photographing instruction performs continuous image capturing operations, the photographing device immediately controls its user interface to output and display text prompt information to prompt acquisition of a step of obtaining N basic images by performing the continuous image capturing operations.

Illustratively, the photographing apparatus displays "in photographing (x/n), do not move" on the user interface when detecting that the multi-person photographing instruction performs continuous photographing. Wherein x represents the shot number, and n represents the image number threshold value for image acquisition by the multi-person shooting instruction.

Optionally, in another possible embodiment, the image processing method for photographing multiple persons according to the present invention may further include:

step C20: and outputting voice prompt information through a preset loudspeaker to prompt the progress of the step of performing continuous image acquisition to obtain the N basic images.

In this embodiment, when detecting that a multi-person photographing instruction performs continuous image capturing operations, the photographing device outputs voice prompt information by controlling a preset speaker to prompt acquisition of steps of acquiring N basic images for the ongoing continuous image capturing operations.

Alternatively, in a possible embodiment, after the step of "performing continuous image acquisition to obtain N basic images" in step S10 of the first embodiment, the image processing method for photographing by multiple persons according to the present invention may further include:

step C30: displaying text prompt information on a preset user interface to prompt according to the progress of image processing;

in this embodiment, after the photographing device performs continuous image acquisition to obtain N basic images, text prompt information is displayed on a preset user interface to prompt the progress of current image processing.

Alternatively, in a possible embodiment, after the step of "performing image synthesis processing using the target base image as a reference map to obtain a target image" in step S40 of the first embodiment, the image processing method for photographing multiple persons of the present invention may further include:

step C40: and storing the target image and displaying text prompt information on a preset user interface to prompt a user to view the target image.

In this embodiment, after the photographing apparatus performs image synthesis processing on a target basic image as a reference image to obtain a target image, text prompt information is displayed on a preset user interface to prompt a user to view the target image.

Illustratively, after the multi-person photographing instruction is executed for the second time, the user interface of the photographing device is changed from 'during photographing (x/n), do not move' to 'during photographing effect optimization', when the photographing device finishes processing and outputs a final target image, the user interface displays that the photographing effect is optimized, the processed target image is stored in the local storage space, and a user using the photographing device can immediately check the optimization effect of multi-person combination.

In the embodiment, the photographing device performs configuration of a related image acquisition progress reminding function on a preset user interface or a preset loudspeaker, so that the visualization of a photographing process can be realized when a plurality of persons are photographed by a user, and an optimized final target image can be immediately checked after image processing is finished, so that the use experience of the user is improved, the photographing efficiency of a plurality of persons photographing scene is greatly improved, and a final picture with the best photographing effect can be quickly obtained in the plurality of persons photographing scene.

In addition, the embodiment of the invention also provides an image processing device for photographing by multiple persons.

Referring to fig. 4, the image processing apparatus for photographing a plurality of persons according to the present invention includes:

the image acquisition module 10 is used for carrying out continuous image acquisition to obtain N basic images when a multi-person photographing instruction is detected;

a face recognition module 20, configured to perform face recognition on the N basic images to obtain respective image data of the N basic images, where the image data includes a face eye state;

a determining module 30, configured to determine the number of the human images in which the eye states of the human faces are open in the N basic images respectively;

and the image processing module 40 is configured to select a target base image with the largest number of the portraits from the N base images, and perform image synthesis processing on the target base image as a reference image to obtain a target image.

Optionally, the image data further includes a number of faces, and the determining module 30 of the image processing apparatus for photographing multiple persons is further configured to determine the number of persons to be photographed according to the number of faces; and determining alternative basic images of which the number of the human faces is equal to the number of the photographed people in the N basic images;

an image processing module 40, comprising:

and the image synthesis unit is used for selecting the target basic image with the largest number of the portraits from the candidate basic images and carrying out image synthesis processing by taking the target basic image as a reference image to obtain a target image.

Optionally, the image data further includes a face and mouth state, and the image processing module 30 includes:

the judging unit is used for judging the adjustable portrait of which the human face eye state is a closed state and/or the human face mouth state is an expressionless state in the reference image by taking the target basic image as the reference image;

an extracting unit, configured to extract, from the base image, a face eye region image in which the face eye state corresponding to the adjustable portrait is open, and/or extract, from the base image, a face mouth region image in which the face mouth state corresponding to the adjustable portrait is smile;

and the synthesis unit is used for carrying out image synthesis processing on the basis of the human face eye region image and/or the human face mouth region image and the adjustable portrait in the reference image to obtain a target image.

Optionally, the image processing apparatus for photographing by multiple persons according to the present invention further includes:

the positioning module is used for sequentially positioning the positions of the human face eyeball in the N basic images and establishing a coordinate system by taking the positions of the eyeball as an original point;

the calculation module is used for acquiring the coordinates of the eye region characteristic points in the coordinate system to calculate the eye aspect ratio;

the determining module 30 of the image processing apparatus for photographing multiple persons is further configured to determine that the eye state of the human face is a closed state if the eye aspect ratio is smaller than a preset aspect ratio threshold; and if the eye aspect ratio is larger than or equal to the aspect ratio threshold, determining that the eye state of the human face is in an open state.

the first prompting module is used for displaying text prompting information on a preset user interface so as to prompt the progress of the step of performing continuous image acquisition to obtain N basic images;

alternatively, the first and second electrodes may be,

The second prompting module is used for displaying text prompting information on a preset user interface so as to prompt according to the progress of image processing;

and the third prompting module is used for storing the target image and displaying text prompting information on a preset user interface so as to prompt a user to check the target image.

the acquisition module is used for acquiring the times N of image acquisition;

image acquisition module 10, comprising:

and the acquisition unit is used for continuously acquiring images according to the times N through a preset image acquisition device so as to obtain N basic images.

The function implementation of each module in the image processing apparatus for photographing by multiple persons corresponds to each step in the embodiment of the image processing method for photographing by multiple persons, and the functions and implementation processes are not described in detail herein.

In addition, the present invention further provides a storage medium, where the storage medium stores a program for processing an image photographed by multiple persons, and the program for processing an image photographed by multiple persons is executed by a processor to implement the steps of the image processing method photographed by multiple persons of the present invention.

The specific embodiment of the storage medium of the present invention is substantially the same as the embodiments of the image processing method for photographing multiple persons, and will not be described herein again.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. An image processing method for photographing multiple persons is characterized by comprising the following steps:

2. The image processing method for photographing a plurality of persons according to claim 1, wherein said image data further includes a number of faces, and after said step of determining the number of faces whose eye states are open in said N base images, respectively, said method further comprises:

3. The image processing method for photographing a plurality of persons according to claim 1, wherein the image data further includes a face mouth state, and the step of performing image synthesis processing using the target base image as a reference image to obtain a target image includes:

4. The image processing method for photographing a plurality of persons according to any one of claims 1 to 3, wherein the method further comprises:

5. An image processing method for photographing of a plurality of persons according to any of claims 1 to 3, said method further comprising:

alternatively, the first and second electrodes may be,

and outputting voice prompt information through a preset loudspeaker to prompt the progress of the step of performing continuous image acquisition to obtain the N basic images.

6. The image processing method for photographing a plurality of persons according to any one of claims 1 to 3, wherein after the step of performing successive image acquisitions to obtain N base images, the method further comprises:

7. The method of image processing for multi-person photographing according to claim 1, wherein before said step of performing successive image acquisitions to acquire N base images, said method further comprises:

acquiring the times N of image acquisition;

8. An image processing apparatus for photographing a plurality of persons, the image processing apparatus for photographing a plurality of persons comprising:

the face recognition module is used for carrying out face recognition on the N basic images to obtain respective image data of the N basic images, wherein the image data comprise the eye state of a human face;

9. A terminal device, characterized in that the terminal device comprises: a memory, a processor and an image processing program for multiple photographing stored on the memory and executable on the processor, the image processing program for multiple photographing implementing the steps of the image processing method for multiple photographing as claimed in any one of claims 1 to 7 when executed by the processor.

10. A storage medium having stored thereon an image processing program for photographing multiple persons, the image processing program for photographing multiple persons when executed by a processor implementing the steps of the image processing method for photographing multiple persons as claimed in any one of claims 1 to 7.