CN108711180A - Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device - Google Patents

Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device Download PDF

Info

Publication number
CN108711180A
CN108711180A CN201810411198.0A CN201810411198A CN108711180A CN 108711180 A CN108711180 A CN 108711180A CN 201810411198 A CN201810411198 A CN 201810411198A CN 108711180 A CN108711180 A CN 108711180A
Authority
CN
China
Prior art keywords
makeups
sub
changing face
key point
face
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810411198.0A
Other languages
Chinese (zh)
Other versions
CN108711180B (en
Inventor
许亲亲
杨瑞健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sensetime Technology Development Co Ltd
Original Assignee
Beijing Sensetime Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sensetime Technology Development Co Ltd filed Critical Beijing Sensetime Technology Development Co Ltd
Priority to CN202110977497.2A priority Critical patent/CN113658298A/en
Priority to CN201810411198.0A priority patent/CN108711180B/en
Publication of CN108711180A publication Critical patent/CN108711180A/en
Application granted granted Critical
Publication of CN108711180B publication Critical patent/CN108711180B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/04Context-preserving transformations, e.g. by using an importance map

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The embodiment of the invention discloses a kind of makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device, wherein the generation method of makeups/special efficacy of changing face program file packet includes:Show preset key point on reference picture and reference picture;Makeups and/or sub- material of changing face are imported, and shows makeups/sub- material of changing face of importing;The parameter value of the special effect parameters of makeups/sub- material of changing face is obtained, and establishes the correspondence between the key point in the display properties and display location coverage area of makeups and/or sub- material of changing face;Makeups and/or special efficacy program file packet of changing face are generated according to makeups and/or sub- material of changing face, the parameter value of special effect parameters and correspondence.The embodiment of the present invention is not necessarily to that executable makeups/special efficacy of the changing face program file of rendering engine can be generated by manual writing program file, improves the whole efficiency of special efficacy realization, and avoid the mistake that manual writing program file is likely to occur.

Description

Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method With device
Technical field
The present invention relates to artificial intelligence technology, the generation and makeups of especially a kind of makeups/special efficacy of changing face program file packet/ Special efficacy of changing face generation method and device.
Background technology
Augmented reality (Augmented Reality, AR) is a kind of by real world information and virtual world information " seamless " integrated new technology, is the entity information script in the certain time spatial dimension of real world, analog simulation It is superimposed virtual information again afterwards, virtual information is applied to real world, by the personage of real world, environment and virtual object It has been added to the same picture in real time or space exists simultaneously, to reach the sensory experience of exceeding reality.
Invention content
The embodiment of the present invention provides a kind of makeups and/or the generation for special efficacy program file packet of changing face and makeups and/or changes The technical solution that face special efficacy generates.
One side according to the ... of the embodiment of the present invention, a kind of generation side of the makeups provided/special efficacy of changing face program file packet Method, including:
Show preset key point on reference picture and the reference picture;The reference picture includes:With reference to personage's At least part image;
Makeups and/or sub- material of changing face are imported, and shows the makeups of importing and/or sub- material of changing face;
The parameter value of the special effect parameters of the makeups and/or sub- material of changing face is obtained, the special effect parameters include superposition side Formula parameter, and establish the key point in the display properties and display location coverage area of the makeups and/or sub- material of changing face it Between correspondence;The display properties includes:Size and/or display location;
It is generated according to the makeups and/or sub- material of changing face, the parameter value of the special effect parameters and correspondence beautiful Adornment and/or special efficacy program file packet of changing face.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the reference At least part image of personage includes described with reference to the following arbitrary part of personage or manifold image:Complete image, Head image, face image, shoulder image, arm image, images of gestures, waist image, leg image, foot's image.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the makeups And/or sub- material of changing face includes:Makeups for the position of personage and/or sub- material of changing face, and/or for personage's The makeups at two or more positions and/or the combination for sub- material of changing face.
Optionally, described default in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face Key point include it is following any one or more:Header key point, face's key point, shoulder key point, arm key point, Gesture key point, waist key point, leg key point, foot's key point, skeleton key point.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the head Key point includes at least one of:Crown key point, nose key point and chin key point;And/or
Face face key point includes at least one of:Face mask key point, eyes key point, eyebrow are crucial Point, nose key point, mouth key point;And/or
The shoulder key point includes at least one of:The key that crosses on the shoulders to cross positioned at shoulder and head at position Shoulder profile midpoint key point at point, and point midway between arm root profile key point and the key point that crosses on the shoulders; And/or
The arm key point includes at least one of:Wrist profile key point, elbow profile key point, arm root wheel Wide key point, the forearm profile midpoint at the point midway between wrist profile key point and elbow profile key point It closes at large arm midpoint at key point, and point midway between elbow profile key point and arm root profile key point Key point;And/or
The gesture key point includes at least one of:In the four vertex key points and gesture box of gesture box Heart key point;And/or
The leg key point includes at least one of:Crotch key point, knee profile key point, ankle profile are crucial Point, thigh root lateral profile key point, at the point midway between knee profile key point and ankle profile key point Shank profile midpoint key point, in the thigh at point midway between knee profile key point and crotch key point Profile midpoint key point, and the point midway between knee profile key point and thigh root lateral profile key point The thigh outer profile midpoint key point at place;And/or
The waist key point includes at least one of:Thigh root lateral profile key point and arm root profile is crucial N deciles between point, generated N number of Along ent;Wherein, the N is more than 1;And/or
Foot's key point includes at least one of:Tiptoe key point and heel key point;And/or
The skeleton key point is including at least one of:Right shoulder bone key point, right elbow bone key point are right Carpal bone bone key point, left shoulder bone key point, left elbow bone key point, left carpal bone bone key point, right hipbone bone key point are right Kneecap bone key point, right anklebone bone key point, left hipbone bone key point, left kneecap bone key point, left anklebone bone key point, head Parietal bone bone key point and neck bone key point.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the eyes Key point includes at least one of:Left eye socket of the eye key point, pupil of left eye center key point, left eye center key point, right eye socket of the eye Key point, pupil of right eye center key point and right eye center key point;And/or
The eyebrow key point includes at least one of:Left eyebrow key point and right eyebrow key point;And/or
The nose key point includes at least one of:Bridge of the nose key point, under nose on the outside of key point and nose Profile key point;And/or
The mouth key point includes at least one of:Upper lip key point and lower lip key point.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the importing Makeups and/or sub- material of changing face, including:
The importing instruction inputted by the interactive interface of action bar is received, the material file for importing instruction and being directed toward is imported Makeups in folder and/or sub- material of changing face.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the reception The importing instruction inputted by the interactive interface of action bar imports the makeups imported in the material file folder that instruction is directed toward And/or sub- material of changing face, including:
It receives by the selection instruction for operating the interactive interface blocked and sending, with the reference section chosen instruction and chosen The display target is blocked as the current target site for needing to add makeups and/or special efficacy of changing face, and in the operation in position Interface is arranged in special effect parameters under position;
It receives the importing that the interactive interface by the special effect parameters being arranged in interface is sent to instruct, imports the importing and refer to Enable the makeups in the material file folder being directed toward and/or sub- material of changing face.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described in importing The makeups in the material file folder that instruction is directed toward and/or sub- material of changing face are imported, including:
It receives and is instructed by the importing that the interactive interface is sent, obtained and show the material text for importing instruction and being directed toward Part presss from both sides;
In response to receiving the makeups in being pressed from both sides to the material file and/or sub- material selectiong operation of changing face, described in importing Makeups and/or the one or more makeups and/or sub- material of changing face that sub- material selectiong operation is chosen of changing face;And/or
In response to not receiving the makeups in being pressed from both sides to the material file and/or sub- material selectiong operation of changing face, according to pre- One or more of material file folder makeups and/or sub- material of changing face are chosen in first setting, and import basis and pre-set selection Makeups and/or sub- material of changing face;
The multiple makeups and/or sub- material of changing face, which form one group, has the predetermined makeups for playing sequential and/or son of changing face Material.
Optionally, one group described in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face In makeups and/or sub- material of changing face the broadcasting sequential of multiple makeups and/or sub- material of changing face be based on the multiple makeups and/or Change face sub- material filename determine.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the display The makeups of importing and/or sub- material of changing face, including:
According to the parameter value of the stacked system, the makeups of importing are shown on the target site and/or sub- element of changing face Material.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the acquisition The parameter value of the special effect parameters of the makeups and/or sub- material of changing face, including:
The spy for being directed to the makeups and/or sub- material of changing face sent in response to the interactive interface received through action bar The parameter value for imitating parameter setting, using the parameter value of the setting as the special effect parameters of the makeups and/or sub- material of changing face Parameter value;And/or
In response to not receiving the makeups and/or sub- material of changing face are directed to by what the interactive interface of action bar was sent The parameter value of special effect parameters setting, using preset parameter value as the makeups and/or the parameter of the special effect parameters for sub- material of changing face Value.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the special efficacy Parameter includes following any one or more:
Display parameters:For indicating whether to show the makeups and/or sub- material of changing face;
Stacked system parameter:Stacked system for indicating the makeups and/or sub- material of changing face;
Triggering mode parameter:For indicating that triggering shows the trigger event of the makeups and/or sub- material of changing face;
Loop parameter:For indicating that cycle shows the number of the makeups and/or sub- material of changing face;
Play frame number parameter:For indicating the makeups and/or sub- material broadcasting how many frame number of changing face;
Postpone trigger parameter:For indicating that delay shows the time of the makeups and/or sub- material of changing face;
Triggering terminates parameter:Trigger event for indicating to terminate to show the makeups and/or sub- material of changing face;
Deform special effect parameters:For indicate to show the makeups and/or change face sub- material when generate deformed area on the image The deformation effect in domain;
Paster special effect parameters, for indicate to show the makeups and/or change face sub- material when generate sub- material on the image Special efficacy;
Retouch side special effect parameters, for indicate to show the makeups and/or change face sub- material when generate retouch side spy on the image Effect.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the triggering Event includes following any one or more:Attonity triggers, eye motion, headwork, supercilium action, hand motion, mouth Portion acts, shoulder action, deforms special efficacy, paster special efficacy, and sound special efficacy retouches side special efficacy.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described in foundation The correspondence between key point in the display properties and the display location coverage area of makeups and/or sub- material of changing face, Including:
It establishes at least two in the display properties and the display location coverage area of the makeups and/or sub- material of changing face Correspondence between key point.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
In response to receiving enabled instruction, operation display interface, the operation interface includes:Action bar, content display field The program file column and/or;
Preset key point on the display reference picture and the reference picture, including:It is aobvious in the content display field Show preset key point on the reference picture and the reference picture;
The makeups and/or sub- material of changing face that the display imports, including:In the makeups that content display field display imports And/or sub- material of changing face.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the operation Interface includes left side, middle part and three, right side region;
The operation display interface, including:
The action bar is shown in the left side of the operation interface, shows that the content is aobvious at the middle part of the operation interface Show column, described program body guoup is shown on the right side of the operation interface.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
Behaviour is moved according to the position to the makeups and/or sub- material of changing face received by the content display field Make, updates the display location of the makeups and/or sub- material of changing face and the correspondence.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
Behaviour is adjusted according to the size to the makeups and/or sub- material of changing face received by the content display field Make, update the makeups and/or change face sub- material the content display field display size.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
It is sent for two or more makeups and/or sub- material of changing face according to what the interactive interface by action bar received Figure layer parameter adjustment instruction, described two or more hiding relations between makeups and/or sub- material of changing face of adjustment, and root It is shown according to the parameter value of hiding relation and the stacked system of described two or more makeups and/or sub- material of changing face after adjustment Described two or more makeups and/or sub- material of changing face.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the generation Makeups/change before special efficacy program file packet further include:
According to pre-set special efficacy program file and the makeups and/or the parameter of the special effect parameters for sub- material of changing face Value, the correspondence generate the special efficacy program file of the makeups and/or sub- material of changing face, and aobvious by program file column Show the special efficacy program file of the makeups and/or sub- material of changing face.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the special efficacy Program file includes:With the special efficacy program file of json Program Generatings.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the generation After makeups and/or special efficacy program file packet of changing face, further include:
According to the preservation instruction received the makeups and/or special efficacy of changing face are preserved in the position for preserving instruction direction Program file packet.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the basis The preservation instruction received preserves the makeups and/or special efficacy program file packet of changing face in the position for preserving instruction direction, Including:
Instruction is preserved in response to receiving, display storing path selection interface and compression interface;
It receives and the save location that interface is sent is selected by the storing path;And it receives and is sent out based on the compression interface The compress mode sent, and the makeups and/or special efficacy program file packet of changing face are compressed according to the compress mode, it is raw At compressed file packet;
The compressed file packet is stored in the file being directed toward to the save location.
Optionally, in the generation method of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the makeups And/or the size of makeups and/or sub- material of changing face remains the makeups and/or son of changing face in special efficacy program file packet of changing face Material be imported into before size.
Other side according to the ... of the embodiment of the present invention, a kind of makeups provided/special efficacy of changing face generation method, including:
Obtain the special effect parameters of makeups and/or sub- material of changing face, the makeups and/or sub- material of changing face parameter value, with And the correspondence between the display properties and key point of the makeups and/or sub- material of changing face;The display properties includes: Size and/or display location;
The parameter of key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Value, generates the special efficacy of the makeups and/or sub- material of changing face on the image.
Optionally, it in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the makeups and/or changes face Sub- material includes:Makeups for the position of personage and/or sub- material of changing face, and/or for the two or more of personage The makeups at position and/or the combination for sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, described image includes following It anticipates one or more:Still image, image in video.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, further include:
Import makeups and/or special efficacy program file packet of changing face;The makeups and/or special efficacy program file packet of changing face include: The parameter value of the special effect parameters of the makeups and/or sub- material of changing face, the makeups and/or sub- material of changing face and described U.S. Correspondence between the display properties and key point of adornment and/or sub- material of changing face;
The parameter of the special effect parameters for obtaining makeups and/or sub- material of changing face, the makeups and/or sub- material of changing face Correspondence between the display properties and key point of value and the makeups and/or sub- material of changing face, including:From described U.S. Obtained in adornment and/or special efficacy program file packet of changing face makeups and/or sub- material of changing face, the special effect parameters parameter value and The correspondence.
Optionally, it in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the makeups and/or changes face Special efficacy program file packet is the makeups generated using the method as described in claim 1-25 is any and/or special efficacy program of changing face File packet.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, further include:
By neural network, the critical point detection that the correspondence is related to is carried out to described image, and export key point Testing result.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the critical point detection result Including following any one or more:
Position of the key point that the correspondence is related in the video in image;
The preset numbers for the key point that the correspondence is related to.
Optionally, it in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the makeups and/or changes face Sub- material includes:One group has the predetermined makeups for playing sequential and/or sub- material of changing face.
Optionally, described based on the corresponding pass in the makeups of the various embodiments described above and/or special efficacy generation method of changing face The parameter value of key point and the special effect parameters in the image that system, the correspondence are related to, generates institute on the image The special efficacy of makeups and/or sub- material of changing face is stated, including:
It is determined based on the filename of multiple makeups and/or sub- material of changing face in one group of makeup and/or sub- material of changing face The broadcasting sequential of the multiple makeups and/or sub- material of changing face;
The parameter of key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Value, the special efficacy of the makeups and/or sub- material of changing face is generated according to determining broadcasting sequential on the image.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Stacked system parameter for the stacked system for indicating the makeups and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Display parameters, the display parameters are for indicating whether to show the makeups and/or sub- material of changing face;
Key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Parameter value generates the special efficacy of the makeups and/or sub- material of changing face on the image, including:
When parameter value in response to the display parameters is the parameter value of the display makeups and/or sub- material of changing face, base The parameter value of key point and the special effect parameters in the image that the correspondence, the correspondence are related to, described The special efficacy of the makeups and/or sub- material of changing face is generated on image.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Triggering mode parameter, the triggering mode parameter are used to indicate the triggering thing that triggering shows the makeups and/or sub- material of changing face Part;
The method further includes:The parameter value for whether occurring the triggering mode parameter in detection described image is corresponding tactile Hair event;
Key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Parameter value generates the special efficacy of the makeups and/or sub- material of changing face on the image, including:
Occur the corresponding trigger event of parameter value of the triggering mode parameter in described image in response to detecting, is based on The parameter value of key point and the special effect parameters in the image that the correspondence, the correspondence are related to, in the figure As the upper special efficacy for generating the makeups and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Postpone trigger parameter, the delay trigger parameter is used to indicate the time that delay shows the makeups and/or sub- material of changing face;
Key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Parameter value generates the special efficacy of the makeups and/or sub- material of changing face on the image, including:
In response to meeting the display condition of makeups and/or sub- material of changing face, according to the parameter value of the delay trigger parameter Corresponding delay reproduction time, the key point in the image being related to based on the correspondence, the correspondence and the spy The parameter value of parameter is imitated, delay generates the special efficacy of the makeups and/or sub- material of changing face on the image;It is described meet makeups and/ Or the display condition for sub- material of changing face includes:The parameter value of the display parameters is for showing the makeups and/or son of changing face Material, and/or, there is the corresponding trigger event of parameter value of the triggering mode parameter.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Loop parameter, the loop parameter are used to indicate the loop play number of the makeups and/or sub- material of changing face;
Key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Parameter value generates the special efficacy of the makeups and/or sub- material of changing face on the image, including:
In response to meeting the display condition of makeups and/or sub- material of changing face, based on the correspondence, the correspondence The parameter value of key point and the special effect parameters in the image being related to is followed according to the parameter value of the loop parameter is corresponding Ring number recycles show the makeups and/or sub- material of changing face on the image, to generate the makeups and/or son of changing face The special efficacy of material;It is described to meet makeups and/or the display condition for sub- material of changing face includes:The parameter value of the display parameters is For showing the makeups and/or sub- material of changing face, and/or, there is the corresponding triggering of parameter value of the triggering mode parameter Event.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Frame number parameter is played, the broadcasting frame number parameter is for indicating the makeups and/or sub- material broadcasting how many frame number of changing face;
Key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Parameter value generates the special efficacy of the makeups and/or sub- material of changing face on the image, including:
In response to meeting the playing condition of makeups and/or sub- material of changing face, based on the correspondence, the correspondence The parameter value of key point and the special effect parameters in the image being related to is corresponded to according to the parameter value for playing frame number parameter Broadcasting frame number, it is described in video to play the spy that the makeups and/or sub- material of changing face are generated on the corresponding image of frame number Effect;It is described to meet makeups and/or the display condition for sub- material of changing face includes:The parameter value of the display parameters is for showing The makeups and/or sub- material of changing face, and/or, there is the corresponding trigger event of parameter value of the triggering mode parameter.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Triggering terminates parameter, and the triggering terminates the triggering thing that parameter is used to indicate to terminate to show the makeups and/or sub- material of changing face Part;
The method further includes:
Detect whether the corresponding trigger event of parameter value that the triggering terminates parameter occur;
In response to detecting the corresponding trigger event of parameter value for the triggering occur and terminating parameter, stop generating described U.S. The special efficacy of adornment and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Deform special effect parameters, the deformation special effect parameters for indicate the display makeups and/or change face sub- material when give birth on the image At the deformation effect of deformed region;
The method further includes:
The parameter of key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Value, when generating the special efficacy of the makeups and/or sub- material of changing face on the image, according to the deformation special effect parameters, in institute State the deformation effect that the deformed region is generated in image.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generation method of changing face, the special effect parameters include: Paster special effect parameters, the paster special effect parameters for indicate to show the makeups and/or change face sub- material when give birth on the image At the special efficacy of sub- material;
The method further includes:
The parameter of key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Value, when generating the special efficacy of the makeups and/or sub- material of changing face on the image, according to the paster special effect parameters, in institute State the special efficacy that the sub- material is generated in image.
Another aspect according to the ... of the embodiment of the present invention, a kind of generation of the makeups provided/special efficacy of changing face program file packet Device, including:
Display module, for showing preset key point on reference picture and the reference picture;The reference picture packet It includes:With reference at least part image of personage;And show the makeups imported and/or sub- material of changing face;
First import modul, for importing makeups and/or sub- material of changing face;
First acquisition module, the parameter value of the special effect parameters for obtaining the makeups and/or sub- material of changing face, the spy It includes stacked system parameter to imitate parameter;
Module is established, display properties and display location coverage area for establishing the makeups and/or sub- material of changing face Correspondence between interior key point;The display properties includes:Size and/or display location;
First generation module, for according to the makeups and/or sub- material of changing face, the parameter value of the special effect parameters and institute It states correspondence and generates makeups and/or special efficacy program file packet of changing face.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the reference At least part image of personage includes described with reference to the following arbitrary part of personage or manifold image:Complete image, Head image, face image, shoulder image, arm image, images of gestures, waist image, leg image, foot's image.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the makeups And/or sub- material of changing face includes:Makeups for the position of personage and/or sub- material of changing face, and/or for personage's The makeups at two or more positions and/or the combination for sub- material of changing face.
Optionally, described default in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face Key point include it is following any one or more:Header key point, face's key point, shoulder key point, arm key point, Gesture key point, waist key point, leg key point, foot's key point, skeleton key point.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the head Key point includes at least one of:Crown key point, nose key point and chin key point;And/or
Face face key point includes at least one of:Face mask key point, eyes key point, eyebrow are crucial Point, nose key point, mouth key point;And/or
The shoulder key point includes at least one of:The key that crosses on the shoulders to cross positioned at shoulder and head at position Shoulder profile midpoint key point at point, and point midway between arm root profile key point and the key point that crosses on the shoulders; And/or
The arm key point includes at least one of:Wrist profile key point, elbow profile key point, arm root wheel Wide key point, the forearm profile midpoint at the point midway between wrist profile key point and elbow profile key point It closes at large arm midpoint at key point, and point midway between elbow profile key point and arm root profile key point Key point;And/or
The gesture key point includes at least one of:In the four vertex key points and gesture box of gesture box Heart key point;And/or
The leg key point includes at least one of:Crotch key point, knee profile key point, ankle profile are crucial Point, thigh root lateral profile key point, at the point midway between knee profile key point and ankle profile key point Shank profile midpoint key point, in the thigh at point midway between knee profile key point and crotch key point Profile midpoint key point, and the point midway between knee profile key point and thigh root lateral profile key point The thigh outer profile midpoint key point at place;And/or
The waist key point includes at least one of:Thigh root lateral profile key point and arm root profile is crucial N deciles between point, generated N number of Along ent;Wherein, the N is more than 1;And/or
Foot's key point includes at least one of:Tiptoe key point and heel key point;And/or
The skeleton key point is including at least one of:Right shoulder bone key point, right elbow bone key point are right Carpal bone bone key point, left shoulder bone key point, left elbow bone key point, left carpal bone bone key point, right hipbone bone key point are right Kneecap bone key point, right anklebone bone key point, left hipbone bone key point, left kneecap bone key point, left anklebone bone key point, head Parietal bone bone key point and neck bone key point.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the eyes Key point includes at least one of:Left eye socket of the eye key point, pupil of left eye center key point, left eye center key point, right eye socket of the eye Key point, pupil of right eye center key point and right eye center key point;And/or
The eyebrow key point includes at least one of:Left eyebrow key point and right eyebrow key point;And/or
The nose key point includes at least one of:Bridge of the nose key point, under nose on the outside of key point and nose Profile key point;And/or
The mouth key point includes at least one of:Upper lip key point and lower lip key point.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described first Import modul is specifically used for receiving the importing instruction inputted by the interactive interface of action bar, imports the importing instruction and is directed toward Material file folder in makeups and/or sub- material of changing face.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described first Import modul is specifically used for:It receives through the selection instruction for operating the interactive interface blocked and sending, is instructed and selected with the selection The reference site taken is blocked in the operation aobvious as the current target site for needing to add makeups and/or special efficacy of changing face Show the special effect parameters setting interface under the target site;And receive the interaction being arranged by the special effect parameters in interface The importing instruction that interface is sent imports the makeups imported in the material file folder that instruction is directed toward and/or sub- material of changing face.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described first Import modul import it is described import instruction be directed toward material file folder in makeups and/or change face sub- material when, be specifically used for:
It receives and is instructed by the importing that the interactive interface is sent, obtained and show the material text for importing instruction and being directed toward Part presss from both sides;
In response to receiving the makeups in being pressed from both sides to the material file and/or sub- material selectiong operation of changing face, described in importing Makeups and/or the one or more makeups and/or sub- material of changing face that sub- material selectiong operation is chosen of changing face;And/or
In response to not receiving the makeups in being pressed from both sides to the material file and/or sub- material selectiong operation of changing face, according to pre- One or more of material file folder makeups and/or sub- material of changing face are chosen in first setting, and import basis and pre-set selection Makeups and/or sub- material of changing face;
The multiple makeups and/or sub- material of changing face, which form one group, has the predetermined makeups for playing sequential and/or son of changing face Material.
Optionally, one group described in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face In makeups and/or sub- material of changing face the broadcasting sequential of multiple makeups and/or sub- material of changing face be based on the multiple makeups and/or Change face sub- material filename determine.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the display Makeups that module display imports and/or change face sub- material when, be specifically used for according to the parameter value of the stacked system, described The makeups of importing are shown on target site and/or sub- material of changing face.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described first Acquisition module is specifically used for:
The spy for being directed to the makeups and/or sub- material of changing face sent in response to the interactive interface received through action bar The parameter value for imitating parameter setting, using the parameter value of the setting as the special effect parameters of the makeups and/or sub- material of changing face Parameter value;And/or
In response to not receiving the makeups and/or sub- material of changing face are directed to by what the interactive interface of action bar was sent The parameter value of special effect parameters setting, using preset parameter value as the makeups and/or the parameter of the special effect parameters for sub- material of changing face Value.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the special efficacy Parameter includes following any one or more:
Display parameters:For indicating whether to show the makeups and/or sub- material of changing face;
Stacked system parameter:Stacked system for indicating the makeups and/or sub- material of changing face;
Triggering mode parameter:For indicating that triggering shows the trigger event of the makeups and/or sub- material of changing face;
Loop parameter:For indicating that cycle shows the number of the makeups and/or sub- material of changing face;
Play frame number parameter:For indicating the makeups and/or sub- material broadcasting how many frame number of changing face;
Postpone trigger parameter:For indicating that delay shows the time of the makeups and/or sub- material of changing face;
Triggering terminates parameter:Trigger event for indicating to terminate to show the makeups and/or sub- material of changing face;
Deform special effect parameters:For indicate to show the makeups and/or change face sub- material when generate deformed area on the image The deformation effect in domain;
Paster special effect parameters, for indicate to show the makeups and/or change face sub- material when generate sub- material on the image Special efficacy;
Retouch side special effect parameters, for indicate to show the makeups and/or change face sub- material when generate retouch side spy on the image Effect.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the triggering Event includes following any one or more:Attonity triggers, eye motion, headwork, supercilium action, hand motion, mouth Portion acts, shoulder action, deforms special efficacy, paster special efficacy, and sound special efficacy retouches side special efficacy.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the foundation Module is specifically used in the display properties and the display location coverage area of establishing the makeups and/or sub- material of changing face extremely Correspondence between few two key points.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the display Module includes:
Operation interface, for being shown in response to receiving enabled instruction, the operation interface includes:Action bar, content are aobvious Show column and/or program file column;
The display module is specifically used for showing on the reference picture and the reference picture in the content display field Preset key point;And show the makeups imported and/or sub- material of changing face in the content display field.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the operation Interface includes left side, middle part and three, right side region;
The action bar is shown in the left side of the operation interface, shows that the content is aobvious at the middle part of the operation interface Show column, described program body guoup is shown on the right side of the operation interface.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
First update module, for according to by the content display field receive to the makeups and/or son of changing face The position moving operation of material updates the display location of the makeups and/or sub- material of changing face and the correspondence.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
Second update module, for according to by the content display field receive to the makeups and/or son of changing face Material size adjustment operation, update the makeups and/or change face sub- material the content display field display size.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
Adjust module, for according to by the interactive interface of action bar receive for two or more makeups and/or The figure layer parameter adjustment instruction that the sub- material of changing face is sent, adjustment are described two or more between makeups and/or sub- material of changing face Hiding relation;
The display module, be additionally operable to according to after adjustment hiding relation and described two or more makeups and/or change face The parameter value of the stacked system of sub- material shows described two or more makeups and/or sub- material of changing face.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, described first Generation module is additionally operable to before generating makeups/change special efficacy program file packet, according to pre-set special efficacy program file and Parameter value, the correspondence of the special effect parameters of the makeups and/or sub- material of changing face, generate the makeups and/or change face The special efficacy program file of sub- material, and show that the special efficacy program of the makeups and/or sub- material of changing face is literary by program file column Part.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the special efficacy Program file includes:With the special efficacy program file of json Program Generatings.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, further include:
Preserving module, for instructing the position being directed toward to preserve the makeups in described preserve according to the preservation instruction received And/or special efficacy program file packet of changing face.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the preservation Module is specifically used for:
Instruction is preserved in response to receiving, display storing path selection interface and compression interface;
It receives and the save location that interface is sent is selected by the storing path;And it receives and is sent out based on the compression interface The compress mode sent, and the makeups and/or special efficacy program file packet of changing face are compressed according to the compress mode, it is raw At compressed file packet;
The compressed file packet is stored in the file being directed toward to the save location.
Optionally, in the generating means of the various embodiments described above makeups and/or special efficacy program file packet of changing face, the makeups And/or the size of makeups and/or sub- material of changing face remains the makeups and/or son of changing face in special efficacy program file packet of changing face Material be imported into before size.
Another aspect according to the ... of the embodiment of the present invention, a kind of makeups provided/special efficacy of changing face generating means, including:
Second acquisition module, for obtaining makeups and/or the spy of sub- material of changing face, the makeups and/or sub- material of changing face Imitate the correspondence between the parameter value and the display properties and key point of the makeups and/or sub- material of changing face of parameter; The display properties includes:Size and/or display location;
Second generation module, key point in image for being related to based on the correspondence, the correspondence and The parameter value of the special effect parameters generates the special efficacy of the makeups and/or sub- material of changing face on the image.
Optionally, it in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the makeups and/or changes face Sub- material includes:Makeups for the position of personage and/or sub- material of changing face, and/or for the two or more of personage The makeups at position and/or the combination for sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, described image includes following It anticipates one or more:Still image, image in video.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, further include:
Second import modul, for importing makeups and/or special efficacy program file packet of changing face;The makeups and/or the spy that changes face Imitating program file packet includes:The special effect parameters of the makeups and/or sub- material of changing face, the makeups and/or sub- material of changing face Correspondence between the display properties and key point of parameter value and the makeups and/or sub- material of changing face;
Second acquisition module, specifically for obtaining makeups from the makeups and/or special efficacy program file packet of changing face And/or parameter value and the correspondence of sub- material of changing face, the special effect parameters.
Optionally, it in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the makeups and/or changes face Special efficacy program file packet is the life using makeups/special efficacy of changing face program file packet as described in any of the above-described embodiment of the present invention The makeups generated at method or the generating means of makeups/special efficacy of changing face program file packet and/or special efficacy program file of changing face Packet.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, further include:
Critical point detection module, for by neural network, the key that the correspondence is related to be carried out to described image Point detection, and export critical point detection result.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the critical point detection result Including following any one or more:
Position of the key point that the correspondence is related in the video in image;
The preset numbers for the key point that the correspondence is related to.
Optionally, it in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the makeups and/or changes face Sub- material includes:One group has the predetermined makeups for playing sequential and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, second generation module, It is specifically used for:
It is determined based on the filename of multiple makeups and/or sub- material of changing face in one group of makeup and/or sub- material of changing face The broadcasting sequential of the multiple makeups and/or sub- material of changing face;And
The parameter of key point and the special effect parameters in the image being related to based on the correspondence, the correspondence Value, the special efficacy of the makeups and/or sub- material of changing face is generated according to determining broadcasting sequential on the image.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Stacked system parameter for the stacked system for indicating the makeups and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Display parameters, the display parameters are for indicating whether to show the makeups and/or sub- material of changing face;
Second generation module, be specifically used for be in response to the parameter value of the display parameters show the makeups and/ Or sub- material of changing face parameter value when, the key point in the image being related to based on the correspondence, the correspondence and institute The parameter value of special effect parameters is stated, generates the special efficacy of the makeups and/or sub- material of changing face on the image.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Triggering mode parameter, the triggering mode parameter are used to indicate the triggering thing that triggering shows the makeups and/or sub- material of changing face Part;
Described device further includes:
First detection module, for detect whether occur in described image the triggering mode parameter parameter value it is corresponding Trigger event;
Second generation module, is specifically used for
Occur the corresponding trigger event of parameter value of the triggering mode parameter in described image in response to detecting, is based on The parameter value of key point and the special effect parameters in the image that the correspondence, the correspondence are related to, in the figure As the upper special efficacy for generating the makeups and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Postpone trigger parameter, the delay trigger parameter is used to indicate the time that delay shows the makeups and/or sub- material of changing face;
Second generation module, specifically for the display condition in response to meeting makeups and/or sub- material of changing face, according to The corresponding delay reproduction time of parameter value of the delay trigger parameter, is related to based on the correspondence, the correspondence Image in key point and the special effect parameters parameter value, delay generates the makeups and/or sub- element of changing face on the image The special efficacy of material;It is described to meet makeups and/or the display condition for sub- material of changing face includes:The parameter value of the display parameters is to use In the display makeups and/or sub- material of changing face, and/or, there is the corresponding triggering thing of parameter value of the triggering mode parameter Part.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Loop parameter, the loop parameter are used to indicate the loop play number of the makeups and/or sub- material of changing face;
Second generation module is based on specifically for the display condition in response to meeting makeups and/or sub- material of changing face The parameter value of key point and the special effect parameters in the image that the correspondence, the correspondence are related to, according to described The corresponding cycle-index of parameter value of loop parameter recycles show the makeups and/or sub- material of changing face on the image, To generate the special efficacy of the makeups and/or sub- material of changing face;The display condition packet for meeting makeups and/or sub- material of changing face It includes:The parameter value of the display parameters be for showing the makeups and/or sub- material of changing face, and/or, there is the triggering The corresponding trigger event of parameter value of mode parameter.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Frame number parameter is played, the broadcasting frame number parameter is for indicating the makeups and/or sub- material broadcasting how many frame number of changing face;
Second generation module is based on specifically for the playing condition in response to meeting makeups and/or sub- material of changing face The parameter value of key point and the special effect parameters in the image that the correspondence, the correspondence are related to, according to described The corresponding broadcasting frame number of parameter value of frame number parameter is played, in video on the corresponding image of the broadcasting frame number described in generation The special efficacy of makeups and/or sub- material of changing face;It is described to meet makeups and/or the display condition for sub- material of changing face includes:The display The parameter value of parameter be for showing the makeups and/or sub- material of changing face, and/or, there is the ginseng of the triggering mode parameter The corresponding trigger event of numerical value.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Triggering terminates parameter, and the triggering terminates the triggering thing that parameter is used to indicate to terminate to show the makeups and/or sub- material of changing face Part;
Described device further includes:
Second detection module, for detecting whether there is the corresponding trigger event of parameter value that the triggering terminates parameter;
Second generation module is additionally operable to detect that the triggering occur terminates ginseng in response to second detection module The corresponding trigger event of several parameter values stops the special efficacy for generating the makeups and/or sub- material of changing face.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Deform special effect parameters, the deformation special effect parameters for indicate the display makeups and/or change face sub- material when give birth on the image At the deformation effect of deformed region;
Second generation module is additionally operable in the image being related to based on the correspondence, the correspondence The parameter value of key point and the special effect parameters generates the special efficacy of the makeups and/or sub- material of changing face on the image When, according to the deformation special effect parameters, the deformation effect of the deformed region is generated in described image.
Optionally, in the makeups of the various embodiments described above and/or special efficacy generating means of changing face, the special effect parameters include: Paster special effect parameters, the paster special effect parameters for indicate to show the makeups and/or change face sub- material when give birth on the image At the special efficacy of sub- material;
Second generation module is additionally operable in the image being related to based on the correspondence, the correspondence The parameter value of key point and the special effect parameters generates the special efficacy of the makeups and/or sub- material of changing face on the image When, according to the paster special effect parameters, the special efficacy of the sub- material is generated in described image.
Another aspect according to the ... of the embodiment of the present invention, a kind of electronic equipment provided, including:
Memory, for storing computer program;
Processor, for executing the computer program stored in the memory, and the computer program is performed, Realize the method described in any of the above-described embodiment of the present invention.
A kind of another aspect according to the ... of the embodiment of the present invention, the computer readable storage medium provided, is stored thereon with Computer program when the computer program is executed by processor, realizes the method described in any of the above-described embodiment of the present invention.
Another aspect according to the ... of the embodiment of the present invention, a kind of computer program provided, including computer instruction, work as institute When stating computer instruction and being run in the processor of equipment, the method described in any of the above-described embodiment of the present invention is realized.
Generation method and device, electricity based on makeups/special efficacy of changing face program file packet that the above embodiment of the present invention provides Sub- equipment, program and medium, generate makeups and/or change face special efficacy program file packet when, show on reference picture and reference picture Preset key point imports makeups and/or sub- material of changing face, and shows the makeups of importing and/or sub- material of changing face;It obtains beautiful The parameter value of the special effect parameters of adornment and/or sub- material of changing face, and establish the display properties of makeups and/or sub- material of changing face and show Show the correspondence between the key point in the coverage area of position;According to makeups and/or the ginseng of change face sub- material, special effect parameters Numerical value and correspondence generate makeups and/or special efficacy program file packet of changing face, to realize makeups on the image and/or the spy that changes face Effect.In addition, the embodiment of the present invention generate makeups and/or change face special efficacy program file packet when, without by manual writing program text Part, it is only necessary to import makeups and/or sub- material of changing face is to corresponding display properties, the executable U.S. of rendering engine can be generated Adornment and/or special efficacy program file of changing face, it is easy to operate, required time is short, improve makeups and/or the whole of special efficacy realization of changing face Body efficiency, and avoid the mistake that manual writing program file is likely to occur, effective guarantee makeups and/or special efficacy of changing face Accuracy.
Makeups/special efficacy of the changing face generation method and the device that are there is provided based on the above embodiment of the present invention, electronic equipment, program and Medium, obtain makeups and/or change face sub- material and its special effect parameters parameter value and makeups and/or sub- material of changing face it is aobvious Show that the correspondence between attribute and key point, display properties therein include size and display location;Based on the correspondence And its parameter value of the key point and special effect parameters in the image being related to, makeups and/or sub- material of changing face are generated on the image Special efficacy.The embodiment of the present invention by the parameter values of pre-set makeups and/or change face sub- material and its special effect parameters and Correspondence between the display properties and key point of makeups and/or sub- material of changing face, can generate on the image makeups and/or It changes face special efficacy, increases the whole ambiance effect of image broadcasting, enhance the recreational of user, improve the feeling of immersion of user, Improve result of broadcast.
Below by drawings and examples, technical scheme of the present invention will be described in further detail.
Description of the drawings
The attached drawing of a part for constitution instruction describes the embodiment of the present invention, and together with description for explaining The principle of the present invention.
The present invention can be more clearly understood according to following detailed description with reference to attached drawing, wherein:
Fig. 1 is the flow chart of generation method one embodiment of makeups of the present invention/special efficacy of changing face program file packet.
Fig. 2 is an illustrative diagram of makeups and/or sub- material of changing face in the embodiment of the present invention.
Fig. 3 is an illustrative diagram of face's key point in the embodiment of the present invention.
Fig. 4 is an operation interface example of the generating means of makeups/change special efficacy program file packet in the embodiment of the present invention Figure.
Fig. 5 is the illustrative diagram that interface is arranged in special effect parameters in the embodiment of the present invention.
Fig. 6 is an illustrative diagram of hand motion in the embodiment of the present invention.
Fig. 7 is the illustrative diagram that special efficacy is deformed in the embodiment of the present invention.
Fig. 8 is an illustrative diagram of paster special efficacy in the embodiment of the present invention.
Fig. 9 is the illustrative diagram that side special efficacy is retouched in the embodiment of the present invention.
Figure 10 is the flow chart of another embodiment of generation method of makeups of the present invention/special efficacy of changing face program file packet.
Figure 11 is the flow chart of makeups of the present invention/special efficacy of changing face generation method one embodiment.
Figure 12 is an exemplary signal of the special efficacy for generating makeups and/or sub- material of changing face on the image based on embodiment Figure.
Figure 13 is the flow chart of another embodiment of makeups of the present invention/special efficacy of changing face generation method.
Figure 14 is the structural schematic diagram of generating means one embodiment of makeups of the present invention/special efficacy of changing face program file packet.
Figure 15 is the structural representation of another embodiment of the makeups of the present invention/generating means of special efficacy of changing face program file packet Figure.
Figure 16 is the structural schematic diagram of makeups of the present invention/special efficacy of changing face generating means one embodiment.
Figure 17 is the structural schematic diagram of another embodiment of makeups of the present invention/special efficacy of changing face generating means.
Figure 18 is the structural schematic diagram of one Application Example of electronic equipment of the present invention.
Specific implementation mode
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should be noted that:Unless in addition having Body illustrates that the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally The range of invention.
Simultaneously, it should be appreciated that for ease of description, the size of attached various pieces shown in the drawings is not according to reality Proportionate relationship draw.
It is illustrative to the description only actually of at least one exemplary embodiment below, is never used as to the present invention And its application or any restrictions that use.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable In the case of, the technology, method and apparatus should be considered as part of specification.
It should be noted that:Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined, then it need not be further discussed in subsequent attached drawing in a attached drawing.
The embodiment of the present invention can be applied to the electronic equipments such as terminal device, computer system, server, can with it is numerous Other general or specialized computing system environments or configuration operate together.Suitable for terminal device, computer system, server etc. The example for well-known terminal device, computing system, environment and/or the configuration that electronic equipment is used together includes but unlimited In:Personal computer system, thin client, thick client computer, hand-held or laptop devices, is based on micro- place at server computer system The system of reason device, set-top box, programmable consumer electronics, NetPC Network PC, little types Ji calculate machine Xi Tong ﹑ mainframe computers System and distributed cloud computing technology environment, etc. including any of the above described system.
The electronic equipments such as terminal device, computer system, server can be in the department of computer science executed by computer system It is described under the general context of system executable instruction (such as program module).In general, program module may include routine, program, mesh Beacon course sequence, component, logic, data structure etc., they execute specific task or realize specific abstract data type. Computer system/server can be implemented in distributed cloud computing environment, and in distributed cloud computing environment, task is by leading to Cross the remote processing devices execution of communication network links.In distributed cloud computing environment, program module, which can be located at, includes On the Local or Remote computing system storage medium of storage device.
Fig. 1 is the flow chart of generation method one embodiment of makeups of the present invention/special efficacy of changing face program file packet.The present invention The generation method of each embodiment makeups and/or special efficacy program file packet of changing face, such as can be through but not limited to a device (following embodiment of the present invention is known as the generating means of makeups/change special efficacy program file packet) is realized.As shown in Figure 1, the embodiment The generation method of makeups/change special efficacy program file packet includes:
102, show preset key point on reference picture and reference picture.
Reference picture therein includes:With reference at least part image of personage, such as with reference to the following any one of personage Part or manifold image:Complete image, head image, face image, shoulder image, arm image, images of gestures, waist Portion's image, leg image, foot's image, etc..
104, makeups and/or sub- material of changing face are imported, and show the makeups of importing and/or sub- material of changing face.
Makeups in various embodiments of the present invention and/or sub- material of changing face, can be pictures, or be made of multiframe picture Animation etc..
106, the parameter value of the special effect parameters of makeups and/or sub- material of changing face is obtained, and establish the makeups and/or son of changing face The correspondence between key point in the display properties and display location coverage area of material.
Special effect parameters therein include stacked system parameter.
Display properties therein includes:Size and/or display location, i.e.,:Both it may include size and display location, also might be used Only to include size or display location.
Wherein, between the key point in the display properties and display location coverage area of makeups and/or sub- material of changing face Correspondence can be at least one key point (such as two or more passes in display properties and display location coverage area Key point) between one-to-one relationship, can also be at least one key point in display properties and display location coverage area Between binding relationship one by one.By the pass in the display properties and display location coverage area of the makeups and/or sub- material of changing face After key point is corresponded to or is bound, can realize makeups and/or change face sub- material and/or display location coverage area inside Position fits closely.
108, according to above-mentioned makeups and/or sub- material of changing face, the parameter value of special effect parameters and correspondence generate makeups and/ Or special efficacy program file packet of changing face.
In the embodiment of the present invention, makeups and/or special efficacy program file packet of changing face can be used for the special effect processing to image, scheme As upper generation makeups and/or the special efficacy for sub- material of changing face, the rendering that AR effects are carried out to still image or video image is handled, For example, when the sub- material of makeups is red lip, can red lip etc. be generated on the lip of personage in the picture.
Generation method based on makeups/special efficacy of changing face program file packet that the above embodiment of the present invention provides, generates makeups And/or change face special efficacy program file packet when, show preset key point on reference picture and reference picture, import makeups and/or It changes face sub- material, and shows the makeups of importing and/or sub- material of changing face;Obtain the special effect parameters of makeups and/or sub- material of changing face Parameter value, and establish between the key point in the display properties and display location coverage area of makeups and/or sub- material of changing face Correspondence;Makeups are generated according to makeups and/or sub- material of changing face, the parameter value of special effect parameters and correspondence and/or are changed Face special efficacy program file packet, to realize makeups on the image and/or special efficacy of changing face.In addition, the embodiment of the present invention generates makeups And/or change face special efficacy program file packet when, without pass through manual writing program file, it is only necessary to import makeups and/or son of changing face Material can generate the executable makeups of rendering engine and/or special efficacy program file of changing face, operation to corresponding display properties Simply, required time is short, improves makeups and/or the whole efficiency for special efficacy realization of changing face, and avoids manual writing program text The mistake that part is likely to occur, the effective guarantee accuracy of makeups and/or special efficacy of changing face.
In various embodiments of the present invention, makeups and/or sub- material of changing face may include:For the U.S. at the position of personage Adornment and/or sub- material of changing face, and/or for personage two or more positions makeups and/or sub- material of changing face combination. For example, makeups and/or sub- material of changing face can be the sub- materials of makeups of a lip, can also be the makeups of eyebrow and eyelashes The combination of the combination of sub- material or eye shadow and the sub- material of blush makeups can also be the makeups for each position of entire face The combination of sub- material.As shown in Fig. 2, being followed successively by from left to right:Combination, eye shadow and the cheek of the sub- material of makeups of eyebrow and eyelashes The combination of the red sub- material of makeups, the sub- material of makeups of lip, each position of entire face one of combination of the sub- material of makeups show Example property schematic diagram.
In various embodiments of the present invention, the position of multiple key points can be pre-set, so as to by makeups and/or son of changing face It is corresponded between key point in the display properties and display location coverage area of material.For example, an embodiment party wherein In formula, it can be based on Face datection and gestures detection, face is directed to respectively and gesture (hand) defines multiple key points, with reality During existing makeups and/or special efficacy of changing face generate, the correspondence of position relationship is carried out based on face key point or gesture key point.
In some embodiments of various embodiments of the present invention, preset key point for example can include but is not limited to following Any one or more:Header key point, face's key point, shoulder key point, arm key point, gesture key point, waist close Key point, leg key point, foot's key point, skeleton key point, etc..
In a wherein optional example, header key point for example can include but is not limited at least one of:The crown Key point, nose key point and chin key point, etc..
In a wherein optional example, face's key point for example can include but is not limited at least one of:Face Profile key point, eyes key point, eyebrow key point, nose key point, mouth key point, etc..
Illustratively, eyes key point for example can include but is not limited at least one of:Left eye socket of the eye key point, left eye Pupil center's key point, left eye center key point, right eye socket of the eye key point, pupil of right eye center key point and right eye center are closed Key point, etc..Eyebrow key point for example can include but is not limited at least one of:Left eyebrow key point and right eyebrow Key point, etc..Nose key point for example can include but is not limited at least one of:Bridge of the nose key point, nose lower edge are closed Key point and nose lateral profile key point, etc..Mouth key point for example can include but is not limited at least one of: Upper lip key point and lower lip key point, etc..
In a wherein optional example, shoulder key point for example can include but is not limited at least one of:It is located at Shoulder and head cross the key point that crosses on the shoulders at position, and positioned at arm root profile key point and the key point that crosses on the shoulders Between point midway at shoulder profile midpoint key point, etc..
In a wherein optional example, arm key point for example can include but is not limited at least one of:Wrist Profile key point, elbow profile key point, arm root profile key point are located at wrist profile key point and are closed with elbow profile Forearm profile midpoint key point at point midway between key point, and positioned at elbow profile key point and arm root profile Large arm midpoint key point at point midway between key point, etc..
In a wherein optional example, gesture key point for example can include but is not limited at least one of:Gesture Frame is (i.e.:Gestures detection frame) four vertex key points and gesture box center key point, etc..
In a wherein optional example, leg key point for example can include but is not limited at least one of:Crotch It is crucial to be located at knee profile for key point, knee profile key point, ankle profile key point, thigh root lateral profile key point Point ankle profile key point between point midway at shank profile midpoint key point, be located at knee profile key point with Thigh Internal periphery midpoint key point at point midway between crotch key point, and positioned at knee profile key point and greatly Thigh outer profile midpoint key point at point midway between the lateral profile key point of leg root, etc..
In a wherein optional example, waist key point for example can include but is not limited at least one of:It will be big N deciles between leg root lateral profile key point and arm root profile key point, generated N number of Along ent;Wherein, N is more than 1.
In a wherein optional example, foot's key point for example can include but is not limited at least one of:Tiptoe Key point and heel key point, etc..
In a wherein optional example, skeleton key point for example can include but is not limited at least one of: Right shoulder bone key point, right elbow bone key point, right carpal bone bone key point, left shoulder bone key point, left elbow bone key point, Left carpal bone bone key point, right hipbone bone key point, right kneecap bone key point, right anklebone bone key point, left hipbone bone key point, Left kneecap bone key point, left anklebone bone key point, crown bone key point and neck bone key point, etc..
For example, the illustrative diagram that Fig. 3 is face's key point in the embodiment of the present invention can at one in conjunction with Fig. 3 It selects in example, can such as be given a definition to face's key point:
Key point project Key point is numbered Key point project Key point is numbered
Face frame (face mask key point) 0-32 The bridge of the nose 43-46
Left eyebrow 33-37,64-67 Right eyebrow 38-42,68-71
Left eye socket of the eye 52-57,72-73 Right eye socket of the eye 58-63,75-76
Pupil of left eye 74,104, Pupil of right eye 77,105
Nose lower edge 47-51 Nose lateral profile 78-83
Upper lip 84-90,96-100 Lower lip 91-95,101-103
In an optional example, can such as it be given a definition to hand key point:
Key point project Key point is numbered Key point project Key point is numbered
Gesture box 110-113 Center 114
Wherein, the key point of number 110-113 is respectively four vertex of gestures detection frame (i.e. the external frame of hand), is compiled Numbers 114 key point is the center of gestures detection frame.
In some embodiments of various embodiments of the present invention, makeups and/or sub- material of changing face are imported, may include:It connects The importing instruction inputted by the interactive interface of action bar is received, the makeups in the material file folder that importing instruction is directed toward are imported And/or sub- material of changing face.
Makeups and/or sub- material of changing face in various embodiments of the present invention can be pre-set, for example, first passing through computer in advance Graphic image software Adobe photoshop set makeups and/or change face sub- material and export to material file folder in, pass through Computer graphic image software sets makeups and/or the sub- material and when exporting of changing face, and can be applied to figure according to each sub- material It is different from original image stacked system when as in individually to export, or by the identical two or more U.S. of stacked system Adornment and/or sub- material of changing face merge into a figure layer export.For example, the sub- material of the makeups of eyebrow and eyelashes can be merged into One figure layer exports to material file folder, and eye shadow and the sub- material of blush makeups are merged into a figure layer and export to material file Folder is exported the sub- material of the makeups of lip as an independent figure layer.
In an embodiment of various embodiments of the present invention, makeups and/or the generation for special efficacy program file packet of changing face dress It may include pre-set special efficacy program file in setting, such as can be such as light weight based on JavaScript language Data interchange format (JavaScript Object Notiation, the json) file or any other executable program of grade File.The parameter value of special effect parameters with vacancy or can be predetermined to be default value in the special efficacy program file, receive for U.S. When the parameter value of the special effect parameters of adornment and/or sub- material of changing face setting, the corresponding parametric values in the special efficacy program file are automatic It is updated to the parameter value received.Optionally, the generating means of above-mentioned makeups and/or special efficacy program file packet of changing face may include Action bar is provided at least one interactive interface in the action bar, for receiving the spy for being directed to makeups and/or sub- material of changing face Imitate the parameter value of parameter setting;In addition, the generating means of the makeups and/or special efficacy program file packet of changing face can also include journey Preface part display field is used for special display effect program file.As shown in figure 4, for makeups/special efficacy of changing face journey in the embodiment of the present invention One operation interface exemplary plot of the generating means of preface part packet, the makeups and/or the generation for special efficacy program file packet of changing face dress The operation interface set includes that operation is blocked and program file display field.The makeups and/or the generation for special efficacy program file packet of changing face dress After setting startup, interface is set corresponding to the special effect parameters of a makeups and/or sub- material of changing face in action bar, program file is shown Special efficacy program file when column shows the special effect parameters vacancy of the makeups and/or sub- material of changing face or is predetermined to be default value, The parameter value being arranged for the special effect parameters of a makeups and/or sub- material of changing face is received by the interactive interface of action bar When, the parameter value of the makeups and/or the special effect parameters for sub- material of changing face is updated to the parameter value being most recently received, program text The updated special efficacy program file of part display field real-time display parameter value.It should be noted that Fig. 4 Program file display fields The program file of display be only used for the operation interface that the generating means of makeups and/or special efficacy program file packet of changing face are showed into Row exemplary illustration, the form of expression and particular content of the present invention without concern wherein special efficacy program file, also not limiting should The form of expression and particular content of special efficacy program file.
In each makeups of the present invention and/or an embodiment of the generation method embodiment for special efficacy program file packet of changing face In, operation 102 may include:The importing instruction sent by the interactive interface of action bar is received, importing instruction is imported and is directed toward Material file folder in makeups and/or sub- material of changing face.
As shown in figure 4, it is unrestricted as an optional example of various embodiments of the present invention, may include spy in action bar Imitate parameter setting interface comprising at least one interactive interface;In addition it can including other regions, such as reference site Display area, at this time special effect parameters setting interface can be under each reference site special effect parameters setting interface.The present invention is each Reference site in embodiment, such as can include but is not limited to following any one or more:Ear (ear), hand (hand), Face (face), hair (hair), neck, limbs.As shown in figure 5, in the embodiment of the present invention, reference site is eyes (eye) When, an exemplary signal at the special effect parameters setting interface of makeups and/or (Makeup/Facetrans) sub- material of changing face Figure.In an optional example of the above embodiment of the present invention, receives the importing inputted by the interactive interface of action bar and refer to It enables, imports the makeups in the material file folder that importing instruction is directed toward and/or sub- material of changing face, may include:Reception passes through behaviour Make the selection instruction that the interactive interface that blocks is sent, using choose reference site that instruction is chosen as currently need to add makeups with/ Or the target site for special efficacy of changing face, and block the special effect parameters under display target position in operation and interface is set;Reception passes through special efficacy The importing instruction that interactive interface in parameter setting interface is sent imports U.S. in the material file folder that importing instruction is directed toward Adornment and/or sub- material of changing face.
In wherein some optional examples, import the importing instruction be directed toward material file folder in makeups and/or change face Sub- material may include:
It receives and is instructed by the importing that interactive interface is sent, obtained and show the material file folder for importing instruction direction;
In response to receiving the makeups in being pressed from both sides to material file and/or sub- material selectiong operation of changing face, import makeups and/or Sub- material selectiong of changing face operates the one or more makeups chosen and/or sub- material of changing face;And/or
In response to not receiving the makeups in being pressed from both sides to material file and/or sub- material selectiong operation of changing face, according to setting in advance It sets and chooses one or more of material file folder makeups and/or sub- material of changing face, and import according to the U.S. for pre-setting selection Adornment and/or sub- material of changing face;
Wherein, multiple makeups in material file folder are chosen and/or the sub- material and when importing of changing face, multiple makeups and/ Or sub- material of changing face can form the makeups and/or sub- material of changing face that one group has predetermined broadcasting sequential.One group of makeup and/ Or the broadcasting sequential of multiple makeups and/or sub- material of changing face can be based on multiple makeups and/or sub- element of changing face in sub- material of changing face The filename of material determines, such as the file of multiple makeups and/or sub- material of changing face in one group of makeup and/or sub- material of changing face Entitled face001, face003, face009 then can determine one group of makeup based on an illustrative preset rules And/or in sub- material of changing face the broadcasting sequential of multiple makeups and/or sub- material of changing face be face001 → face003 → face009。
May include multiple makeups and/or sub- material of changing face in each material file folder, if for example, target site is mouth When, the sub- material of lip that material file may be including different shape, color in pressing from both sides, in an implementation of various embodiments of the present invention In mode, import makeups and/or change face sub- material when, do not receive user to material file press from both sides in makeups and/or change face It when sub- material selectiong operation, can pre-set, import predeterminated position or default in the material file folder that importing instruction is directed toward The makeups of serial number and/or sub- material of changing face.For example, user do not choose makeups and/or change face sub- material when, acquiescence choose simultaneously First makeup in material file folder and/or sub- material of changing face are imported, to not choose makeups and/or son of changing face in user Corresponding makeups and/or effect of changing face can also be realized in the case of material.
Correspondingly, in wherein some optional examples, the makeups of importing and/or sub- material of changing face may include:According to spy The parameter value for imitating stacked system parameter (tag) in parameter, shows the makeups of importing and/or sub- material of changing face on target site.
Wherein, the parameter value of stacked system parameter defines corresponding stacked system.Stacked system includes computer graphical The combination of " superposition " pattern and/or transparency in image software Adobe photoshop.Wherein, " superposition " pattern is computer A kind of mixed mode in graphic image software Adobe photoshop, be present in color blend mode, channel mixed mode, In " superposition " modal sets of figure layer mixed mode." superposition " model function leads to image between image pixel and surrounding pixel Contrast increases or reduces, and is the pattern that a primary colours determine mixed effect, the mixing side of secondary colour is determined by the light and shade of primary colours Formula.The general color range that not will produce is overflowed after using " superposition " mixed mode, image detail will not be caused to lose, when exchange primary colours With the position of secondary colour, as a result color differ.
In wherein some optional examples, " superposition " pattern for example can include but is not limited to following any one or more :It passes through, normally, positive folds bottom, is superimposed, and dissolving is linear to deepen, sheen, light, Qiang Guang, linear light, brightness, and color is satisfied And degree, difference, linear intensification, etc..The value of transparency can Shi [0%, 100%].It can be by selecting any one " superposition " pattern and any one transparency value, determine corresponding stacked system.
In order to realize corresponding makeups and/or effect of changing face, the makeups suitable for different target position and/or sub- element of changing face Material may need different stacked systems to realize corresponding makeups and/or effect of changing face, and can pre-set suitable for difference The stacked system of the makeups of target site and/or sub- material of changing face, be arranged corresponding " superposition " pattern of each stacked system and/or Transparency, in this way, the makeups for the target site importing for needing makeups and/or changing face and/or sub- material setting superposition of changing face When the parameter value of mode parameter, the makeups can be directly chosen and/or the corresponding stacked system of sub- material of changing face.As follows, For pre-set makeups and/or an example of change face sub- material and its corresponding stacked system:
Makeups and/or sub- material of changing face (Face Transplant) Stacked system
Eyes (Makeup-eye) Normally, transparency is superimposed
Eye shadow (Makeup-eyeshadow) Superposition
Blush (Makeup-blush) Positive folds bottom
Nose (Makeup-nose) Normally, transparency is superimposed
Lip (Makeup-lips) Superposition, bloom
In some embodiments of various embodiments of the present invention, the special effect parameters of makeups and/or sub- material of changing face are obtained Parameter value may include:In response to receive by the interactive interface of action bar send for makeups and/or sub- element of changing face The parameter value of the special effect parameters setting of material, using the parameter value of setting as makeups and/or the ginseng of the special effect parameters for sub- material of changing face Numerical value;And/or makeups and/or sub- material of changing face are directed to by what the interactive interface of action bar was sent in response to not receiving The parameter value of special effect parameters setting, using preset parameter value as makeups and/or the parameter value of the special effect parameters for sub- material of changing face.
The embodiment of the present invention is not necessarily to by manual writing program file generated rendering engine executable file, based on user's Selection operation in action bar to makeups and/or sub- material of changing face and makeups can be realized to the setting operation of parameter value And/or the generation for special efficacy program bag of changing face, it is easy to operate, required time is short, improve makeups and/or special efficacy realization of changing face Whole efficiency, and avoid the mistake that manual writing program file is likely to occur, effective guarantee makeups and/or effect of changing face Accuracy.
In some embodiments of various embodiments of the present invention, special effect parameters for example can include but is not limited to following arbitrary It is one or more:
1, display parameters (Display):For indicating whether display makeups and/or sub- material of changing face.Its parameter value includes " being (Yes) " and " no (No) " two options, parameter value select to indicate in image or video display process when " being (Yes) " It needs to show corresponding makeups and/or sub- material of changing face, parameter value selects to indicate in image or video display process when " no (No) " In need not show corresponding makeups and/or sub- material of changing face;
2, stacked system parameter (Tag):Stacked system for indicating makeups and/or sub- material of changing face;
3, triggering mode parameter (TriggerType):For indicating that triggering shows makeups and/or the triggering for sub- material of changing face Event refers to what trigger event triggering showing that makeups and/or sub- material of changing face, parameter value may include each triggering by Event, user can select at least one event as trigger event from predeterminable event set.I.e.:It is played in image/video In the process, the corresponding makeups of display and/or sub- material of changing face are can trigger when detecting corresponding trigger event, for example, detecting video In there is trigger event specified in the triggering mode parameter and " open one's mouth " to start to be displayed in red when This move lip this makeup Sub- material, the specific makeups and/or sub- material of changing face start to show the time, terminate to show the time, display how long etc., specifically may be used To be determined according to the parameter value of other parameters, such as can parameter, loop parameter be terminated according to delay trigger parameter, triggering respectively Parameter value determine;
4, loop parameter (TriggerLoop):For indicating that cycle shows the number of makeups and/or sub- material of changing face.It can To be arranged or select the concrete numerical value of loop play number as its parameter value, for example, 1,5 etc., parameter value setting can be arranged It is that Infinite Cyclic plays for 0;
5, play frame number parameter (Frames):For indicating makeups and/or the sub- material of changing face plays how many frame number, i.e., regarding It needs to show corresponding makeups on how many frame images and/or sub- material of changing face in frequency playing process, the specific makeups and/or change Face material starts the display time, can be determined according to the parameter value of other parameters, such as can be respectively according to triggering mode Parameter, the parameter value for postponing trigger parameter determine;
6, delay trigger parameter (TriggerDelay):For indicate delay show makeups and/or sub- material of changing face when Between, i.e.,:From when detecting the triggering mode in triggering mode parameter, delay how long or prolong in video display process Slow how many frames start to show the makeups and/or sub- material of changing face, and can be arranged or delay is selected to show makeups and/or son of changing face The specific time of material or frame number are as its parameter value;
7, triggering terminates parameter (TriggerStop):For indicating to terminate to show makeups and/or the triggering for sub- material of changing face Event refers to what trigger event terminating makeups by and/or sub- material of changing face is shown, parameter value includes each trigger event, User can select at least one event to be touched as what end makeups and/or sub- material of changing face were shown from predeterminable event set Hair event;
8, deformation special effect parameters (Deformation):For indicate show makeups and/or change face sub- material when on the image The deformation effect of deformed region is generated, which may include that the display location parameter of deformed region and deformation are imitated The display location of fruit parameter, deformed region can be by the location determination of its corresponding scheduled at least key point, therefore shows Location parameter can be position or number of corresponding key point etc., deformation effect parameter can be indicate inwardly to stretch, to Out-draw etc. indicates that the parameter of deformation effect, the parameter value for deforming special effect parameters may include:The corresponding key point of deformed region Position or the parameter value of number, deformation effect parameter can be used for figure by the way that the parameter value of the deformation special effect parameters is arranged The deformation special effect processing of picture generates the deformation effect of deformed region (also referred to as on the image:Deform special efficacy), for example, to video Image carries out the rendering processing of AR effects;
9, paster special effect parameters, for indicate display makeups and/or change face sub- material when generate sub- material on the image Special efficacy, the paster special effect parameters may include display location and the broadcasting of the sub- material of paster special efficacy (such as earrings, cap etc.) The display location of parameter, the sub- material of paster special efficacy can be by the location determination of its corresponding scheduled at least key point, therefore Display location parameter can be position or number of corresponding key point etc., and play parameter can indicate paster special efficacy The parameter of material result of broadcast (such as cycle-index, broadcasting frame number etc.), the parameter value of paster special effect parameters may include: The position of the corresponding key point of the sub- material of paster special efficacy or the parameter value of number, play parameter, based on the paster special effect parameters Parameter value, can be used for the sub- material of generation paster special efficacy in video or image, such as play on the ear of personage earrings, in head Top plays cap etc., and the rendering that AR effects are carried out to video or image is handled;
10, retouch side special effect parameters (BackgroundEdge), for indicate show makeups and/or change face sub- material when scheming As side special efficacy is retouched in upper generation, this retouches target object (such as the face when being retouched during special effect parameters may include image Portion, clothes, hand, ear etc.) and retouch in efficacy parameter (such as rugosity when retouching, color etc.), retouch the ginseng of side special effect parameters Numerical value may include accordingly:The number or title of target object retouch parameter value (such as rugosity when retouching in efficacy parameter Value, color value etc.), by the way that the parameter value for retouching side special effect parameters is arranged, can be used for retouching the target object in image Side special effect processing, in image target object addition retouch while, realize retouch while special efficacy, to the target object in video image into The rendering of row AR effects is handled, for example, in order to highlight some object in game, some purpose object in game can be given to increase One is added to retouch side effect.
In wherein some optional examples, above-mentioned trigger event for example can include but is not limited to following any one or more :
Attonity triggers (NULL), i.e.,:The sub- material can be shown by being not required to any action;
Eye motion, for example, blink, eye closing, eye opening etc.;
Headwork, for example, shake the head, nod, torticollis, rotary head etc.;
Supercilium acts, for example, choosing eyebrow etc.;
Hand motion, for example, love hand, support hand, palm, big thumb brother, embrace fist congratulate, it is singlehanded than the heart, OK hands, scissors hand, Pistol hand, index finger etc..As shown in fig. 6, for an illustrative diagram of hand motion in the embodiment of the present invention;
Mouth action, for example, opening one's mouth, shutting up;
Shoulder acts, for example, shrugging;
Special efficacy is deformed, for example, deformation special efficacy etc. is shown on the face in personage, as shown in fig. 7, in the embodiment of the present invention Deform an illustrative diagram of special efficacy;
Paster special efficacy, for example, cap etc. is shown on the personage crown, as shown in figure 8, to be pasted in the embodiment of the present invention One illustrative diagram of paper special efficacy;
Sound special efficacy, for example, occurring a certain sound etc. in video, as shown in figure 9, to retouch side special efficacy in the embodiment of the present invention An illustrative diagram;
Side special efficacy is retouched, for example, a certain target object occurs retouching side etc. in video;
Other actions.
In some optional examples of various embodiments of the present invention, establish makeups and/or sub- material of changing face display properties and The correspondence between key point in the coverage area of display location may include:Establish makeups and/or sub- material of changing face Correspondence in display properties and display location coverage area between at least two key points.
Figure 10 is the flow chart of another embodiment of the makeups of the present invention/generation method of special efficacy of changing face program file packet.Such as Shown in Figure 10, the generation method of the embodiment makeups/change special efficacy program file packet includes:
302, in response to receiving enabled instruction, operation display interface.
The operation interface includes:Action bar, content display field and/or program file column.
304, show preset key point on reference picture and reference picture in content display field.
306, makeups and/or sub- material of changing face are imported, and the makeups imported in the display of content display field and/or sub- element of changing face Material.
For example, can be according to the display location of the pre-set makeups and/or sub- material of changing face and display size, inside Hold display field and shows the makeups of the importing and/or sub- material of changing face.
308, the parameter value of the special effect parameters of makeups and/or sub- material of changing face is obtained, and establish the makeups and/or son of changing face The correspondence between key point in the display properties and display location coverage area of material.
Special effect parameters therein include stacked system parameter.Display properties therein includes:Size and display location.
In certain embodiments of the present invention, after the makeups imported in the display of content display field and/or sub- material of changing face, Its position is moved after the makeups being chosen on content display field and/or sub- material of changing face or changes its size, in the makeups And/or sub- material of changing face position and size determine after, display properties just determines, can detect the makeups and/or change face Key point in the size and display location coverage area of sub- material, and by the makeups and/or the display properties for sub- material of changing face It is corresponded to the key point in the coverage area of display location, to realize makeups and/or change face sub- material and display location is covered Position fits closely within the scope of lid.
310, according to above-mentioned makeups and/or sub- material of changing face, the parameter value of special effect parameters and correspondence generate makeups and/ Or special efficacy program file packet of changing face.
As shown in figure 4, in certain embodiments of the present invention, operation interface may include left side, middle part and right side three A region.Correspondingly, in operation 302, on the left side display operation column of operation interface, in the middle part of operation interface is shown Hold display field, program file column is shown on the right side of operation interface.
After the makeups imported in the display of content display field and/or sub- material of changing face, user can change the makeups of the display And/or display properties of the sub- material in content display field of changing face, including adjust its display location or size.
As a result, in makeups of the present invention and/or the generation method of special efficacy program file packet another embodiment of changing face, may be used also To include:According to the position moving operation to makeups and/or sub- material of changing face received by content display field, update is beautiful The display location and correspondence of adornment and/or sub- material of changing face.
In the generation method further embodiment of makeups of the present invention and/or special efficacy program file packet of changing face, it can also wrap It includes:Operation adjusted to the sizes of makeups and/or sub- material of changing face according to what is received by content display field, update makeups and/ Or change face sub- material content display field display size.
For example, user can choose the makeups shown in content display field and/or sub- material of changing face by mouse, it will Mouse is moved at the small frame in the makeups and/or the sub- material lower right corner of changing face, and is scaled makeups by the mobile small frame and/or is changed Face material, so as to adjust the makeups and/or the display size of change face makeups and/or sub- material of changing face;User can pass through mouse Mark chooses the makeups shown in content display field and/or change face sub- material and its directly mobile position, by makeups and/or Sub- material of changing face is moved to correct or desired position.In follow-up makeups and/or the special efficacy program file packet for sub- material of changing face Broadcasting in, the makeups and/or position of the sub- material on playback terminal of changing face, display scale will in the content display field In position, display scale it is consistent.Based on any of the above-described embodiment of the present invention, user can be directed to multiple reference sites and add Special efficacy, for example, any of the above-described reality can be executed respectively using ear, face, hand as the target site for currently needing addition special efficacy Example is applied, realizes the special effect to ear, face, the makeups of hand position and/or sub- material of changing face.
When user import two or more makeups and/or change face sub- material when, each makeups can be adjusted and/or sub- element of changing face The show layers of material is (i.e.:Hiding relation).As a result, in makeups of the present invention and/or the generation method for special efficacy program file packet of changing face In another embodiment, can also include:It is directed to two or more makeups according to what the interactive interface by action bar received And/or the figure layer parameter adjustment instruction that sub- material of changing face is sent, between adjusting two or more makeups and/or sub- material of changing face Hiding relation, and according to the hiding relation and the stacked system of two or more makeups and/or sub- material of changing face after adjustment Parameter value shows two or more makeups and/or sub- material of changing face.
As shown in figure 4, makeups and/or sub- material of changing face can be imported by the interactive interface 20 in left-hand operation column, can lead to The hiding relation between the adjustment makeups of interactive interface 21 and/or sub- material figure layer of changing face is crossed, each makeups are set and/or are changed face The figure layer parameter of sub- material, can be by interactive interface 22 to the special effect parameters arrange parameter of each makeups and/or sub- material of changing face Value;Content display field is to be directly displayed with reference to face, the makeups of all importings and/or sub- material of changing face with average face, can The display location that makeups and/or sub- material of changing face are moved by mouse, moves the makeups and/or sub- material of changing face by mouse The small frame in the lower right corner is sized;The program file display field on right side is currently set for being shown by display area 23 therein The content for setting the playing program file of the makeups of parameter value and/or sub- material of changing face, passes through the preservation in program file display field Instruction interface 24 can export special efficacy program file packet, i.e.,:It generates and preserves the special efficacy program file packet.
In addition, in makeups of the present invention and/or the generation method of special efficacy program file packet another embodiment of changing face, in life At before makeups/change special efficacy program file packet, can also include:According to pre-set special efficacy program file and makeups and/or Change face sub- material special effect parameters parameter value, correspondence, generate the special efficacy program file of makeups and/or sub- material of changing face, And the special efficacy program file of makeups and/or sub- material of changing face is shown by program file column.
Special efficacy program file therein for example can be the special efficacy journey generated with json programs or other executable programs Preface part.
In a further embodiment, above-described embodiment generates makeups and/or special efficacy program file packet of changing face through the invention Later, can also include:
According to the preservation instruction received makeups and/or special efficacy program file of changing face are preserved in the position for preserving instruction direction Packet.
In wherein some embodiments, makeups are preserved in the position for preserving instruction direction according to the preservation instruction received And/or special efficacy program file packet of changing face, may include:
Instruction is preserved in response to receiving, display storing path selection interface and compression interface;
It receives and the save location that interface is sent is selected by storing path;And receive the compression sent based on compression interface Mode, and makeups and/or special efficacy program file packet of changing face are compressed according to the compress mode, generate compressed file packet;
The compressed file packet is stored in the file being directed toward to save location.
When the size of makeups and/or special efficacy program file packet of changing face is larger, be not suitable for running in mobile phone terminal, this hair Bright embodiment preserves after being compressed to makeups and/or special efficacy program file packet of changing face, in order to import in mobile phone terminal Carry out special efficacy generation.In wherein some embodiments, the embodiment of the present invention is only to makeups and/or special efficacy program file of changing face The size of packet is compressed, and does not change the size of makeups and/or sub- material of changing face in special efficacy program file packet, i.e.,:In makeups And/or the size of makeups and/or sub- material of changing face remains the makeups and/or sub- element of changing face in special efficacy program file packet of changing face Material be imported into before size.
It, can be by the U.S. after generating makeups and/or special efficacy program file packet of changing face based on the various embodiments described above of the present invention Adornment and/or special efficacy program file packet of changing face import in terminal, and special efficacy generation is carried out to the video of terminal plays.
Figure 11 is the flow chart of makeups of the present invention/special efficacy of changing face generation method one embodiment.Various embodiments of the present invention Makeups/special efficacy of changing face generation method can (following embodiment of the present invention be known as makeups and/or special efficacy of changing face by a device Generating means) it realizes.As shown in figure 11, the makeups of the embodiment and/or special efficacy generation method of changing face include:
402, obtain the special effect parameters of makeups and/or sub- material of changing face, makeups and/or sub- material of changing face parameter value, with And the correspondence between the display properties and key point of makeups and/or sub- material of changing face.
Display properties therein includes:Size and/or display location, i.e.,:Both it may include size and display location, also might be used Only to include size or display location.
Wherein, between the key point in the display properties and display location coverage area of makeups and/or sub- material of changing face Correspondence can be at least one key point (such as two or more passes in display properties and display location coverage area Key point) between one-to-one relationship, can also be at least one key point in display properties and display location coverage area Between binding relationship one by one.
Makeups therein and/or sub- material of changing face may include:Makeups for the position of personage and/or son of changing face Material, and/or for personage two or more positions makeups and/or sub- material of changing face combination.
In wherein some embodiments, above-mentioned special effect parameters may include:For indicating makeups and/or sub- material of changing face Stacked system stacked system parameter.
404, the parameter of key point and special effect parameters in the image being related to based on above-mentioned correspondence, the correspondence Value generates the special efficacy of makeups and/or sub- material of changing face on the image.
Image in various embodiments of the present invention can include but is not limited to following any one or more:Still image, depending on Image in frequency.As shown in figure 12, to generate one of special efficacy of makeups and/or sub- material of changing face on the image based on embodiment Illustrative diagram.
Based on makeups/special efficacy of changing face generation method that the above embodiment of the present invention provides, makeups are obtained and/or sub- element of changing face Corresponding pass between the display properties and key point of the parameter value and makeups of material and its special effect parameters and/or sub- material of changing face System, display properties therein includes size and display location;Based in the correspondence and its image being related to key point and The parameter value of special effect parameters generates the special efficacy of makeups and/or sub- material of changing face on the image.The embodiment of the present invention passes through advance The parameter value and makeups of the makeups of setting and/or change face sub- material and its special effect parameters and/or the display for sub- material of changing face Correspondence between attribute and key point can generate makeups on the image and/or special efficacy of changing face, and increase image broadcasting Whole ambiance effect enhances the recreational of user, improves the feeling of immersion of user, improves result of broadcast.
Optionally, it before the flow of the above-mentioned makeups of the present invention and/or special efficacy generation method embodiment of changing face, can also wrap It includes:Import makeups and/or special efficacy program file packet of changing face;The makeups and/or special efficacy program file packet of changing face include:Makeups and/ Or the parameter value and makeups and/or sub- material of changing face of the special effect parameters of sub- material of changing face, makeups and/or sub- material of changing face Correspondence between display properties and key point.Correspondingly, in the embodiment, operation 402 may include:From makeups and/or The parameter value and correspondence of makeups and/or sub- material of changing face, special effect parameters are obtained in special efficacy of changing face program file packet.
In a wherein embodiment, imports makeups and/or special efficacy program file packet of changing face may include:Pass through calling The makeups and/or special efficacy program file packet of changing face are read in memory by the interface function for reading file packet;Parse the makeups And/or special efficacy program file packet of changing face, obtain makeups and/or change face sub- material and special efficacy program file, the special efficacy program file The parameter value of special effect parameters including makeups and/or sub- material of changing face.
The makeups of any of the above-described embodiment of the present invention may be used in makeups therein and/or special efficacy program file packet of changing face And/or the generation method for special efficacy program file packet of changing face generates.
In addition, in another embodiment of makeups of the present invention and/or special efficacy generation method of changing face, can also include:Pass through Neural network carries out the critical point detection that above-mentioned correspondence is related to image, and exports critical point detection result.
In some embodiments, above-mentioned critical point detection result for example can include but is not limited to following any one or It is multinomial:The key point that correspondence the is related to position in image in video;The default volume for the key point that correspondence is related to Number.
In some embodiments of the above embodiment of the present invention, makeups and/or sub- material of changing face can be one independent Makeups and/or sub- material of changing face, can also be two or more makeups and/or the combination for sub- material of changing face, alternatively, may be used also There is the predetermined makeups for playing sequential and/or sub- material of changing face to be one group.
Be one group there are the predetermined makeups for playing sequential and/or change face sub- material when, in a wherein optional example, Operating 404 may include:
It is determined based on the filename of multiple makeups and/or sub- material of changing face in one group of makeup and/or sub- material of changing face multiple The broadcasting sequential of makeups and/or sub- material of changing face;
The parameter of key point and special effect parameters in the image being related to based on above-mentioned correspondence and the correspondence Value, the special efficacy of makeups and/or sub- material of changing face is generated according to determining broadcasting sequential on the image.
In some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters may include:Display parameters, should Display parameters are for indicating whether display makeups and/or sub- material of changing face.Correspondingly, it in above-described embodiment, is closed based on corresponding The parameter value of key point and special effect parameters in the image that system, correspondence are related to generates makeups and/or changes face on the image The special efficacy of sub- material may include:Parameter value in response to display parameters is the parameter for showing makeups and/or sub- material of changing face When value, the parameter value of key point and special effect parameters in the image being related to based on above-mentioned correspondence, the correspondence is being schemed As upper generation makeups and/or the special efficacy for sub- material of changing face.
Figure 13 is the flow chart of another embodiment of makeups of the present invention/special efficacy of changing face generation method.As shown in figure 13, the reality Makeups/special efficacy of the changing face generation method for applying example includes:
502, obtain the special effect parameters of makeups and/or sub- material of changing face, makeups and/or sub- material of changing face parameter value, with And the correspondence between the display properties and key point of makeups and/or sub- material of changing face.
Display properties therein includes:Size and display location.Special effect parameters therein may include:Triggering mode is joined Number, the triggering mode parameter are used to indicate the trigger event that triggering shows makeups and/or sub- material of changing face.
504, by neural network, the critical point detection that above-mentioned correspondence is related to is carried out to image, and export key point Testing result.
506, occur the corresponding trigger event of parameter value of triggering mode parameter in image in response to detecting, based on above-mentioned The parameter value of key point and special effect parameters in the image that correspondence, correspondence are related to, on the image generate makeups and/ Or the special efficacy for sub- material of changing face.
In addition, in some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters may include:Delay is touched Parameter is sent out, which is used to indicate the time that delay shows makeups and/or sub- material of changing face.Correspondingly, above-mentioned reality It applies in example, the parameter value of key point and special effect parameters in the image being related to based on correspondence, correspondence, on the image The special efficacy for generating makeups and/or sub- material of changing face may include:In response to meeting the display item of makeups and/or sub- material of changing face Part is related to according to the corresponding delay reproduction time of the parameter value of the delay trigger parameter based on above-mentioned correspondence, correspondence And image in key point and special effect parameters parameter value, delay generates the spy of makeups and/or sub- material of changing face on the image Effect.Wherein, the display condition for meeting makeups and/or sub- material of changing face includes:The parameter value of display parameters is for showing makeups And/or sub- material of changing face, and/or, there is the corresponding trigger event of parameter value of triggering mode parameter.
In addition, in some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters may include:Cycle ginseng Number, the loop parameter are used to indicate the loop play number of makeups and/or sub- material of changing face.Correspondingly, in above-described embodiment, The parameter value of key point and special effect parameters in the image being related to based on correspondence, correspondence, generates makeups on the image And/or the special efficacy for sub- material of changing face, may include:In response to meeting the display condition of makeups and/or sub- material of changing face, it is based on The parameter value of key point and special effect parameters in the image that above-mentioned correspondence, the correspondence are related to, according to loop parameter The corresponding cycle-index of parameter value recycles show makeups and/or sub- material of changing face on the image, to generate makeups and/or change face The special efficacy of sub- material.Wherein, the display condition for meeting makeups and/or sub- material of changing face includes:The parameter value of display parameters is to use In display makeups and/or sub- material of changing face, and/or, there is the corresponding trigger event of parameter value of triggering mode parameter.
In addition, in some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters may include:Play frame Number parameter, the broadcasting frame number parameter is for indicating makeups and/or sub- material broadcasting how many frame number of changing face.Correspondingly, above-mentioned implementation In example, the parameter value of key point and special effect parameters in the image being related to based on correspondence, correspondence is given birth on the image At makeups and/or the special efficacy for sub- material of changing face, may include:In response to meeting the broadcasting item of makeups and/or sub- material of changing face Part, the parameter value of key point and special effect parameters in the image being related to based on above-mentioned correspondence, correspondence, according to broadcasting The corresponding broadcasting frame number of parameter value of frame number parameter plays and generates makeups on the corresponding image of frame number and/or change face in video The special efficacy of sub- material.Wherein, the display condition for meeting makeups and/or sub- material of changing face includes:The parameter value of display parameters is to use In display makeups and/or sub- material of changing face, and/or, there is the corresponding trigger event of parameter value of triggering mode parameter.
In addition, referring back to Figure 13, in some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters can be with Including:Triggering terminates parameter, which terminates triggering thing of the parameter for indicating to terminate to show makeups and/or sub- material of changing face Part.Correspondingly, after the special efficacy for generating makeups and/or sub- material of changing face on the image, can also include:
508, detect whether the corresponding trigger event of parameter value that triggering terminates parameter occur.
510, in response to detecting the corresponding trigger event of parameter value for triggering occur and terminating parameter, stop generating makeups And/or the special efficacy for sub- material of changing face.
If being not detected and the corresponding trigger event of parameter value that triggering terminates parameter occur, operation 510 is not executed.
In addition, in some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters may include:Deformation is special Imitate parameter, the deformation special effect parameters for indicates show makeups and/or change face sub- material when generate deformed region on the image Deformation effect.Correspondingly, in the embodiment, the key point in the image being related to based on correspondence, correspondence and special efficacy ginseng Several parameter values, when generating the special efficacy of makeups and/or sub- material of changing face on the image, also according to above-mentioned deformation special effect parameters, The deformation effect of deformed region is generated in image.
In addition, in some embodiments of the various embodiments described above of the present invention, above-mentioned special effect parameters may include:Paster is special Imitate parameter, the paster special effect parameters be used to indicate to show makeups and/or change face sub- material when generate the spy of sub- material on the image Effect.Correspondingly, in the embodiment, the ginseng of key point and special effect parameters in the image being related to based on correspondence, correspondence Numerical value, also according to paster special effect parameters, generates in the picture on the image when the special efficacy of generation makeups and/or sub- material of changing face The special efficacy of sub- material.
In some embodiments of the above-mentioned each makeups of the present invention and/or special efficacy generation method embodiment of changing face, obtain beautiful The parameter value of the special effect parameters of adornment and/or sub- material of changing face, makeups and/or sub- material of changing face and makeups and/or son of changing face Correspondence between the display properties and key point of material may include:Pass through the interface function for creating paster handle Create paster handle;The parameter value of the special effect parameters of reading makeups and/or sub- material of changing face, makeups and/or sub- material of changing face, And the correspondence between the display properties and key point of makeups and/or sub- material of changing face, and store into paster handle.
Correspondingly, in other embodiment, the pass in the image being related to based on above-mentioned correspondence, correspondence The parameter value of key point and special effect parameters generates the special efficacy of makeups and/or sub- material of changing face, may include on the image:Pass through tune With the interface function for rendering makeups and/or material of changing face, parameter value, the makeups of special effect parameters are read from paster handle And/or it correspondence between the display properties and key point for sub- material of changing face and needs the makeups played and/or changes face Sub- material;Based on above-mentioned parameter value and correspondence, the special efficacy of makeups and/or sub- material of changing face is generated on the image.
In some optional examples of the above embodiment, when above-mentioned image is image in video, it is based on above-mentioned correspondence The parameter value of key point and special effect parameters in the image that relationship, correspondence are related to generates makeups and/or changes on the image The special efficacy of face material can also include:According to the parameter value of above-mentioned special effect parameters, acquisition is needed to generate makeups and/or be changed face The video frame number of the special efficacy of sub- material, and the corresponding image of the video frame number is read from video in advance, to be based on above-mentioned spy The parameter value of parameter and above-mentioned correspondence are imitated, generates the special efficacy of makeups and/or sub- material of changing face on the image.
Further, in other embodiment, can also include:In response to makeups and/or special efficacy program of changing face File packet finishes, by for calling the interface function for destroying paster handle to destroy paster handle.
Each makeups of the present invention and/or special efficacy generation method embodiment of changing face can be used for various images or video playing field Scape, such as to contain the net cast scene of personage, makeups and/or special efficacy of changing face are generated for the live video, according to makeups And/or special efficacy program file packet of changing face is superimposed on live video and plays corresponding makeups and/or sub- material of changing face, to increase Ambiance effect enhances the recreational of client, promotes the feeling of immersion used.
Either method provided in an embodiment of the present invention can be executed by any suitable equipment with data-handling capacity, Including but not limited to:Terminal device and server etc..Alternatively, either method provided in an embodiment of the present invention and special efficacy generation side Method can be executed by processor, as processor is carried by the command adapted thereto for calling memory to store to execute the embodiment of the present invention And either method.Hereafter repeat no more.
One of ordinary skill in the art will appreciate that:Realize that all or part of step of above method embodiment can pass through The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer read/write memory medium, the program When being executed, step including the steps of the foregoing method embodiments is executed;And storage medium above-mentioned includes:ROM, RAM, magnetic disc or The various media that can store program code such as CD.
Figure 14 is the structural schematic diagram of generating means one embodiment of makeups of the present invention/special efficacy of changing face program file packet. The generating means of various embodiments of the present invention makeups/special efficacy of changing face program file packet can be used for realizing the various embodiments described above of the present invention The generation method of makeups and/or special efficacy program file packet of changing face.As shown in figure 14, the generating means of the embodiment may include: Display module, the first import modul, the first acquisition module establish module and the first generation module.Wherein:
Display module, for showing preset key point on reference picture and reference picture, and the makeups of display importing And/or sub- material of changing face.Reference picture therein includes:With reference at least part image of personage, for example, with reference to personage with Under an arbitrary part or manifold image:Complete image, head image, face image, shoulder image, arm image, gesture Image, waist image, leg image, foot's image, etc..
First import modul, for importing makeups and/or sub- material of changing face.Makeups in various embodiments of the present invention and/or It changes face sub- material, can be picture, or the animation etc. being made of multiframe picture.In various embodiments of the present invention, makeups and/ Or sub- material of changing face may include:Makeups for the position of personage and/or sub- material of changing face, and/or for personage's The makeups at two or more positions and/or the combination for sub- material of changing face.
First acquisition module, the parameter value of the special effect parameters for obtaining makeups and/or sub- material of changing face, special efficacy therein Parameter includes stacked system parameter.
Module is established, for establishing in the display properties and display location coverage area of makeups and/or sub- material of changing face Correspondence between key point;Display properties includes:Size and/or display location.
In some embodiments of various embodiments of the present invention, preset key point for example can include but is not limited to following Any one or more:Header key point, face's key point, shoulder key point, arm key point, gesture key point, waist close Key point, leg key point, foot's key point, skeleton key point, etc..
In a wherein optional example, header key point for example can include but is not limited at least one of:The crown Key point, nose key point and chin key point, etc..
In a wherein optional example, face's key point for example can include but is not limited at least one of:Face Profile key point, eyes key point, eyebrow key point, nose key point, mouth key point, etc..
Illustratively, eyes key point for example can include but is not limited at least one of:Left eye socket of the eye key point, left eye Pupil center's key point, left eye center key point, right eye socket of the eye key point, pupil of right eye center key point and right eye center are closed Key point, etc..Eyebrow key point for example can include but is not limited at least one of:Left eyebrow key point and right eyebrow Key point, etc..Nose key point for example can include but is not limited at least one of:Bridge of the nose key point, nose lower edge are closed Key point and nose lateral profile key point, etc..Mouth key point for example can include but is not limited at least one of: Upper lip key point and lower lip key point, etc..
In a wherein optional example, shoulder key point for example can include but is not limited at least one of:It is located at Shoulder and head cross the key point that crosses on the shoulders at position, and positioned at arm root profile key point and the key point that crosses on the shoulders Between point midway at shoulder profile midpoint key point, etc..
In a wherein optional example, arm key point for example can include but is not limited at least one of:Wrist Profile key point, elbow profile key point, arm root profile key point are located at wrist profile key point and are closed with elbow profile Forearm profile midpoint key point at point midway between key point, and positioned at elbow profile key point and arm root profile Large arm midpoint key point at point midway between key point, etc..
In a wherein optional example, gesture key point for example can include but is not limited at least one of:Gesture Frame is (i.e.:Gestures detection frame) four vertex key points and gesture box center key point, etc..
In a wherein optional example, leg key point for example can include but is not limited at least one of:Crotch It is crucial to be located at knee profile for key point, knee profile key point, ankle profile key point, thigh root lateral profile key point Point ankle profile key point between point midway at shank profile midpoint key point, be located at knee profile key point with Thigh Internal periphery midpoint key point at point midway between crotch key point, and positioned at knee profile key point and greatly Thigh outer profile midpoint key point at point midway between the lateral profile key point of leg root, etc..
In a wherein optional example, waist key point for example can include but is not limited at least one of:It will be big N deciles between leg root lateral profile key point and arm root profile key point, generated N number of Along ent;Wherein, N is more than 1.
In a wherein optional example, foot's key point for example can include but is not limited at least one of:Tiptoe Key point and heel key point, etc..
In a wherein optional example, skeleton key point for example can include but is not limited at least one of: Right shoulder bone key point, right elbow bone key point, right carpal bone bone key point, left shoulder bone key point, left elbow bone key point, Left carpal bone bone key point, right hipbone bone key point, right kneecap bone key point, right anklebone bone key point, left hipbone bone key point, Left kneecap bone key point, left anklebone bone key point, crown bone key point and neck bone key point, etc..
First generation module, for being given birth to according to makeups and/or sub- material of changing face, the parameter value of special effect parameters and correspondence At makeups and/or special efficacy program file packet of changing face.
Generating means based on makeups/special efficacy of changing face program file packet that the above embodiment of the present invention provides, generate makeups And/or change face special efficacy program file packet when, show preset key point on reference picture and reference picture, import makeups and/or It changes face sub- material, and shows the makeups of importing and/or sub- material of changing face;Obtain the special effect parameters of makeups and/or sub- material of changing face Parameter value, and establish between the key point in the display properties and display location coverage area of makeups and/or sub- material of changing face Correspondence;Makeups are generated according to makeups and/or sub- material of changing face, the parameter value of special effect parameters and correspondence and/or are changed Face special efficacy program file packet, to realize makeups on the image and/or special efficacy of changing face.In addition, the embodiment of the present invention generates makeups And/or change face special efficacy program file packet when, without pass through manual writing program file, it is only necessary to import makeups and/or son of changing face Material can generate the executable makeups of rendering engine and/or special efficacy program file of changing face, operation to corresponding display properties Simply, required time is short, improves makeups and/or the whole efficiency for special efficacy realization of changing face, and avoids manual writing program text The mistake that part is likely to occur, the effective guarantee accuracy of makeups and/or special efficacy of changing face.
In wherein some embodiments, the first import modul is specifically used for receiving to be inputted by the interactive interface of action bar Importing instruction, import the importing instruction be directed toward material file folder in makeups and/or sub- material of changing face.
In wherein some optional examples, the first import modul is specifically used for:Receive the interactive interface hair blocked by operation The selection instruction sent, instructs the reference site chosen as the target for currently needing addition makeups and/or special efficacy of changing face to choose Position, and block the special effect parameters under display target position in operation and interface is set;And it receives and interface is set by special effect parameters In interactive interface send importing instruction, import the importing instruction be directed toward material file folder in makeups and/or son of changing face Material.
In wherein some optional examples, the first import modul imports in the material file folder that above-mentioned importing instruction is directed toward Makeups and/or change face sub- material when, be specifically used for:It receives and is instructed by the importing that interactive interface is sent, obtain and show importing The material file folder that instruction is directed toward;In response to receiving the makeups in being pressed from both sides to material file and/or the sub- material selectiong behaviour that changes face Make, imports makeups and/or the one or more makeups and/or sub- material of changing face that sub- material selectiong operation is chosen of changing face;And/or In response to not receiving the makeups in being pressed from both sides to material file and/or sub- material selectiong operation of changing face, element is chosen according to pre-setting The makeups of one or more of material file and/or sub- material of changing face, and import basis and pre-set the makeups of selection and/or change Face material;Wherein, multiple makeups and/or sub- material of changing face form one group and have the predetermined makeups for playing sequential and/or change Face material.
For example, the broadcasting sequential base of multiple makeups and/or sub- material of changing face in above-mentioned one group of makeup and/or sub- material of changing face It is determined in the filename of multiple makeups and/or sub- material of changing face.
In wherein some embodiments, display module display import makeups and/or change face sub- material when, be specifically used for According to the parameter value of stacked system, the makeups of importing are shown on target site and/or sub- material of changing face.
In wherein some embodiments, the first acquisition module is specifically used for:In response to receiving the friendship by action bar The parameter value for the setting of the special effect parameters of makeups and/or sub- material of changing face that mutual interface is sent, using the parameter value of setting as The parameter value of the special effect parameters of makeups and/or sub- material of changing face;And/or it is connect by the interaction of action bar in response to not receiving The parameter value for the setting of the special effect parameters of makeups and/or sub- material of changing face that mouth is sent, using preset parameter value as makeups And/or the parameter value of the special effect parameters for sub- material of changing face.
In some embodiments of various embodiments of the present invention, special effect parameters for example can include but is not limited to following arbitrary It is one or more:
1, display parameters (Display):For indicating whether display makeups and/or sub- material of changing face.2, stacked system ginseng Number (Tag):Stacked system for indicating makeups and/or sub- material of changing face.
3, triggering mode parameter (TriggerType):For indicating that triggering shows makeups and/or the triggering for sub- material of changing face Event refers to what trigger event triggering showing makeups and/or sub- material of changing face by;
4, loop parameter (TriggerLoop):For indicating that cycle shows the number of makeups and/or sub- material of changing face.It can To be arranged or select the concrete numerical value of loop play number as its parameter value;
5, play frame number parameter (Frames):For indicating makeups and/or the sub- material of changing face plays how many frame number, i.e., regarding It needs to show corresponding makeups on how many frame images and/or sub- material of changing face in frequency playing process;
6, delay trigger parameter (TriggerDelay):For indicate delay show makeups and/or sub- material of changing face when Between, i.e.,:From when detecting the triggering mode in triggering mode parameter, delay how long or prolong in video display process Slow how many frames start to show the makeups and/or sub- material of changing face;
7, triggering terminates parameter (TriggerStop):For indicating to terminate to show makeups and/or the triggering for sub- material of changing face Event refers to what trigger event terminating makeups by and/or sub- material of changing face is shown;
8, deformation special effect parameters (Deformation):For indicate show makeups and/or change face sub- material when on the image The deformation effect of deformed region is generated, which may include that the display location parameter of deformed region and deformation are imitated The display location of fruit parameter, deformed region can be by the location determination of its corresponding scheduled at least key point, therefore shows Location parameter can be position or number of corresponding key point etc., deformation effect parameter can be indicate inwardly to stretch, to Out-draw etc. indicates that the parameter of deformation effect, the parameter value for deforming special effect parameters may include:The corresponding key point of deformed region Position or the parameter value of number, deformation effect parameter can be used for figure by the way that the parameter value of the deformation special effect parameters is arranged The deformation special effect processing of picture generates the deformation effect of deformed region (also referred to as on the image:Deform special efficacy);
9, paster special effect parameters, for indicate display makeups and/or change face sub- material when generate sub- material on the image Special efficacy, the paster special effect parameters may include display location and the broadcasting of the sub- material of paster special efficacy (such as earrings, cap etc.) The display location of parameter, the sub- material of paster special efficacy can be by the location determination of its corresponding scheduled at least key point, therefore Display location parameter can be position or number of corresponding key point etc., and play parameter can indicate paster special efficacy The parameter of material result of broadcast (such as cycle-index, broadcasting frame number etc.), the parameter value of paster special effect parameters may include: The position of the corresponding key point of the sub- material of paster special efficacy or the parameter value of number, play parameter, based on the paster special effect parameters Parameter value can be used for the sub- material of generation paster special efficacy in video or image;
10, retouch side special effect parameters (BackgroundEdge), for indicate show makeups and/or change face sub- material when scheming As side special efficacy is retouched in upper generation, this retouches target object (such as the face when being retouched during special effect parameters may include image Portion, clothes, hand, ear etc.) and retouch in efficacy parameter (such as rugosity when retouching, color etc.), retouch the ginseng of side special effect parameters Numerical value may include accordingly:The number or title of target object retouch parameter value (such as rugosity when retouching in efficacy parameter Value, color value etc.), by the way that the parameter value for retouching side special effect parameters is arranged, can be used for retouching the target object in image Side special effect processing, in image target object addition retouch while, realize retouch while special efficacy, to the target object in video image into The rendering of row AR effects is handled.
In wherein some optional examples, above-mentioned trigger event for example can include but is not limited to following any one or more :Attonity triggers, eye motion, headwork, supercilium action, hand motion, mouth action, shoulder action, and deformation is special Effect, paster special efficacy, sound special efficacy retouch side special efficacy, other actions.
In some embodiments of various embodiments of the present invention, establishes module and be specifically used for establishing makeups and/or son of changing face Correspondence in the display properties and display location coverage area of material between at least two key points.
Figure 15 is the structural representation of another embodiment of the makeups of the present invention/generating means of special efficacy of changing face program file packet Figure.As shown in figure 15, in the generating means of the embodiment, display module includes:Operation interface, for being opened in response to receiving Dynamic instruction display.The operation interface may include:Action bar, content display field and/or program file column.As shown in figure 4, being One optional exemplary plot of the operation interface.Correspondingly, in the embodiment, display module is specifically used for aobvious in content display field Show preset key point on reference picture and reference picture;And show the makeups imported and/or son of changing face in content display field Material.
In some embodiments of various embodiments of the present invention, operation interface includes left side, middle part and three, right side region, Wherein, on the left side display operation column of operation interface, content display field is shown at the middle part of operation interface, on the operation interface right side Side shows program file column.
In addition, referring back to Figure 15, in the makeups/generating means of special efficacy of changing face program file packet another embodiments, also May include:First update module, for according to by content display field receive to makeups and/or sub- material of changing face Position moving operation updates display location and the correspondence of makeups and/or sub- material of changing face.
In addition, referring back to Figure 15, in the makeups/generating means of special efficacy of changing face program file packet another embodiments, also May include:Second update module, for according to by content display field receive to makeups and/or sub- material of changing face Size adjustment operation, update makeups and/or change face sub- material content display field display size.
In addition, referring back to Figure 15, in the makeups/generating means of special efficacy of changing face program file packet another embodiments, also May include:Adjust module, for according to by the interactive interface of action bar receive for two or more makeups and/ Or the figure layer parameter adjustment instruction that sub- material of changing face is sent, the screening between adjusting two or more makeups and/or sub- material of changing face Gear relationship.Correspondingly, in the embodiment, display module, be additionally operable to according to after adjustment hiding relation and two or more makeups And/or the parameter value of the stacked system for sub- material of changing face shows two or more makeups and/or sub- material of changing face.
In addition, in the generating means embodiment of above-mentioned each makeups and/or special efficacy program file packet of changing face, first generates mould Block, it may also be used for before generating makeups/change special efficacy program file packet, according to pre-set special efficacy program file and makeups And/or parameter value, the correspondence of the special effect parameters for sub- material of changing face, generate the special efficacy program of makeups and/or sub- material of changing face File, and pass through the display makeups of program file column and/or the special efficacy program file for sub- material of changing face.Special efficacy program text therein Part for example may include:With the special efficacy program file of json Program Generatings.
In addition, referring back to Figure 15, in the makeups/generating means of special efficacy of changing face program file packet another embodiments, also May include:Preserving module, for according to receive preservation instruction preserve instruction be directed toward position preserve makeups and/or Special efficacy of changing face program file packet.
In some embodiments of various embodiments of the present invention, preserving module is specifically used for:Refer in response to receiving preservation It enables, display storing path selection interface and compression interface;It receives and the save location that interface is sent is selected by storing path;With And the compress mode sent based on compression interface is received, and according to compress mode to makeups and/or special efficacy program file packet of changing face It is compressed, generates compressed file packet;And compressed file packet is stored in the file being directed toward to save location.
In some embodiments of various embodiments of the present invention, in makeups and/or special efficacy program file packet of changing face makeups and/ Or the size for sub- material of changing face remain makeups and/or sub- material of changing face be imported into before size.
Figure 16 is the structural schematic diagram of makeups of the present invention/special efficacy of changing face generating means one embodiment.The present invention is respectively implemented Makeups/special efficacy of changing face generating means of example can be used for realizing the makeups of the various embodiments described above of the present invention and/or special efficacy generation of changing face Method.As shown in figure 16, the generating means of the embodiment may include:Second acquisition module and the second generation module.Wherein:
Second acquisition module, for obtaining makeups and/or the special efficacy of sub- material of changing face, makeups and/or sub- material of changing face ginseng Correspondence between the display properties and key point of several parameter values and makeups and/or sub- material of changing face;Display properties Including:Size and/or display location.Display properties therein includes:Size and/or display location, i.e.,:Both may include big Small and display location can also only include size or display location.
Wherein, between the key point in the display properties and display location coverage area of makeups and/or sub- material of changing face Correspondence can be at least one key point (such as two or more passes in display properties and display location coverage area Key point) between one-to-one relationship, can also be at least one key point in display properties and display location coverage area Between binding relationship one by one.Makeups therein and/or sub- material of changing face may include:For the U.S. at the position of personage Adornment and/or sub- material of changing face, and/or for personage two or more positions makeups and/or sub- material of changing face combination.
In wherein some embodiments, above-mentioned special effect parameters may include:For indicating makeups and/or sub- material of changing face Stacked system stacked system parameter.
Second generation module, the key point and special effect parameters in image for being related to based on correspondence, correspondence Parameter value, generate the special efficacy of makeups and/or sub- material of changing face on the image.
Image therein can include but is not limited to following any one or more:Still image, image in video.
Based on makeups/special efficacy of changing face generating means that the above embodiment of the present invention provides, makeups are obtained and/or sub- element of changing face Corresponding pass between the display properties and key point of the parameter value and makeups of material and its special effect parameters and/or sub- material of changing face System, display properties therein includes size and display location;Based in the correspondence and its image being related to key point and The parameter value of special effect parameters generates the special efficacy of makeups and/or sub- material of changing face on the image.The embodiment of the present invention passes through advance The parameter value and makeups of the makeups of setting and/or change face sub- material and its special effect parameters and/or the display for sub- material of changing face Correspondence between attribute and key point can generate makeups on the image and/or special efficacy of changing face, and increase image broadcasting Whole ambiance effect enhances the recreational of user, improves the feeling of immersion of user, improves result of broadcast.
Figure 17 is the structural schematic diagram of another embodiment of makeups of the present invention/special efficacy of changing face generating means.As shown in figure 17, Compared with embodiment illustrated in fig. 16, makeups/special efficacy of changing face generating means of the embodiment can also include:Second import modul, For importing makeups and/or special efficacy program file packet of changing face;The makeups and/or special efficacy program file packet of changing face include:Makeups And/or the parameter value and makeups and/or sub- element of changing face of the special effect parameters of sub- material of changing face, makeups and/or sub- material of changing face Correspondence between the display properties and key point of material.Optionally, above-mentioned makeups and/or change face special efficacy program file packet can Think that generation method or device using any of the above-described embodiment makeups of the present invention and/or special efficacy program file packet of changing face generate Makeups and/or special efficacy program file packet of changing face.
Correspondingly, in the embodiment, the second acquisition module, specifically for from makeups and/or special efficacy program file packet of changing face The middle parameter value and correspondence for obtaining makeups and/or sub- material of changing face, special effect parameters.
In addition, referring back to Figure 17, in another embodiment of makeups/special efficacy of changing face generating means, further include:Key point Detection module for by neural network, the critical point detection that correspondence is related to be carried out to image, and exports key point inspection Survey result.Critical point detection result therein for example can include but is not limited to following any one or more:Correspondence relates to And the key point position in image in video;The preset numbers for the key point that correspondence is related to.
In wherein some embodiments, above-mentioned makeups and/or sub- material of changing face include:One group has predetermined broadcasting sequential Makeups and/or sub- material of changing face.Correspondingly, in wherein some embodiments, the second generation module is specifically used for:It is based on The filename of multiple makeups and/or sub- material of changing face determines multiple makeups and/or changes in one group of makeup and/or sub- material of changing face The broadcasting sequential of face material;And key point in the image being related to based on correspondence, correspondence and special effect parameters Parameter value generates the special efficacy of makeups and/or sub- material of changing face according to determining broadcasting sequential on the image.
In wherein some embodiments, above-mentioned special effect parameters include:For indicating the folded of makeups and/or sub- material of changing face The stacked system parameter of add mode.
In wherein some embodiments, above-mentioned special effect parameters include:Display parameters, the display parameters are for indicating whether Show makeups and/or sub- material of changing face.Correspondingly, in the embodiment, the second generation module is specifically used in response to display parameters Parameter value be the image being related to based on correspondence, correspondence when showing the parameter value of makeups and/or sub- material of changing face In key point and special effect parameters parameter value, generate the special efficacy of makeups and/or sub- material of changing face on the image.
In wherein some embodiments, above-mentioned special effect parameters include:Triggering mode parameter, the triggering mode parameter are used for Indicate that triggering shows the trigger event of makeups and/or sub- material of changing face.Correspondingly, referring back to Figure 17, the device of the embodiment is also Including:First detection module, for whether occurring the corresponding trigger event of the parameter value of triggering mode parameter in detection image. Correspondingly, the second generation module, specifically in response to detecting that the parameter value for occurring triggering mode parameter in image is corresponding Trigger event, the parameter value of key point and special effect parameters in the image being related to based on correspondence, correspondence, in image The upper special efficacy for generating makeups and/or sub- material of changing face.
In wherein some embodiments, above-mentioned special effect parameters include:Postpone trigger parameter, which is used for Indicate that delay shows the time of makeups and/or sub- material of changing face.Correspondingly, in the embodiment, the second generation module is specific to use In the display condition in response to meeting makeups and/or sub- material of changing face, according to the corresponding delay of parameter value of delay trigger parameter Reproduction time, the parameter value of key point and special effect parameters in the image being related to based on correspondence, correspondence, delay are existed The special efficacy of makeups and/or sub- material of changing face is generated on image;The display condition for meeting makeups and/or sub- material of changing face includes:It is aobvious Show the parameter value of parameter be for showing makeups and/or sub- material of changing face, and/or, there is the parameter value pair of triggering mode parameter The trigger event answered.
In wherein some embodiments, above-mentioned special effect parameters include:Loop parameter, the loop parameter is for indicating makeups And/or the loop play number for sub- material of changing face.Correspondingly, in the embodiment, the second generation module, be specifically used in response to Meet the display condition of makeups and/or sub- material of changing face, the key point in the image being related to based on correspondence, correspondence It recycles show makeups on the image according to the corresponding cycle-index of the parameter value of loop parameter with the parameter value of special effect parameters And/or sub- material of changing face, to generate the special efficacy of makeups and/or sub- material of changing face;Meet the aobvious of makeups and/or sub- material of changing face The condition of showing includes:The parameter value of display parameters be for showing makeups and/or sub- material of changing face, and/or, there is triggering mode ginseng The corresponding trigger event of several parameter values.
In wherein some embodiments, above-mentioned special effect parameters include:Frame number parameter is played, which is used for It indicates makeups and/or sub- material of changing face plays how many frame number.Correspondingly, in the embodiment, the second generation module is specifically used for In response to meeting the playing condition of makeups and/or sub- material of changing face, in the image being related to based on correspondence, correspondence The parameter value of key point and special effect parameters plays in video according to the corresponding broadcasting frame number of parameter value for playing frame number parameter The special efficacy of makeups and/or sub- material of changing face is generated on the corresponding image of frame number;Meet makeups and/or the display for sub- material of changing face Condition includes:The parameter value of display parameters be for showing makeups and/or sub- material of changing face, and/or, there is triggering mode parameter The corresponding trigger event of parameter value.
In wherein some embodiments, above-mentioned special effect parameters include:Triggering terminates parameter, and triggering terminates parameter and is used for table Show the trigger event for terminating to show makeups and/or sub- material of changing face.Correspondingly, referring back to Figure 17, the device of the embodiment also wraps It includes:Second detection module, for detecting whether there is the corresponding trigger event of parameter value that triggering terminates parameter.The embodiment In, the second generation module is additionally operable to detect that the parameter value for triggering end parameter occur is corresponding in response to the second detection module Trigger event stops the special efficacy for generating makeups and/or sub- material of changing face.
In wherein some embodiments, above-mentioned special effect parameters include:Special effect parameters are deformed, deformation special effect parameters are used for table Show display makeups and/or change face sub- material when generate the deformation effect of deformed region on the image.Correspondingly, in the embodiment, Second generation module, the ginseng of the key point and special effect parameters that are additionally operable in the image being related to based on correspondence, correspondence Numerical value on the image when the special efficacy of generation makeups and/or sub- material of changing face, according to deformation special effect parameters, generates become in the picture The deformation effect in shape region.
In wherein some embodiments, above-mentioned special effect parameters include:Paster special effect parameters, paster special effect parameters are used for table Show display makeups and/or change face sub- material when generate the special efficacy of sub- material on the image.Correspondingly, in the embodiment, the second life At module, the parameter value of the key point and special effect parameters that are additionally operable in the image being related to based on correspondence, correspondence, On the image when the special efficacy of generation makeups and/or sub- material of changing face, according to paster special effect parameters, sub- material is generated in the picture Special efficacy.
In addition, another kind electronic equipment provided in an embodiment of the present invention, including:
Memory, for storing computer program;
Processor, for executing the computer program stored in memory, and computer program is performed, and realizes this hair The generation method or makeups of the makeups of bright any of the above-described embodiment and/or special efficacy program file packet of changing face and/or the spy that changes face Imitate generation method.
Figure 18 is the structural schematic diagram of one Application Example of electronic equipment of the present invention.Below with reference to Figure 18, it illustrates Suitable for for realizing the structural schematic diagram of the terminal device of the embodiment of the present application or the electronic equipment of server.As shown in figure 18, The electronic equipment includes one or more processors, communication unit etc., and one or more of processors are for example:It is one or more Central processing unit (CPU), and/or one or more image processors (GPU) etc., processor can be read-only according to being stored in Executable instruction in memory (ROM) is loaded into the executable finger in random access storage device (RAM) from storage section It enables and executes various actions appropriate and processing.Communication unit may include but be not limited to network interface card, and the network interface card may include but be not limited to IB (Infiniband) network interface card, processor can communicate executable to execute with read-only memory and/or random access storage device Instruction, is connected with communication unit by bus and is communicated with other target devices through communication unit, to complete the embodiment of the present application The corresponding operation of either method of offer, for example, preset key point on display reference picture and the reference picture;It is described Reference picture includes:With reference at least part image of personage;Makeups and/or sub- material of changing face are imported, and shows U.S. of importing Adornment and/or sub- material of changing face;Obtain the parameter value of the special effect parameters of the makeups and/or sub- material of changing face, the special effect parameters Including stacked system parameter, and establish in the display properties and display location coverage area of the makeups and/or sub- material of changing face Key point between correspondence;The display properties includes:Size and/or display location;According to the makeups and/or change Face material, the parameter value of the special effect parameters and the correspondence generate makeups and/or special efficacy program file packet of changing face. For another example, obtain the special effect parameters of makeups and/or sub- material of changing face, the makeups and/or sub- material of changing face parameter value and Correspondence between the display properties and key point of the makeups and/or sub- material of changing face;The display properties includes:Greatly Small and/or display location;Key point in the image being related to based on the correspondence, the correspondence and the special efficacy The parameter value of parameter generates the special efficacy of the makeups and/or sub- material of changing face on the image.
In addition, in RAM, it can also be stored with various programs and data needed for device operation.CPU, ROM and RAM are logical Bus is crossed to be connected with each other.In the case where there is RAM, ROM is optional module.RAM store executable instruction, or at runtime to Executable instruction is written in ROM, executable instruction makes processor execute the corresponding operation of any of the above-described method of the present invention.Input/ Output (I/O) interface is also connected to bus.Communication unit can be integrally disposed, may be set to be with multiple submodule (such as Multiple IB network interface cards), and in bus link.
It is connected to I/O interfaces with lower component:Include the importation of keyboard, mouse etc.;Including such as cathode-ray tube (CRT), the output par, c of liquid crystal display (LCD) etc. and loud speaker etc.;Storage section including hard disk etc.;And including The communications portion of the network interface card of LAN card, modem etc..Communications portion is held via the network of such as internet Row communication process.Driver is also according to needing to be connected to I/O interfaces.Detachable media, such as disk, CD, magneto-optic disk, half Conductor memory etc., as needed installation on a drive, in order to from the computer program read thereon quilt as needed It installs into storage section.
It should be noted that framework as shown in figure 18 is only a kind of optional realization method, it, can root during concrete practice The component count amount and type of above-mentioned Figure 18 are selected, are deleted, increased or replaced according to actual needs;In different function component In setting, separately positioned or integrally disposed and other implementations, such as separable settings of GPU and CPU or can will can also be used GPU is integrated on CPU, the separable setting of communication unit, can also be integrally disposed on CPU or GPU, etc..These are alternatively real The mode of applying each falls within protection domain disclosed by the invention.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising being tangibly embodied in machine can The computer program on medium is read, computer program includes the program code for method shown in execution flow chart, program generation Code may include the corresponding instruction of corresponding execution face false-proof detection method step provided by the embodiments of the present application.In such reality It applies in example, which can be downloaded and installed by communications portion from network, and/or from detachable media quilt Installation.When the computer program is executed by CPU, the above-mentioned function of being limited in the present processes is executed.
In addition, the embodiment of the present invention additionally provides a kind of computer program, including computer instruction, when computer instruction exists When being run in the processor of equipment, the makeups of any of the above-described embodiment of the present invention and/or special efficacy program file packet of changing face are realized Generation method or makeups and/or special efficacy generation method of changing face.
In addition, the embodiment of the present invention additionally provides a kind of computer readable storage medium, it is stored thereon with computer program, When the computer program is executed by processor, the makeups of any of the above-described embodiment of the present invention are realized and/or special efficacy program text of changing face The generation method of part packet or makeups and/or special efficacy generation method of changing face.
Each embodiment is described in a progressive manner in this specification, the highlights of each of the examples are with its The difference of its embodiment, same or analogous part cross-reference between each embodiment.For system embodiment For, since it is substantially corresponding with embodiment of the method, so description is fairly simple, related place is referring to embodiment of the method Part illustrates.
Methods and apparatus of the present invention may be achieved in many ways.For example, can by software, hardware, firmware or Software, hardware, firmware any combinations realize methods and apparatus of the present invention.The step of for the method it is above-mentioned suitable Sequence is merely to illustrate, and the step of method of the invention is not limited to sequence described in detail above, unless otherwise It illustrates.In addition, in some embodiments, also the present invention can be embodied as to record program in the recording medium, these journeys Sequence includes for realizing machine readable instructions according to the method for the present invention.Thus, the present invention also covers storage for executing root According to the recording medium of the program of the method for the present invention.
Description of the invention provides for the sake of example and description, and is not exhaustively or will be of the invention It is limited to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.It selects and retouches It states embodiment and is to more preferably illustrate the principle of the present invention and practical application, and enable those skilled in the art Understand various embodiments with various modifications of the present invention to design suitable for special-purpose.

Claims (10)

1. a kind of generation method of makeups/special efficacy of changing face program file packet, which is characterized in that including:
Show preset key point on reference picture and the reference picture;The reference picture includes:At least with reference to personage A part of image;
Makeups and/or sub- material of changing face are imported, and shows the makeups of importing and/or sub- material of changing face;
The parameter value of the special effect parameters of the makeups and/or sub- material of changing face is obtained, the special effect parameters include stacked system ginseng Number, and establish between the key point in the display properties and display location coverage area of the makeups and/or sub- material of changing face Correspondence;The display properties includes:Size and/or display location;
According to the makeups and/or sub- material of changing face, the parameter value of the special effect parameters and the correspondence generate makeups and/ Or special efficacy program file packet of changing face.
2. according to the method described in claim 1, it is characterized in that, at least part image with reference to personage includes described With reference to the following arbitrary part of personage or manifold image:Complete image, head image, face image, shoulder image, hand Arm image, images of gestures, waist image, leg image, foot's image.
3. method according to claim 1 or 2, which is characterized in that the makeups and/or sub- material of changing face include:For The makeups at the position of personage and/or sub- material of changing face, and/or for personage two or more positions makeups and/or It changes face the combination of sub- material.
4. according to any methods of claim 1-3, which is characterized in that the preset key point includes following any one Kind is a variety of:Header key point, face's key point, shoulder key point, arm key point, gesture key point, waist key point, leg Portion's key point, foot's key point, skeleton key point.
5. a kind of makeups/special efficacy of changing face generation method, which is characterized in that including:
Obtain parameter value, the Yi Jisuo of the special effect parameters of makeups and/or sub- material of changing face, the makeups and/or sub- material of changing face State the correspondence between the display properties and key point of makeups and/or sub- material of changing face;The display properties includes:Size The display location and/or;
The parameter value of key point and the special effect parameters in the image being related to based on the correspondence, the correspondence, The special efficacy of the makeups and/or sub- material of changing face is generated on the image.
6. a kind of generating means of makeups/special efficacy of changing face program file packet, which is characterized in that including:
Display module, for showing preset key point on reference picture and the reference picture;The reference picture includes:Ginseng Examine at least part image of personage;And show the makeups imported and/or sub- material of changing face;
First import modul, for importing makeups and/or sub- material of changing face;
First acquisition module, the parameter value of the special effect parameters for obtaining the makeups and/or sub- material of changing face, the special efficacy ginseng Number includes stacked system parameter;
Module is established, for establishing in the display properties and display location coverage area of the makeups and/or sub- material of changing face Correspondence between key point;The display properties includes:Size and/or display location;
First generation module, for according to the parameter value of the makeups and/or sub- material of changing face, the special effect parameters and described right It should be related to and generate makeups and/or special efficacy program file packet of changing face.
7. a kind of makeups/special efficacy of changing face generating means, which is characterized in that including:
Second acquisition module, for obtaining makeups and/or the special efficacy of sub- material of changing face, the makeups and/or sub- material of changing face ginseng Correspondence between the display properties and key point of several parameter values and the makeups and/or sub- material of changing face;It is described aobvious Show that attribute includes:Size and/or display location;
Second generation module, key point in image for being related to based on the correspondence, the correspondence and described The parameter value of special effect parameters generates the special efficacy of the makeups and/or sub- material of changing face on the image.
8. a kind of electronic equipment, which is characterized in that including:
Memory, for storing computer program;
Processor, for executing the computer program stored in the memory, and the computer program is performed, and is realized Any methods of the claims 1-5.
9. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program is located When managing device execution, any methods of the claims 1-5 are realized.
10. a kind of computer program, including computer instruction, which is characterized in that when the computer instruction is in the processing of equipment When being run in device, any methods of the claims 1-5 are realized.
CN201810411198.0A 2018-05-02 2018-05-02 Method and device for generating makeup and/or face-changing special effect program file package and method and device for generating makeup and/or face-changing special effect Active CN108711180B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110977497.2A CN113658298A (en) 2018-05-02 2018-05-02 Method and device for generating special-effect program file package and special effect
CN201810411198.0A CN108711180B (en) 2018-05-02 2018-05-02 Method and device for generating makeup and/or face-changing special effect program file package and method and device for generating makeup and/or face-changing special effect

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810411198.0A CN108711180B (en) 2018-05-02 2018-05-02 Method and device for generating makeup and/or face-changing special effect program file package and method and device for generating makeup and/or face-changing special effect

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202110977497.2A Division CN113658298A (en) 2018-05-02 2018-05-02 Method and device for generating special-effect program file package and special effect

Publications (2)

Publication Number Publication Date
CN108711180A true CN108711180A (en) 2018-10-26
CN108711180B CN108711180B (en) 2021-08-06

Family

ID=63868672

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201810411198.0A Active CN108711180B (en) 2018-05-02 2018-05-02 Method and device for generating makeup and/or face-changing special effect program file package and method and device for generating makeup and/or face-changing special effect
CN202110977497.2A Pending CN113658298A (en) 2018-05-02 2018-05-02 Method and device for generating special-effect program file package and special effect

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202110977497.2A Pending CN113658298A (en) 2018-05-02 2018-05-02 Method and device for generating special-effect program file package and special effect

Country Status (1)

Country Link
CN (2) CN108711180B (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109167936A (en) * 2018-10-29 2019-01-08 Oppo广东移动通信有限公司 A kind of image processing method, terminal and storage medium
CN109803165A (en) * 2019-02-01 2019-05-24 北京达佳互联信息技术有限公司 Method, apparatus, terminal and the storage medium of video processing
CN110070592A (en) * 2019-02-28 2019-07-30 北京字节跳动网络技术有限公司 Generation method, device and the hardware device of special efficacy packet
CN110321849A (en) * 2019-07-05 2019-10-11 腾讯科技(深圳)有限公司 Image processing method, device and computer readable storage medium
CN110503724A (en) * 2019-08-19 2019-11-26 北京猫眼视觉科技有限公司 A kind of AR expression resource construction management system and method based on human face characteristic point
CN111444743A (en) * 2018-12-27 2020-07-24 北京奇虎科技有限公司 Video portrait replacing method and device
CN112486263A (en) * 2020-11-30 2021-03-12 科珑诗菁生物科技(上海)有限公司 Eye protection makeup method based on projection and projection makeup dressing wearing equipment
WO2021056998A1 (en) * 2019-09-27 2021-04-01 成都星时代宇航科技有限公司 Double-picture display method and device, terminal and storage medium
CN112784622A (en) * 2019-11-01 2021-05-11 北京字节跳动网络技术有限公司 Image processing method and device, electronic equipment and storage medium
US11074733B2 (en) 2019-03-15 2021-07-27 Neocortext, Inc. Face-swapping apparatus and method
CN113709549A (en) * 2021-08-24 2021-11-26 北京市商汤科技开发有限公司 Special effect data packet generation method, special effect data packet generation device, special effect data packet image processing method, special effect data packet image processing device, special effect data packet image processing equipment and storage medium
CN113938618A (en) * 2021-09-29 2022-01-14 北京达佳互联信息技术有限公司 Special effect manufacturing method and device, electronic equipment and storage medium
WO2022228362A1 (en) * 2021-04-25 2022-11-03 北京字跳网络技术有限公司 Method and apparatus for generating special effect configuration file, device, and medium
WO2022227687A1 (en) * 2021-04-25 2022-11-03 北京达佳互联信息技术有限公司 Special effect material processing method and apparatus
WO2023030550A1 (en) * 2021-08-31 2023-03-09 上海商汤智能科技有限公司 Data generation method, image processing method, apparatuses, device, and storage medium
EP4142278A4 (en) * 2020-05-21 2023-08-16 Beijing Bytedance Network Technology Co., Ltd. Method and apparatus for configuring video special effect, device, and storage medium
EP4254181A4 (en) * 2020-12-21 2024-05-01 Beijing Zitiao Network Technology Co., Ltd. Simulated photographing special effect generation method and apparatus, device, and medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010094536A (en) * 2010-01-07 2010-04-30 Kao Corp Makeup simulation method
CN102708575A (en) * 2012-05-17 2012-10-03 彭强 Daily makeup design method and system based on face feature region recognition
CN103731583A (en) * 2013-12-17 2014-04-16 四川金手指时代投资管理有限公司 Integrated device for intelligent photograph synthesizing and printing and processing method for intelligent photograph synthesizing and printing
CN104123749A (en) * 2014-07-23 2014-10-29 邢小月 Picture processing method and system
CN104469179A (en) * 2014-12-22 2015-03-25 杭州短趣网络传媒技术有限公司 Method for combining dynamic pictures into mobile phone video
CN104778712A (en) * 2015-04-27 2015-07-15 厦门美图之家科技有限公司 Method and system for pasting image to human face based on affine transformation
CN107274493A (en) * 2017-06-28 2017-10-20 河海大学常州校区 A kind of three-dimensional examination hair style facial reconstruction method based on mobile platform
CN107424115A (en) * 2017-05-31 2017-12-01 成都品果科技有限公司 A kind of colour of skin correction algorithm based on face key point

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101436306B (en) * 2008-12-19 2013-03-27 北京中星微电子有限公司 Method, apparatus and video display card for implementing image special effect
US8966402B2 (en) * 2011-06-29 2015-02-24 National Taipei University Of Education System and method for editing interactive three-dimension multimedia, and online editing and exchanging architecture and method thereof
JP5367919B1 (en) * 2013-07-22 2013-12-11 株式会社 ディー・エヌ・エー Image processing apparatus and image processing program
CN104899825B (en) * 2014-03-06 2019-07-05 腾讯科技(深圳)有限公司 A kind of method and apparatus of pair of picture character moulding
CN105451090B (en) * 2014-08-26 2019-03-29 联想(北京)有限公司 Image processing method and image processing apparatus
CN106296781B (en) * 2015-05-27 2020-09-22 深圳超多维科技有限公司 Special effect image generation method and electronic equipment
CN105791692B (en) * 2016-03-14 2020-04-07 腾讯科技(深圳)有限公司 Information processing method, terminal and storage medium
CN105975935B (en) * 2016-05-04 2019-06-25 腾讯科技(深圳)有限公司 A kind of face image processing process and device
CN106204696B (en) * 2016-07-05 2019-05-28 网易(杭州)网络有限公司 A kind of special efficacy implementation method and device
WO2018033154A1 (en) * 2016-08-19 2018-02-22 北京市商汤科技开发有限公司 Gesture control method, device, and electronic apparatus
CN107343220B (en) * 2016-08-19 2019-12-31 北京市商汤科技开发有限公司 Data processing method and device and terminal equipment
CN106373170A (en) * 2016-08-31 2017-02-01 北京云图微动科技有限公司 Video making method and video making device
CN107551549A (en) * 2017-08-09 2018-01-09 广东欧珀移动通信有限公司 Video game image method of adjustment and its device
CN107820027A (en) * 2017-11-02 2018-03-20 北京奇虎科技有限公司 Video personage dresss up method, apparatus, computing device and computer-readable storage medium
CN107945219B (en) * 2017-11-23 2019-12-03 翔创科技(北京)有限公司 Face image alignment schemes, computer program, storage medium and electronic equipment

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010094536A (en) * 2010-01-07 2010-04-30 Kao Corp Makeup simulation method
CN102708575A (en) * 2012-05-17 2012-10-03 彭强 Daily makeup design method and system based on face feature region recognition
CN103731583A (en) * 2013-12-17 2014-04-16 四川金手指时代投资管理有限公司 Integrated device for intelligent photograph synthesizing and printing and processing method for intelligent photograph synthesizing and printing
CN104123749A (en) * 2014-07-23 2014-10-29 邢小月 Picture processing method and system
CN104469179A (en) * 2014-12-22 2015-03-25 杭州短趣网络传媒技术有限公司 Method for combining dynamic pictures into mobile phone video
CN104778712A (en) * 2015-04-27 2015-07-15 厦门美图之家科技有限公司 Method and system for pasting image to human face based on affine transformation
CN107424115A (en) * 2017-05-31 2017-12-01 成都品果科技有限公司 A kind of colour of skin correction algorithm based on face key point
CN107274493A (en) * 2017-06-28 2017-10-20 河海大学常州校区 A kind of three-dimensional examination hair style facial reconstruction method based on mobile platform

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109167936A (en) * 2018-10-29 2019-01-08 Oppo广东移动通信有限公司 A kind of image processing method, terminal and storage medium
CN111444743A (en) * 2018-12-27 2020-07-24 北京奇虎科技有限公司 Video portrait replacing method and device
CN109803165A (en) * 2019-02-01 2019-05-24 北京达佳互联信息技术有限公司 Method, apparatus, terminal and the storage medium of video processing
CN110070592B (en) * 2019-02-28 2020-05-05 北京字节跳动网络技术有限公司 Generation method and device of special effect package and hardware device
CN110070592A (en) * 2019-02-28 2019-07-30 北京字节跳动网络技术有限公司 Generation method, device and the hardware device of special efficacy packet
US11074733B2 (en) 2019-03-15 2021-07-27 Neocortext, Inc. Face-swapping apparatus and method
CN110321849B (en) * 2019-07-05 2023-12-22 腾讯科技(深圳)有限公司 Image data processing method, device and computer readable storage medium
CN110321849A (en) * 2019-07-05 2019-10-11 腾讯科技(深圳)有限公司 Image processing method, device and computer readable storage medium
CN110503724A (en) * 2019-08-19 2019-11-26 北京猫眼视觉科技有限公司 A kind of AR expression resource construction management system and method based on human face characteristic point
WO2021056998A1 (en) * 2019-09-27 2021-04-01 成都星时代宇航科技有限公司 Double-picture display method and device, terminal and storage medium
CN112784622B (en) * 2019-11-01 2023-07-25 抖音视界有限公司 Image processing method and device, electronic equipment and storage medium
CN112784622A (en) * 2019-11-01 2021-05-11 北京字节跳动网络技术有限公司 Image processing method and device, electronic equipment and storage medium
EP4142278A4 (en) * 2020-05-21 2023-08-16 Beijing Bytedance Network Technology Co., Ltd. Method and apparatus for configuring video special effect, device, and storage medium
CN112486263A (en) * 2020-11-30 2021-03-12 科珑诗菁生物科技(上海)有限公司 Eye protection makeup method based on projection and projection makeup dressing wearing equipment
US11991470B2 (en) 2020-12-21 2024-05-21 Beijing Zitiao Network Technology Co., Ltd. Simulated photographing special effect generation method and apparatus, device, and medium
EP4254181A4 (en) * 2020-12-21 2024-05-01 Beijing Zitiao Network Technology Co., Ltd. Simulated photographing special effect generation method and apparatus, device, and medium
WO2022227687A1 (en) * 2021-04-25 2022-11-03 北京达佳互联信息技术有限公司 Special effect material processing method and apparatus
WO2022228362A1 (en) * 2021-04-25 2022-11-03 北京字跳网络技术有限公司 Method and apparatus for generating special effect configuration file, device, and medium
CN113709549A (en) * 2021-08-24 2021-11-26 北京市商汤科技开发有限公司 Special effect data packet generation method, special effect data packet generation device, special effect data packet image processing method, special effect data packet image processing device, special effect data packet image processing equipment and storage medium
WO2023030550A1 (en) * 2021-08-31 2023-03-09 上海商汤智能科技有限公司 Data generation method, image processing method, apparatuses, device, and storage medium
CN113938618A (en) * 2021-09-29 2022-01-14 北京达佳互联信息技术有限公司 Special effect manufacturing method and device, electronic equipment and storage medium
CN113938618B (en) * 2021-09-29 2024-04-30 北京达佳互联信息技术有限公司 Special effect manufacturing method, device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113658298A (en) 2021-11-16
CN108711180B (en) 2021-08-06

Similar Documents

Publication Publication Date Title
CN108711180A (en) Makeups/generation and makeups of special efficacy of changing face program file packet/special efficacy of changing face generation method and device
CN108259496A (en) The generation of special efficacy program file packet and special efficacy generation method and device, electronic equipment
KR102386640B1 (en) Creation of transform special effect program file package and method and apparatus for generating transform special effect
KR102466689B1 (en) Special effect program file package and special effect generation method and device, electronic device
CN109035373A (en) The generation of three-dimensional special efficacy program file packet and three-dimensional special efficacy generation method and device
CN108564646A (en) Rendering intent and device, storage medium, the electronic device of object
KR102386639B1 (en) Creation of a stroke special effect program file package and a method and apparatus for creating a stroke special effect
CN107657651A (en) Expression animation generation method and device, storage medium and electronic installation
CN113099298B (en) Method and device for changing virtual image and terminal equipment
KR20080018407A (en) Computer-readable recording medium for recording of 3d character deformation program
CN106683193A (en) Three-dimensional model design method and design device
CN108765520A (en) Rendering intent and device, storage medium, the electronic device of text message
CN108536790A (en) The generation of sound special efficacy program file packet and sound special efficacy generation method and device
CN109285209A (en) Processing method, device, processor and the terminal of the mask of game role
JP5002103B2 (en) Image generation system, image generation method, and program
CN108986227A (en) The generation of particle effect program file packet and particle effect generation method and device
CN108563327A (en) Augmented reality method, apparatus, storage medium and electronic equipment
JP2723070B2 (en) User interface device with human image display
US20240193838A1 (en) Computer-implemented method for controlling a virtual avatar
JP2003178323A (en) Movement generating system for display object and its movement generating program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant