CN110473608B - Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery - Google Patents

Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery Download PDF

Info

Publication number
CN110473608B
CN110473608B CN201910565482.8A CN201910565482A CN110473608B CN 110473608 B CN110473608 B CN 110473608B CN 201910565482 A CN201910565482 A CN 201910565482A CN 110473608 B CN110473608 B CN 110473608B
Authority
CN
China
Prior art keywords
eyelid
picture
double
user
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910565482.8A
Other languages
Chinese (zh)
Other versions
CN110473608A (en
Inventor
周一雄
宋雪霏
周知天
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Hezhi Medical Technology Co ltd
Original Assignee
Shanghai Hezhi Medical Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Hezhi Medical Technology Co ltd filed Critical Shanghai Hezhi Medical Technology Co ltd
Priority to CN201910565482.8A priority Critical patent/CN110473608B/en
Publication of CN110473608A publication Critical patent/CN110473608A/en
Application granted granted Critical
Publication of CN110473608B publication Critical patent/CN110473608B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/50—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for simulation or modelling of medical disorders

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Primary Health Care (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Epidemiology (AREA)
  • Databases & Information Systems (AREA)
  • Pathology (AREA)
  • Computer Hardware Design (AREA)
  • Data Mining & Analysis (AREA)
  • Biomedical Technology (AREA)
  • Architecture (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Processing Or Creating Images (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

The invention provides a method for simulating the effect after a double-eyelid surgery, which comprises the following steps: s1: establishing a single eyelid picture library; s2: establishing a surgical library; s3: establishing a double eyelid picture library; s4: processing a user picture; s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment. According to the invention, the postoperative effect simulation picture can be generated according to the user requirement for the reference of the user, so that the user has more visual experience on the postoperative appearance, and the difference between the postoperative effect and the expected effect is reduced.

Description

Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery
Technical Field
The invention belongs to the technical field of effect simulation, and particularly relates to a simulation system for postoperative effect of double eyelid surgery.
Background
Double-fold eyelid surgery, also known as double-fold eyelid plasty, is one of the most common operations in plastic surgery. The double eyelid surgery can accurately master the width and radian of double eyelids according to the proportion of individual eye shape and five facial ducts and the integral quality of the eye, and the personalized double eyelid shape is designed by measuring the body.
The eyebrow-eye spacing, eyelid thickness and eye length of each person are different, and the double eyelid operation includes line embedding, incision, three-point method, peeling and canthus opening, and the double eyelid effect includes sector, parallel and flat. Thus, selecting different procedures produces different results, and the double-palpebral procedure is permanent and difficult to adjust once performed.
People who need accept the double-eyelid operation now select the effect that oneself needs to reach through observing other people's postoperative effect photo before accepting the operation usually, and because everyone's face shape, eye shape are all inequality, cause the postoperative effect to be great with anticipated gap easily, influence user experience.
Disclosure of Invention
The invention aims to solve the problems in the prior art and provides a method, a system, a device and a storage medium for simulating the effect after double-eyelid surgery.
The first object of the present invention can be achieved by the following technical solutions: a simulation method of the effect after the double-eyelid surgery comprises the following steps:
s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library;
s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library;
s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library;
s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture;
s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
The working principle of the invention is as follows: the administrator establishes the single eyelid picture library, the operation type library and the double eyelid picture library firstly, the user can send own pictures to the server end, and selects the operation type and the postoperative effect to be simulated, the server end selects the corresponding operation double eyelid picture according to the obtained user picture, the operation type and the postoperative effect, and the eye region in the double eyelid picture is spliced with the picture of the user, so as to generate the simulated postoperative effect picture. The user can refer to the generated postoperative effect picture, select the eyelid operation formula most suitable for oneself, prevent that postoperative effect and anticipated gap are too big, and user experience is good.
In the method for simulating the effect after the double-eyelid surgery, the method further includes step S41: user color simulation: the server identifies a color mark on the user' S own picture, wherein the color mark comprises one or any combination of spots, moles or pigmentation, and the step S5 splices the color mark into the post-operation effect simulation picture when splicing the post-operation effect simulation picture.
In the method for simulating the effect after the double-eyelid surgery, the method further includes step S42: processing a target picture: the server receives the other person pictures uploaded by the user, identifies the types of the double eyelids in the other person pictures, generates double eyelid tags of the other person pictures, and in the step S5, when the postoperative effect simulation pictures are spliced, the double eyelid pictures in the double eyelid picture library corresponding to the double eyelid tags of the other person pictures are matched and spliced to the own pictures of the user to generate the postoperative effect simulation pictures.
The simulation method of the effect after the double-eyelid surgery further comprises the following steps: s6: establishing a three-dimensional model library: the server receives a three-dimensional model uploaded by an administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, and the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model; s7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server side matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type and the double-eyelid label input by the user, and the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to the display equipment of the user.
In the method for simulating the effect after the double-eyelid surgery, the method further includes step S71: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user.
In the method for simulating the effect after the double-eyelid surgery, the method further includes step S8: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture.
The simulation method of the effect after the double-eyelid surgery further comprises the following steps: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid index in the user preference library and outputs the pictures to the display equipment of the user.
The second object of the present invention can be achieved by the following technical solutions: a simulation system for the effect after the double-eyelid surgery comprises a user end, an administrator end and a server end, wherein the user end and the administrator end are in communication connection with the server end;
-the user side comprises an input and output module, and the input and output module comprises a picture uploading module and a surgical type selection module;
-said administrator side comprises an input module, said input module comprising a picture input module and a surgical input module;
the server comprises a receiving module, an image processing module, a storage module and a comparison and matching module, wherein the storage module comprises a single-eyelid picture library, a double-eyelid picture library and a surgical library, and the image processing module comprises an image intercepting module, an eyelid classification module and an image splicing module;
the image input module is used for the administrator to upload the single-eyelid image and the double-eyelid image and send the single-eyelid image and the double-eyelid image to the receiving module of the server, and the receiving module receives the single-eyelid image and the double-eyelid image uploaded by the administrator and respectively stores the single-eyelid image and the double-eyelid image into the single-eyelid image library and the double-eyelid image library;
the single-eyelid picture library is used for receiving, storing and extracting a single-eyelid picture, the double-eyelid picture library is used for receiving, storing and extracting a double-eyelid picture, the picture intercepting module is used for extracting a single-eyelid picture in the single-eyelid picture library, intercepting a single-eyelid region picture and storing the single-eyelid region picture in the single-eyelid picture library, and the eyelid classifying module is used for extracting the single-eyelid region picture, identifying the type of the single-eyelid region picture and matching the single-eyelid region picture with a corresponding single-eyelid label;
-the surgical formula input module is used for an administrator to input surgical formulas and send the surgical formulas to a surgical formula library, and the surgical formula library is used for receiving the surgical formulas and reading the surgical formulas;
the eyelid classification module is configured to extract an eyelid region image, identify a type of the eyelid region image, and match the eyelid region image with a corresponding eyelid tag;
the image uploading module is used for a user to input an image and send the image to the receiving module of the background system, the receiving module is used for receiving the image input by the user and extracting the image, and the eyelid classification module is used for extracting the image, identifying the single eyelid type of the image, matching a corresponding single eyelid tag and sending the matched single eyelid tag to the comparison and matching module;
the operation formula selection module is used for reading operation formulas in the operation formula library, displaying operation formulas for a user to read, receiving operation formulas selected by the user and sending the operation formulas selected by the user to the receiving module, and the receiving module is used for receiving operation formulas selected by the user and forwarding the operation formulas selected by the user to the comparison and matching module;
the comparison matching module is used for receiving the single eyelid tag of the user picture and the operation form selected by the user, matching the corresponding double eyelid tag according to the single eyelid tag of the user picture and the operation form selected by the user, extracting the double eyelid area picture corresponding to the double eyelid tag from the double eyelid library according to the double eyelid tag, and sending the matched double eyelid area picture to the picture splicing module;
the image splicing module is used for extracting an own image input by a user, receiving the matched double-eyelid eye region image, splicing the double-eyelid eye region image into the own image, generating a postoperative effect simulation image and sending the postoperative effect simulation image to the input and output module;
-the input/output module is used for receiving and displaying the postoperative effect simulation picture.
In the simulation system of foretell heavy eyelid operation postoperative effect, the server side still include color simulation module, color simulation module be used for drawing user's input own picture, discern the color mark on the own picture and send the color mark to picture concatenation module, the color mark include one or arbitrary combination in spot or mole or the pigmentation, picture concatenation module be arranged in receiving the color mark and with color mark stack to postoperative effect simulation picture.
In the above-mentioned simulation system of effect after double-eyelid surgery, the picture upload module still be used for supplying the user to upload other people's picture and to the eyelid classification module of backstage system concurrently, eyelid classification module be used for receiving other people's picture, discernment other people's picture double-eyelid type, match corresponding double-eyelid label, extract from the double-eyelid picture storehouse with the corresponding double-eyelid eye area picture of the double-eyelid label that matches and send this double-eyelid eye area picture to picture concatenation module, the picture module be used for receiving this double-eyelid eye area picture, generate the simulation picture of postoperative effect and send the simulation picture of postoperative effect to input output module.
In the simulation system for the effect after the double-eyelid surgery, the storage module further comprises a three-dimensional model library, the input module further comprises a three-dimensional model input module, the three-dimensional model input module is used for a manager to upload a three-dimensional model and forward the three-dimensional model to the three-dimensional model library, the three-dimensional model library is used for receiving the three-dimensional model and extracting the three-dimensional model, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server end further comprises a three-dimensional processing module, the three-dimensional processing module comprises a three-dimensional model classification module, a three-dimensional model matching module and a three-dimensional model splicing module, the three-dimensional model classification module is used for extracting the head three-dimensional model and the double-eyelid three-dimensional model, respectively identifying the head three-dimensional model and the double-eyelid three-dimensional model, generating the corresponding head label and the double-eyelid label for reading, and the three-dimensional model matching module is used for receiving the self picture, the double-eyelid label and the reading input by the user, The three-dimensional model splicing module is used for receiving the head three-dimensional model and the double eyelid three-dimensional model, splicing the double eyelid three-dimensional model onto the head three-dimensional model to form a post-operation effect simulation three-dimensional model, and conveying the post-operation effect simulation three-dimensional model to the input and output module.
In the above-mentioned simulation system of effect after double eyelid surgery, the user side still include the camera, three-dimensional processing module still include the motion capture module, the camera be used for shooting user's action, generate action video signal and send to the motion capture module, the motion capture module be arranged in receiving action video signal, catching the action among the action video signal and control the corresponding action of postoperative effect simulation three-dimensional model generation and output.
In the above simulation system for the effect after the double-eyelid surgery, the storage module further comprises a doctor library, the input module further comprises a doctor information input module, the doctor information input module is used for an administrator to input doctor information, and the doctor information input module is further used for the administrator to input a doctor label and enable the doctor label to establish a corresponding relationship with a corresponding double-image picture.
In the simulation system of foretell double-eyelid operation postoperative effect, storage module still include preference storage module, preference storage module be used for recording and storing user input's art formula or double-eyelid label, the server end still include the propelling movement module, the propelling movement module draw the double-eyelid picture of matching and send to input output module according to art formula or double-eyelid label, input output module receive the double-eyelid picture and show.
The third object of the present invention can be achieved by the following technical solutions: a simulation device for the effect after the double-eyelid surgery comprises an input end and an output end; a server side; one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for performing the steps of:
s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library;
s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library;
s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library;
s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture;
s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
In the simulation apparatus for the effect after the double-eyelid surgery, the method further includes step S41: user color simulation: the server identifies a color mark on the user' S own picture, wherein the color mark comprises one or any combination of spots, moles or pigmentation, and the step S5 splices the color mark into the post-operation effect simulation picture when splicing the post-operation effect simulation picture.
In the simulation apparatus for the effect after the double-eyelid surgery, the method further includes step S42: processing a target picture: the server receives the other person pictures uploaded by the user, identifies the types of the double eyelids in the other person pictures, generates double eyelid tags of the other person pictures, and in the step S5, when the postoperative effect simulation pictures are spliced, the double eyelid pictures in the double eyelid picture library corresponding to the double eyelid tags of the other person pictures are matched and spliced to the own pictures of the user to generate the postoperative effect simulation pictures.
The simulation device for the effect of the double-eyelid surgery operation further comprises the following steps: s6: establishing a three-dimensional model library: the server receives a three-dimensional model uploaded by an administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, and the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model; s7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server side matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type and the double-eyelid label input by the user, and the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to the display equipment of the user.
In the simulation apparatus for the effect after the double-eyelid surgery, the method further includes step S71: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user.
In the simulation apparatus for the effect after the double-eyelid surgery, the method further includes step S8: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture.
In the simulation device for the effect after the double-eyelid surgery, the following steps are also included: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid index in the user preference library and outputs the pictures to the display equipment of the user.
The fourth object of the present invention can be achieved by the following technical solutions: a storage medium storing a computer program for use in conjunction with an electronic device, the electronic device including an input and an output, the electronic device communicatively coupled to a network server, the computer program executable by a processor to perform the steps of:
s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library;
s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library;
s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library;
s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture;
s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
In the storage medium, step S41 is further included: user color simulation: the server identifies a color mark on the user' S own picture, wherein the color mark comprises one or any combination of spots, moles or pigmentation, and the step S5 splices the color mark into the post-operation effect simulation picture when splicing the post-operation effect simulation picture.
In the storage medium, step S42 is further included: processing a target picture: the server receives the other person pictures uploaded by the user, identifies the types of the double eyelids in the other person pictures, generates double eyelid tags of the other person pictures, and in the step S5, when the postoperative effect simulation pictures are spliced, the double eyelid pictures in the double eyelid picture library corresponding to the double eyelid tags of the other person pictures are matched and spliced to the own pictures of the user to generate the postoperative effect simulation pictures.
In the above storage medium, further comprising the steps of: s6: establishing a three-dimensional model library: the server receives a three-dimensional model uploaded by an administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, and the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model; s7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server side matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type and the double-eyelid label input by the user, and the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to the display equipment of the user.
In the storage medium, step S71 is further included: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user.
In the storage medium, step S8 is further included: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture.
In the above storage medium, further comprising the steps of: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid index in the user preference library and outputs the pictures to the display equipment of the user.
Compared with the prior art, the method and the device can generate the postoperative effect simulation picture for the user to refer to according to the user requirement, so that the user can have more visual experience on the postoperative appearance, and the difference between the postoperative effect and the expected effect is reduced.
Drawings
FIG. 1 is a schematic diagram of the principle of the steps of the present invention.
Fig. 2 is a block diagram of a simulation system for the effect after the double-eyelid surgery in the present invention.
In the figure, 1, a user side; 2. a server side; 3. a manager side; 11. an input-output module; 12. a camera; 21. a push module; 22. a receiving module; 23. a storage module; 24. a three-dimensional model library; 25. a picture processing module; 26. a comparison matching module; 27. (ii) a A color simulation module; 28. a three-dimensional processing module; 31. an input module; 111. a picture uploading module; 112. a surgical selection module; 231. a doctor library; 232. a surgical library; 233. a double-eyelid picture library; 234. a single-eyelid picture library; 235. a preference storage module; 241. a three-dimensional model of the head; 242. a double eyelid three-dimensional model; 251. a picture intercepting module; 252. a picture splicing module; 253. an eyelid classification module; 281. a three-dimensional model classification module; 282. a three-dimensional model matching module; 283. a three-dimensional model splicing module; 284. a motion capture module; 311. a picture input module; 312. a surgical input module; 313. a three-dimensional model input module; 314. and a doctor information input module.
Detailed Description
The following are specific embodiments of the present invention and are further described with reference to the drawings, but the present invention is not limited to these embodiments.
As shown in fig. 1, the method for simulating the effect after the double-eyelid surgery comprises the following steps: s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library; s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library; s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library; s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture; s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
The working principle of the invention is as follows: the administrator establishes the single eyelid picture library, the operation type library and the double eyelid picture library firstly, the user can send own pictures to the server end, and selects the operation type and the postoperative effect to be simulated, the server end selects the corresponding operation double eyelid picture according to the obtained user picture, the operation type and the postoperative effect, and the eye region in the double eyelid picture is spliced with the picture of the user, so as to generate the simulated postoperative effect picture. The user can refer to the generated postoperative effect picture, select the eyelid operation formula most suitable for oneself, prevent that postoperative effect and anticipated gap are too big, and user experience is good.
In more detail, the method for simulating the effect after the double-eyelid surgery further includes step S41: user color simulation: the server identifies the color marks on the picture of the user, the color marks comprise one or any combination of spots, moles or pigmentation, and the step S5 splices the color marks into the postoperative effect simulation picture when splicing the postoperative effect simulation picture, so that the spliced effect simulation picture has more real colors, and the vivid simulation effect is improved for the user.
In more detail, the method for simulating the effect after the double-eyelid surgery further includes step S42: processing a target picture: the server receives other people ' S pictures that the user uploaded, discern the type of the heavy eyelid in other people ' S pictures, generate the heavy eyelid label of other people ' S pictures, step S5 when splicing the postoperative effect simulation picture, match the heavy eyelid photo in the heavy eyelid picture storehouse corresponding with the heavy eyelid label of other people ' S pictures, and splice to and generate postoperative effect simulation picture in user ' S own picture, make the user can freely select the type of the heavy eyelid of liking, provide multiple choice for the user.
In more detail, the method for simulating the effect after the double-eyelid surgery further comprises the following steps: s6: establishing a three-dimensional model library: the server receives a three-dimensional model uploaded by an administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, and the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model; s7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server end matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type input by the user and the double-eyelid label, the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to display equipment of the user, and the user can see the three-dimensional effect of the double-eyelid through the establishment of the three-dimensional model, so that the judgment of the user on the effect is facilitated.
In more detail, the method for simulating the effect after the double-eyelid surgery further includes step S71: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user, so that the user can see the change effect of the double eyelids during motion in the three-dimensional model, and sufficient effect information is provided for the user before the operation.
In more detail, the method for simulating the effect after the double-eyelid surgery further includes step S8: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture, so that a user can directly match the doctor with the doctor after selecting the favorite double-eyelid type, and the time for searching the doctor is saved.
In more detail, the method for simulating the effect after the double-eyelid surgery further comprises the following steps: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid mark in the user preference library and outputs the pictures to the display equipment of the user, so that the user can provide various double-eyelid types according with the user preference for the user when selecting the pictures, and the other person pictures with the double-eyelid types for the user to refer to.
The second object of the present invention can be achieved by the following technical solutions: as shown in fig. 2, the simulation system for the postoperative effect of double eyelid surgery comprises a user end, an administrator end and a server end, wherein the user end and the administrator end are both in communication connection with the server end;
the user end comprises an input/output module, and the input/output module 11 comprises a picture uploading module 111 and a surgical selection module 112;
the administrator terminal 3 comprises an input module 31, the input module 31 comprising a picture input module 311 and a surgical input module 312;
the server 2 comprises a receiving module 22, a picture processing module 25, a storage module 23, and a comparison matching module 262626, wherein the storage module 23 comprises a single-eyelid picture library 234, a double-eyelid picture library 233, and a surgery library 232, and the picture processing module 25 comprises a picture intercepting module 251, an eyelid classifying module 253, and a picture splicing module 252;
the picture input module 311 is used for the administrator to upload the single-eyelid picture and the double-eyelid picture and send the single-eyelid picture and the double-eyelid picture to the receiving module 22 of the server 2, and the receiving module 22 receives the single-eyelid picture and the double-eyelid picture uploaded by the administrator and stores the single-eyelid picture and the double-eyelid picture in the single-eyelid picture library 234 and the double-eyelid picture library 233 respectively;
the single-eyelid picture library 234 is used for receiving, storing and extracting a single-eyelid picture, the double-eyelid picture library 233 is used for receiving, storing and extracting a double-eyelid picture, the picture intercepting module 251 is used for extracting a single-eyelid picture from the single-eyelid picture library 234, intercepting a single-eyelid area picture and storing the single-eyelid area picture in the single-eyelid picture library 234, and the eyelid classifying module 253 is used for extracting a single-eyelid eye area picture, identifying a single-eyelid eye area picture type and matching the single-eyelid eye area picture with a corresponding single-eyelid label;
a surgical formula input module 312 for the administrator to input surgical formulas and send the surgical formulas to the surgical formula library 232, the surgical formula library 232 being used for receiving the surgical formulas and reading them;
the double-eyelid picture library 233 is used for receiving, storing and extracting a double-eyelid picture, the picture intercepting module 251 is used for extracting a double-eyelid picture in the double-eyelid picture library, intercepting a double-eyelid area picture and storing the double-eyelid area picture in the double-eyelid picture library 233, and the eyelid classifying module 253 is used for extracting a double-eyelid area picture, identifying a type of the double-eyelid area picture and matching the double-eyelid area picture with a corresponding double-eyelid label;
the image uploading module 111 is used for the user to input the image and send the image to the receiving module 22 of the background system, the receiving module 22 receives the image input by the user and extracts the image, and the eyelid classification module 253 is used for extracting the image, identifying the single eyelid type of the image, matching the corresponding single eyelid tag and sending the matched single eyelid tag to the comparison matching module 262626;
the surgical formula selection module 112 is configured to read surgical formulas in the surgical formula library 232, display the surgical formulas for the user to read, receive the surgical formula selected by the user, and send the surgical formula selected by the user to the receiving module 22, where the receiving module 22 is configured to receive the surgical formula selected by the user and forward the surgical formula selected by the user to the comparison and matching module 26;
the comparison matching module 26 is configured to receive the single-eyelid tag of the user's own picture and the formula selected by the user, match the corresponding double-eyelid tag according to the single-eyelid tag of the user's own picture and the formula selected by the user, extract the double-eyelid area picture corresponding to the double-eyelid tag from the double-eyelid library according to the double-eyelid tag, and send the matched double-eyelid area picture to the picture stitching module 252;
the picture stitching module 252 is configured to extract a self picture input by the user, receive the matched double-eyelid region picture, stitch the double-eyelid region picture into the self picture, generate a post-operation effect simulation picture, and send the post-operation effect simulation picture to the input/output module 11;
the input/output module 11 is used for receiving and displaying the postoperative effect simulation picture.
In further detail, in the above simulation system for the postoperative effect of the double-eyelid surgery, the server 2 further includes a color simulation module, the color simulation module is configured to extract the own image input by the user, identify the color marker on the own image, and send the color marker to the image stitching module 252, the color marker includes one or any combination of a spot, a mole, or pigmentation, and the image stitching module 252 is configured to receive the color marker and superimpose the color marker on the postoperative effect simulation image.
In further detail, in the above simulation system for the effect after the double-eyelid surgery, the image uploading module 111 is further configured to allow the user to upload other people images and send the other people images to the eyelid classification module 253 of the background system, the eyelid classification module 253 is configured to receive other people images, identify the type of the double-eyelid of the other people images, match the corresponding double-eyelid tag, extract the image of the area of the double-eyelid area corresponding to the matched double-eyelid tag from the double-eyelid image library 233, and send the image of the area of the double-eyelid area to the image stitching module 252, and the image module is configured to receive the image of the area of the double-eyelid, generate a simulation image of the postoperative effect, and send the simulation image of the postoperative effect to the input and output module 11.
In further detail, in the simulation system for the effect after the double-eyelid surgery, the storage module 23 further includes a three-dimensional model library 24, the input module 31 further includes a three-dimensional model input module 313, the three-dimensional model input module 313 is used by an administrator to upload a three-dimensional model and forward the three-dimensional model to the three-dimensional model library 24, the three-dimensional model library 24 is used to receive and extract a three-dimensional model, the three-dimensional model includes a head three-dimensional model 241 and a double-eyelid three-dimensional model 242, the server 2 further includes a three-dimensional processing module 28, the three-dimensional processing module 28 includes a three-dimensional model classification module 281, a three-dimensional model matching module 282 and a three-dimensional model splicing module 283, the three-dimensional model classification module 281 is used to extract the head three-dimensional model 241 and the double-eyelid three-dimensional model 242, respectively identify the head three-dimensional model 241 and the double-eyelid three-dimensional model 242, generate corresponding head labels and double-eyelid labels for reading, and the three-dimensional model matching module 282 is used to receive the own picture 282 input by the user, The head three-dimensional model 241 is matched and sent to the three-dimensional model splicing module 283, the three-dimensional model matching module 282 is further used for receiving the double eyelid tag, matching the corresponding double eyelid three-dimensional model 242 according to the double eyelid tag and sending to the three-dimensional model splicing module 283, and the three-dimensional model splicing module 283 is used for receiving the head three-dimensional model 241 and the double eyelid three-dimensional model 242, splicing the double eyelid three-dimensional model 242 to the head three-dimensional model 241 to form a post-operation effect simulation three-dimensional model, and delivering the post-operation effect simulation three-dimensional model to the input and output module 11.
In further detail, in the simulation system for the effect after the double-eyelid surgery, the user terminal 1 further includes a camera 12, the three-dimensional processing module 28 further includes a motion capture module 284, the camera 12 is configured to capture the motion of the user, generate a motion video signal and send the motion video signal to the motion capture module 284, and the motion capture module 284 is configured to receive the motion video signal, capture the motion in the motion video signal, and control the post-surgery effect simulation three-dimensional model to generate and output a corresponding motion.
In further detail, in the simulation system for the effect after the double-eyelid surgery, the storage module 23 further includes a doctor library 231, the input module 31 further includes a doctor information input module 314, the doctor information input module 314 is used for an administrator to input information of a doctor, and the doctor information input module 314 is further used for the administrator to input a doctor label and to establish a corresponding relationship between the doctor label and a corresponding double-image picture.
In further detail, in the above simulation system for the effect after the double-eyelid surgery, the storage module 23 further includes a preference storage module 235, the preference storage module 235 is used for recording and storing the operation type or the label of the double-eyelid inputted by the user, the server end 2 further includes a push module 21, the push module 21 extracts the matched double-eyelid picture according to the operation type or the label of the double-eyelid and transmits the picture to the input and output module 11, and the input and output module 11 receives the picture of the double-eyelid and displays the picture.
The third object of the present invention can be achieved by the following technical solutions: the simulation device for the effect after the double-eyelid surgery comprises an input end and an output end; a server side; one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for performing the steps of: s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library; s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library; s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library; s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture; s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
In more detail, the simulation apparatus for the effect after the double-eyelid surgery further includes step S41: user color simulation: the server identifies a color mark on the user' S own picture, the color mark including one or any combination of a spot or a mole or pigmentation, and step S5 splices the color mark into the post-operative effect simulation picture when splicing the post-operative effect simulation picture.
In more detail, the simulation apparatus for the effect after the double-eyelid surgery further includes step S42: processing a target picture: the server receives the other person pictures uploaded by the user, identifies the types of the double eyelids in the other person pictures, generates double eyelid tags of the other person pictures, and in the step S5, when the postoperative effect simulation pictures are spliced, the double eyelid pictures in the double eyelid picture library corresponding to the double eyelid tags of the other person pictures are matched and spliced to the own pictures of the user to generate the postoperative effect simulation pictures.
In more detail, the simulation device for the effect of the double-eyelid surgery operation further comprises the following steps: s6: establishing a three-dimensional model library: the server receives a three-dimensional model uploaded by an administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, and the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model; s7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server side matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type and the double-eyelid label input by the user, and the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to the display equipment of the user.
In more detail, the simulation apparatus for the effect after the double-eyelid surgery further includes step S71: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user.
In more detail, the simulation apparatus for the effect after the double-eyelid surgery further includes step S8: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture.
In more detail, the simulation device for the effect after the double-eyelid surgery further comprises the following steps: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid index in the user preference library and outputs the pictures to the display equipment of the user.
The fourth object of the present invention can be achieved by the following technical solutions: the storage medium stores a computer program for use in conjunction with an electronic device, the electronic device including an input and an output, the electronic device communicatively coupled to a network server, the computer program executable by a processor to perform the steps of: s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library; s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library; s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library; s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture; s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
More specifically, the storage medium further includes step S41: user color simulation: the server identifies a color mark on the user' S own picture, the color mark including one or any combination of a spot or a mole or pigmentation, and step S5 splices the color mark into the post-operative effect simulation picture when splicing the post-operative effect simulation picture.
More specifically, the storage medium further includes step S42: processing a target picture: the server receives the other person pictures uploaded by the user, identifies the types of the double eyelids in the other person pictures, generates double eyelid tags of the other person pictures, and in the step S5, when the postoperative effect simulation pictures are spliced, the double eyelid pictures in the double eyelid picture library corresponding to the double eyelid tags of the other person pictures are matched and spliced to the own pictures of the user to generate the postoperative effect simulation pictures.
To put it more concretely, the storage medium described above further includes the steps of: s6: establishing a three-dimensional model library: the server receives a three-dimensional model uploaded by an administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, and the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model; s7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server side matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type and the double-eyelid label input by the user, and the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to the display equipment of the user.
More specifically, the storage medium further includes step S71: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user.
More specifically, the storage medium further includes step S8: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture.
To put it more concretely, the storage medium described above further includes the steps of: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid index in the user preference library and outputs the pictures to the display equipment of the user.
The specific embodiments described herein are merely illustrative of the spirit of the invention. Various modifications or additions may be made to the described embodiments or alternatives may be employed by those skilled in the art without departing from the spirit or ambit of the invention as defined in the appended claims.
Although a large number of terms are used here more, the possibility of using other terms is not excluded. These terms are used merely to more conveniently describe and explain the nature of the present invention; they are to be construed as being without limitation to any additional limitations that may be imposed by the spirit of the present invention.

Claims (10)

1. A method for simulating the effect after the double-eyelid surgery is characterized by comprising the following steps:
s1: establishing a single eyelid picture library: the server receives the single-eyelid picture uploaded by the administrator, intercepts the eye area of the single-eyelid picture, identifies the type of the single eyelid, generates a single-eyelid tag corresponding to the single-eyelid picture, and stores the single-eyelid tag in a single-eyelid picture library;
s2: establishing a surgical library: the server receives the double eyelid surgery style uploaded by the administrator and stores the double eyelid surgery style in a surgery style library;
s3: establishing a double eyelid picture library: the server receives the double-eyelid picture uploaded by the administrator, intercepts the eye area of the double-eyelid picture, identifies the type of the double-eyelid, generates a double-eyelid tag corresponding to the double-eyelid picture and stores the double-eyelid tag in a double-eyelid picture library;
s4: processing the user picture: the server receives the picture uploaded by the user, intercepts the eye area of the picture, identifies the type of the single eyelid, and generates a single eyelid tag corresponding to the picture;
s5: simulation of postoperative effect: the server receives the operation type and the double-eyelid label selected by the user, matches the corresponding double-eyelid picture through the single-eyelid label, the operation type and the double-eyelid mark check, splices the double-eyelid picture to the user's own picture to generate an operation effect simulation picture and outputs the operation effect simulation picture to the user's display equipment.
2. The method for simulating the effect after the double-eyelid surgery of claim 1, further comprising step S41: user color simulation: the server identifies a color mark on the user' S own picture, wherein the color mark comprises one or any combination of spots, moles or pigmentation, and the step S5 splices the color mark into the post-operation effect simulation picture when splicing the post-operation effect simulation picture.
3. The method for simulating the effect after the double-eyelid surgery of claim 1, further comprising step S42: processing a target picture: the server receives the other person pictures uploaded by the user, identifies the types of the double eyelids in the other person pictures, generates double eyelid tags of the other person pictures, and in the step S5, when the postoperative effect simulation pictures are spliced, the double eyelid pictures in the double eyelid picture library corresponding to the double eyelid tags of the other person pictures are matched and spliced to the own pictures of the user to generate the postoperative effect simulation pictures.
4. The method for simulating the effect after the double-eyelid surgery according to claim 1, further comprising the steps of: s6: establishing a three-dimensional model library: the server receives the three-dimensional model uploaded by the administrator and stores the three-dimensional model in a three-dimensional model library, the three-dimensional model comprises a head three-dimensional model and a double-eyelid three-dimensional model, the server generates a corresponding head label according to the head three-dimensional model, the server generates a corresponding double-eyelid label according to the double-eyelid three-dimensional model, and S7: user three-dimensional effect simulation: the server generates a corresponding head label by identifying the user picture, the server side matches a relative head three-dimensional model through the head label in the user picture, matches a relative double-eyelid three-dimensional model through the operation type and the double-eyelid label input by the user, and the head three-dimensional model and the double-eyelid three-dimensional model are spliced to generate a postoperative effect simulation three-dimensional model and output the postoperative effect simulation three-dimensional model to the display equipment of the user.
5. The method for simulating the effect after the double-eyelid surgery of claim 1, further comprising step S71: capturing by user action: the camera captures the motion of the user, and enables the three-dimensional model of the postoperative effect simulation to generate a three-dimensional model of corresponding motion according to the captured motion and output the three-dimensional model to the display equipment of the user.
6. The method for simulating the effect after the double-eyelid surgery of claim 1, further comprising step S8: establishing a doctor library: the server receives doctor information input by an administrator and establishes a doctor library, the doctor library comprises doctor labels, and the server also receives the doctor labels which are input by the administrator and are associated with the single-eyelid picture and the double-eyelid picture.
7. The method for simulating the effect after the double-eyelid surgery according to claim 1, further comprising the steps of: s51: user preference collection: the server records the operation type and the double eyelid marking check input by the user in the step S5, and stores the operation type and the double eyelid marking check to form a user preference library; s52: checking the effect of other people: the server pushes matched other person double-eyelid pictures according to the operation type and the double-eyelid index in the user preference library and outputs the pictures to the display equipment of the user.
8. A simulation system for the effect after the double-eyelid surgery is characterized by comprising a user end (1), an administrator end (3) and a server end (2), wherein the user end (1) and the administrator end (3) are in communication connection with the server end (2);
-said user terminal (1) comprises an input/output module (11), said input/output module (11) comprises a picture uploading module (111) and a surgical selection module (112);
-said administrator terminal (3) comprises an input module (31), said input module (31) comprising a picture input module (311) and a surgical input module (312);
the server (2) comprises a receiving module (22), a picture processing module (25), a storage module (23) and a comparison matching module (26), wherein the storage module (23) comprises a single-eyelid picture library (234), a double-eyelid picture library (233) and a surgery library (232), and the picture processing module (25) comprises a picture intercepting module (251), an eyelid classification module (253) and a picture splicing module (252);
the picture input module (311) is used for the administrator to upload the single-eyelid picture and the double-eyelid picture and send the single-eyelid picture and the double-eyelid picture to the receiving module (22) of the server (2), and the receiving module (22) receives the single-eyelid picture and the double-eyelid picture uploaded by the administrator and respectively stores the single-eyelid picture and the double-eyelid picture to the single-eyelid picture library (234) and the double-eyelid picture library (233);
-the single-eyelid picture library (234) is used for receiving, storing and extracting single-eyelid pictures, the double-eyelid picture library (233) is used for receiving, storing and extracting double-eyelid pictures, the picture intercepting module (251) is used for extracting the single-eyelid pictures in the single-eyelid picture library (234), intercepting single-eyelid region pictures and storing the single-eyelid region pictures in the single-eyelid picture library (234), the eyelid classifying module (253) is used for extracting the single-eyelid region pictures, identifying the single-eyelid region picture types and matching the single-eyelid region pictures with corresponding single-eyelid tags;
-the surgical input module (312) is used for an administrator to input surgical procedures and to send surgical procedures to the surgical repository (232), the surgical repository (232) being used for receiving surgical procedures and for reading;
-the double-eyelid picture library (233) is used for receiving, storing and extracting double-eyelid pictures, the picture intercepting module (251) is used for extracting the double-eyelid pictures in the double-eyelid picture library, intercepting the double-eyelid area pictures and storing the double-eyelid area pictures in the double-eyelid picture library (233), and the eyelid classifying module (253) is used for extracting the double-eyelid area pictures, identifying the type of the double-eyelid area pictures and matching the double-eyelid area pictures with corresponding double-eyelid tags;
-the picture uploading module (111) is used for a user to input a picture and send the picture to the receiving module (22) of the background system, the receiving module (22) receives the picture input by the user and extracts the picture, and the eyelid classification module (253) is used for extracting the picture, identifying the single eyelid type of the picture, matching the corresponding single eyelid tag and sending the matched single eyelid tag to the comparison matching module (26);
-the surgical formula selection module (112) is configured to read surgical formulas in the surgical formula library (232), display the surgical formulas for reading by a user, receive the surgical formula selected by the user, and send the surgical formula selected by the user to the receiving module (22), and the receiving module (22) is configured to receive the surgical formula selected by the user and forward the surgical formula selected by the user to the comparison and matching module (26);
the contrast matching module (26) is configured to receive the single-eyelid tag of the user's own picture and the user-selected formula, match the corresponding double-eyelid tag according to the single-eyelid tag of the user's own picture and the user-selected formula, extract the double-eyelid area picture corresponding to the double-eyelid tag from the double-eyelid library according to the double-eyelid tag, and send the matched double-eyelid area picture to the picture stitching module (252);
the picture splicing module (252) is used for extracting a self picture input by a user, receiving the matched double-eyelid eye region picture, splicing the double-eyelid eye region picture into the self picture, generating a postoperative effect simulation picture and sending the postoperative effect simulation picture to the input and output module (11);
-said input/output module (11) is adapted to receive and display a simulation image of the post-operative effect.
9. A simulation device for the effect after the double-eyelid surgery is characterized by comprising an input end and an output end; a server side; one or more processors; a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the programs comprising instructions for performing a simulation method of a post-double-lid surgery effect of any one of claims 1-7.
10. A storage medium storing a computer program for use in conjunction with an electronic device, the electronic device including an input and an output, the electronic device being communicatively connected to a network server, wherein the computer program is executable by a processor to perform a method for simulating a post-operative effect of a double-eyelid procedure as claimed in any one of claims 1 to 7.
CN201910565482.8A 2019-06-27 2019-06-27 Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery Active CN110473608B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910565482.8A CN110473608B (en) 2019-06-27 2019-06-27 Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910565482.8A CN110473608B (en) 2019-06-27 2019-06-27 Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery

Publications (2)

Publication Number Publication Date
CN110473608A CN110473608A (en) 2019-11-19
CN110473608B true CN110473608B (en) 2022-04-19

Family

ID=68507301

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910565482.8A Active CN110473608B (en) 2019-06-27 2019-06-27 Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery

Country Status (1)

Country Link
CN (1) CN110473608B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103258343A (en) * 2013-05-07 2013-08-21 中南大学 Eye image processing method based on image editing
CN107123160A (en) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 Simulation lift face system, method and mobile terminal based on three-dimensional image
CN107506559A (en) * 2017-09-08 2017-12-22 廖海斌 Star's face shaping based on human face similarity degree analysis, which is made up, recommends method and apparatus
CN107993280A (en) * 2017-11-30 2018-05-04 广州星天空信息科技有限公司 Beauty method and system based on threedimensional model
CN108538375A (en) * 2018-02-28 2018-09-14 厦门波耐模型设计有限责任公司 Shaping and beauty mechanism operation system based on artificial intelligence and small routine

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103258343A (en) * 2013-05-07 2013-08-21 中南大学 Eye image processing method based on image editing
CN107123160A (en) * 2017-05-02 2017-09-01 成都通甲优博科技有限责任公司 Simulation lift face system, method and mobile terminal based on three-dimensional image
CN107506559A (en) * 2017-09-08 2017-12-22 廖海斌 Star's face shaping based on human face similarity degree analysis, which is made up, recommends method and apparatus
CN107993280A (en) * 2017-11-30 2018-05-04 广州星天空信息科技有限公司 Beauty method and system based on threedimensional model
CN108538375A (en) * 2018-02-28 2018-09-14 厦门波耐模型设计有限责任公司 Shaping and beauty mechanism operation system based on artificial intelligence and small routine

Also Published As

Publication number Publication date
CN110473608A (en) 2019-11-19

Similar Documents

Publication Publication Date Title
US9898647B2 (en) Systems and methods for detecting, identifying and tracking objects and events over time
US11321583B2 (en) Image annotating method and electronic device
KR102118000B1 (en) Target target display method and device
CN103548025B (en) The method and termination of the object included in supporting collection input picture
RU2018137829A (en) METHOD, DEVICE AND INFORMATION DISPLAY SYSTEM
CN110674664A (en) Visual attention recognition method and system, storage medium and processor
CN109598188A (en) Information-pushing method, device, computer equipment and storage medium
KR101889025B1 (en) System and Method for Displaying 3-Dimension Images for Mobile Terminal Using Object Recognition Based on R-CNN Algorithm
CN111242704B (en) Method and electronic equipment for superposing live character images in real scene
CN111507246A (en) Method, device, system and storage medium for selecting marked object through gesture
CN108229450A (en) The method and living creature characteristic recognition system of light filling are carried out based on screen display
JP2015185875A (en) Management server, photograph seal creation device, image management method, control program, and recording medium
KR20200050262A (en) Apparatus and method for generating multimedia surgery record contents
CN109451240A (en) Focusing method, device, computer equipment and readable storage medium storing program for executing
CN110473608B (en) Method, system, device and storage medium for simulating postoperative effect of double-eyelid surgery
CN113010009B (en) Object sharing method and device
KR20050116398A (en) Medical image recording system
CN113784059A (en) Video generation and splicing method, equipment and storage medium for clothing production
KR20190101620A (en) Moving trick art implement method using augmented reality technology
CN108647710A (en) A kind of method for processing video frequency, device, computer and storage medium
KR101738580B1 (en) System and service for providing audio source based on facial expression recognition
CN107368193A (en) Human-machine operation exchange method and system
CN106817574A (en) The image processing method and device of a kind of desk lamp
CN114299269A (en) Display method, display device, display system, electronic device, and storage medium
KR20150067653A (en) Using chinese character's radical, chinese character cards and teaching aids augmented reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210817

Address after: 200000 room 392, No. 236, Zhangcao Road, Caojing Town, Jinshan District, Shanghai

Applicant after: Shanghai Hezhi Medical Technology Co.,Ltd.

Address before: 200000 room 2718, building 5, No. 3688, Tingwei Road, Caojing Town, Jinshan District, Shanghai

Applicant before: SHANGHAI YIJIU MEDICAL TECHNOLOGY CENTER

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant