WO2020224136A1 - Interface interaction method and device - Google Patents
Interface interaction method and device Download PDFInfo
- Publication number
- WO2020224136A1 WO2020224136A1 PCT/CN2019/104315 CN2019104315W WO2020224136A1 WO 2020224136 A1 WO2020224136 A1 WO 2020224136A1 CN 2019104315 W CN2019104315 W CN 2019104315W WO 2020224136 A1 WO2020224136 A1 WO 2020224136A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- face
- adjusted
- points
- key points
- area
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 230000003993 interaction Effects 0.000 title claims abstract description 48
- 238000001514 detection method Methods 0.000 claims description 25
- 230000014509 gene expression Effects 0.000 claims description 22
- 238000013507 mapping Methods 0.000 claims description 10
- 238000004364 calculation method Methods 0.000 claims description 7
- 238000004422 calculation algorithm Methods 0.000 claims description 6
- 230000001815 facial effect Effects 0.000 abstract description 7
- 230000006870 function Effects 0.000 description 25
- 238000012545 processing Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 230000003796 beauty Effects 0.000 description 7
- 238000013527 convolutional neural network Methods 0.000 description 3
- 238000012937 correction Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 210000001061 forehead Anatomy 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 102000006822 Agouti Signaling Protein Human genes 0.000 description 1
- 108010072151 Agouti Signaling Protein Proteins 0.000 description 1
- 239000003990 capacitor Substances 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000002087 whitening effect Effects 0.000 description 1
- 210000000216 zygoma Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
Definitions
- the present disclosure relates to the technical field of interface interaction, and in particular to an interface interaction method and device.
- Portrait beautification is one of the commonly used functions in retouching applications. It can be used to modify and beautify the portrait in the picture, for example, for skin resurfacing, whitening, face thinning, etc. It is widely used and loved by users.
- One of the objectives of the present disclosure is to provide an interface interaction method and device for the above-mentioned deficiencies in the prior art.
- an interface interaction method including:
- Identify and acquire multiple areas to be adjusted in the face part of the image to be processed receive user operation instructions, which are used to select the target area in the image to be processed; determine the area to be adjusted to which the target area belongs according to the position information of the target area, The adjustment interface corresponding to the area to be adjusted to which the target area belongs is displayed, where each area to be adjusted corresponds to an adjustment interface, and the adjustment interface contains function options corresponding to the area to be adjusted.
- recognizing and acquiring multiple regions to be adjusted in the face part of the image to be processed includes: identifying the face part in the image to be processed; using a face key point detection model to detect the face part to obtain the person Multiple face key points in the face part; according to the face key points, multiple areas to be adjusted in the face part are determined.
- each face key point has a face attribute, and the face attribute indicates the area to be adjusted to which the face key point belongs; according to the face key points, determining multiple areas to be adjusted in the face part includes:
- determining the area to be adjusted corresponding to the face attribute according to the coordinates of the face key points having the face attribute includes:
- a plurality of preset anchor points are calculated according to the coordinates of the face key points having the face attributes, and the face key points having the face attributes and the plurality of preset anchor points are enclosed
- the area of is determined as the area to be adjusted corresponding to the face attribute.
- determining the area to be adjusted corresponding to the face attribute according to the coordinates of the face key points having the face attribute includes:
- the face key points with the face attributes as anchor points corresponding to the face attributes; or, calculate multiple preset anchor points according to the face key points with the face attributes, which will have the
- the face key points of the face attributes and the plurality of preset anchor points are used as anchor points corresponding to the face attributes, where the preset anchor points include face attributes, and the preset anchor points and the face key points have the same person Face attributes
- the area to be adjusted corresponding to the face attribute is determined.
- calculating multiple preset anchor points according to the coordinates of the face key points having the face attributes includes: acquiring multiple face standard key points on the standard face image, and comparing the multiple face standard key points The key points are connected end to end according to the set order, and there is a line between every two connected face standard key points; on at least one of the lines, set the standard anchor point; according to where each standard anchor point is The coordinates of the standard key points of the face at both ends of the line and the interpolation algorithm are calculated to obtain the expression of the standard anchor point coordinates based on the standard key points of the face at both ends of the line; according to the expression of the standard anchor point coordinates and the expression of the face key points Coordinates, calculate multiple preset anchor points.
- said calculating and acquiring a plurality of preset anchor points according to the expression of the standard anchor point coordinates and the coordinates of the key points of the face includes: according to the set sequence, the said face attributes are set to The key points of the face are sequentially connected end to end; according to the expression of the standard anchor point coordinates, one of the preset anchor points is calculated according to the coordinates of every two connected key points of the face.
- using a face key point detection model to detect and acquire multiple face key points in the face part includes: correcting the direction of the face part to a preset direction to obtain a corrected face image.
- the face key point detection model is used to detect and obtain multiple face key points in the corrected face image.
- the method further includes: displaying each region to be adjusted on the image to be processed.
- the present disclosure also provides an interface interaction device, including: a recognition module configured to recognize and acquire a plurality of regions to be adjusted in the face part of the image to be processed; a receiving module configured to receive operation instructions from a user, and operate The instruction is used to select the target area in the image to be processed; the first display module is configured to determine the area to be adjusted to which the target area belongs according to the position information of the target area, and display the adjustment interface corresponding to the area to be adjusted to which the target area belongs, where each Each area to be adjusted corresponds to an adjustment interface, and the adjustment interface contains function options corresponding to the area to be adjusted.
- a recognition module configured to recognize and acquire a plurality of regions to be adjusted in the face part of the image to be processed
- a receiving module configured to receive operation instructions from a user, and operate The instruction is used to select the target area in the image to be processed
- the first display module is configured to determine the area to be adjusted to which the target area belongs according to the position information of the target area, and display the adjustment interface corresponding to
- the recognition module is specifically configured to recognize the face part in the image to be processed; use a face key point detection model to detect the face part to obtain multiple face key points in the face part; The key points of the face are to determine multiple areas to be adjusted in the face.
- each face key point has a face attribute, and the face attribute indicates the area to be adjusted to which the face key point belongs;
- the recognition module is specifically configured to: obtain the face key point coordinates of the face key point and the face key point feature value; according to the face key point feature value and the preset mapping relationship between the face key point feature value and the face attribute, Obtain the face key points having the face attributes; and determine the area to be adjusted corresponding to the face attributes according to the coordinates of the face key points having the face attributes.
- the identification module is specifically configured as:
- the face key points with the face attributes as anchor points corresponding to the face attributes; or, calculate multiple preset anchor points according to the face key points with the face attributes, and set the The face key points of the face attributes and the plurality of preset anchor points are used as anchor points corresponding to the face attributes, wherein the preset anchor points include face attributes, the preset anchor points and the face key points Have the same face attributes;
- the area to be adjusted corresponding to the face attribute is determined.
- the calculation module is configured to: obtain multiple face standard key points on the standard face image; set multiple standard anchors on the line between the multiple face standard key points Point; According to the coordinates of the face standard key points at both ends of the line where each standard anchor point is located and the interpolation algorithm, the expression based on the standard anchor point coordinates of the face standard key points at both ends of the line is calculated; according to the standard anchor point The expression of coordinates and the coordinates of key points on the face are calculated to obtain multiple preset anchor points.
- the recognition module is specifically configured to: correct the direction of the face part to a preset direction to obtain a corrected face image; use a face key point detection model to detect and obtain multiple faces in the corrected face image key point.
- it further includes a second display module configured to display each area to be adjusted on the image to be processed.
- the present disclosure provides an electronic device, a processor, a storage medium, and a bus.
- the storage medium stores machine-readable instructions executable by the processor.
- the processor and the bus The storage media communicate through a bus, and the processor executes the machine-readable instructions to execute the steps of any method of the first aspect described above.
- the present disclosure also provides a computer-readable storage medium having a computer program stored on the computer-readable storage medium, and when the computer program is run by a processor, the steps of any one of the methods in the first aspect described above are executed.
- FIG. 1 is a schematic flowchart of an interface interaction method provided by an embodiment of the disclosure
- FIG. 2 is a schematic diagram of another flow of an interface interaction method provided by an embodiment of the disclosure.
- FIG. 3 is a schematic diagram of an area to be adjusted in an interface interaction method provided by an embodiment of the disclosure
- FIG. 4 is another schematic flowchart of the interface interaction method provided by the embodiments of the disclosure.
- FIG. 5 is another schematic flowchart of an interface interaction method provided by an embodiment of the disclosure.
- FIG. 6 is a schematic flowchart of another interface interaction method provided by an embodiment of the disclosure.
- FIG. 7 is a schematic flowchart of another interface interaction method provided by an embodiment of the disclosure.
- FIG. 8 is a schematic structural diagram of an interface interaction device provided by an embodiment of the disclosure.
- FIG. 9 is a schematic diagram of another structure of an interface interaction device provided by an embodiment of the disclosure.
- FIG. 10 is another schematic structural diagram of an interface interaction device provided by an embodiment of the disclosure.
- FIG. 11 is a schematic diagram of a structure of an electronic device provided by an embodiment of the disclosure.
- FIG. 1 is a schematic flowchart of an interface interaction method provided by an embodiment of the disclosure.
- the execution subject of the interface interaction method may be a terminal with image processing capabilities, such as a desktop computer, a notebook computer, a tablet computer, a smart phone, a camera, etc., which is not limited here.
- the interface interaction method includes:
- S110 Identify and acquire multiple regions to be adjusted in the face portion of the image to be processed.
- the source of the image to be processed includes an image pre-stored in the device, a frame image of a video pre-stored in the device, an image obtained through an image acquisition device connected to the device, etc., which are not limited herein.
- the image acquisition device may be a camera, an external camera, etc.
- each area to be adjusted is used to represent a part of the facial features to be adjusted, such as eyes, nose, chin, forehead, cheeks, etc.
- multiple areas to be adjusted can represent the same facial feature to be adjusted, for example, Both the left eye and right eye areas are used to represent the eyes.
- the area to be adjusted may be divided according to the beauty function provided by the terminal running the interface interaction method. For example, if the terminal provides four beauty function options A, B, C, and D, the area corresponding to the four function options A, B, C, and D in the face image can be set as the area to be adjusted. .
- S120 Receive an operation instruction from a user, where the operation instruction is used to select a target area in the image to be processed.
- the received user operation instructions are also different.
- the user's operation instruction may be the instruction corresponding to the user's touch and click operation, and the target area in the image to be processed can be selected according to the position of the touch and click operation;
- the user's operation instruction may be an instruction corresponding to a key operation, and the target area in the image to be processed may be selected according to the operated key, but is not limited to this.
- S130 Determine the area to be adjusted to which the target area belongs according to the position information of the target area, and display an adjustment interface corresponding to the area to be adjusted to which the target area belongs.
- each area to be adjusted corresponds to an adjustment interface
- the adjustment interface includes function options corresponding to the area to be adjusted.
- the terminal may store the corresponding relationship (or mapping relationship) between the area to be adjusted and the function option, and after determining the area to be adjusted to which the target area belongs, it may determine what needs to be provided to the user according to the stored mapping relationship. Function options, and then show the user an adjustment interface including the determined function options.
- the function option can be configured to adjust the corresponding area to be adjusted.
- the function option can be configured to perform related adjustments to the eyes, such as magnifying the eyes, and if the area to be adjusted is the chin ,
- the function option can be configured to perform face-lifting, etc., and there is no restriction here.
- the adjustment interface corresponding to the region to be adjusted to which the target region belongs is displayed.
- the adjustment interface includes function options corresponding to the area to be adjusted, and intuitively displays the area to be adjusted that can be adjusted by the adjustment interface.
- the terminal can intelligently provide the user with corresponding image processing function options according to the area selected by the user that needs to be adjusted, and the user can quickly get started without learning or trying the application. , Effectively reducing interaction costs.
- FIG. 2 is a schematic flowchart of another interface interaction method provided by the present disclosure
- FIG. 3 is a schematic diagram of an area to be adjusted in the interface interaction method.
- recognizing and acquiring multiple regions to be adjusted in the face portion of the image to be processed includes:
- the face part in the image to be processed can be recognized through a face detection model.
- the face detection model can include a You Only Look Once (YOLO) model, a fast area convolutional neural network (FAST- Region Convolutional Neural Networks, FAST-RCNN) model, Multi-task Convolutional Neural Networks (MTCNN) model, etc., but not limited to this.
- YOLO You Only Look Once
- FAST- Region Convolutional Neural Networks FAST-RCNN
- MTCNN Multi-task Convolutional Neural Networks
- the face in the face frame may be squared to obtain the face after the square.
- the straightened face can be used for face key point detection.
- the coordinates of the two eyes recognized from the face part can be used as the standard for the alignment.
- S112 Use a face key point detection model to detect and acquire multiple face key points in the face part.
- Face attributes can refer to the description of a certain location area on the face, or the description of a certain feature, etc.
- the key points of the face may be anchor points of the designated face contour and the contour of the facial features
- the key point detection model of the face may include a Heatmap Regression model, an MTCNN model, etc.
- the face key points 201 are obtained through the face key point detection model (marked by black dots in Fig. 3).
- a face can obtain tens to hundreds of face key points 201, and each face The key point 201 corresponds to a face attribute, such as eyes, nose, chin, forehead, cheeks, etc.
- the face key points refer to key feature points on the facial image, and each key feature point has a face attribute, which indicates which key feature point belongs to on the face.
- the area to be adjusted for example, the eye area, the nose area, the mouth area, the eyebrow area, and other facial parts.
- the acquired key points of the face may be the corner points of the eyes, the tip of the nose, the corner points of the mouth, the brow peak, and the contour points of various parts of the face.
- S113 According to the key points of the human face, determine multiple regions to be adjusted in the human face.
- multiple face key points 201 of the same face attribute enclose the area to be adjusted corresponding to the face attribute, and the same face attribute may correspond to more than one area to be adjusted.
- the area to be adjusted may include The chin area 203, the cheek area 204, the cheekbone area 205, the eye area 206, the forehead area 207, the nose area 208, etc., but not limited to this.
- FIG. 4 is a schematic diagram of another flow of an interface interaction method provided by an embodiment of the disclosure.
- the foregoing determination of multiple areas to be adjusted in the face part according to the key points of the face includes:
- the coordinates of the key points of the face may be the coordinates of the anchor points of the designated face contour and the contour of the facial features in the image to be processed, and the feature values of the key points of the face may be the number and order of the key points of the face. There is no restriction here.
- the preset mapping relationship may be the mapping relationship between the number of the face key point and the face attribute, for example, the face key numbered 1-15
- the face attribute of the point is the contour of the face
- the face attribute of the key points of the face numbered 16-20 is the nose, but not limited to this.
- S1133 Determine a region to be adjusted corresponding to the face attribute according to the coordinates of the key points of the face having the face attribute.
- the anchor points corresponding to the key point coordinates of the face key points numbered 1-15 enclose a closed area in the image to be processed, which is the face area, and the key points of the face key points numbered 16-20
- the anchor point corresponding to the point coordinate encloses another closed area in the image to be processed, and this area is the nose area.
- Fig. 5 is another schematic flowchart of the interface interaction method provided by the disclosed embodiment.
- the foregoing determination of the region to be adjusted corresponding to the face attribute according to the coordinates of the face key points having the face attribute includes:
- S1133a Use the key points of the face with the face attributes as anchor points corresponding to the face attributes.
- S1133a is the method in steps S1131 and S1132 above, and will not be repeated here.
- S1133b calculates multiple preset anchor points according to the face key points having the face attributes, and uses the face key points having the face attributes and the multiple preset anchor points as the corresponding The anchor point of the face attribute.
- the preset anchor points include face attributes, and the preset anchor points have the same face attributes as the face key points.
- a white point is used to mark the preset anchor point 202 in FIG. 3.
- the preset anchor point 202 can be used to supplement the face key points, so that the face key points and the preset anchor points
- the edge of the determined area to be adjusted is smoother and the area range is more accurate.
- S1133c Determine an area to be adjusted corresponding to the face attribute according to the anchor point of the face attribute.
- the anchor points of the face attributes may include face feature points with the same face attributes and preset anchor points.
- the area represented by the anchor point of the face attribute on the image to be processed is the area to be adjusted corresponding to the face attribute.
- step S1133 can also be implemented in one of the following ways:
- the area enclosed by the key points of the face having the face attribute may be determined as the area to be adjusted corresponding to the face attribute.
- the area enclosed by each face key point whose face attribute is the face contour (such as the face key points numbered 1-15 above) can be determined as the area to be adjusted corresponding to the face contour, that is, the face area .
- the area enclosed by each face key point whose face attribute is the nose (such as the aforementioned face key points numbered 16-20) can be determined as the area to be adjusted corresponding to the nose, that is, the nose area.
- multiple preset anchor points may be calculated according to the coordinates of the face key points having the face attributes, and the face key points having the face attributes and the The area enclosed by a plurality of preset anchor points is determined as the area to be adjusted corresponding to the face attribute.
- FIG. 6 is a schematic flowchart of another interface interaction method provided by an embodiment of the disclosure.
- the calculation of multiple preset anchor points according to the face key points having the face attributes can be implemented through the following process:
- the standard face image may be a face image that meets the requirements of the face key point detection model, and the face key points obtained on it may be used to calculate the expression of the preset anchor point.
- each standard anchor point and the face standard key points at both ends of the line where it is located can be used to calculate the expression corresponding to the preset anchor point.
- the standard anchor point corresponds to a preset anchor point, wherein the feature value of the face standard key point at both ends of the line where each standard anchor point is located is the same as the feature value of the face key point at both ends of the line where the preset anchor point is located.
- the standard anchor point S(X s ', Y s ') can be expressed as:
- ⁇ is the ratio of the distance between the standard anchor point S and the face standard key point A
- , namely ⁇
- S340 According to the expression of the standard anchor point coordinates and the coordinates of the key points of the human face, calculate and obtain multiple preset anchor points.
- the face key points at both ends of the line where the preset anchor point is located can be obtained according to the feature values of the face standard key points at both ends of the line where the standard anchor point corresponding to each preset anchor point is located, and The coordinates of the key points of the face and the expression of the standard anchor point coordinates are calculated to obtain the coordinates of the preset anchor points.
- the key points of the face with the face attributes may be connected end to end in sequence in a set order, and according to the expression of the standard anchor point coordinates, according to every two connected The coordinates of the key points of the human face are calculated to obtain one of the preset anchor points. In this way, multiple preset anchor points can be obtained.
- sequence rules used when connecting the standard key points of the face and the key points of the face are the same to ensure that the face key points that are connected end to end in sequence conform to the expression of the standard anchor point coordinates.
- FIG. 7 is a schematic flowchart of another interface interaction method provided by an embodiment of the disclosure.
- the above-mentioned use of the face key point detection model to detect and acquire multiple face key points in the face part includes:
- the face image in the face part may have a certain offset, which can be corrected by a face correction network to obtain a corrected face image.
- the face key point detection model used in S1122 is the same as the above, and will not be repeated here.
- the method further includes: displaying each region to be adjusted on the image to be processed.
- displaying each area to be adjusted on the image to be processed can be achieved by highlighting or marking each area to be adjusted.
- the area to be adjusted corresponding to different face attributes can be covered with different color highlight layers, such as red for eyes, brown for nose, yellow for cheeks, etc.; in other embodiments , Can be on the highlight layer, or without using the highlight layer, directly on the area to be adjusted, using text, graphics, etc., to label the area to be adjusted with different face attributes with different text or graphics
- each area to be adjusted on the image to be processed is to be able to distinguish different face areas clearly and quickly, so that the user can intuitively select the required adjustment function and reduce the interaction cost.
- the area to be adjusted can also be used to indicate the adjustment of other parts of the human body in the image, for example, the legs, waist, etc. are marked by the area to be adjusted.
- the selection method and the display method of the adjustment interface are the same as those of the human face, so I will not repeat them here.
- a photo including a face image can be taken through a smart phone, and the photo is stored in the flash memory of the smart phone.
- the photo After the user selects the photo, first operate in the background of the smart phone, that is, obtain the correction through the face detection model and the face correction network
- the face image After the face image, the face image is detected through the face key point detection model, and multiple face key points on the face image are obtained, and the preset anchor points are calculated through the obtained face key points.
- the key points of the face and the calculated preset anchor points obtain the range coordinates of the area to be adjusted. After obtaining the range coordinates of the area to be adjusted, they are displayed on the front end of the smartphone, that is, on the face image in the photo displayed on the phone screen , By highlighting different areas to be adjusted.
- FIG. 8 is a schematic structural diagram of an interface interaction device provided by an embodiment of the disclosure.
- an embodiment of the present disclosure also provides an interface interaction device, which includes: a recognition module 401 configured to recognize and acquire multiple regions to be adjusted in the face portion of the image to be processed.
- the receiving module 402 is configured to receive a user's operation instruction, and the operation instruction is used to select a target area in the image to be processed.
- the first display module 403 is configured to determine the area to be adjusted to which the target area belongs according to the location information of the target area, and display the adjustment interface corresponding to the area to be adjusted to which the target area belongs, wherein each area to be adjusted corresponds to an adjustment interface, and the adjustment The interface contains the function options corresponding to the area to be adjusted.
- the recognition module 401 is specifically configured to recognize the face part in the image to be processed.
- the face key point detection model is used to detect the face part, and multiple face key points in the face part are obtained. According to the key points of the human face, multiple regions to be adjusted in the human face are determined.
- each face key point has a face attribute, and the face attribute indicates the area to be adjusted to which the face key point belongs.
- the recognition module 401 is specifically configured to: obtain the face key point coordinates and the face key point feature value of the face key point; for each face attribute, according to the face key point feature value and the face key point feature The preset mapping relationship between the value and the face attribute is used to obtain the face key point with the face attribute; according to the coordinates of the face key point with the face attribute, the area to be adjusted corresponding to the face attribute is determined.
- the specific method for the recognition module 401 to determine the region to be adjusted corresponding to the face attribute according to the coordinates of the face key points having the face attribute may be:
- the face key points and the multiple preset anchor points are used as anchor points corresponding to the face attributes.
- the preset anchor points include face attributes, and the preset anchor points and the face key points have the same face attributes ;
- the area to be adjusted corresponding to the face attribute is determined.
- FIG. 9 is a schematic structural diagram of an interface interaction device provided by an embodiment of the disclosure.
- a calculation module 404 is further included.
- the calculation module 404 is configured to: obtain multiple face standard key points on the standard face image; set multiple standard anchor points on the line between the multiple face standard key points. According to the coordinates of the standard key points of the face at both ends of the line where each standard anchor point is located and the interpolation algorithm, the expression based on the standard anchor point coordinates of the standard key points of the face at both ends of the line is calculated; according to the standard anchor point coordinates Expressions and coordinates of key points on the face are calculated to obtain multiple preset anchor points.
- the recognition module 401 may be specifically configured to correct the direction of the face part to a preset direction to obtain a corrected face image; use a face key point detection model to detect and obtain multiple people in the corrected face image Key points of the face.
- FIG. 10 is a schematic structural diagram of an interface interaction device provided by an embodiment of the disclosure.
- a second display module 405 is further included, configured to display each area to be adjusted on the image to be processed.
- the foregoing device is configured to execute the method provided in the foregoing embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.
- the above modules may be one or more integrated circuits configured to implement the above methods, for example: one or more specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), or one or more microprocessors (digital singnal processor, DSP for short), or, one or more Field Programmable Gate Array (FPGA for short), etc.
- ASIC Application Specific Integrated Circuit
- DSP digital singnal processor
- FPGA Field Programmable Gate Array
- the processing element may be a general-purpose processor, such as a central processing unit (CPU for short) or other processors that can call program codes.
- these modules can be integrated together and implemented in the form of a system-on-a-chip (SOC for short).
- FIG. 11 is a schematic diagram of a structure of an electronic device provided by an embodiment of the disclosure.
- the electronic device includes: a processor 501, a computer-readable storage medium 502, and a bus 503, where:
- the electronic device may include one or more processors 501, a bus 503, and a computer-readable storage medium 502, where the computer-readable storage medium 502 is configured to store a program, and the processor 501 is communicatively connected to the computer-readable storage medium 502 through the bus 503
- the processor 501 invokes a program stored in the computer-readable storage medium 502 to execute the foregoing method embodiment.
- the electronic device can be a general-purpose computer, a server, or a mobile terminal, etc., which is not limited here.
- the electronic device is configured to implement the face recognition method of the present disclosure.
- the processor 501 may include one or more processing cores (for example, a single-core processor or a multi-core processor).
- the processor may include a central processing unit (CPU), an application specific integrated circuit (ASIC), a special instruction set processor (Application Specific Instruction-set Processor, ASIP), and a graphics processing unit (Graphics Processing Unit, GPU), Physical Processing Unit (Physics Processing Unit, PPU), Digital Signal Processor (Digital Signal Processor, DSP), Field Programmable Gate Array (Field Programmable Gate Array, FPGA), Programmable Logic Device ( Programmable Logic Device (PLD), controller, microcontroller unit, Reduced Instruction Set Computing (RISC), or microprocessor, etc., or any combination thereof.
- CPU central processing unit
- ASIC application specific integrated circuit
- ASIP Application Specific Instruction-set Processor
- GPU Graphics Processing Unit
- PPU Physical Processing Unit
- DSP Digital Signal Processor
- DSP Digital Signal Processor
- FPGA Field Programmable Gate Array
- PLD Programmable Logic Device
- the computer-readable storage medium 502 may include: including mass memory, removable memory, volatile read-write memory, or read-only memory (Read-Only Memory, ROM), or any combination thereof.
- mass storage may include magnetic disks, optical disks, solid-state drives, etc.
- removable storage may include flash drives, floppy disks, optical disks, memory cards, zip disks, tapes, etc.
- volatile read-write storage may include random access memory ( Random Access Memory, RAM; RAM can include dynamic RAM (Dynamic Random Access Memory, DRAM), double data rate synchronous dynamic RAM (Double Date-Rate Synchronous RAM, DDR SDRAM); static RAM (Static Random-Access Memory, SRAM) ), Thyristor-Based Random Access Memory (T-RAM) and Zero-Capacitor RAM (Zero-RAM), etc.
- ROM may include mask ROM (Mask Read-Only Memory, MROM), programmable ROM (Programmable Read-Only Memory, PROM), erasable programmable ROM (Programmable Read-only Memory, PEROM), electronic Erasable programmable ROM (Electrically Erasable Programmable read only memory, EEPROM), compact disc ROM (CD-ROM), and digital universal disk ROM, etc.
- MROM mask ROM
- PROM Programmable Read-Only Memory
- PROM Programmable Read-Only Memory
- PEROM Erasable programmable ROM
- EEPROM Electrical Erasable Programmable read only memory
- CD-ROM compact disc ROM
- digital universal disk ROM etc.
- processor 501 For ease of description, only one processor 501 is described in the electronic device. However, it should be noted that the electronic device in the present disclosure may also include multiple processors 501, so the steps performed by one processor described in the present disclosure may also be performed jointly or individually by multiple processors. For example, if the processor 501 of the electronic device executes step A and step B, it should be understood that step A and step B may also be executed by two different processors or be executed separately in one processor. For example, the first processor performs step A and the second processor performs step B, or the first processor and the second processor perform steps A and B together.
- the present disclosure also provides a program product, such as a computer-readable storage medium, including a program, which is used to execute the foregoing method embodiments when executed by a processor.
- a program product such as a computer-readable storage medium, including a program, which is used to execute the foregoing method embodiments when executed by a processor.
- the interface interaction method and device obtain multiple regions to be adjusted in the face portion of the image to be processed by identifying, and select the target region according to the user's operation instruction, and display the target region to be adjusted
- the adjustment interface corresponding to the area the adjustment interface contains the function options corresponding to the area to be adjusted, and intuitively shows the area to be adjusted that can be adjusted by the adjustment interface. You can quickly get started without learning or trying the application. Effectively reduce the interaction cost.
- the disclosed device and method may be implemented in other ways.
- the device embodiments described above are only illustrative.
- the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
- the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
- the functional units in the various embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.
- the above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.
- the above-mentioned integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium.
- the above-mentioned software functional unit is stored in a storage medium, and includes several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (English: processor) execute the various embodiments of the present disclosure Part of the method.
- the aforementioned storage media include: U disk, mobile hard disk, read-only memory (English: Read-Only Memory, abbreviated as: ROM), random access memory (English: Random Access Memory, abbreviated as: RAM), magnetic disk or optical disk, etc.
- ROM Read-Only Memory
- RAM Random Access Memory
- magnetic disk or optical disk etc.
- the interface interaction method and device provided by the present disclosure enable the terminal to intelligently provide the user with corresponding image processing function options according to the area selected by the user to be adjusted, and the user can quickly get started without learning or trying the application. Effectively reduce interaction costs.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (16)
- 一种界面交互方法,其特征在于,包括:An interface interaction method, characterized by comprising:识别获取待处理图像中人脸部分的多个待调整区域;Identify and acquire multiple regions to be adjusted in the face part of the image to be processed;接收用户的操作指令,所述操作指令用于选择所述待处理图像中的目标区域;Receiving an operation instruction from a user, the operation instruction being used to select a target area in the image to be processed;根据所述目标区域的位置信息确定所述目标区域所属的待调整区域,展示所述目标区域所属的待调整区域对应的调整界面,其中,每个所述待调整区域与一个所述调整界面对应,所述调整界面包含所述待调整区域对应的功能选项。Determine the area to be adjusted to which the target area belongs according to the position information of the target area, and display the adjustment interface corresponding to the area to be adjusted to which the target area belongs, wherein each area to be adjusted corresponds to one adjustment interface , The adjustment interface includes function options corresponding to the area to be adjusted.
- 根据权利要求1所述的方法,其特征在于,所述识别获取待处理图像中所述人脸部分的多个待调整区域,包括:The method according to claim 1, wherein the identifying and acquiring a plurality of regions to be adjusted of the face part in the image to be processed comprises:识别所述待处理图像中的人脸部分;Identifying the face part in the image to be processed;采用人脸关键点检测模型检测所述人脸部分,得到所述人脸部分中的多个人脸关键点;Using a face key point detection model to detect the face part, and obtain multiple face key points in the face part;根据所述人脸关键点,确定所述人脸部分的多个待调整区域。According to the key points of the human face, multiple regions to be adjusted of the human face are determined.
- 根据权利要求2所述的方法,其特征在于,每个人脸关键点具有一人脸属性,所述人脸属性指示该人脸关键点所属的待调整区域;The method according to claim 2, wherein each face key point has a face attribute, and the face attribute indicates the area to be adjusted to which the face key point belongs;所述根据所述人脸关键点,确定所述人脸部分的多个待调整区域,包括:The determining a plurality of regions to be adjusted of the human face part according to the key points of the human face includes:获取所述人脸关键点的人脸关键点坐标以及人脸关键点特征值;Acquiring the face key point coordinates and the face key point feature value of the face key point;针对每个所述人脸属性,根据所述人脸关键点特征值以及所述人脸关键点特征值与人脸属性的预设映射关系,确定具有所述人脸属性的所述人脸关键点;For each of the face attributes, determine the face key having the face attribute according to the feature value of the face key point and the preset mapping relationship between the feature value of the face key point and the face attribute point;根据具有所述人脸属性的所述人脸关键点的坐标,确定所述人脸属性对应的待调整区域。According to the coordinates of the key points of the face having the face attributes, the area to be adjusted corresponding to the face attributes is determined.
- 根据权利要求3所述的方法,其特征在于,所述根据具有所述人脸属性的所述人脸关键点的坐标,确定所述人脸属性对应的待调整区域,包括:The method according to claim 3, wherein the determining the area to be adjusted corresponding to the face attribute according to the coordinates of the face key points having the face attribute comprises:将具有所述人脸属性的所述人脸关键点围成的区域,确定为所述人脸属性对应的待调整区域;或者,Determine the area surrounded by the key points of the face with the face attributes as the area to be adjusted corresponding to the face attributes; or,根据具有所述人脸属性的所述人脸关键点的坐标计算得到多个预设锚点,将具有所述人脸属性的所述人脸关键点以及所述多个预设锚点围成的区域,确定为所述人脸属性对应的待调整区域。A plurality of preset anchor points are calculated according to the coordinates of the face key points having the face attributes, and the face key points having the face attributes and the plurality of preset anchor points are enclosed The area of is determined as the area to be adjusted corresponding to the face attribute.
- 根据权利要求3所述的方法,其特征在于,所述根据具有所述人脸属性的所述人脸关键点的坐标,确定所述人脸属性对应的待调整区域,包括:The method according to claim 3, wherein the determining the area to be adjusted corresponding to the face attribute according to the coordinates of the face key points having the face attribute comprises:将具有所述人脸属性的所述人脸关键点,作为对应所述人脸属性的锚点;或,根据具有所述人脸属性的所述人脸关键点的坐标计算得到多个预设锚点,将具有所述人脸属性的 所述人脸关键点以及所述多个预设锚点,作为对应所述人脸属性的锚点,其中,所述预设锚点包括所述人脸属性,所述预设锚点与所述人脸关键点具有相同的人脸属性;Use the face key points with the face attributes as anchor points corresponding to the face attributes; or calculate multiple presets based on the coordinates of the face key points with the face attributes Anchor point, using the face key points having the face attributes and the multiple preset anchor points as anchor points corresponding to the face attributes, wherein the preset anchor points include the person Face attributes, the preset anchor points and the face key points have the same face attributes;根据所述人脸属性的锚点,确定所述人脸属性对应的所述待调整区域。According to the anchor point of the face attribute, the area to be adjusted corresponding to the face attribute is determined.
- 根据权利要求4或5所述的方法,其特征在于,所述根据具有所述人脸属性的所述人脸关键点的坐标计算得到多个预设锚点,包括:The method according to claim 4 or 5, wherein the calculating a plurality of preset anchor points according to the coordinates of the face key points having the face attributes includes:获取标准人脸图像上的多个人脸标准关键点,将所述多个人脸标准关键点按照设定的顺序依次首尾相连,每两个相连的人脸标准关键点之间存在一连线;Acquiring multiple face standard key points on the standard face image, connecting the multiple face standard key points in sequence according to a set order end to end, and there is a line between every two connected face standard key points;在至少一所述连线上,设置标准锚点;Set a standard anchor point on at least one of the connecting lines;根据每个所述标准锚点所在的所述连线两端的人脸标准关键点的坐标以及插值算法,计算获得基于所述连线两端的人脸标准关键点的所述标准锚点坐标的表达式;According to the coordinates of the standard key points of the face at both ends of the line where each standard anchor point is located, and an interpolation algorithm, the expression of the coordinates of the standard anchor points based on the standard key points of the face at both ends of the line is calculated formula;根据所述标准锚点坐标的表达式、所述人脸关键点的坐标,计算获取多个预设锚点。According to the expression of the standard anchor point coordinates and the coordinates of the key points of the human face, a plurality of preset anchor points are calculated and acquired.
- 根据权利要求6所述的方法,其特征在于,所述根据所述标准锚点坐标的表达式、所述人脸关键点的坐标,计算获取多个预设锚点,包括:The method according to claim 6, wherein said calculating and acquiring a plurality of preset anchor points according to the expression of the standard anchor point coordinates and the coordinates of the key points of the face comprises:按照所述设定的顺序将具有所述人脸属性的所述人脸关键点依次首尾相连;Connecting the face key points with the face attributes end to end in sequence according to the set sequence;按照所述标准锚点坐标的表达式,根据每两个相连的所述人脸关键点的坐标计算得到一个所述预设锚点。According to the expression of the standard anchor point coordinates, one of the preset anchor points is calculated according to the coordinates of every two connected key points of the human face.
- 根据权利要求2-7中任一项所述的方法,其特征在于,所述采用人脸关键点检测模型检测获取所述人脸部分中的多个人脸关键点,包括:The method according to any one of claims 2-7, wherein the detecting and acquiring a plurality of face key points in the face part using a face key point detection model comprises:将所述人脸部分的方向校正为预设方向,得到校正后的人脸图像;Correcting the direction of the part of the face to a preset direction to obtain a corrected face image;采用人脸关键点检测模型检测获取所述校正后的人脸图像中多个所述人脸关键点。A face key point detection model is used to detect and acquire a plurality of the face key points in the corrected face image.
- 根据权利要求1-8中任一项所述的方法,其特征在于,所述识别获取待处理图像中人脸部分的多个待调整区域之后,还包括:The method according to any one of claims 1-8, characterized in that, after the recognizing and acquiring a plurality of regions to be adjusted in the face portion of the image to be processed, the method further comprises:在所述待处理图像上展示每个所述待调整区域。Each of the regions to be adjusted is displayed on the image to be processed.
- 一种界面交互装置,其特征在于,包括:An interface interaction device, characterized in that it comprises:识别模块,配置成识别获取待处理图像中人脸部分的多个待调整区域;A recognition module, configured to recognize and obtain multiple regions to be adjusted in the face portion of the image to be processed;接收模块,配置成接收用户的操作指令,所述操作指令用于选择所述待处理图像中的目标区域;A receiving module configured to receive a user's operation instruction, the operation instruction being used to select a target area in the image to be processed;第一展示模块,配置成根据所述目标区域的位置信息确定所述目标区域所属的待调整区域,展示所述目标区域所属的待调整区域对应的调整界面,其中,每个所述待调整区域与一个所述调整界面对应,所述调整界面包含所述待调整区域对应的功能选项。The first display module is configured to determine the area to be adjusted to which the target area belongs according to the location information of the target area, and display the adjustment interface corresponding to the area to be adjusted to which the target area belongs, wherein each of the areas to be adjusted Corresponding to one of the adjustment interfaces, the adjustment interface includes function options corresponding to the area to be adjusted.
- 根据权利要求10所述的装置,其特征在于,所述识别模块,具体配置成:The device according to claim 10, wherein the identification module is specifically configured to:识别所述待处理图像中的人脸部分;Identifying the face part in the image to be processed;采用人脸关键点检测模型检测所述人脸部分,得到所述人脸部分中的多个人脸关键点;Using a face key point detection model to detect the face part, and obtain multiple face key points in the face part;根据所述人脸关键点,确定所述人脸部分的多个待调整区域。According to the key points of the human face, multiple regions to be adjusted of the human face are determined.
- 根据权利要求11所述的装置,其特征在于,每个人脸关键点具有一人脸属性,所述人脸属性指示该人脸关键点所属的待调整区域;所述识别模块,具体配置成:The device according to claim 11, wherein each face key point has a face attribute, and the face attribute indicates the region to be adjusted to which the face key point belongs; the recognition module is specifically configured as:获取所述人脸关键点的人脸关键点坐标以及人脸关键点特征值;Acquiring the face key point coordinates and the face key point feature value of the face key point;针对每个所述人脸属性,根据所述人脸关键点特征值以及所述人脸关键点特征值与人脸属性的预设映射关系,确定具有所述人脸属性的所述人脸关键点;For each of the face attributes, determine the face key having the face attribute according to the feature value of the face key point and the preset mapping relationship between the feature value of the face key point and the face attribute point;根据具有所述人脸属性的所述人脸关键点的坐标,确定所述人脸属性对应的待调整区域。According to the coordinates of the key points of the face having the face attributes, the area to be adjusted corresponding to the face attributes is determined.
- 根据权利要求12所述的装置,其特征在于,所述识别模块根据具有所述人脸属性的所述人脸关键点的坐标,确定所述人脸属性对应的待调整区域的具体方式,为:The device according to claim 12, wherein the specific method for the recognition module to determine the region to be adjusted corresponding to the face attribute according to the coordinates of the face key point having the face attribute is :将具有所述人脸属性的所述人脸关键点,作为对应所述人脸属性的锚点;或,根据具有所述人脸属性的所述人脸关键点计算得到多个预设锚点,将具有所述人脸属性的所述人脸关键点以及所述多个预设锚点,作为对应所述人脸属性的锚点,其中,所述预设锚点包括所述人脸属性,所述预设锚点与所述人脸关键点具有相同的人脸属性;Use the face key points with the face attributes as anchor points corresponding to the face attributes; or calculate multiple preset anchor points according to the face key points with the face attributes , Taking the face key points having the face attributes and the multiple preset anchor points as anchor points corresponding to the face attributes, wherein the preset anchor points include the face attributes , The preset anchor point and the face key point have the same face attributes;根据所述人脸属性的锚点,生成所述人脸属性对应的所述待调整区域。According to the anchor point of the face attribute, the region to be adjusted corresponding to the face attribute is generated.
- 根据权利要求12或13所述的装置,其特征在于,还包括计算模块;The device according to claim 12 or 13, characterized in that it further comprises a calculation module;所述计算模块,配置成获取标准人脸图像上的多个人脸标准关键点;在多个所述人脸标准关键点之间的连线上,设置多个标准锚点;根据每个所述标准锚点所在的所述连线两端的人脸标准关键点的坐标以及插值算法,计算获得基于所述连线两端的人脸标准关键点的所述标准锚点坐标的表达式;根据所述标准锚点坐标的表达式、所述人脸关键点的坐标,计算获取多个预设锚点。The calculation module is configured to obtain a plurality of face standard key points on a standard face image; set a plurality of standard anchor points on the line between the plurality of face standard key points; According to the coordinates of the standard key points of the face at both ends of the line where the standard anchor points are located, and an interpolation algorithm, the expression based on the standard key points of the face at both ends of the line is calculated; The expression of the standard anchor point coordinates and the coordinates of the key points of the face are calculated to obtain multiple preset anchor points.
- 根据权利要求11-14中任一项所述的装置,其特征在于,所述识别模块,具体配置成:The device according to any one of claims 11-14, wherein the identification module is specifically configured to:将所述人脸部分的方向校正为预设方向,得到校正后的人脸图像;Correcting the direction of the part of the face to a preset direction to obtain a corrected face image;采用人脸关键点检测模型检测获取所述校正后的人脸图像中多个所述人脸关键点。A face key point detection model is used to detect and acquire a plurality of the face key points in the corrected face image.
- 根据权利要求10-15中任一项所述的装置,其特征在于,还包括第二展示模块,配置成在所述待处理图像上展示每个所述待调整区域。15. The device according to any one of claims 10-15, further comprising a second display module configured to display each of the regions to be adjusted on the image to be processed.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910375059.1A CN110084219B (en) | 2019-05-07 | 2019-05-07 | Interface interaction method and device |
CN201910375059.1 | 2019-05-07 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020224136A1 true WO2020224136A1 (en) | 2020-11-12 |
Family
ID=67418999
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/104315 WO2020224136A1 (en) | 2019-05-07 | 2019-09-04 | Interface interaction method and device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110084219B (en) |
WO (1) | WO2020224136A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112613357A (en) * | 2020-12-08 | 2021-04-06 | 深圳数联天下智能科技有限公司 | Face measurement method, face measurement device, electronic equipment and medium |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110084219B (en) * | 2019-05-07 | 2022-06-24 | 厦门美图之家科技有限公司 | Interface interaction method and device |
CN114185628B (en) * | 2021-11-19 | 2024-04-12 | 北京奇艺世纪科技有限公司 | Picture adjustment method, device and equipment of iOS (integrated operation system) and computer readable medium |
CN114546211A (en) * | 2022-02-21 | 2022-05-27 | 深圳硬盒交互设计科技有限公司 | Image processing method |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140023231A1 (en) * | 2012-07-19 | 2014-01-23 | Canon Kabushiki Kaisha | Image processing device, control method, and storage medium for performing color conversion |
CN105825486A (en) * | 2016-04-05 | 2016-08-03 | 北京小米移动软件有限公司 | Beautifying processing method and apparatus |
CN108021308A (en) * | 2016-10-28 | 2018-05-11 | 中兴通讯股份有限公司 | Image processing method, device and terminal |
CN108550117A (en) * | 2018-03-20 | 2018-09-18 | 维沃移动通信有限公司 | A kind of image processing method, device and terminal device |
CN109064388A (en) * | 2018-07-27 | 2018-12-21 | 北京微播视界科技有限公司 | Facial image effect generation method, device and electronic equipment |
CN110084219A (en) * | 2019-05-07 | 2019-08-02 | 厦门美图之家科技有限公司 | Interface alternation method and device |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101130817B1 (en) * | 2011-09-27 | 2012-04-16 | (주)올라웍스 | Face recognition method, apparatus, and computer-readable recording medium for executing the method |
CN105787878B (en) * | 2016-02-25 | 2018-12-28 | 杭州格像科技有限公司 | A kind of U.S. face processing method and processing device |
CN109559288A (en) * | 2018-11-30 | 2019-04-02 | 深圳市脸萌科技有限公司 | Image processing method, device, electronic equipment and computer readable storage medium |
CN109584180A (en) * | 2018-11-30 | 2019-04-05 | 深圳市脸萌科技有限公司 | Face image processing process, device, electronic equipment and computer storage medium |
CN109614951A (en) * | 2018-12-27 | 2019-04-12 | 广东金杭科技有限公司 | Portrait compares task distribution processor algorithm |
-
2019
- 2019-05-07 CN CN201910375059.1A patent/CN110084219B/en active Active
- 2019-09-04 WO PCT/CN2019/104315 patent/WO2020224136A1/en active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140023231A1 (en) * | 2012-07-19 | 2014-01-23 | Canon Kabushiki Kaisha | Image processing device, control method, and storage medium for performing color conversion |
CN105825486A (en) * | 2016-04-05 | 2016-08-03 | 北京小米移动软件有限公司 | Beautifying processing method and apparatus |
CN108021308A (en) * | 2016-10-28 | 2018-05-11 | 中兴通讯股份有限公司 | Image processing method, device and terminal |
CN108550117A (en) * | 2018-03-20 | 2018-09-18 | 维沃移动通信有限公司 | A kind of image processing method, device and terminal device |
CN109064388A (en) * | 2018-07-27 | 2018-12-21 | 北京微播视界科技有限公司 | Facial image effect generation method, device and electronic equipment |
CN110084219A (en) * | 2019-05-07 | 2019-08-02 | 厦门美图之家科技有限公司 | Interface alternation method and device |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112613357A (en) * | 2020-12-08 | 2021-04-06 | 深圳数联天下智能科技有限公司 | Face measurement method, face measurement device, electronic equipment and medium |
CN112613357B (en) * | 2020-12-08 | 2024-04-09 | 深圳数联天下智能科技有限公司 | Face measurement method, device, electronic equipment and medium |
Also Published As
Publication number | Publication date |
---|---|
CN110084219B (en) | 2022-06-24 |
CN110084219A (en) | 2019-08-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020224136A1 (en) | Interface interaction method and device | |
US11250241B2 (en) | Face image processing methods and apparatuses, and electronic devices | |
US10990803B2 (en) | Key point positioning method, terminal, and computer storage medium | |
WO2020199906A1 (en) | Facial keypoint detection method, apparatus and device, and storage medium | |
WO2020207191A1 (en) | Method and apparatus for determining occluded area of virtual object, and terminal device | |
US10599914B2 (en) | Method and apparatus for human face image processing | |
WO2017193906A1 (en) | Image processing method and processing system | |
WO2022012085A1 (en) | Face image processing method and apparatus, storage medium, and electronic device | |
EP3454250A1 (en) | Facial image processing method and apparatus and storage medium | |
WO2020001013A1 (en) | Image processing method and device, computer readable storage medium, and terminal | |
EP3992919B1 (en) | Three-dimensional facial model generation method and apparatus, device, and medium | |
US20160328825A1 (en) | Portrait deformation method and apparatus | |
US10311295B2 (en) | Heuristic finger detection method based on depth image | |
CN106778453B (en) | Method and device for detecting glasses wearing in face image | |
CN105096353B (en) | Image processing method and device | |
WO2021083125A1 (en) | Call control method and related product | |
US11238569B2 (en) | Image processing method and apparatus, image device, and storage medium | |
JP6694465B2 (en) | Display method and electronic device for recommending eyebrow shape | |
WO2021062998A1 (en) | Image processing method, apparatus and electronic device | |
WO2019237747A1 (en) | Image cropping method and apparatus, and electronic device and computer-readable storage medium | |
WO2019095117A1 (en) | Facial image detection method and terminal device | |
WO2020244160A1 (en) | Terminal device control method and apparatus, computer device, and readable storage medium | |
WO2020223940A1 (en) | Posture prediction method, computer device and storage medium | |
CN106875332A (en) | A kind of image processing method and terminal | |
WO2020124442A1 (en) | Pushing method and related product |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19927808 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19927808 Country of ref document: EP Kind code of ref document: A1 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19927808 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 06/05/2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19927808 Country of ref document: EP Kind code of ref document: A1 |