WO2019061281A1 - Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine - Google Patents

Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine Download PDF

Info

Publication number
WO2019061281A1
WO2019061281A1 PCT/CN2017/104348 CN2017104348W WO2019061281A1 WO 2019061281 A1 WO2019061281 A1 WO 2019061281A1 CN 2017104348 W CN2017104348 W CN 2017104348W WO 2019061281 A1 WO2019061281 A1 WO 2019061281A1
Authority
WO
WIPO (PCT)
Prior art keywords
contact
photo
video
album
face
Prior art date
Application number
PCT/CN2017/104348
Other languages
English (en)
Chinese (zh)
Inventor
吴锡昌
Original Assignee
深圳传音通讯有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳传音通讯有限公司 filed Critical 深圳传音通讯有限公司
Priority to CN201780097260.7A priority Critical patent/CN111418196A/zh
Priority to PCT/CN2017/104348 priority patent/WO2019061281A1/fr
Publication of WO2019061281A1 publication Critical patent/WO2019061281A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467—Methods of retrieving data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/26—Devices for calling a subscriber
    • H04M1/27—Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745—Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467—Methods of retrieving data
    • H04M1/27475—Methods of retrieving data using interactive graphical means or pictorial representations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the present application relates to the field of communications technologies, and in particular, to a communication method based on face recognition, and to a mobile communication terminal.
  • the mobile communication terminal in addition to the complete telephone function, usually has a large-capacity business card management function, an outgoing power management function, a telephone firewall function for preventing telephone harassment, and an internal business card of the enterprise group telephone business card.
  • mobile communication terminals have the ability to access the Internet via the Internet and have strong multimedia functions.
  • Photo browsing, web browsing, audio and video playback, e-books, electronic photo frames, etc. can be performed on the mobile communication terminal.
  • the functions of the same mobile communication terminal in auxiliary office, auxiliary marketing, entertainment, etc. have also been greatly enhanced.
  • the contact avatar can be customized in the phone book application of the mobile communication terminal, but after the contact avatar is set, it is only displayed on the contact list interface for reference, and there is no Take advantage of other features of your contact avatar.
  • the method for the mobile communication terminal to make a call is to find the corresponding contact from the address book, find the corresponding contact, enter the interface of the contact, and dial the dial button set by the contact interface, and the operation steps are cumbersome. .
  • the two functions of the photo album and the communication of the mobile communication terminal are difficult to implement, and the interaction between the two forms an unfriendly experience for the user, and each of the mobile communication terminal systems
  • the degree of integration of the application is not high.
  • the photo C in the photo album is used for editing and saving, and the contact information of the contact QQ/WeChat is entered, and when the user browses to the photo C, and wants to communicate with the A, it is required.
  • Exit the photo album application enter the communication interface and enter the contact information for communication.
  • the whole operation process is complicated, the operation path is cumbersome, the experience is not good, and the user is greatly inconvenient and affects the user experience.
  • the purpose of the present application is to provide a mobile communication terminal and a communication method based on the face recognition, which can help the mobile communication terminal to switch to another function in different interfaces, thereby facilitating communication by the user. Simple operation and improved user experience.
  • the present application provides a communication method based on face recognition, wherein the communication method includes:
  • the mobile communication terminal After browsing the album interface, the mobile communication terminal detects whether a predefined operation of the video and/or photo in the album is triggered;
  • At least one contact manner of the target object is popped up to perform instant communication by using the contact method.
  • the communication method further includes: the mobile communication terminal detects the edited contact, obtains the specified video and/or photo from the album according to the editing operation, and sets the avatar of the contact;
  • the communication method further includes: the mobile communication terminal detects the edited contact, and captures the specified video and/or photo according to the shooting operation and sets the avatar of the contact;
  • the target face matches the video and/or photo face of the album successfully, storing the contact and the corresponding at least one contact manner in the local address book, and triggering in the designation
  • the video and/or photo is tagged and entered to eject at least one contact corresponding to the contact upon detecting the predefined operation of the specified video and/or photo.
  • predefined operations include long press, rotation, multi-touch, and click on a face region.
  • the contact method comprises a mobile phone number, a fixed phone number, an email address, a short number, a QQ message, a QQ phone, a WeChat message, a WeChat phone, and a personal network homepage;
  • the step of successfully matching the video and/or the photo face, and storing the contact and the corresponding at least one contact in the local address book further includes:
  • a pop-up window presents the target face and the video and/or photo of the album to the user;
  • the present application provides a mobile communication terminal, wherein the mobile communication terminal includes a processor, and the processor is configured to execute communication program data based on face recognition, and the implemented steps include:
  • At least one contact manner of the target object is popped up to perform instant communication by using the contact method.
  • the processor is configured to execute communication program data based on face recognition, and the implemented steps are further included Includes:
  • the specified video and/or photo is obtained from the album according to the editing operation and set as the avatar of the contact;
  • the processor is configured to execute communication program data based on face recognition, and the implemented steps further include:
  • the specified video and/or photo is taken according to the shooting operation and set as the avatar of the contact;
  • predefined operations include long press, rotation, multi-touch, and click on a face region.
  • the contact information includes a mobile phone number, a fixed phone number, an email address, a short number, and a Q
  • Q information QQ phone, WeChat information, WeChat phone and personal network home page.
  • the mobile communication terminal of the present application and the communication method based on the face recognition after browsing the album interface, the mobile communication terminal detects whether a predefined operation of the video and/or photo in the album is triggered, and when the Pre-defined operation ⁇ , popping up at least one contact manner of the target object to perform instant communication through the contact method.
  • the mobile communication terminal of the present application can fuse the two functions of the photo album and the communication well, can realize the fast switching use, improve the interaction realization between the two, and can implement the mobile communication terminal.
  • Albums are highly integrated with multiple communication applications. In the photo album interface, the application no longer needs to exit the photo album application, and can enter the communication interface for communication, the operation flow Simple, user-friendly, and improved user experience.
  • FIG. 1 is a flow chart of an embodiment of a communication method based on face recognition according to the present application.
  • FIG. 2 is a block diagram of a block diagram of an embodiment of a mobile communication terminal according to the present application.
  • the term “if” may be interpreted to mean “when" or “once" or “in response to determining” or “in response to detecting” depending on the context.
  • the phrase “if determined” or “if a condition or event is stated” depends on the context, optionally interpreted as meaning “once If yes, then “or” in response to determining “or” once the [Stated Condition or Event] is detected or “in response to detecting the [Stated Condition or Event]”.
  • FIG. 1 is a flowchart of an embodiment of a communication method based on face recognition according to the present application.
  • the communication method based on face recognition includes but is not limited to the following steps.
  • Step S101 After browsing the album interface, the mobile communication terminal detects whether the video in the album is triggered.
  • the predefined operations of the present embodiment may include long press, rotation, multi-touch, and click on a face area.
  • long press can be long press for more than 3 seconds, 5 seconds, etc.
  • rotation can be used to rotate the video and / or photo at a certain angle (such as 30 °, 45 ° or 90 °)
  • multi-touch can A touch action that occurs when two fingers and three fingers are equivalent to a video and/or photo.
  • clicking on the face area allows the user to click on the face of the video and/or photo while browsing.
  • the video may be a short video or a long video, and if there are multiple faces, the user may click on the specified face for subsequent recognition, and the photo may be taken, or downloaded. Local picture of the mobile communication terminal.
  • Step S102 after detecting the predefined operation, performing face recognition on the video and/or photo to obtain a target object.
  • the video and/or the photo may be preprocessed, the corner points in the preprocessed picture are extracted, and the corner points are filtered and combined to obtain a connected area of the corner points. And then, extracting a centroid in the connected region of the corner point, matching the centroid with the face template, calculating a matching probability of the centroid and the face template, and positioning the region formed by the centroid whose matching probability is greater than or equal to a predetermined value
  • feature extraction of the eye, mouth, and the like is performed on the candidate face region, and when at least one feature is extracted, it is determined that the face is recognized.
  • Step S103 Determine whether the target object is a contact pre-stored in the local address book.
  • the manner in which the local address book contacts are pre-stored in this embodiment may include at least the following two types.
  • the mobile communication terminal detects the edited contact, obtains the specified video and/or photo from the album according to the editing operation, and sets the avatar as the contact; and the at least the contact and the corresponding One
  • the contact information is stored in the local address book, and triggers adding a mark and an entry in the specified video and/or photo to pop up after detecting the predefined operation on the specified video and/or photo. At least one contact manner corresponding to the contact.
  • the mobile communication terminal detects the edit contact ⁇ , takes a specified video and/or photo according to the shooting operation, and sets it as the avatar of the contact; performs a face on the specified video and/or photo Identifying to obtain a target face; performing face recognition and matching in the video and/or photo of the album according to the target face; and successfully matching the video and/or photo face of the target face with the album, Storing the contact and its corresponding at least one contact in a local address book and triggering an addition of a tag and entry in the specified video and/or photo to detect the specified video and/or Or the photo performs the predefined operation, and at least one contact manner corresponding to the contact is popped up.
  • the step of storing the contact and the corresponding at least one contact manner in the local address book after the matching of the target face and the video and/or photo face of the album is successful may further include: after the target face is successfully matched with the video and/or photo face of the album, the pop-up window prompts the user and the video and/or photo of the album to the user; After the failure, the face recognition and matching are performed in the video and/or photo of the album according to the target face; after the user confirms that the matching is successful, the contact and the corresponding at least one contact manner are stored locally. In the address book.
  • the mobile communication terminal edits the contact ⁇ , selects a video and/or photo of the face feature from the album or the captured video and/or photo, and then performs local processing, and the processed video and/or Or the photo is set to the contact avatar.
  • the mobile communication terminal extracts the feature identification information in the avatar, traverses all the videos and/or photos of the album according to the feature identification information, and searches for all videos and/or photos that match the feature identification information; All matching videos and/or photos are aggregated into a collection of contacts, added to the video and/or photo properties of the contact, to complete the matching video and/or photo with the contact Interrelated.
  • Step S104 After determining that the target object is a contact pre-stored in the local address book, at least one contact mode of the target object is popped up to perform instant communication by using the contact mode.
  • the contact information may include a mobile phone number, a fixed phone number, an email address, a short number, a QQ message, a QQ phone, a WeChat message, a WeChat phone, and a personal network homepage.
  • FIG. 2 is a block diagram of an embodiment of a mobile communication terminal according to the present application.
  • the mobile communication terminal in this embodiment may include a processor 21 and a memory 22, and the memory 22 may be configured to store communication program data based on face recognition, data of an album, and other application data, and the processing
  • the device 21 is configured to execute the face recognition based communication program data, and the implementing step may include: detecting, by browsing the album interface, whether to trigger a predefined operation on the video and/or the photo in the album; Defining an operation, performing face recognition on the video and/or photo to obtain a target object; determining whether the target object is a contact pre-stored in a local address book; determining that the target object is pre-stored in a local address book
  • the contact port ⁇ popping up at least one contact manner of the target object to perform instant communication through the contact method.
  • the predefined operations of the present embodiment may include long press, rotation, multi-touch, and click on a face area.
  • long press can be long press for more than 3 seconds, 5 seconds, etc.
  • rotation can be used to rotate the video and / or photo at a certain angle (such as 30 °, 45 ° or 90 °)
  • multi-touch can A touch action that occurs when two fingers and three fingers are equivalent to a video and/or photo.
  • clicking on the face area allows the user to click on the face of the video and/or photo to view the defined action.
  • the video of the embodiment may be a short video or a long video, and if there are multiple faces in the video, the user may click on the specified face to perform subsequent recognition, and the photo may be taken, or downloaded. A picture to the mobile communication terminal.
  • the processor 21 is configured to execute the communication program data based on the face recognition, and the implemented step may further include: after detecting the edited contact, obtaining the specified from the album according to the editing operation. Video and/or photo and set as the avatar of the contact; storing the contact and its corresponding at least one contact in the local address book, and triggering an addition of the tag in the specified video and/or photo And an entry, to perform the predefined operation on the specified video and/or photo, popping up at least one contact manner corresponding to the contact.
  • the processor 21 is configured to execute the communication program data based on the face recognition, and the implemented step may further include: after detecting the edited contact, shooting the specified video and/or photo according to the shooting operation. Setting an avatar of the contact; performing face recognition on the specified video and/or photo to obtain a target face; performing face recognition on the video and/or photo of the album according to the target face and Matching; after the target face and the photo and/or photo face of the album match successfully, the contact and the pair thereof At least one contact should be stored in the local address book and triggering the addition of a tag and entry in the specified video and/or photo to detect the predefined video and/or photo of the specified video After operation, at least one contact method corresponding to the contact is popped up.
  • the contact information may include a mobile phone number, a fixed phone number, an email address, a short number, a QQ message, a QQ phone, a WeChat message, a WeChat phone, and a personal network homepage.
  • the application may further simplify the operation process, and may specifically include the following: After browsing the album interface, the mobile communication terminal detects whether the video in the album is triggered. And/or a predefined operation of the photo; after detecting the predefined operation, popping up at least one contact manner of the target object to perform instant communication by the contact method.
  • the mobile communication terminal receives a predefined operation generated by the user triggering a face of the video and/or the photo.
  • displaying at least one contact mode after receiving the predefined operation such as a list, displaying a mobile phone number in the list, a fixed phone number, an email address, a short number, a QQ message, a QQ phone, a WeChat message, and a WeChat Telephone and personal network homepage for users to choose.
  • the predefined operation such as a list, displaying a mobile phone number in the list, a fixed phone number, an email address, a short number, a QQ message, a QQ phone, a WeChat message, and a WeChat Telephone and personal network homepage for users to choose.
  • the video and/or photo of the selected face is "Zhang San", "Zhang San, number 137****; [email protected]; QQ: 2798xxxx" is displayed.
  • the mobile communication terminal receives a selection instruction generated by selecting one of the contact methods, and performs communication by using the selected contact method, for example, making a call.
  • a face of any one of the videos and/or photos in the album may be triggered to be marked and imported, and the contact represented by the face is bound to all contacts thereof, and then After the user browses the album, the user only needs to click on the face of the video and/or photo to directly communicate.
  • the mobile communication terminal of the present application and the communication method based on the face recognition after browsing the album interface, the mobile communication terminal detects whether a predefined operation of the video and/or photo in the album is triggered, and when the Pre-defined operation ⁇ , popping up at least one contact manner of the target object to perform instant communication through the contact method.
  • the mobile communication terminal of the present application can fuse the two functions of the album and the communication well, and can realize the fast switching use and improve the interaction between the two.
  • the album of the mobile communication terminal can be highly integrated with a plurality of communication applications. In the photo album interface, the application no longer needs to exit the photo album application, and can enter the communication interface for communication, and the operation flow is simple, which brings convenience to the user and improves the user experience.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un terminal de communication mobile, et un procédé de communication associé basé sur la reconnaissance faciale humaine. Le procédé de communication comprend les étapes suivantes : lors de l'observation d'une interface d'album photo, un terminal de communication mobile détecte l'opportunité de déclencher une opération prédéfinie pour une vidéo et/ou une photo dans l'album photo ; et lorsque l'opération prédéfinie est détectée, il fait apparaître au moins un élément d'informations de contact concernant un objet cible de sorte à exécuter une communication instantanée au moyen des informations de contact. Le procédé permet à un terminal de communication mobile selon la présente invention de : fusionner efficacement une fonction d'album photo et une fonction de communication ; exécuter une commutation et une utilisation sans délai, et améliorer l'implémentation interactive des deux fonctions ; et fusionner dans une large mesure un album photo du terminal de communication mobile avec une pluralité d'applications de communication. Dans la présente invention, une interface de communication peut être entrée pour une communication sur une interface d'album photo, sans quitter l'application d'album photo. Cela simplifie le fonctionnement et l'utilisation pour un utilisateur, et améliore l'expérience de l'utilisateur.
PCT/CN2017/104348 2017-09-29 2017-09-29 Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine WO2019061281A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201780097260.7A CN111418196A (zh) 2017-09-29 2017-09-29 移动通讯终端及其基于人脸识别的通讯方法
PCT/CN2017/104348 WO2019061281A1 (fr) 2017-09-29 2017-09-29 Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/104348 WO2019061281A1 (fr) 2017-09-29 2017-09-29 Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine

Publications (1)

Publication Number Publication Date
WO2019061281A1 true WO2019061281A1 (fr) 2019-04-04

Family

ID=65903594

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/104348 WO2019061281A1 (fr) 2017-09-29 2017-09-29 Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine

Country Status (2)

Country Link
CN (1) CN111418196A (fr)
WO (1) WO2019061281A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111050080A (zh) * 2019-12-27 2020-04-21 珠海市魅族科技有限公司 相机中显示图像相关信息的方法、装置、设备和存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7751597B2 (en) * 2006-11-14 2010-07-06 Lctank Llc Apparatus and method for identifying a name corresponding to a face or voice using a database
CN102693088A (zh) * 2012-05-11 2012-09-26 广东欧珀移动通信有限公司 一种基于图片的智能交互方法
CN103227859A (zh) * 2013-03-27 2013-07-31 东莞宇龙通信科技有限公司 一种终端的快速拨号方法及终端
CN103414815A (zh) * 2013-07-15 2013-11-27 珠海市魅族科技有限公司 联系人信息的显示方法和终端
CN104050226A (zh) * 2013-03-14 2014-09-17 三星电子株式会社 移动终端的应用信息处理方法和装置
CN104112119A (zh) * 2014-06-25 2014-10-22 小米科技有限责任公司 基于人脸识别的通信方法及装置
CN106506778A (zh) * 2016-12-29 2017-03-15 努比亚技术有限公司 一种拨号装置及方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7751597B2 (en) * 2006-11-14 2010-07-06 Lctank Llc Apparatus and method for identifying a name corresponding to a face or voice using a database
CN102693088A (zh) * 2012-05-11 2012-09-26 广东欧珀移动通信有限公司 一种基于图片的智能交互方法
CN104050226A (zh) * 2013-03-14 2014-09-17 三星电子株式会社 移动终端的应用信息处理方法和装置
CN103227859A (zh) * 2013-03-27 2013-07-31 东莞宇龙通信科技有限公司 一种终端的快速拨号方法及终端
CN103414815A (zh) * 2013-07-15 2013-11-27 珠海市魅族科技有限公司 联系人信息的显示方法和终端
CN104112119A (zh) * 2014-06-25 2014-10-22 小米科技有限责任公司 基于人脸识别的通信方法及装置
CN106506778A (zh) * 2016-12-29 2017-03-15 努比亚技术有限公司 一种拨号装置及方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111050080A (zh) * 2019-12-27 2020-04-21 珠海市魅族科技有限公司 相机中显示图像相关信息的方法、装置、设备和存储介质

Also Published As

Publication number Publication date
CN111418196A (zh) 2020-07-14

Similar Documents

Publication Publication Date Title
JP6415554B2 (ja) 迷惑電話番号確定方法、装置及びシステム
JP6123119B2 (ja) 情報を関連付ける方法および端末
WO2017084541A1 (fr) Procédé et appareil pour envoyer une image d'expression pendant une session d'appel
US10091643B2 (en) Method and apparatus for displaying associated information in electronic device
US10225215B2 (en) Method and system for caching input content
TWI677225B (zh) 即時通訊的實現方法和裝置
CN105847288B (zh) 一种验证码处理方法和装置
CN104615769A (zh) 图片分类方法及装置
CN105677512B (zh) 一种数据处理方法、装置及电子设备
WO2012065518A1 (fr) Procédé de modification d'une interface utilisateur d'exploitation et terminal
CN110677682B (zh) 直播检测与数据处理方法、设备、***及存储介质
CN105488154A (zh) 主题应用推荐方法及装置
TW201540115A (zh) 通訊事件歷史
CN105389113B (zh) 基于手势的应用控制方法、装置及终端
WO2013189317A1 (fr) Procédé d'interaction multimédia basé sur des informations du visage humain, dispositif et terminal associés
CN114726947B (zh) 消息展示方法、装置、用户终端及可读存储介质
WO2017121332A1 (fr) Procédé et système de partage d'informations
CN110020145A (zh) 一种信息推荐方法及装置
WO2023066100A1 (fr) Procédé et appareil de partage de fichiers
CN106777016A (zh) 基于即时通信进行信息推荐的方法及装置
WO2019061281A1 (fr) Terminal de communication mobile, et procédé de communication associé basé sur la reconnaissance faciale humaine
CN111897474A (zh) 文件处理方法和电子设备
CN104902055B (zh) 联系人创建方法和装置
CN105657121B (zh) 设置联系人信息的方法及装置
CN109922199B (zh) 一种联系人信息处理方法及终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17927494

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17927494

Country of ref document: EP

Kind code of ref document: A1