EP3312766A3 - Procédé et appareil de reconnaissance d'expression faciale - Google Patents

Procédé et appareil de reconnaissance d'expression faciale Download PDF

Info

Publication number
EP3312766A3
EP3312766A3 EP17194781.5A EP17194781A EP3312766A3 EP 3312766 A3 EP3312766 A3 EP 3312766A3 EP 17194781 A EP17194781 A EP 17194781A EP 3312766 A3 EP3312766 A3 EP 3312766A3
Authority
EP
European Patent Office
Prior art keywords
facial expression
recognizing
feature
recognizing facial
input image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP17194781.5A
Other languages
German (de)
English (en)
Other versions
EP3312766A2 (fr
Inventor
Youngsung Kim
Byungin Yoo
Youngjun KWAK
Chang Kyu Choi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of EP3312766A2 publication Critical patent/EP3312766A2/fr
Publication of EP3312766A3 publication Critical patent/EP3312766A3/fr
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/7715—Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174—Facial expression recognition
    • G06V40/175—Static expression

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Molecular Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
EP17194781.5A 2016-10-21 2017-10-04 Procédé et appareil de reconnaissance d'expression faciale Ceased EP3312766A3 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160137382A KR102252298B1 (ko) 2016-10-21 2016-10-21 표정 인식 방법 및 장치

Publications (2)

Publication Number Publication Date
EP3312766A2 EP3312766A2 (fr) 2018-04-25
EP3312766A3 true EP3312766A3 (fr) 2018-08-22

Family

ID=60051356

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17194781.5A Ceased EP3312766A3 (fr) 2016-10-21 2017-10-04 Procédé et appareil de reconnaissance d'expression faciale

Country Status (4)

Country Link
US (1) US10387716B2 (fr)
EP (1) EP3312766A3 (fr)
KR (1) KR102252298B1 (fr)
CN (1) CN107977598B (fr)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110263599A (zh) * 2018-03-12 2019-09-20 鸿富锦精密工业(武汉)有限公司 信息传送***及信息传送方法
JP6760318B2 (ja) * 2018-03-14 2020-09-23 オムロン株式会社 顔画像識別システム、識別器生成装置、識別装置、画像識別システム、及び識別システム
US11163981B2 (en) * 2018-09-11 2021-11-02 Apple Inc. Periocular facial recognition switching
CN109190582B (zh) * 2018-09-18 2022-02-08 河南理工大学 一种微表情识别的新方法
US10942637B2 (en) * 2018-10-09 2021-03-09 Midea Group Co., Ltd. Method and system for providing control user interfaces for home appliances
CN111079472A (zh) * 2018-10-19 2020-04-28 北京微播视界科技有限公司 图像对比方法和装置
KR102174175B1 (ko) * 2018-11-06 2020-11-06 숙명여자대학교산학협력단 감정을 식별하기 위한 얼굴 감정 인식 장치 및 그 방법
WO2020115791A1 (fr) * 2018-12-03 2020-06-11 三菱電機株式会社 Dispositif de commande d'équipement, procédé de commande d'équipement, et procédé d'apprentissage
US11222199B2 (en) * 2018-12-05 2022-01-11 International Business Machines Corporation Automatically suggesting behavioral adjustments during video conferences
CN109635813B (zh) * 2018-12-13 2020-12-25 银河水滴科技（北京）有限公司 一种钢轨区域图像分割方法及装置
US11240492B2 (en) * 2019-01-22 2022-02-01 Apple Inc. Neural network based residual coding and prediction for predictive coding
CN111797249A (zh) 2019-04-09 2020-10-20 华为技术有限公司 一种内容推送方法、装置与设备
CN110363099A (zh) * 2019-06-24 2019-10-22 昆明理工大学 一种基于局部并行深度神经网络的表情识别方法
KR20210053427A (ko) 2019-11-02 2021-05-12 이동현 블루라이트 콘택트렌즈
CN111634233A (zh) * 2020-05-25 2020-09-08 杭州鸿泉物联网技术股份有限公司 一种安全驾驶***和方法
CN111797696B (zh) * 2020-06-10 2022-04-15 武汉大学 一种现场自主学习的人脸识别***和方法
CN112528835B (zh) * 2020-12-08 2023-07-04 北京百度网讯科技有限公司 表情预测模型的训练方法、识别方法、装置及电子设备
CN114764765A (zh) * 2020-12-30 2022-07-19 富泰华工业（深圳）有限公司 图像瑕疵检测方法、装置、电子设备及存储介质
KR102296220B1 (ko) * 2021-03-16 2021-08-31 국방과학연구소 합성개구 레이다 영상의 건물 추출 방법
JPWO2023032014A1 (fr) * 2021-08-30 2023-03-09
CN117540789B (zh) * 2024-01-09 2024-04-26 腾讯科技（深圳）有限公司 模型训练方法、面部表情迁移方法、装置、设备及介质

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8488023B2 (en) * 2009-05-20 2013-07-16 DigitalOptics Corporation Europe Limited Identifying facial expressions in acquired digital images
US7599840B2 (en) * 2005-07-15 2009-10-06 Microsoft Corporation Selectively using multiple entropy models in adaptive coding and decoding
JP4799104B2 (ja) * 2005-09-26 2011-10-26 キヤノン株式会社 情報処理装置及びその制御方法、コンピュータプログラム、記憶媒体
US8542928B2 (en) * 2005-09-26 2013-09-24 Canon Kabushiki Kaisha Information processing apparatus and control method therefor
WO2007116551A1 (fr) * 2006-03-30 2007-10-18 Kabushiki Kaisha Toshiba Appareil et procédé de codage d'image et appareil et procédé de décodage d'image
AU2007330109A1 (en) * 2006-11-30 2008-06-12 Ntt Docomo, Inc. Dynamic image encoding device, dynamic image encoding method, dynamic image encoding program, dynamic image decoding device, dynamic image decoding method, and dynamic image decoding program
JP5123630B2 (ja) * 2007-09-27 2013-01-23 株式会社ニューフレアテクノロジー パターン検査装置及びパターン検査方法
KR100918862B1 (ko) * 2007-10-19 2009-09-28 광주과학기술원 참조영상을 이용한 깊이영상 생성방법 및 그 장치, 생성된깊이영상을 부호화/복호화하는 방법 및 이를 위한인코더/디코더, 그리고 상기 방법에 따라 생성되는 영상을기록하는 기록매체
US20090232365A1 (en) * 2008-03-11 2009-09-17 Cognimatics Ab Method and device for face recognition
US8208183B2 (en) * 2008-11-19 2012-06-26 Xerox Corporation Detecting image quality defects by measuring images printed on image bearing surfaces of printing devices
KR101708682B1 (ko) * 2010-03-03 2017-02-21 엘지전자 주식회사 영상표시장치 및 그 동작 방법.
JP5234833B2 (ja) 2010-01-19 2013-07-10 日本電信電話株式会社 表情識別器作成装置，表情識別器作成方法，表情認識装置，表情認識方法およびそれらのプログラム
JP5057184B2 (ja) * 2010-03-31 2012-10-24 アイシン・エィ・ダブリュ株式会社 画像処理システム及び車両制御システム
JP2013003706A (ja) 2011-06-14 2013-01-07 Nippon Telegr & Teleph Corp <Ntt> 表情認識装置、方法、及びプログラム
US9305240B2 (en) * 2011-12-07 2016-04-05 Google Technology Holdings LLC Motion aligned distance calculations for image comparisons
US8971591B2 (en) * 2011-12-09 2015-03-03 Google Technology Holdings LLC 3D image estimation for 2D image recognition
KR101910659B1 (ko) * 2011-12-29 2018-10-24 삼성전자주식회사 디지털 영상장치 및 그 제어방법
TWI479435B (zh) * 2012-04-03 2015-04-01 Univ Chung Hua 人臉辨識方法
US8948465B2 (en) * 2012-04-09 2015-02-03 Accenture Global Services Limited Biometric matching technology
US9165180B2 (en) * 2012-10-12 2015-10-20 Microsoft Technology Licensing, Llc Illumination sensitive face recognition
KR20150140644A (ko) * 2013-02-08 2015-12-16 이모션트 표정 인식을 위한 기계 학습 훈련 데이터의 수집
US20140293030A1 (en) * 2013-03-26 2014-10-02 Texas Instruments Incorporated Real Time Math Using a Camera
US9697233B2 (en) * 2014-08-12 2017-07-04 Paypal, Inc. Image processing and matching
KR20160053455A (ko) 2014-11-04 2016-05-13 경북대학교 산학협력단 로봇의 표정 기반 연속적 정서 인식 방법, 이를 수행하기 위한 기록 매체 및 장치
US9384385B2 (en) * 2014-11-06 2016-07-05 Intel Corporation Face recognition using gradient based feature analysis
KR20160061856A (ko) * 2014-11-24 2016-06-01 삼성전자주식회사 객체 인식 방법 및 장치, 및 인식기 학습 방법 및 장치
US9928410B2 (en) * 2014-11-24 2018-03-27 Samsung Electronics Co., Ltd. Method and apparatus for recognizing object, and method and apparatus for training recognizer
US9547763B1 (en) * 2015-03-31 2017-01-17 EMC IP Holding Company LLC Authentication using facial recognition
US9672632B2 (en) * 2015-10-21 2017-06-06 Disney Enterprises, Inc. Device and method for camera driven background subtraction
DE102016207367A1 (de) * 2016-04-29 2017-11-02 Siemens Healthcare Gmbh Festlegen von Scanparametern einer CT-Bildaufnahme mit Hilfe einer Außenbildaufnahme
US10083347B2 (en) * 2016-07-29 2018-09-25 NTech lab LLC Face identification using artificial neural network

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
ABHISHEKSHARMA ET AL: "FacialExpressionRecognitionusingVirtualNeutralImageSynthesis", 3 February 2015 (2015-02-03), XP055454386, Retrieved from the Internet <URL:https://www.researchgate.net/profile/Abhishek_Sharma96/publication/267845873_Facial_Expression_Recognition_using_Virtual_Neutral_Image_Synthesis/links/54d073390cf29ca811014604/Facial-Expression-Recognition-using-Virtual-Neutral-Image-Synthesis.pdf?origin=publication_detail> [retrieved on 20180226] *
CHANDRASIRI N P ET AL: "REAL TIME FACIAL EXPRESSION RECOGNITION SYSTEM WITH APPLICATIONS TO FACIAL ANIMATION IN MPEG-4", IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, INFORMATION & SYSTEMS SOCIETY, TOKYO, JP, vol. E84-D, no. 8, 1 August 2001 (2001-08-01), pages 1007 - 1017, XP001123165, ISSN: 0916-8532 *
LAI J H ET AL: "Face recognition using holistic Fourier invariant features", PATTERN RECOGNIT, ELSEVIER, GB, vol. 34, no. 1, 1 January 2001 (2001-01-01), pages 95 - 109, XP004321249, ISSN: 0031-3203, DOI: 10.1016/S0031-3203(99)00200-9 *
LEE SEUNG HO ET AL: "Intra-Class Variation Reduction Using Training Expression Images for Sparse Representation Based Facial Expression Recognition", IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, IEEE, USA, vol. 5, no. 3, 1 July 2014 (2014-07-01), pages 340 - 351, XP011562380, ISSN: 1949-3045, [retrieved on 20141022], DOI: 10.1109/TAFFC.2014.2346515 *
MLAKAR UROS ET AL: "Automated facial expression recognition based on histograms of oriented gradient feature vector differences", SIGNAL, IMAGE AND VIDEO PROCESSING, SPRINGER LONDON, LONDON, vol. 9, no. 1, 13 August 2015 (2015-08-13), pages 245 - 253, XP035948027, ISSN: 1863-1703, [retrieved on 20150813], DOI: 10.1007/S11760-015-0810-4 *
WEI-FENG LIU ET AL: "Expression feature extraction based on difference of Local Binary Pattern histogram sequences", SIGNAL PROCESSING, 2008. ICSP 2008. 9TH INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 26 October 2008 (2008-10-26), pages 2082 - 2084, XP031369476, ISBN: 978-1-4244-2178-7, DOI: 10.1109/ICOSP.2008.4697555 *

Also Published As

Publication number Publication date
CN107977598A (zh) 2018-05-01
KR20180043937A (ko) 2018-05-02
EP3312766A2 (fr) 2018-04-25
US10387716B2 (en) 2019-08-20
CN107977598B (zh) 2024-05-07
KR102252298B1 (ko) 2021-05-14
US20180114057A1 (en) 2018-04-26

Similar Documents

Publication Publication Date Title
EP3312766A3 (fr) Procédé et appareil de reconnaissance d&#39;expression faciale
EP3885965A4 (fr) Procédé de reconnaissance d&#39;image basé sur des expressions microfaciales, appareil et dispositif associé
EP3324333A3 (fr) Procédé et appareil pour effectuer l&#39;apprentissage et la reconnaissance d&#39;expression faciale
EP2983111A3 (fr) Procédé et appareil de reconnaissance faciale
EP3035246A3 (fr) Procédé et appareil de reconnaissance d&#39;image, procédé et appareil de vérification d&#39;image, procédé et appareil d&#39;apprentissage pour reconnaître une image et procédé et appareil d&#39;apprentissage pour vérifier une image
EP2961150A3 (fr) Appareil de formation d&#39;images et procede de formation d&#39;images
EP3026627A3 (fr) Procédé et appareil de traitement d&#39;image
EP3154054A3 (fr) Procédé et appareil pour l&#39;apprentissage de la parole et la reconnaissance d&#39;un modèle de langage
EP3046053A3 (fr) Procédé et appareil pour modèle de langage d&#39;apprentissage et procédé et appareil de reconnaissance de langage
EP4276819A3 (fr) Dispositif électronique et procédé de reconnaissance vocale associé
EP2980758A3 (fr) Procédé et dispositif pour la fourniture d&#39;une image
EP3133818A3 (fr) Procédé et appareil permettant de commander un dispositif et tapis intelligent
EP2993624A3 (fr) Appareil d&#39;identification et procédé de commande d&#39;un appareil d&#39;identification controlling identification apparatus
EP3869364A4 (fr) Procédé d&#39;interaction de reconnaissance biologique, interface d&#39;interaction graphique et appareil associé
EP2860663A3 (fr) Appareil pour détecter une partie de l&#39;oeil
EP3757873A4 (fr) Procédé et dispositif de reconnaissance faciale
EP2753065A3 (fr) Procédé et appareil permettant la mise en page d&#39;image à l&#39;aide d&#39;une reconnaissance d&#39;image
EP2778989A3 (fr) Procédé de traitement d&#39;informations d&#39;application et appareil de terminal mobile
EP3336588A3 (fr) Procédé et appareil de mise en correspondance d&#39;images
EP3056138A3 (fr) Appareil d&#39;authentification basé sur un électrocardiogramme (ecg) et procédé associé, appareil d&#39;entraînement et procédé pour une authentification basée sur un ecg
EP2919115A3 (fr) Procédé et appareil de migration de tâches
EP3349148A3 (fr) Procédé et appareil d&#39;identification d&#39;empreintes digitales
EP3038015A3 (fr) Appareil de reconnaissance d&#39;image et appareil de traitement d&#39;informations sur des marchandises
EP2892051A3 (fr) Appareil et procédé de structuration de contenus de réunion
EP3244323A8 (fr) Appareil de traitement d&#39;images, procédé de traitement d&#39;images, appareil de recherche et programme informatique

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06K 9/00 20060101AFI20180716BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20190221

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200131

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20220329