IT1314671B1 - Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio. - Google Patents

Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio.

Info

Publication number
IT1314671B1
IT1314671B1 IT1998TO000842A ITTO980842A IT1314671B1 IT 1314671 B1 IT1314671 B1 IT 1314671B1 IT 1998TO000842 A IT1998TO000842 A IT 1998TO000842A IT TO980842 A ITTO980842 A IT TO980842A IT 1314671 B1 IT1314671 B1 IT 1314671B1
Authority
IT
Italy
Prior art keywords
animation
audio signal
visemes
standard
model
Prior art date
Application number
IT1998TO000842A
Other languages
English (en)
Inventor
Mauro Quaglia
Claudio Lande
Original Assignee
Cselt Centro Studi Lab Telecom
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cselt Centro Studi Lab Telecom filed Critical Cselt Centro Studi Lab Telecom
Priority to IT1998TO000842A priority Critical patent/IT1314671B1/it
Priority to US09/407,027 priority patent/US6665643B1/en
Priority to CA002285158A priority patent/CA2285158C/en
Priority to JP28550899A priority patent/JP3215823B2/ja
Priority to DE69941942T priority patent/DE69941942D1/de
Priority to EP99119180A priority patent/EP0993197B1/en
Publication of ITTO980842A1 publication Critical patent/ITTO980842A1/it
Application granted granted Critical
Publication of IT1314671B1 publication Critical patent/IT1314671B1/it

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/06—Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids
    • G10L21/10—Transforming into visible information
    • G10L2021/105—Synthesis of the lips movements from speech, e.g. for talking heads

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)
IT1998TO000842A 1998-10-07 1998-10-07 Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio. IT1314671B1 (it)

Priority Applications (6)

Application Number Priority Date Filing Date Title
IT1998TO000842A IT1314671B1 (it) 1998-10-07 1998-10-07 Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio.
US09/407,027 US6665643B1 (en) 1998-10-07 1999-09-28 Method of and apparatus for animation, driven by an audio signal, of a synthesized model of a human face
CA002285158A CA2285158C (en) 1998-10-07 1999-10-06 A method and an apparatus for the animation, driven by an audio signal, of a synthesised model of human face
JP28550899A JP3215823B2 (ja) 1998-10-07 1999-10-06 人間の顔の合成モデルの音声信号駆動アニメーションの方法及び装置
DE69941942T DE69941942D1 (de) 1998-10-07 1999-10-07 Verfahren und Vorrichtung zur durch ein Audiosignal gesteuerten Animation eines synthetisierten Modells eines menschlichen Gesichts
EP99119180A EP0993197B1 (en) 1998-10-07 1999-10-07 A method and an apparatus for the animation, driven by an audio signal, of a synthesised model of human face

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
IT1998TO000842A IT1314671B1 (it) 1998-10-07 1998-10-07 Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio.

Publications (2)

Publication Number Publication Date
ITTO980842A1 ITTO980842A1 (it) 2000-04-07
IT1314671B1 true IT1314671B1 (it) 2002-12-31

Family

ID=11417087

Family Applications (1)

Application Number Title Priority Date Filing Date
IT1998TO000842A IT1314671B1 (it) 1998-10-07 1998-10-07 Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio.

Country Status (6)

Country Link
US (1) US6665643B1 (it)
EP (1) EP0993197B1 (it)
JP (1) JP3215823B2 (it)
CA (1) CA2285158C (it)
DE (1) DE69941942D1 (it)
IT (1) IT1314671B1 (it)

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6826540B1 (en) * 1999-12-29 2004-11-30 Virtual Personalities, Inc. Virtual human interface for conducting surveys
US7080473B2 (en) * 2000-05-24 2006-07-25 Virtual Video Uk Ltd. Novelty animated device with synchronized audio output, and method for achieving synchronized audio output therein
US6661418B1 (en) 2001-01-22 2003-12-09 Digital Animations Limited Character animation system
US20020120643A1 (en) * 2001-02-28 2002-08-29 Ibm Corporation Audio-visual data collection system
US20020140718A1 (en) * 2001-03-29 2002-10-03 Philips Electronics North America Corporation Method of providing sign language animation to a monitor and process therefor
US7343082B2 (en) * 2001-09-12 2008-03-11 Ryshco Media Inc. Universal guide track
US20030058932A1 (en) * 2001-09-24 2003-03-27 Koninklijke Philips Electronics N.V. Viseme based video coding
US7076430B1 (en) 2002-05-16 2006-07-11 At&T Corp. System and method of providing conversational visual prosody for talking heads
ITTO20020724A1 (it) * 2002-08-14 2004-02-15 Telecom Italia Lab Spa Procedimento e sistema per la trasmissione di messaggi su
US20050049005A1 (en) * 2003-08-29 2005-03-03 Ken Young Mobile telephone with enhanced display visualization
WO2005031701A2 (de) * 2003-09-29 2005-04-07 Siemens Aktiengesellschaft Automatisierte generierung gebärdensprachelemente repräsentierender mehrdimensionaler graphischer darstellungen
US8965771B2 (en) * 2003-12-08 2015-02-24 Kurzweil Ainetworks, Inc. Use of avatar with event processing
US20080228497A1 (en) * 2005-07-11 2008-09-18 Koninklijke Philips Electronics, N.V. Method For Communication and Communication Device
US7567251B2 (en) * 2006-01-10 2009-07-28 Sony Corporation Techniques for creating facial animation using a face mesh
US8224652B2 (en) * 2008-09-26 2012-07-17 Microsoft Corporation Speech and text driven HMM-based body animation synthesis
KR101541907B1 (ko) * 2008-10-14 2015-08-03 삼성전자 주식회사 음성 기반 얼굴 캐릭터 형성 장치 및 방법
CN101436312B (zh) * 2008-12-03 2011-04-06 腾讯科技（深圳）有限公司 一种生成视频动画的方法及装置
JP5178607B2 (ja) * 2009-03-31 2013-04-10 株式会社バンダイナムコゲームス プログラム、情報記憶媒体、口形状制御方法及び口形状制御装置
BRPI0904540B1 (pt) * 2009-11-27 2021-01-26 Samsung Eletrônica Da Amazônia Ltda método para animar rostos/cabeças/personagens virtuais via processamento de voz
US8594993B2 (en) 2011-04-04 2013-11-26 Microsoft Corporation Frame mapping approach for cross-lingual voice transformation
US20120276504A1 (en) * 2011-04-29 2012-11-01 Microsoft Corporation Talking Teacher Visualization for Language Learning
TW201301148A (zh) * 2011-06-21 2013-01-01 Hon Hai Prec Ind Co Ltd 網頁瀏覽控制系統及方法
US8655152B2 (en) 2012-01-31 2014-02-18 Golden Monkey Entertainment Method and system of presenting foreign films in a native language
CN102609969B (zh) * 2012-02-17 2013-08-07 上海交通大学 基于汉语文本驱动的人脸语音同步动画的处理方法
US20150279364A1 (en) * 2014-03-29 2015-10-01 Ajay Krishnan Mouth-Phoneme Model for Computerized Lip Reading
US10839825B2 (en) * 2017-03-03 2020-11-17 The Governing Council Of The University Of Toronto System and method for animated lip synchronization
US10910001B2 (en) * 2017-12-25 2021-02-02 Casio Computer Co., Ltd. Voice recognition device, robot, voice recognition method, and storage medium
GB201804807D0 (en) * 2018-03-26 2018-05-09 Orbital Media And Advertising Ltd Interaactive systems and methods
US10699705B2 (en) * 2018-06-22 2020-06-30 Adobe Inc. Using machine-learning models to determine movements of a mouth corresponding to live speech
CN112911340A (zh) * 2020-08-19 2021-06-04 赵蒙 基于云计算的媒体数据处理方法、***及大数据平台
CN117877509B (zh) * 2024-03-13 2024-06-04 亚信科技（中国）有限公司 一种数字人实时交互方法及装置、电子设备、存储介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8528143D0 (en) * 1985-11-14 1985-12-18 British Telecomm Image encoding & synthesis
US6122616A (en) * 1993-01-21 2000-09-19 Apple Computer, Inc. Method and apparatus for diphone aliasing
US5608839A (en) * 1994-03-18 1997-03-04 Lucent Technologies Inc. Sound-synchronized video system
US6330023B1 (en) * 1994-03-18 2001-12-11 American Telephone And Telegraph Corporation Video signal processing systems and methods utilizing automated speech analysis
US5657426A (en) * 1994-06-10 1997-08-12 Digital Equipment Corporation Method and apparatus for producing audio-visual synthetic speech
CA2162199A1 (en) * 1994-11-07 1996-05-08 Homer H. Chen Acoustic-assisted image processing
DE69715175T2 (de) * 1996-03-26 2003-05-15 British Telecomm Bildsynthetisierung
US5818463A (en) * 1997-02-13 1998-10-06 Rockwell Science Center, Inc. Data compression for animated three dimensional objects
US6208356B1 (en) * 1997-03-24 2001-03-27 British Telecommunications Public Limited Company Image synthesis
US6154222A (en) * 1997-03-27 2000-11-28 At&T Corp Method for defining animation parameters for an animation definition interface
US5995119A (en) * 1997-06-06 1999-11-30 At&T Corp. Method for generating photo-realistic animated characters
US6177928B1 (en) * 1997-08-22 2001-01-23 At&T Corp. Flexible synchronization framework for multimedia streams having inserted time stamp
US6112177A (en) * 1997-11-07 2000-08-29 At&T Corp. Coarticulation method for audio-visual text-to-speech synthesis
US6250928B1 (en) * 1998-06-22 2001-06-26 Massachusetts Institute Of Technology Talking facial display method and apparatus

Also Published As

Publication number Publication date
CA2285158A1 (en) 2000-04-07
CA2285158C (en) 2006-04-11
US6665643B1 (en) 2003-12-16
DE69941942D1 (de) 2010-03-11
EP0993197A2 (en) 2000-04-12
ITTO980842A1 (it) 2000-04-07
EP0993197B1 (en) 2010-01-20
EP0993197A3 (en) 2002-03-27
JP3215823B2 (ja) 2001-10-09
JP2000113216A (ja) 2000-04-21

Similar Documents

Publication Publication Date Title
IT1314671B1 (it) Procedimento e apparecchiatura per l'animazione di un modellosintetizzato di volto umano pilotata da un segnale audio.
EP1037167A3 (en) System and method for generating and playback of three-dimensional movies
AU2002317900A1 (en) Method and system for producing update frequency of means
WO2003002047A3 (de) Verfahren und vorrichtung zur darstellung eines operationsgebietes bei laseroperationen
EP1294194B8 (en) Apparatus and method for motion vector estimation
EP0994627A3 (en) Regulation of the computational and memory requirements of a compressed bitstream in a video decoder
AU2003279189A1 (en) Method and apparatus for providing an animated display with translated speech
AU2001230274A1 (en) A method for filtering digital images, and a filtering device
AU3100300A (en) Method and apparatus for simultaneously producing compressed play and trick playbitstreams from a video frame sequence
WO2004113991A3 (en) Calibrating real and virtual views
HK1042366A1 (zh) 用於透視人體器官的三維圖像的方法和裝置
AU3054801A (en) Method and apparatus for transcoding of compressed image
EP1402869A4 (en) DEVICE FOR RECOVERING THE EYE BY USING A STEREOSCOPIC VIDEO AND A METHOD OF ILLUSTRATING THE STEREOSCOPIC VIDEO
AU6780301A (en) Method and system for real time motion picture segmentation and supersosition
AU2002366041A1 (en) Medical image segmentation apparatus and method thereof
WO2002032107A3 (en) Method for the graphical representation of motion in video in still images
AU3592499A (en) Method and apparatus for creating facial images
EP1145567A3 (en) Methods and apparatus for constructing a 3d model of a scene from calibrated images of the scene
MX9504648A (es) Metodo y aparato para el procesamiento de imagenes, asistido por acustica.
AU2002227227A1 (en) Apparatus and method for die casting
AU2001277177A1 (en) Methods and apparatus for producing topocompositional images
AU2542701A (en) Method and apparatus for displaying video
AU2002327356A1 (en) Method and apparatus for golf instruction
WO2002065397A8 (en) Method and apparatus for improving object boundaries extracted from stereoscopic images
WO2003014988A8 (en) System and method for providing real time pricing based on variables