CN110166844B - 一种数据处理方法和装置、一种用于数据处理的装置 - Google Patents
一种数据处理方法和装置、一种用于数据处理的装置 Download PDFInfo
- Publication number
- CN110166844B CN110166844B CN201910295572.XA CN201910295572A CN110166844B CN 110166844 B CN110166844 B CN 110166844B CN 201910295572 A CN201910295572 A CN 201910295572A CN 110166844 B CN110166844 B CN 110166844B
- Authority
- CN
- China
- Prior art keywords
- text
- target
- sequence
- mode
- processed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 29
- 238000003672 processing method Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 80
- 230000003993 interaction Effects 0.000 claims description 14
- 239000013598 vector Substances 0.000 claims description 10
- 230000004927 fusion Effects 0.000 claims description 8
- 230000001815 facial effect Effects 0.000 claims description 6
- 230000008569 process Effects 0.000 description 18
- 238000004891 communication Methods 0.000 description 15
- 238000013507 mapping Methods 0.000 description 11
- 238000001308 synthesis method Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 210000000214 mouth Anatomy 0.000 description 8
- 238000010801 machine learning Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008451 emotion Effects 0.000 description 6
- 230000002996 emotional effect Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 238000013528 artificial neural network Methods 0.000 description 5
- 239000010410 layer Substances 0.000 description 4
- 230000033001 locomotion Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000012549 training Methods 0.000 description 4
- 230000015572 biosynthetic process Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 210000003128 head Anatomy 0.000 description 3
- 230000007935 neutral effect Effects 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000007619 statistical method Methods 0.000 description 2
- 230000002194 synthesizing effect Effects 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 241000282412 Homo Species 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 210000001015 abdomen Anatomy 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000010219 correlation analysis Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000003066 decision tree Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012417 linear regression Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000000306 recurrent effect Effects 0.000 description 1
- 230000008439 repair process Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
- G10L13/033—Voice editing, e.g. manipulating the voice of the synthesiser
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/08—Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
- G10L13/086—Detection of language
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Processing Or Creating Images (AREA)
- Machine Translation (AREA)
Abstract
Description
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910295572.XA CN110166844B (zh) | 2019-04-12 | 2019-04-12 | 一种数据处理方法和装置、一种用于数据处理的装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910295572.XA CN110166844B (zh) | 2019-04-12 | 2019-04-12 | 一种数据处理方法和装置、一种用于数据处理的装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110166844A CN110166844A (zh) | 2019-08-23 |
CN110166844B true CN110166844B (zh) | 2022-05-31 |
Family
ID=67639275
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910295572.XA Active CN110166844B (zh) | 2019-04-12 | 2019-04-12 | 一种数据处理方法和装置、一种用于数据处理的装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110166844B (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113689879B (zh) * | 2020-05-18 | 2024-05-14 | 北京搜狗科技发展有限公司 | 实时驱动虚拟人的方法、装置、电子设备及介质 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104412258A (zh) * | 2014-05-22 | 2015-03-11 | 华为技术有限公司 | 应用文本信息进行通信的方法及装置 |
CN105829995A (zh) * | 2013-10-22 | 2016-08-03 | 谷歌公司 | 根据观看者表情捕捉媒体内容 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8054964B2 (en) * | 2009-04-30 | 2011-11-08 | Avaya Inc. | System and method for detecting emotions at different steps in a communication |
US9082400B2 (en) * | 2011-05-06 | 2015-07-14 | Seyyer, Inc. | Video generation based on text |
US9350594B2 (en) * | 2013-06-26 | 2016-05-24 | Avaya Inc. | Shared back-to-back user agent |
-
2019
- 2019-04-12 CN CN201910295572.XA patent/CN110166844B/zh active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105829995A (zh) * | 2013-10-22 | 2016-08-03 | 谷歌公司 | 根据观看者表情捕捉媒体内容 |
CN104412258A (zh) * | 2014-05-22 | 2015-03-11 | 华为技术有限公司 | 应用文本信息进行通信的方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN110166844A (zh) | 2019-08-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110688911B (zh) | 视频处理方法、装置、***、终端设备及存储介质 | |
CN110162598B (zh) | 一种数据处理方法和装置、一种用于数据处理的装置 | |
WO2022048403A1 (zh) | 基于虚拟角色的多模态交互方法、装置及***、存储介质、终端 | |
US20200279553A1 (en) | Linguistic style matching agent | |
CN110148406B (zh) | 一种数据处理方法和装置、一种用于数据处理的装置 | |
TWI766499B (zh) | 互動物件的驅動方法、裝置、設備以及儲存媒體 | |
JP7227395B2 (ja) | インタラクティブ対象の駆動方法、装置、デバイス、及び記憶媒体 | |
CN114144790A (zh) | 具有三维骨架正则化和表示性身体姿势的个性化语音到视频 | |
WO2021196646A1 (zh) | 交互对象的驱动方法、装置、设备以及存储介质 | |
US20230082830A1 (en) | Method and apparatus for driving digital human, and electronic device | |
WO2022079933A1 (ja) | コミュニケーション支援プログラム、コミュニケーション支援方法、コミュニケーション支援システム、端末装置及び非言語表現プログラム | |
CN113689879B (zh) | 实时驱动虚拟人的方法、装置、电子设备及介质 | |
CN114357135A (zh) | 交互方法、交互装置、电子设备以及存储介质 | |
WO2021232877A1 (zh) | 实时驱动虚拟人的方法、装置、电子设备及介质 | |
US20240022772A1 (en) | Video processing method and apparatus, medium, and program product | |
CN110166844B (zh) | 一种数据处理方法和装置、一种用于数据处理的装置 | |
Kolivand et al. | Realistic lip syncing for virtual character using common viseme set | |
CN114155849A (zh) | 一种虚拟对象的处理方法、装置和介质 | |
Verma et al. | Animating expressive faces across languages | |
KR102138132B1 (ko) | 언어학습을 위한 애니메이션 더빙 서비스 제공 시스템 | |
Heisler et al. | Making an android robot head talk | |
Gonzalez et al. | Passing an enhanced Turing test–interacting with lifelike computer representations of specific individuals | |
d’Alessandro et al. | Reactive statistical mapping: Towards the sketching of performative control with data | |
US20240221260A1 (en) | End-to-end virtual human speech and movement synthesization | |
Gjaci | Comunicazione Non Verbale Culturalmente Competente Basata Su Generative Adversarial Networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20190902 Address after: 100084 Beijing, Zhongguancun East Road, building 1, No. 9, Sohu cyber building, room 9, room, room 01 Applicant after: BEIJING SOGOU TECHNOLOGY DEVELOPMENT Co.,Ltd. Applicant after: SOGOU (HANGZHOU) INTELLIGENT TECHNOLOGY Co.,Ltd. Address before: 100084 Beijing, Zhongguancun East Road, building 1, No. 9, Sohu cyber building, room 9, room, room 01 Applicant before: BEIJING SOGOU TECHNOLOGY DEVELOPMENT Co.,Ltd. |
|
TA01 | Transfer of patent application right | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220801 Address after: 100084. Room 9, floor 01, cyber building, building 9, building 1, Zhongguancun East Road, Haidian District, Beijing Patentee after: BEIJING SOGOU TECHNOLOGY DEVELOPMENT Co.,Ltd. Address before: 100084. Room 9, floor 01, cyber building, building 9, building 1, Zhongguancun East Road, Haidian District, Beijing Patentee before: BEIJING SOGOU TECHNOLOGY DEVELOPMENT Co.,Ltd. Patentee before: SOGOU (HANGZHOU) INTELLIGENT TECHNOLOGY Co.,Ltd. |
|
TR01 | Transfer of patent right |