CN107221324A - 语音处理方法及装置 - Google Patents
语音处理方法及装置 Download PDFInfo
- Publication number
- CN107221324A CN107221324A CN201710652375.XA CN201710652375A CN107221324A CN 107221324 A CN107221324 A CN 107221324A CN 201710652375 A CN201710652375 A CN 201710652375A CN 107221324 A CN107221324 A CN 107221324A
- Authority
- CN
- China
- Prior art keywords
- user
- audio signal
- image
- frequency
- lip motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 25
- 238000000034 method Methods 0.000 title claims abstract description 20
- 230000005236 sound signal Effects 0.000 claims abstract description 164
- 230000033001 locomotion Effects 0.000 claims abstract description 103
- 238000012549 training Methods 0.000 claims description 8
- 241001282135 Poromitra oscitans Species 0.000 description 2
- 206010048232 Yawning Diseases 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012706 support-vector machine Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000036461 convulsion Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/20—Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification techniques
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710652375.XA CN107221324B (zh) | 2017-08-02 | 2017-08-02 | 语音处理方法及装置 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710652375.XA CN107221324B (zh) | 2017-08-02 | 2017-08-02 | 语音处理方法及装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107221324A true CN107221324A (zh) | 2017-09-29 |
CN107221324B CN107221324B (zh) | 2021-03-16 |
Family
ID=59955006
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710652375.XA Active CN107221324B (zh) | 2017-08-02 | 2017-08-02 | 语音处理方法及装置 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107221324B (zh) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109145853A (zh) * | 2018-08-31 | 2019-01-04 | 百度在线网络技术(北京)有限公司 | 用于识别噪音的方法和装置 |
CN111326175A (zh) * | 2020-02-18 | 2020-06-23 | 维沃移动通信有限公司 | 一种对话者的提示方法及穿戴设备 |
WO2020172828A1 (zh) * | 2019-02-27 | 2020-09-03 | 华为技术有限公司 | 一种声源分离方法、装置及设备 |
CN111933174A (zh) * | 2020-08-16 | 2020-11-13 | 云知声智能科技股份有限公司 | 语音处理方法、装置、设备和*** |
WO2020233061A1 (zh) * | 2019-05-21 | 2020-11-26 | 深圳壹账通智能科技有限公司 | 静音检测方法、***、设备及计算机可读存储介质 |
CN113362849A (zh) * | 2020-03-02 | 2021-09-07 | 阿里巴巴集团控股有限公司 | 一种语音数据处理方法以及装置 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5680481A (en) * | 1992-05-26 | 1997-10-21 | Ricoh Corporation | Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system |
JP2000338987A (ja) * | 1999-05-28 | 2000-12-08 | Mitsubishi Electric Corp | 発話開始監視装置、話者同定装置、音声入力システム、および話者同定システム、並びに通信システム |
CN1442845A (zh) * | 2002-03-04 | 2003-09-17 | 株式会社Ntt都科摩 | 语音识别***及方法、语音合成***及方法及程序产品 |
KR20100041061A (ko) * | 2008-10-13 | 2010-04-22 | 성균관대학교산학협력단 | 화자의 얼굴을 확대하는 영상 통화 방법 및 이를 위한 단말 |
CN104103274A (zh) * | 2013-04-11 | 2014-10-15 | 纬创资通股份有限公司 | 语音处理装置和语音处理方法 |
CN105915798A (zh) * | 2016-06-02 | 2016-08-31 | 北京小米移动软件有限公司 | 视频会议中摄像头的控制方法和控制装置 |
-
2017
- 2017-08-02 CN CN201710652375.XA patent/CN107221324B/zh active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5680481A (en) * | 1992-05-26 | 1997-10-21 | Ricoh Corporation | Facial feature extraction method and apparatus for a neural network acoustic and visual speech recognition system |
JP2000338987A (ja) * | 1999-05-28 | 2000-12-08 | Mitsubishi Electric Corp | 発話開始監視装置、話者同定装置、音声入力システム、および話者同定システム、並びに通信システム |
CN1442845A (zh) * | 2002-03-04 | 2003-09-17 | 株式会社Ntt都科摩 | 语音识别***及方法、语音合成***及方法及程序产品 |
KR20100041061A (ko) * | 2008-10-13 | 2010-04-22 | 성균관대학교산학협력단 | 화자의 얼굴을 확대하는 영상 통화 방법 및 이를 위한 단말 |
CN104103274A (zh) * | 2013-04-11 | 2014-10-15 | 纬创资通股份有限公司 | 语音处理装置和语音处理方法 |
CN105915798A (zh) * | 2016-06-02 | 2016-08-31 | 北京小米移动软件有限公司 | 视频会议中摄像头的控制方法和控制装置 |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109145853A (zh) * | 2018-08-31 | 2019-01-04 | 百度在线网络技术(北京)有限公司 | 用于识别噪音的方法和装置 |
WO2020172828A1 (zh) * | 2019-02-27 | 2020-09-03 | 华为技术有限公司 | 一种声源分离方法、装置及设备 |
CN111868823A (zh) * | 2019-02-27 | 2020-10-30 | 华为技术有限公司 | 一种声源分离方法、装置及设备 |
CN111868823B (zh) * | 2019-02-27 | 2024-07-05 | 华为技术有限公司 | 一种声源分离方法、装置及设备 |
WO2020233061A1 (zh) * | 2019-05-21 | 2020-11-26 | 深圳壹账通智能科技有限公司 | 静音检测方法、***、设备及计算机可读存储介质 |
CN111326175A (zh) * | 2020-02-18 | 2020-06-23 | 维沃移动通信有限公司 | 一种对话者的提示方法及穿戴设备 |
CN113362849A (zh) * | 2020-03-02 | 2021-09-07 | 阿里巴巴集团控股有限公司 | 一种语音数据处理方法以及装置 |
CN111933174A (zh) * | 2020-08-16 | 2020-11-13 | 云知声智能科技股份有限公司 | 语音处理方法、装置、设备和*** |
Also Published As
Publication number | Publication date |
---|---|
CN107221324B (zh) | 2021-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107221324A (zh) | 语音处理方法及装置 | |
US11398235B2 (en) | Methods, apparatuses, systems, devices, and computer-readable storage media for processing speech signals based on horizontal and pitch angles and distance of a sound source relative to a microphone array | |
CN108090458B (zh) | 人体跌倒检测方法和装置 | |
EP3092619B1 (en) | Information processing apparatus and information processing method | |
Fisher et al. | Speaker association with signal-level audiovisual fusion | |
CN102682273A (zh) | 嘴唇运动检测设备和方法 | |
Sahoo et al. | Emotion recognition from audio-visual data using rule based decision level fusion | |
CN107799126A (zh) | 基于有监督机器学习的语音端点检测方法及装置 | |
CN110750152B (zh) | 一种基于唇部动作的人机交互方法和*** | |
KR101937323B1 (ko) | 위장 얼굴 판별 장치 및 방법 | |
KR20140141034A (ko) | 사람 검출 장치 및 방법과 사람 계수 장치 및 방법 | |
CN101199207A (zh) | 用于独立于说话者特征测量音频视频同步的方法、***和程序产品 | |
TWI780366B (zh) | 臉部辨識系統、臉部辨識方法及臉部辨識程式 | |
CN111353338B (zh) | 一种基于营业厅视频监控的能效改进方法 | |
WO2020073403A1 (zh) | 静默语音输入辨识方法、计算装置和计算机可读介质 | |
CN107992813A (zh) | 一种唇部状态检测方法及装置 | |
CN114299953B (zh) | 一种结合嘴部运动分析的话者角色区分方法与*** | |
CN115512259A (zh) | 一种基于多模态的短视频审核方法 | |
CN111626240A (zh) | 一种人脸图像识别方法、装置、设备及可读存储介质 | |
CN114282621B (zh) | 一种多模态融合的话者角色区分方法与*** | |
CN112395900A (zh) | 基于YOLOv3算法的疲劳驾驶状态检测算法 | |
CN114299952B (zh) | 结合多种运动分析的话者角色区分方法及*** | |
CN106599765B (zh) | 基于对象连续发音的视-音频判断活体的方法及*** | |
CN107203734A (zh) | 一种获取嘴部状态的方法及电子设备 | |
KR20060044008A (ko) | 다수의 화자 분별을 위한 음성 인식장치 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information |
Address after: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Applicant after: Shanghai zhihuilin Medical Technology Co.,Ltd. Address before: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Applicant before: Shanghai Zhihui Medical Technology Co.,Ltd. Address after: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Applicant after: Shanghai Zhihui Medical Technology Co.,Ltd. Address before: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Applicant before: SHANGHAI MROBOT TECHNOLOGY Co.,Ltd. Address after: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Applicant after: SHANGHAI MROBOT TECHNOLOGY Co.,Ltd. Address before: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Applicant before: SHANGHAI MUYE ROBOT TECHNOLOGY Co.,Ltd. |
|
CB02 | Change of applicant information | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address |
Address after: 202150 room 205, zone W, second floor, building 3, No. 8, Xiushan Road, Chengqiao Town, Chongming District, Shanghai (Shanghai Chongming Industrial Park) Patentee after: Shanghai Noah Wood Robot Technology Co.,Ltd. Address before: 200336 402 rooms, No. 33, No. 33, Guang Shun Road, Shanghai Patentee before: Shanghai zhihuilin Medical Technology Co.,Ltd. |
|
CP03 | Change of name, title or address |