EP1733382A2 - System and method for computer recognition and interpretation of arbitrary spoken-characters - Google Patents
System and method for computer recognition and interpretation of arbitrary spoken-charactersInfo
- Publication number
- EP1733382A2 EP1733382A2 EP05728332A EP05728332A EP1733382A2 EP 1733382 A2 EP1733382 A2 EP 1733382A2 EP 05728332 A EP05728332 A EP 05728332A EP 05728332 A EP05728332 A EP 05728332A EP 1733382 A2 EP1733382 A2 EP 1733382A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- pronunciation
- characters
- spoken
- character
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims description 28
- 238000009877 rendering Methods 0.000 abstract 1
- 238000013507 mapping Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 230000001413 cellular effect Effects 0.000 description 2
- 238000013479 data entry Methods 0.000 description 2
- 238000012805 post-processing Methods 0.000 description 2
- 238000010079 rubber tapping Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 description 1
- 241000252794 Sphinx Species 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002040 relaxant effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
Definitions
- This invention generally relates to user interfaces for speech recognition systems, and particularly to a system and method for speech recognition of arbitrarily spoken characters. Another aspect of this invention relates to relaxing constraints specific to remembering words (and their respective pronunciations) corresponding to characters, which is currently required for computerized recognition of spoken characters.
- Yet another aspect of this invention is that it dramatically improves a speech recognition system's accuracy for recognition of characters (alphabet or alphanumeric) and thus solves the problem associated with recognition of sub-sets of characters that sound similar and thus bear close similarities in the so called acoustic space; for example the E-set in English language (comprising of B, C, D, E, G, P, T, V, Z) and also M, N.
- Some of these problem include: (1) the users have to memorize/remember these tags which, in almost all real- world applications, is not desirable; (2) the users have to remember/train to pronounce these words/tags in a manner that is well-suited for the specific recognition system; (3) the time it takes to render the speech for these words/tags is large (and depends on the choice of words) compared to the time it takes to simply render speech corresponding to the characters; and (4) the choice of words does not always guarantee optimum separation of the words in the acoustic space.
- accuracy, speed, and ease of learning when it comes to designing a user- interface for character recognition.
- This invention is a system and method for speech recognition of spoken characters that is based on simple coding-schemes at the user-interface. In particular, it requires association of each character with a plurality of individually spoken characters in sequence. For instance, in one embodiment, the method involves speaking a character followed by its "N" (note that N denoting length of coding- scheme should not be confused with letter N) subsequent characters like "EFG" in place of "E".
- N denoting length of coding- scheme should not be confused with letter N
- FIG. 1 A shows a block diagram that illustrates a prior art speech recognition method in contrast to the present invention's speech recognition method.
- FIG. IB shows a block diagram that illustrates another prior art speech recognition system in contrast to a different embodiment of the present invention.
- FIG. 2 illustrates a wireless text messaging application using the interface described in the present invention; real-time and audible feedback may be included.
- a typical speech recognition system also referred to as an Automatic Speech Recognizer or ASR
- ASR Automatic Speech Recognizer
- the system itself may reside as software or may be implemented on a computing device such as a conventional embedded system; and thus may include memory (ROM, RAM etc.), storage, processors (fixed-point, floating-point etc.), interface ports, and other hardware components.
- a speech recognition system for recognizing and interpreting arbitrarily spoken characters (in any character-based language), that relaxes constraints specific to remembering words (and their respective pronunciations) corresponding to characters, is designed by (a) pre-determining a coding/mapping scheme that maps the individual characters to a sequence of characters (by wrapping around at the end of the sequential list of characters) as per TABLE 1, (b) modifying an existing grammar-file (or creating a new grammar-file) for implementing the coding-scheme as per TABLE 7, or modifying a vocabulary-file (or creating a new vocabulary file) that has pronunciations to implement the coding scheme as per TABLE 8 or more generally as shown in TABLE 9, (c) capturing a character as an audio speech signal spoken by a user, (d) recognizing the inputted character by referring to the modified grammar/vocabulary in conjunction with the system's acoustic model and language model, and (e) generating programming code or system module to post-process the recognizer's standard output
- CODING-SCHEME FOR EACH CHARACTER, SPEAK THAT CHARACTER, FOLLOWED BY “N” SUBSEQUENT CHARACTERS; WRAP AROUND UPON REACHING THE END-OF-LIST.
- EXAMPLE FOR SPEAKING LETTER “V”, SPEAK “VW”; NOTE THAT "V” AND, FOR EXAMPLE, "E” WHICH WERE CONFUSABLE, ARE NOW MAPPED TO "VW” AND “EF” RESPECTIVELY AND ARE LESS CONFUSABLE.
- TABLE 1 illustrates one embodiment of a coding-scheme that associates a character with its spoken counterpart.
- the present invention also works with other languages, when based on a character sequence, in their native form.
- the invention similarly can be used with Romanized translators, as in Romanji for Japanese, Pin Yin for Chinese, and
- TABLE 2 illustrates an example of the coding-scheme described in TABLE 1 as applied to the alphanumeric characters of the English Alphabet.
- CODING-SCHEME FOR EACH CHARACTER, SPEAK THAT CHARACTER “M” TIMES, FOLLOWED BY “N” SUBSEQUENT CHARACTERS.
- TABLE 3 illustrates another coding-scheme that is a variant of the coding- scheme described in TABLE 1.
- TABLE 4 illustrates an example of the coding-scheme described in TABLE 3ed to the alphanumeric characters of the English Alphabet.
- CODING-SCHEME FOR EACH CHARACTER (OR FOR A PRE-DETERMINED SUB-SET OF CHARACTERS), SPEAK THAT CHARACTER, FOLLOWED BY THE WORD “AS IN” OR “FOR”, FOLLOWED BY THAT CHARACTER AND ITS “N” SUBSEQUENT CHARACTERS; WRAP AROUND UPON REACHING THE END-OF-LIST.
- TABLE 6 illustrates another embodiment of a coding-scheme in accordance with this invention.
- ⁇ alphabets> : : ⁇ alphabet>
- TABLE 7 illustrates a grammar file in BNF format (other formats may be easily used as would be appreciated by one skilled in the art and others) that forms a module of a speech recognition engine, for implementing an example of the coding- scheme in TABLE 1. or modifying a vocabulary-file (or creating a new vocabulary file) that has pronunciations to implement the coding-scheme as per TABLE 8,
- TABLE 10 illustrates post-processing step (which basically decodes the coded characters back to their original form) required to implement the coding-scheme as used in TABLE 7/TABLE 8.
- the speech recognition system described above results in improved accuracy for the specific task of character-recognition, especially so when the characters exhibit high degrees of acoustic similarities; like the E-Set in English language.
- special techniques may be employed to build and/or adapt acoustic models and language models, that exploit the coding scheme used, so as to further improve the systems performance; for instance collecting corpus of acoustic training/adaptation/test data (speech samples) where the speakers are specifically instructed to speak using the coding-scheme.
- the above system may also be used to improve accuracy in noisy environments, by selecting the parameter "TV" (in TABLE 1) which determines the code-length of the coding scheme, based on the known signal-to-noise ratio.
- the coding scheme proposed in this invention has the properties of noise robustness, discrimination in the acoustic space, ease-of-learning, and user- friendliness.
- a user-interface in accordance with this invention has the advantage of being easy-to-adapt by anyone who can speak and type naturally the characters that they wish to dictate. It allows users to conveniently dictate any arbitrary text (by speaking characters into devices) in eyes-busy, hands-busy situations like "driving an automobile".
- the user-interface may also be used for correcting errors (and/or entering new words) of a general-purpose speech recognition system.
- the invention may be naturally viewed as a method/apparatus for dictating short text messages, as in text-messaging, into small form-factor embedded devices like cellular phones, using real-time visual and audible feedback.
- the proposed interface is faster, more intuitive, and may be used in eyes-busy-hands-busy conditions and hence may be more useful compared to existing interfaces (like "Triple Tapping" where to enter a character "C” user has to tap the key "2" three times).
- FIG. 2 illustrates the prior art of the "triple tapping"(the left side of the figure) method as compared to one embodiment of the present invention (the right side of the figure).
- This application of the present invention for "text-messaging” allows a handset to be either viewed as a multi-modal interface that complements the existing "keypad” interface or as the only interface in certain situations like "while driving a vehicle". Since the handset is capable of visual displays giving visual feedback and audio speakers allowing audio feedback, both feedback methods made be used to give the user useful information as to the text inputted using the present invention.
- TABLE 11 shows an embodiment of the invention where the two subsequent letters of the text letter to be inputted are used. These subsequent letters are wrapped around the alphabet in the case of "Y” and “Z” as shown. Numbers “8" and “9” are also shown as being wrapped around the Arabic number system sequence.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Machine Translation (AREA)
- Character Discrimination (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US55146604P | 2004-03-09 | 2004-03-09 | |
PCT/US2005/007934 WO2005086908A2 (en) | 2004-03-09 | 2005-03-08 | System and method for computer recognition and interpretation of arbitrary spoken-characters |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1733382A2 true EP1733382A2 (en) | 2006-12-20 |
Family
ID=34976231
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05728332A Withdrawn EP1733382A2 (en) | 2004-03-09 | 2005-03-08 | System and method for computer recognition and interpretation of arbitrary spoken-characters |
Country Status (4)
Country | Link |
---|---|
US (1) | US7865363B2 (ja) |
EP (1) | EP1733382A2 (ja) |
JP (1) | JP2007535692A (ja) |
WO (1) | WO2005086908A2 (ja) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6859652B2 (en) * | 2000-08-02 | 2005-02-22 | Mobile Satellite Ventures, Lp | Integrated or autonomous system and method of satellite-terrestrial frequency reuse using signal attenuation and/or blockage, dynamic assignment of frequencies and/or hysteresis |
US8447613B2 (en) * | 2008-04-28 | 2013-05-21 | Irobot Corporation | Robot and server with optimized message decoding |
EP2755202B1 (en) * | 2011-09-09 | 2016-07-13 | Asahi Kasei Kabushiki Kaisha | Voice recognition device |
Family Cites Families (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6601027B1 (en) * | 1995-11-13 | 2003-07-29 | Scansoft, Inc. | Position manipulation in speech recognition |
US6064959A (en) * | 1997-03-28 | 2000-05-16 | Dragon Systems, Inc. | Error correction in speech recognition |
JP2820093B2 (ja) * | 1995-12-26 | 1998-11-05 | 日本電気株式会社 | 単音節認識装置 |
JP3825526B2 (ja) * | 1997-03-31 | 2006-09-27 | 株式会社東芝 | 音声認識装置 |
JPH1188507A (ja) * | 1997-09-08 | 1999-03-30 | Hitachi Ltd | ページャ用音声認識装置 |
JPH11167393A (ja) * | 1997-12-04 | 1999-06-22 | Hitachi Eng & Service Co Ltd | 音声認識装置および音声認識装置用辞書 |
JPH11184495A (ja) * | 1997-12-24 | 1999-07-09 | Toyota Motor Corp | 音声認識装置 |
DE19847419A1 (de) * | 1998-10-14 | 2000-04-20 | Philips Corp Intellectual Pty | Verfahren zur automatischen Erkennung einer buchstabierten sprachlichen Äußerung |
US6321196B1 (en) * | 1999-07-02 | 2001-11-20 | International Business Machines Corporation | Phonetic spelling for speech recognition |
GB2353887B (en) * | 1999-09-04 | 2003-09-24 | Ibm | Speech recognition system |
DE19944608A1 (de) * | 1999-09-17 | 2001-03-22 | Philips Corp Intellectual Pty | Erkennung einer in buchstabierter Form vorliegenden Sprachäußerungseingabe |
US6665640B1 (en) * | 1999-11-12 | 2003-12-16 | Phoenix Solutions, Inc. | Interactive speech based learning/training system formulating search queries based on natural language parsing of recognized user queries |
JP2001223816A (ja) * | 2000-02-04 | 2001-08-17 | Hitachi Ltd | 電話機によるテキストメッセージの作成方法および装置 |
WO2001084535A2 (en) * | 2000-05-02 | 2001-11-08 | Dragon Systems, Inc. | Error correction in speech recognition |
US7149970B1 (en) * | 2000-06-23 | 2006-12-12 | Microsoft Corporation | Method and system for filtering and selecting from a candidate list generated by a stochastic input method |
US6694296B1 (en) * | 2000-07-20 | 2004-02-17 | Microsoft Corporation | Method and apparatus for the recognition of spelled spoken words |
US6934683B2 (en) * | 2001-01-31 | 2005-08-23 | Microsoft Corporation | Disambiguation language model |
US6975986B2 (en) * | 2001-05-30 | 2005-12-13 | International Business Machines Corporation | Voice spelling in an audio-only interface |
US7143037B1 (en) * | 2002-06-12 | 2006-11-28 | Cisco Technology, Inc. | Spelling words using an arbitrary phonetic alphabet |
US20050049858A1 (en) * | 2003-08-25 | 2005-03-03 | Bellsouth Intellectual Property Corporation | Methods and systems for improving alphabetic speech recognition accuracy |
-
2005
- 2005-03-08 EP EP05728332A patent/EP1733382A2/en not_active Withdrawn
- 2005-03-08 WO PCT/US2005/007934 patent/WO2005086908A2/en active Application Filing
- 2005-03-08 US US11/074,613 patent/US7865363B2/en not_active Expired - Fee Related
- 2005-03-08 JP JP2007503000A patent/JP2007535692A/ja active Pending
Non-Patent Citations (1)
Title |
---|
See references of WO2005086908A2 * |
Also Published As
Publication number | Publication date |
---|---|
US7865363B2 (en) | 2011-01-04 |
US20050203742A1 (en) | 2005-09-15 |
WO2005086908A2 (en) | 2005-09-22 |
JP2007535692A (ja) | 2007-12-06 |
WO2005086908A3 (en) | 2008-10-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1267326B1 (en) | Artificial language generation | |
US5787230A (en) | System and method of intelligent Mandarin speech input for Chinese computers | |
CN1260704C (zh) | 语音合成方法 | |
EP1217609A2 (en) | Speech recognition | |
AU2010212370B2 (en) | Generic spelling mnemonics | |
CN103578464A (zh) | 语言模型的建立方法、语音辨识方法及电子装置 | |
US5995934A (en) | Method for recognizing alpha-numeric strings in a Chinese speech recognition system | |
US7676364B2 (en) | System and method for speech-to-text conversion using constrained dictation in a speak-and-spell mode | |
US20120109633A1 (en) | Method and system for diacritizing arabic language text | |
CN1359514A (zh) | 多模式数据输入设备 | |
US20020198712A1 (en) | Artificial language generation and evaluation | |
WO2006044253A1 (en) | Method and system for improving the fidelity of a dialog system | |
KR20180025559A (ko) | 발음 사전 학습 방법 및 장치 | |
US7865363B2 (en) | System and method for computer recognition and interpretation of arbitrary spoken-characters | |
EP3185132B1 (en) | Method for writing a foreign language in a pseudo language phonetically resembling native language of the speaker | |
JP2002268680A (ja) | 悪環境下でのキーパッド/音声を用いたハイブリッドな東洋文字認識技術 | |
CN115298736A (zh) | 用于数据输入的语音识别和训练 | |
WO2002029613A1 (en) | Method and system for building a domain specific statistical language model from rule-based grammar specifications | |
JP7165439B2 (ja) | ソース言語の音声によって拡張言語の音声認識モデルをトレーニングする方法 | |
JPH04291399A (ja) | 音声認識方法 | |
Pisarn et al. | Thai spelling analysis for automatic spelling speech recognition | |
JP2006113269A (ja) | 発音系列認識装置、発音系列認識方法及び発音系列認識プログラム | |
JPH0473694A (ja) | 日本語音声認識方法 | |
JPH05232990A (ja) | 日本語音声認識方法 | |
CN103455301A (zh) | 一种语音输入法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20061006 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR LV MK YU |
|
DAX | Request for extension of the european patent (deleted) | ||
PUAK | Availability of information related to the publication of the international search report |
Free format text: ORIGINAL CODE: 0009015 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G10L 15/26 20060101AFI20081118BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN |
|
18W | Application withdrawn |
Effective date: 20090501 |