EP0886853B1 - Auf mikrosegmenten basierendes sprachsyntheseverfahren - Google Patents
Auf mikrosegmenten basierendes sprachsyntheseverfahren Download PDFInfo
- Publication number
- EP0886853B1 EP0886853B1 EP97917259A EP97917259A EP0886853B1 EP 0886853 B1 EP0886853 B1 EP 0886853B1 EP 97917259 A EP97917259 A EP 97917259A EP 97917259 A EP97917259 A EP 97917259A EP 0886853 B1 EP0886853 B1 EP 0886853B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- vowel
- speech
- segments
- microsegments
- synthesis process
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 46
- 238000000034 method Methods 0.000 title claims abstract description 40
- 230000008569 process Effects 0.000 title claims abstract description 29
- 230000007704 transition Effects 0.000 claims abstract description 23
- 230000008859 change Effects 0.000 claims description 10
- 238000004904 shortening Methods 0.000 claims description 6
- 210000001260 vocal cord Anatomy 0.000 claims description 4
- 230000004048 modification Effects 0.000 claims description 3
- 238000012986 modification Methods 0.000 claims description 3
- 230000010355 oscillation Effects 0.000 claims 1
- 230000001502 supplementing effect Effects 0.000 claims 1
- 230000015572 biosynthetic process Effects 0.000 abstract description 31
- 238000003860 storage Methods 0.000 description 11
- MQJKPEGWNLWLTK-UHFFFAOYSA-N Dapsone Chemical compound C1=CC(N)=CC=C1S(=O)(=O)C1=CC=C(N)C=C1 MQJKPEGWNLWLTK-UHFFFAOYSA-N 0.000 description 9
- 230000009467 reduction Effects 0.000 description 7
- 230000003595 spectral effect Effects 0.000 description 6
- 230000005284 excitation Effects 0.000 description 4
- 210000000056 organ Anatomy 0.000 description 4
- 238000005070 sampling Methods 0.000 description 4
- 238000001308 synthesis method Methods 0.000 description 4
- 238000005520 cutting process Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 230000000630 rising effect Effects 0.000 description 3
- 210000005182 tip of the tongue Anatomy 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 210000004704 glottis Anatomy 0.000 description 2
- 210000004283 incisor Anatomy 0.000 description 2
- 230000000877 morphologic effect Effects 0.000 description 2
- 238000010189 synthetic method Methods 0.000 description 2
- 230000001755 vocal effect Effects 0.000 description 2
- 241000238557 Decapoda Species 0.000 description 1
- 230000001944 accentuation Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009172 bursting Effects 0.000 description 1
- 210000001072 colon Anatomy 0.000 description 1
- 238000005336 cracking Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001627 detrimental effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000004069 differentiation Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000001983 hard palate Anatomy 0.000 description 1
- 201000000615 hard palate cancer Diseases 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 210000002640 perineum Anatomy 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 210000003800 pharynx Anatomy 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 210000001584 soft palate Anatomy 0.000 description 1
- 239000000829 suppository Substances 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000013518 transcription Methods 0.000 description 1
- 230000035897 transcription Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/06—Elementary speech units used in speech synthesisers; Concatenation rules
- G10L13/07—Concatenation rules
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
- G10L13/04—Details of speech synthesis systems, e.g. synthesiser structure or memory management
Definitions
- the invention relates to a digital speech synthesis method according to the preamble of claim 1.
- the concatenation synthesis is known with parts of real spoken utterances like that be chained that new expressions arise.
- the So individual parts of the language form building blocks for Speech generation.
- the size of the parts can - depending by application - from words and phrases to Excerpts from sounds are sufficient.
- For the artificial Generate language with unlimited vocabulary are offered as units of half syllables or smaller ones Cutouts. Larger units only make sense when a limited vocabulary is synthesized should.
- Phonesis involves the concatenation of sounds or Phones made.
- the storage space requirement is manageably small.
- these speech signal modules are missing perceptually important transitions between the individual sounds that even incomplete by blending out individual ones Loud or more complex resynthesis processes can be modeled.
- this Type of synthesis qualitatively unsatisfactory.
- the Consideration of the phonetic context of individuals Lute by dropping sound variants of a Loud in their own speech signal modules in the so-called allophone synthesis improves this Speech result due to non-compliance with the articulatory-acoustic dynamics not essential.
- Diphone synthesis uses signal modules from the middle of an acoustically defined speech up to range to the middle of the next speech. Thereby the perceptually important transitions from one According to the other, considered as acoustic Bear the movements of the speech organs in the speech signal occur. It also becomes the signal building blocks at spectrally relatively constant locations put together what the potentially existing Disturbances in the signal flow at the joints of the individual Diphone decreased.
- the sound inventory of western European Languages consist of 35 to 50 sounds. For one language with 40 sounds, there are theoretically 1600 Diphone pairs, which are then identified by phonotactic Restrictions can actually be reduced to around 1000.
- the cutting point is in the middle of the Lute.
- larger units are recorded which takes larger phonetic contexts into account can be.
- the number of combinations increases however proportional to.
- half syllable synthesis is an intersection for the units used in the middle of the vowel of a syllable.
- the other cutting point is at the beginning or end of a syllable, so depending on the structure of the syllable also sequences of several Consonants can be included in a language module.
- German there are about 52 different sound sequences in initial syllables of morphemes and about 120 sound sequences counted for medial or final syllables of morphemes. This results in a theoretical number of 6240 Half syllables for German, some of which are uncommon. Since half-syllables are usually longer as a diphone, the storage space requirement for the Speech signal modules that the diphones a lot.
- the speech part of the input characters determines whether two read unit speech waveforms either directly be connected when the input speech part of the Input character is unvoiced, or a given one first interpolation method is used if the input speech part of the input times voiced is the same unit waveform for both a voiced / g, d, b / as well as for his corresponding voiceless / k, t, p / sound used becomes.
- unit speech waveforms should also be in the memory that the one Consonants following the vowel part or the one Represent consonants preceding vowel part.
- the Transitional areas from a consonant to a vowel or from a vowel to a consonant can in each case for the consonants k and g, t and d as well as p and b be equated.
- the space requirement will be thus reduced, but requires the specified Interpolation process a not insignificant Computing effort.
- the disadvantage is that a sufficient naturalness of the Voice playback due to multiple playback same period pieces, possibly only shortened synthetically or extended, is not reached. Furthermore, the significantly reduced memory requirements by one bought more analysis and interpolation effort, what computing time costs.
- the object of the invention is therefore based on the DE 27 40 520 A1 to specify a speech synthesis method, in the case of small storage space requirements without high Computing effort a high quality speech output is achieved.
- Microsegments multiple times in different phonetic Contexts can be used. That is, at Sound transitions the perceptually important transitions from one sound to another without being considered that for each of the possible connections of two Speech loud own acoustic segments required are.
- the division according to the invention into microsegments, that shares a sound transition enables use identical segments for different sound transitions for a group of consonants.
- This principle of Generalization when using Speech signal modules is the one for storing the Speech signal modules reduced memory space required. Still, the quality is synthetic output language due to the consideration of the perceptually important sound transitions very well.
- consonant segments for Plosive are divided into two microsegments, a first segment, which includes the closing phase and a second segment, that includes the solution phase becomes a further generalization of the language segments reached.
- closure phase can be carried out for all plosives represent a time series of zeros. For this part the sound reproduction is therefore no storage space required.
- the solution phase of the plosive is in context differentiated the following sound. It can be another Generalization can be achieved in solving for vowels only after the following four vowel groups - front, unrounded vowels; front, rounded Vowels; deep or centralized vowels and back, rounded vowels - and with a solution to consonants only after three different articulation points, labial, alveolar or velar, is distinguished so that for example, 42 microsegments for the German language for the six plosives / p, t, k, b, d, g / zu three consonant groups by articulation point and to four vowel groups must be saved. This reduced due to the multiple use of the Micro segments for different phonetic context the storage space requirement further.
- pauses in speech are recognized.
- the Phoneme chain is closed at these points with pause symbols a symbol chain added, whereby in the sequence of the micro segments on the digital break symbols Zeros are inserted in the time series signal.
- the additional information about a break point and their pause duration is due to the sentence structure and predetermined rules determined.
- the pause will be by the number of digital zeros to be inserted in Dependency of the sampling rate realized.
- the Main information regarding the by the playing time word accent formed is in a lexicon.
- the then for sentence accents to be selected with intonation Emphasis is placed on the analysis of language Text to be output from the sentence structure and predetermined rules determined. Depending on the determined Emphasis is placed on the relevant microsegment or by omitting certain microsegment sections abbreviated.
- Intonation symbols are added to form a symbol chain, being in the sequence of the microsegments a change in fundamental frequency in the intonation symbols certain parts of the periods of microsegments in Time range is performed, the melody reproduced linguistic utterances.
- the fundamental frequency change is preferably carried out by skipping and adding certain Samples. For this, the previously recorded voiced microsegments, i.e. Vowels and sonorants, marked. Every voting period is automatically included the spectrally important first part, in which the vocal folds are closed, and the less important second part, in which the vocal folds are open, treated separately.
- the markings are set so that only the spectrally noncritical in the signal output second part of each period Fundamental frequency change shortened or extended are reproduced. This will take up space for the reproduction of intonations at the Not significantly increased and the Computational effort due to the manipulation in the time domain kept low.
- the process steps of the speech synthesis system according to the invention are in a flowchart in Fig. 1 shown.
- the input for the speech synthesis system is a text, for example a text file.
- the Words in the text are saved using a computer stored lexicons assigned a phoneme chain that represents the pronunciation of each word.
- word formation often takes place through composition of words and parts of words, e.g. with pre and Suffixes.
- the pronunciation of words like "house building”, “Development”, “buildable” etc. can be from one trunk, here "bau", derived and with the pronunciation of the Vorund Suffixes are connected.
- the sequence of parts of speech becomes with given rules determines the limit of phrases.
- the implementation of the intonation is based on a Intonation and pause description system in which basically between intonation courses that Phrase boundaries take place (rising, falling, constant, falling-rising) and those that around Accents are localized (low, high, rising, falling).
- the assignment of the Intonation courses are based on the syntactic and morphological analysis under Inclusion of certain keywords and characters in the text. For example, have questions with Bursting position (recognizable by the question mark on End and information that the first word of the sentence a finite verb is) a deep accent and one high rising limit tone. Normal statements have one high accent tone and a falling final phrase limit.
- the course of the intonation is according to given Rules generated.
- the phoneme-based symbol chain in a microsegment sequence converted.
- the conversion of a sequence of two Phonemes in microsegment sequences are made using a Rule set in which each phoneme sequence is a sequence of Micro segments is assigned.
- the voice output then takes place through digital / analog conversion the manipulated time series signal, for example, one arranged in the computer "Soundblaster" card.
- Fig. 2 shows a spectrogram in the upper part and lower part the associated time signal for the Word example "Phonetics".
- the word "phonetics” is used in Symbols as a phoneme sequence between slashes like shown as follows / fone: tIk /. This phoneme sequence is on the abscissa representing the time axis in the upper Part of Fig. 2 applied.
- the ordinate of the Spectrogram of Fig. 2 denotes the frequency content of the speech signal, the degree of blackening to Amplitude of the corresponding frequency is proportional.
- Corresponds to the time signal shown above in FIG. 2 the ordinate of the current amplitude of the signal. in the middle fields are the with vertical lines Microsegment boundaries shown. The specified therein Abbreviations give the designation or Symbolization of the respective microsegment.
- the Example word "phonetics” thus consists of twelve Microsegments.
- the names of the microsegments are chosen so that the lute outside the parentheses the context mark, in the brackets the sounding sound is specified. It will be the contextual Transitions of the speech sounds are taken into account.
- the consonant segments ... (f) and (n) e are on segmented the respective sound limit.
- the Plosive / t / and / k / are in a locking phase (t (t) and k (k)), the digitally by sampling values set to zero is reproduced and used for all plosives, and a short solution phase (here: (t) I and (k) 7), which is context sensitive, split.
- the vowels are each divided into vowel halves, with the intersection points at the beginning and in the middle of the vowel.
- Fig. 3 is another word example " womanizer" in Played time range.
- the phoneme sequence is with / fraU @ nhElt / specified.
- the word shown in Fig. 3 comprises 15 microsegments, here also quasi stationary microsegments occur.
- the first two Microsegments ... (f) and (r) a are consonant Segments whose context is only on one side is specified.
- the one Transition of the velar articulation point to the middle of the a includes, to form the diphthong / aU / die Starting position a (a).
- AU (AU) includes the perceptual important transition between the start and the Target position u (U).
- (U) @ contains the transition from / U / after / @ /, which is usually followed by @ (@) ought to. This would make / @ / take too long, so this The segment for / @ / and / 6 / is omitted for permanent reasons and only the second vowel half (@) n is played.
- (n) h represents a consonant segment. The transition from consonants to / h / - unlike vowels - not specified. Therefore there is no segment n (h).
- (h) E contains the breathed part of the vowel / E /, the followed by the quasi-stationary E (E).
- (E) 1 contains the second vowel half of / E / with the transition to the dental articulation site.
- E (1) is a consonant microsegment, in which only the Precontext is specified. The / t / is divided into a closure phase t (t) and a solution phase (t) ..., that goes to
- the large number of possible articulation points is limited to three essential areas.
- the grouping is based on the similar movements carried out by the articulators to form the sounds. Because of the comparable articulator movements, the spectral transitions between the sounds are similar within the three groups listed in Table 1.
- a further generalization is achieved by grouping the postalveolar consonants / S / (as in Ma sch e) and / Z / (as in Ga g e) to the alveolar and labiodental consonates / f / and / v / with the labial, so that, as stated above, / fa (tS) /, / va (tS) /, / fa (dZ) / and / va (dZ) / can also contain the same vowel segments.
- microsegment markings that a Shortening, stretching or frequency change on the microsegment allow in the time domain.
- the markings are at the zero crossings with a positive slope of the time signal of the microsegments. All in all five reduction levels are carried out, so that Microsegment together with the unabridged rendering has six different levels of play time.
- the intonation can be linguistic Comments by a change in the fundamental frequency of the periodic parts of vowels and sonorants become. This is done through a fundamental frequency manipulation performed in the time domain on the microsegment, although hardly tonal losses arise.
- the digital signal has to limit the memory requirement for example a bandwidth of 8 bits and a sampling rate of 22 kHz.
- microsegments separated in this way are addressed according to the sound and context and stored in a memory.
- a text to be output as language is accompanied by the corresponding Address order fed to the system.
- the order of sounds determines the selection of Addresses. According to this order of addresses the microsegments are read from the memory and strung together.
- This digital time series is in a digital / analog converter, for example in one so-called Soundblaster card, in an analog signal converted that through speech devices, for example a speaker or headphones, can be spent.
- the speech synthesis system according to the invention can be based on an ordinary PC, where a RAM of about 4 MB is sufficient.
- the one with the System realizable vocabulary is practical unlimited.
- the language is easy to understand, the computational effort for modifications of the Microsegments, for example cuts or Fundamental frequency changes, is small since that Voice signal is processed in the time domain.
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Electrically Operated Instructional Devices (AREA)
- Machine Translation (AREA)
- Document Processing Apparatus (AREA)
Description
- 1.
- Segmente für Vokalhälften und Halbvokalhälften: Sie geben in der Dynamik der spektralen Struktur die Bewegungen der Sprechorgane von bzw. zu der Artikulationsstelle des benachbarten Konsonanten an. Aufgrund der Silbenstruktur der meisten Sprachen ist häufig eine Konsonant-Vokal-Konsonant-Folge anzutreffen. Da die Bewegungen der Sprechorgane für eine gegebene Artikulationsstelle entsprechend den relativ unbeweglichen Teilen des menschlichen Ansatzrohres unabhängig von der Artikulationsart, d. h., unabhängig von den vorangehenden oder nachfolgenden Konsonanten, vergleichbar sind, ist daher für jeden Vokal nur ein Mikrosegment pro globaler Artikulationsstelle des vorherigen Konsonanten (= erste Hälfte des Vokals) und ein Mikrosegment pro Artikulationsstelle des folgenden Konsonanten (= zweite Hälfte des Vokals) nötig.
- 2.
- Segmente für quasi stationäre Vokalteile: Diese Segmente sind aus der Mitte von langen Vokalrealisierungen, die klanglich relativ konstant wahrgenommen werden, herausgetrennt. Sie werden in verschiedenen Textpositionen bzw. Kontexten eingesetzt, beispielsweise am Wortanfang, nach den Halbvokalsegmenten, die bestimmten Konsonanten bzw. Konsonantfolgen folgen, im Deutschen beispielsweise nach /h/, /j/ sowie /?/, zur Enddehnung, zwischen nicht diphthongischen Vokal-Vokalfolgen und in Diphthongen als Start- und Zielpositionen.
- 3.
- Konsonantische Segmente: Die konsonantischen Segmente sind so gebildet, daß sie unabhängig von der Art der Nachbarlaute für mehrere Vorkommen des Lautes entweder generell oder wie vornehmlich bei Plosiven im Kontext von bestimmten Lautgruppen verwendet werden können.
normal | [2v]o | v[5o] | [5o]n | [2n]t | t[2t] | [2t] . . . |
Symbol | % | % | +1 | +2 | +3 | +4 |
gedehnt | [2v]o | v[5o] | [6o]n | [4n]t | t[5t] | [6t]... |
normal | [2S]r | [2r]I | r[3I] | [3I]m | [2m]p | p[2p] | [2p]... |
Symbol | % | % | % | +1 | +2 | +3 | +4 |
gedehnt | [2S]r | [2r]I | r[3I] | [4I]m | [4m]p | p[5p] | [6p]... |
normal | d[2d] | [2d]a | d[4a] | [4a]... |
Symbol | % | % | % | +2 |
gedehnt | d[2d] | [2d]a | d[4a] | [6a]... |
- Fig. 1
- ein Ablaufdiagramm des Sprachsyntheseverfahrens,
- Fig. 2
- ein Spektrogramm und Zeitsignal des Wortes "Phonetik" und
- Fig. 3
- das Wort "Frauenheld" im Zeitbereich.
- der phonologischen Länge eines Lautes, die bei jedem Phonem bezeichnet ist, beispielsweise /e:/ für langes 'e' in /fo'ne:tIK/,
- der Akzentuierung der Silbe, die in der Phonemkette vor der betonten Silbe bezeichnet ist, beispielsweise, /fo'ne:tIK/,
- den Regeln für phrasenfinale Dehnung und
- ggf. andere Regeln, die auf der Abfolge von akzentuierten Silben beruhen, wie beispielsweise die Längung von zwei betonten aufeinanderfolgenden Silben.
Artikulatoren und Artikulationsstellen und deren Bezeichnung | |||
Zusammenfassung | Bezeichnung | Artikulator | Artikulationsstelle |
labial | bilabial | Unterlippe | Oberlippe |
labiodental | Unterlippe | obere Schneidezähne | |
alveolar | dental alveolar | Zungenspitze | ober Schneidezähne |
Zungenspitze oder Zungenblatt | Zahndamm, Alveolen | ||
velar | palatal | vorderer Zungenrücken | harter Gaumen, Palatum |
velar | mittlerer Zungenrücken | weicher Gaumen, Velum | |
uvular | hinterer Zungenrücken | Zäpfchen, Uvulum | |
-- | pharyngeal | Zungenwurzel | hintere Rachenwand |
glottal | Stimmlippe | Stimmlippe |
(a)t = (a)d = (a)s = (a)z = (a)(ts) = (a)(tS) = (a)(dZ)
= (a)n = (a)1.
- die ersten Hälften der Monophthonge
/i:, I, e:, E, E:, a(:), O, o:, U, u:, y:, Y, 2:, 9, @, 6/, die nach einem labial, alveolar bzw. velar gebildeten Laut auftreten; - die zweiten Hälften der Monophthonge
/I:, I, e:, E, E:, a(:), O, o:, U, u:, y:, Y, 2:, 9, @, 6/ vor einem labialen, alveolaren oder velaren Laut; - Erste und zweite Hälften der Konsonanten /h/ und /j/
aus den Kontexten:
- nicht-offener ungerundeter Vordervokal /i:, I, e, E, E:/,
- nicht-offener gerunder Vordervorkal /y:, Y, 2:, 9/,
- offener ungerundeter zentrale Vokal /a(:), @; 6/,
- nicht-offener gerunderter Hinterzungenvokal /O, o:, U, u:/.
- wortinitial,
- nach den Halbvokalsegmenten /h/, /j/ sowie um /?/,
- zur Enddehnung, wenn auf einer Endsilbe komplexe Tonbewegungen realisiert werden müssen,
- zwischen nicht diphthongischen Vokal-Vokal-Folgen, sowie
- in Diphthongen als Start- und Zielpositionen.
Claims (15)
- Digitales Sprachsyntheseverfahren, bei dem vorab Äußerungen einer Sprache aufgenommen, die aufgenommenen Äußerungen in Sprachsegmente geteilt und die Segmente bestimmten Phonemen zuordbar abgespeichert werden, wobei dann jeweils ein als Sprache auszugebender Text in eine Phonemkette überführt wird und die abgespeicherten Segmente in einer durch diese Phonemkette definierten Reihenfolge aufeinanderfolgend ausgegeben werden, wobei eine Analyse an dem als Sprache auszugebenden Text erfolgt und damit der Phonemkette ergänzende Informationen liefert, die das Zeitreihensignal der für die Sprachausgabe aneinanderzureihenden Sprachsegmente beeinflussen, dadurch gekennzeichnet, daß Mikrosegmente als Sprachsegmente verwendet werden, die bestehen aus:Segmenten für Vokalhälften und Halbvokalhälften, wobei Vokale, die zwischen Konsonanten stehen, in zwei Mikrosegmente, eine erste Vokalhälfte beginnend kurz hinter dem Vokalanfang bis zur Mitte des Vokals und eine zweite Vokalhälfte von der Vokalmitte bis kurz vor das Vokalende, geteilt sind,Segmenten für quasi stationäre Vokalteile, die aus der Mitte eines Vokals herausgeschnitten werden,konsonantischen Segmenten, die kurz hinter der vorderen Lautgrenze beginnen und kurz vor der hinteren Lautgrenze enden, undSegmenten für Vokal-Vokal-Folgen, die aus der Mitte eines Vokal-Vokalübergangs herausgeschnitten werden.
- Sprachsyntheseverfahren nach Anspruch 1, dadurch gekennzeichnet, daß die Segmente für Vokalhälften und Halbvokalhälften in einer Konsonant-Vokal- oder Vokal-Konsonant-Folge für jede der Artikulationsstellen des benachbarten Konsonanten, nämlich labial, alveolar oder velar, gleich sind.
- Sprachsyntheseverfahren nach Anspruch 1 oder 2, dadurch gekennzeichnet, daß die Segmente für quasi stationäre Vokalteile vorgesehen sind für Vokale an Wortanfängen und Vokal-Vokal-Folgen sowie für die Laute /h/, /j/ und Glottalverschlüsse.
- Sprachsyntheseverfahren nach Anspruch 1, 2 oder 3, dadurch gekennzeichnet, daß die konsonantischen Segmente für Plosive in zwei Mikrosegmente geteilt sind, ein erstes Segment, das die Verschlußphase umfaßt, und ein zweites Segment, das die Lösungsphase umfaßt.
- Sprachsyntheseverfahren nach Anspruch 4, dadurch gekennzeichnet, daß die Verschlußphase für alle Plosive durch Aneinanderreihen von digitalen Nullen erreicht wird.
- Sprachsyntheseverfahren nach Anspruch 4 oder 5, dadurch gekennzeichnet, daß die Lösungsphase der Plosive nach dem im Kontext folgenden Laut wie folgt differenziert werden; Lösung zu Vokalen:vorderen, ungerundeten Vokalen;vorderen, gerundeten Vokalen;tiefen bzw. zentralisierten Vokalen undhinteren, gerundeten Vokalen sowielabialalveolar undvelar.
- Sprachsyntheseverfahren nach Anspruch 1, 2, 3, 4, 5 oder 6, dadurch gekennzeichnet, daß mit der Analyse Sprachpausen erkannt werden und die Phonemkette an diesen Stellen mit Pausesymbolen zu einer Symbolkette ergänzt wird, wobei bei der Aneinanderreihung der Mikrosegmente an den Pausesymbolen digitale Nullen im Zeitreihensignal eingefügt werden.
- Sprachsyntheseverfahren nach Anspruch 1, 2, 3, 4, 5, 6 oder 7, dadurch gekennzeichnet, daß mit der Analyse Phrasengrenzen erkannt werden und die Phonemkette an diesen Stellen mit Dehnungssymbolen zu einer Symbolkette ergänzt wird, wobei bei der Aneinanderreihung der Mikrosegmente an den Markierungen eine Abspieldauerdehnung im Zeitbereich erfolgt.
- Sprachsyntheseverfahren nach Anspruch 1, 2, 3, 4, 5, 6, 7 oder 8, dadurch gekennzeichnet, daß mit der Analyse Betonungen erkannt werden und die Phonemkette an diesen Stellen mit Betonungssymbolen für verschiedene Betonungswerte zu einer Symbolkette ergänzt wird, wobei bei der Aneinanderreihung der Mikrosegmente entsprechend dem Betonungssymbol das Zeitsignal ungekürzt oder gekürzt wiedergegeben wird.
- Sprachsyntheseverfahren nach Anspruch 8 oder 9, dadurch gekennzeichnet, daß 5 Kürzungsstufen durch Markierungen am Zeitreihensignal der Mikrosegmente vorgesehen sind.
- Sprachsyntheseverfahren nach Anspruch 8 und 10, dadurch gekennzeichnet, daß die Abspieldauerdehnung für phrasenfinale Silben bei geschlossenen Silben ab dem zweiten Mikrosegment des Vokals durch Erhöhen der Kürzungsstufe zur längeren Abspieldauer um jeweils eine Stufe erfolgt und bei offenen Silben für das zweite Mikrosegment des Vokals durch Erhöhen der Kürzungsstufe zur längeren Abspieldauer um zwei Stufen erfolgt.
- Sprachsyntheseverfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß mit der Analyse Intonationen zugeordnet werden und die Phonemkette an diesen Stellen mit Intonationssymbolen zu einer Symbolkette ergänzt wird, wobei bei der Aneinanderreihung der Mikrosegmente an den Intonationssymbolen eine Grundfrequenzveränderung bestimmter Teile der Perioden von Mikrosegmenten im Zeitbereich durchgeführt wird.
- Sprachsyntheseverfahren nach Anspruch 12, dadurch gekennzeichnet, daß zur Senkung der Grundfrequenz bestimmte Abtastwerte ergänzt oder zur Erhöhung der Grundfrequenz Abtastwerte in der offenen Phase der Schwingungsperiode der Stimmlippen übersprungen werden.
- Sprachsyntheseverfahren nach Anspruch 8, 9, 10, 11, 12 oder 13, dadurch gekennzeichnet, daß die Symbolkette unter Berücksichtigung der Phonemreihenfolge und der Symbole in eine die Reihenfolge der Mikrosegmente und deren Abwandlungen repräsentierende Mikrosegmentkette überführt wird.
- Sprachsyntheseverfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß die Mikrosegmente mit dem ersten Abtastwert nach dem ersten positiven Nulldurchgang beginnen und mit dem letzten Abtastwert vor dem letzten positiven Nulldurchgang enden.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE19610019A DE19610019C2 (de) | 1996-03-14 | 1996-03-14 | Digitales Sprachsyntheseverfahren |
DE19610019 | 1996-03-14 | ||
PCT/DE1997/000454 WO1997034291A1 (de) | 1996-03-14 | 1997-03-08 | Auf mikrosegmenten basierendes sprachsyntheseverfahren |
Publications (2)
Publication Number | Publication Date |
---|---|
EP0886853A1 EP0886853A1 (de) | 1998-12-30 |
EP0886853B1 true EP0886853B1 (de) | 1999-08-04 |
Family
ID=7788258
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP97917259A Expired - Lifetime EP0886853B1 (de) | 1996-03-14 | 1997-03-08 | Auf mikrosegmenten basierendes sprachsyntheseverfahren |
Country Status (5)
Country | Link |
---|---|
US (1) | US6308156B1 (de) |
EP (1) | EP0886853B1 (de) |
AT (1) | ATE183010T1 (de) |
DE (2) | DE19610019C2 (de) |
WO (1) | WO1997034291A1 (de) |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19841683A1 (de) * | 1998-09-11 | 2000-05-11 | Hans Kull | Vorrichtung und Verfahren zur digitalen Sprachbearbeitung |
US6928404B1 (en) * | 1999-03-17 | 2005-08-09 | International Business Machines Corporation | System and methods for acoustic and language modeling for automatic speech recognition with large vocabularies |
US7369994B1 (en) * | 1999-04-30 | 2008-05-06 | At&T Corp. | Methods and apparatus for rapid acoustic unit selection from a large speech corpus |
DE19939947C2 (de) * | 1999-08-23 | 2002-01-24 | Data Software Ag G | Digitales Sprachsyntheseverfahren mit Intonationsnachbildung |
US20030191625A1 (en) * | 1999-11-05 | 2003-10-09 | Gorin Allen Louis | Method and system for creating a named entity language model |
US7085720B1 (en) * | 1999-11-05 | 2006-08-01 | At & T Corp. | Method for task classification using morphemes |
US8392188B1 (en) | 1999-11-05 | 2013-03-05 | At&T Intellectual Property Ii, L.P. | Method and system for building a phonotactic model for domain independent speech recognition |
US7286984B1 (en) | 1999-11-05 | 2007-10-23 | At&T Corp. | Method and system for automatically detecting morphemes in a task classification system using lattices |
US7213027B1 (en) | 2000-03-21 | 2007-05-01 | Aol Llc | System and method for the transformation and canonicalization of semantically structured data |
JP2002221980A (ja) * | 2001-01-25 | 2002-08-09 | Oki Electric Ind Co Ltd | テキスト音声変換装置 |
US20040030555A1 (en) * | 2002-08-12 | 2004-02-12 | Oregon Health & Science University | System and method for concatenating acoustic contours for speech synthesis |
US8768701B2 (en) * | 2003-01-24 | 2014-07-01 | Nuance Communications, Inc. | Prosodic mimic method and apparatus |
US7308407B2 (en) * | 2003-03-03 | 2007-12-11 | International Business Machines Corporation | Method and system for generating natural sounding concatenative synthetic speech |
JP2005031259A (ja) * | 2003-07-09 | 2005-02-03 | Canon Inc | 自然言語処理方法 |
US20050125236A1 (en) * | 2003-12-08 | 2005-06-09 | International Business Machines Corporation | Automatic capture of intonation cues in audio segments for speech applications |
JP4265501B2 (ja) * | 2004-07-15 | 2009-05-20 | ヤマハ株式会社 | 音声合成装置およびプログラム |
DE102005002474A1 (de) | 2005-01-19 | 2006-07-27 | Obstfelder, Sigrid | Handy und Verfahren zur Spracheingabe in ein solches sowie Spracheingabebaustein und Verfahren zur Spracheingabe in einen solchen |
US8924212B1 (en) * | 2005-08-26 | 2014-12-30 | At&T Intellectual Property Ii, L.P. | System and method for robust access and entry to large structured data using voice form-filling |
JP2008225254A (ja) * | 2007-03-14 | 2008-09-25 | Canon Inc | 音声合成装置及び方法並びにプログラム |
JP5119700B2 (ja) * | 2007-03-20 | 2013-01-16 | 富士通株式会社 | 韻律修正装置、韻律修正方法、および、韻律修正プログラム |
US7953600B2 (en) * | 2007-04-24 | 2011-05-31 | Novaspeech Llc | System and method for hybrid speech synthesis |
WO2008142836A1 (ja) * | 2007-05-14 | 2008-11-27 | Panasonic Corporation | 声質変換装置および声質変換方法 |
CN101312038B (zh) * | 2007-05-25 | 2012-01-04 | 纽昂斯通讯公司 | 用于合成语音的方法 |
US8321222B2 (en) * | 2007-08-14 | 2012-11-27 | Nuance Communications, Inc. | Synthesis by generation and concatenation of multi-form segments |
JP6047922B2 (ja) | 2011-06-01 | 2016-12-21 | ヤマハ株式会社 | 音声合成装置および音声合成方法 |
JP5914996B2 (ja) * | 2011-06-07 | 2016-05-11 | ヤマハ株式会社 | 音声合成装置およびプログラム |
US9368104B2 (en) | 2012-04-30 | 2016-06-14 | Src, Inc. | System and method for synthesizing human speech using multiple speakers and context |
PL401371A1 (pl) * | 2012-10-26 | 2014-04-28 | Ivona Software Spółka Z Ograniczoną Odpowiedzialnością | Opracowanie głosu dla zautomatyzowanej zamiany tekstu na mowę |
PL401372A1 (pl) * | 2012-10-26 | 2014-04-28 | Ivona Software Spółka Z Ograniczoną Odpowiedzialnością | Hybrydowa kompresja danych głosowych w systemach zamiany tekstu na mowę |
JP2015014665A (ja) * | 2013-07-04 | 2015-01-22 | セイコーエプソン株式会社 | 音声認識装置及び方法、並びに、半導体集積回路装置 |
DE102013219828B4 (de) * | 2013-09-30 | 2019-05-02 | Continental Automotive Gmbh | Verfahren zum Phonetisieren von textenthaltenden Datensätzen mit mehreren Datensatzteilen und sprachgesteuerte Benutzerschnittstelle |
RU2692051C1 (ru) | 2017-12-29 | 2019-06-19 | Общество С Ограниченной Ответственностью "Яндекс" | Способ и система для синтеза речи из текста |
FR3087566B1 (fr) * | 2018-10-18 | 2021-07-30 | A I O | Dispositif de suivi des mouvements et/ou des efforts d’une personne, methode d’apprentissage dudit dispositif et procede d’analyse des mouvements et/ou des efforts d’une personne |
US11302300B2 (en) * | 2019-11-19 | 2022-04-12 | Applications Technology (Apptek), Llc | Method and apparatus for forced duration in neural speech synthesis |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
BG24190A1 (en) * | 1976-09-08 | 1978-01-10 | Antonov | Method of synthesis of speech and device for effecting same |
JPS5919358B2 (ja) * | 1978-12-11 | 1984-05-04 | 株式会社日立製作所 | 音声内容伝送方式 |
JPH0642158B2 (ja) * | 1983-11-01 | 1994-06-01 | 日本電気株式会社 | 音声合成装置 |
US4692941A (en) * | 1984-04-10 | 1987-09-08 | First Byte | Real-time text-to-speech conversion system |
DE69028072T2 (de) * | 1989-11-06 | 1997-01-09 | Canon Kk | Verfahren und Einrichtung zur Sprachsynthese |
KR940002854B1 (ko) * | 1991-11-06 | 1994-04-04 | 한국전기통신공사 | 음성 합성시스팀의 음성단편 코딩 및 그의 피치조절 방법과 그의 유성음 합성장치 |
JP3083640B2 (ja) * | 1992-05-28 | 2000-09-04 | 株式会社東芝 | 音声合成方法および装置 |
US5878396A (en) * | 1993-01-21 | 1999-03-02 | Apple Computer, Inc. | Method and apparatus for synthetic speech in facial animation |
EP0681729B1 (de) | 1993-01-30 | 1999-09-08 | Korea Telecommunications Authority | System zur sprachsynthese und spracherkennung |
JP3085631B2 (ja) * | 1994-10-19 | 2000-09-11 | 日本アイ・ビー・エム株式会社 | 音声合成方法及びシステム |
US5864812A (en) * | 1994-12-06 | 1999-01-26 | Matsushita Electric Industrial Co., Ltd. | Speech synthesizing method and apparatus for combining natural speech segments and synthesized speech segments |
-
1996
- 1996-03-14 DE DE19610019A patent/DE19610019C2/de not_active Expired - Fee Related
-
1997
- 1997-03-08 AT AT97917259T patent/ATE183010T1/de not_active IP Right Cessation
- 1997-03-08 WO PCT/DE1997/000454 patent/WO1997034291A1/de active IP Right Grant
- 1997-03-08 DE DE59700315T patent/DE59700315D1/de not_active Expired - Fee Related
- 1997-03-08 US US09/142,728 patent/US6308156B1/en not_active Expired - Fee Related
- 1997-03-08 EP EP97917259A patent/EP0886853B1/de not_active Expired - Lifetime
Also Published As
Publication number | Publication date |
---|---|
WO1997034291A1 (de) | 1997-09-18 |
DE59700315D1 (de) | 1999-09-09 |
US6308156B1 (en) | 2001-10-23 |
DE19610019A1 (de) | 1997-09-18 |
ATE183010T1 (de) | 1999-08-15 |
EP0886853A1 (de) | 1998-12-30 |
DE19610019C2 (de) | 1999-10-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP0886853B1 (de) | Auf mikrosegmenten basierendes sprachsyntheseverfahren | |
DE69028072T2 (de) | Verfahren und Einrichtung zur Sprachsynthese | |
DE69719654T2 (de) | Grundfrequenzmuster enthaltende Prosodie-Datenbanken für die Sprachsynthese | |
DE69506037T2 (de) | Audioausgabeeinheit und Methode | |
DE69909716T2 (de) | Formant Sprachsynthetisierer unter Verwendung von Verkettung von Halbsilben mit unabhängiger Überblendung im Filterkoeffizienten- und Quellenbereich | |
DE69821673T2 (de) | Verfahren und Vorrichtung zum Editieren synthetischer Sprachnachrichten, sowie Speichermittel mit dem Verfahren | |
Gårding | A generative model of intonation | |
DE60112512T2 (de) | Kodierung von Ausdruck in Sprachsynthese | |
WO2000011647A1 (de) | Verfahren und vorrichtungen zur koartikulationsgerechten konkatenation von audiosegmenten | |
EP0058130B1 (de) | Verfahren zur Synthese von Sprache mit unbegrenztem Wortschatz und Schaltungsanordnung zur Durchführung des Verfahrens | |
EP1110203B1 (de) | Vorrichtung und verfahren zur digitalen sprachbearbeitung | |
US6829577B1 (en) | Generating non-stationary additive noise for addition to synthesized speech | |
KR101029493B1 (ko) | 음성 신호 합성 방법, 컴퓨터 판독가능 저장 매체 및 컴퓨터 시스템 | |
Kumar et al. | Significance of durational knowledge for speech synthesis system in an Indian language | |
Furtado et al. | Synthesis of unlimited speech in Indian languages using formant-based rules | |
JPH0580791A (ja) | 音声規則合成装置および方法 | |
DE19939947C2 (de) | Digitales Sprachsyntheseverfahren mit Intonationsnachbildung | |
JPS62138898A (ja) | 音声規則合成方式 | |
JPS5972494A (ja) | 規則合成方式 | |
Takeda et al. | Analysis of prominence in spoken Japanese sentences and application to text-to-speech synthesis | |
COLEMAN | The Secret History of Prosodic and Autosegmental Phonology | |
JPS63174100A (ja) | 音声規則合成方式 | |
Zhu et al. | A New Chinese Speech Synthesis Method Apply in Chinese Poetry Learning | |
Nooteboom et al. | Speech synthesis by rule; Why, what and how? | |
Shetake | anagri Text To Speech Conversion |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 19980912 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT CH DE FR GB LI |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAG | Despatch of communication of intention to grant |
Free format text: ORIGINAL CODE: EPIDOS AGRA |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
17Q | First examination report despatched |
Effective date: 19990414 |
|
GRAH | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOS IGRA |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT CH DE FR GB LI |
|
REF | Corresponds to: |
Ref document number: 183010 Country of ref document: AT Date of ref document: 19990815 Kind code of ref document: T |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REF | Corresponds to: |
Ref document number: 59700315 Country of ref document: DE Date of ref document: 19990909 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: NV Representative=s name: PATENTANWAELTE SCHAAD, BALASS, MENZL & PARTNER AG |
|
GBT | Gb: translation of ep patent filed (gb section 77(6)(a)/1977) |
Effective date: 19990831 |
|
ET | Fr: translation filed | ||
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed | ||
REG | Reference to a national code |
Ref country code: GB Ref legal event code: IF02 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20030305 Year of fee payment: 7 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20040308 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: AT Payment date: 20040308 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: CH Payment date: 20040323 Year of fee payment: 8 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20040330 Year of fee payment: 8 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee | ||
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050308 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050331 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20050331 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20051130 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20051130 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20070321 Year of fee payment: 11 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20081001 |