CN111816157B - Music score intelligent video-singing method and system based on voice synthesis - Google Patents
Music score intelligent video-singing method and system based on voice synthesis Download PDFInfo
- Publication number
- CN111816157B CN111816157B CN202010590726.0A CN202010590726A CN111816157B CN 111816157 B CN111816157 B CN 111816157B CN 202010590726 A CN202010590726 A CN 202010590726A CN 111816157 B CN111816157 B CN 111816157B
- Authority
- CN
- China
- Prior art keywords
- music score
- audio
- abc
- splicing
- notes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 21
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 21
- 238000012549 training Methods 0.000 claims abstract description 35
- 230000002194 synthesizing effect Effects 0.000 claims abstract description 11
- 238000002360 preparation method Methods 0.000 claims abstract description 10
- 230000011218 segmentation Effects 0.000 claims abstract description 10
- 230000008569 process Effects 0.000 claims abstract description 6
- 238000004590 computer program Methods 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 9
- 230000000630 rising effect Effects 0.000 claims description 6
- 238000012800 visualization Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 5
- 238000004364 calculation method Methods 0.000 abstract description 2
- 230000000007 visual effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000011160 research Methods 0.000 description 2
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 description 1
- 241001442654 Percnon planissimum Species 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004883 computer application Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000004936 stimulating effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Electrically Operated Instructional Devices (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
The invention provides a music score intelligent video-singing method and a music score intelligent video-singing system based on voice synthesis, wherein the method comprises the following steps: step one, data preparation, namely inputting and analyzing an abc music score to obtain pitch and duration information of each note in the specific abc music score; step two, training parameters, namely generating notes with the length within 5 when training data are made, namely dividing all notes into a group of 5 notes when a complete abc music score is processed; step three, synthesizing audio splicing, specifically comprising three substeps of music score segmentation identification, segment splicing, waveform alignment and blank segment filling; and step four, performing visual display on the synthesized audio. The invention solves the technical problems of large calculation amount in the training process, obvious splicing trace in direct splicing, splicing noise and the like, and the difference is difficult to distinguish by comparing the effects of the generated audio and the original data.
Description
Technical Field
The invention belongs to the field of computers, and particularly relates to a music score intelligent video-singing method and system based on voice synthesis.
Background
In recent years, with the continuous development of networks, network education is continuously developed due to the continuous updating and iteration of mobile phone application and computer application, subjects of art are special, communication and mutual feedback of teachers and students are emphasized, students need to receive feedback in time when learning the class of courses to correctly recognize own errors, for example, when music learning is performed, each student simply looks at a music score and sings the music score, the teachers cannot give consideration to each student at the same time, and when the students learn the class of music, the students preferably look at the eyes, listen to ears, sing in the mouth and cooperate with multiple senses, so that the better subjects of learning the music and other stimulating senses can be realized.
The invention researches a video-song teaching block of a music on-line teaching platform, hopes that music score video-song can be changed from the traditional professional teacher to the computer for simulating the real-person singing method to sing the music score, so that students can flexibly learn various music scores and play a great role in expanding a database for the teacher or the platform, and the research problem of the invention is that the computer is used for completing the music score video-song task.
Music score sing is a problem similar to speech synthesis, and the current speech synthesis technology reaches the level of putting on the market, the music score can be regarded as a special language, and all the computer needs to learn the pronunciation of each note. The music score gives information such as beats in the information of the beginning, so the information needs to be brought into all notes in the character string during processing, the character string contains the information of the duration and the pitch of each note, but the specific application has the technical problems that too large training data can cause training failure, splicing traces are obvious when direct splicing is carried out, noise is generated, and the like.
Disclosure of Invention
The invention provides a music score intelligent video-singing method and system based on voice synthesis, which can translate a music score into a new language to be fit with the corresponding mapping relation of characters and pronunciations of a certain language, solves the technical problems of large calculation amount in the training process, obvious splicing trace in direct splicing, splicing noise and the like, and is difficult to distinguish the difference by comparing the effects of generated audio and original data.
In order to solve the above problems, the present invention provides a music score intelligent video-singing method based on speech synthesis, the method comprising:
step one, data preparation, namely inputting and analyzing an abc music score to obtain pitch and duration information of each note in the specific abc music score;
step two, training parameters, namely generating notes with the length within 5 when training data are made, namely dividing all notes into a group of 5 notes when a complete abc music score is processed;
step three, synthesizing audio splicing, specifically comprising three substeps of music score segmentation identification, segment splicing, waveform alignment and blank segment filling;
and fourthly, visually displaying the synthesized audio.
In a second aspect, an embodiment of the present application provides a music score intelligent video-song system based on speech synthesis, where the system includes:
the data preparation module is used for inputting and analyzing the abc music score to obtain the pitch and duration information of each note in the specific abc music score;
the training parameter module generates notes with the length within 5 when training data are produced, namely, all notes of a complete abc music score are divided into a group of 5 notes when the complete abc music score is processed;
the synthesis audio splicing module comprises a music score segmentation identification sub-module, a segment splicing sub-module and a waveform alignment and blank segment filling sub-module;
and the visualization module is used for visually displaying the synthesized audio.
In a third aspect, an embodiment of the present application provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the method described in the embodiment of the present application.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which is stored a computer program, where the computer program is configured to:
which when executed by a processor implements a method as described in embodiments of the present application.
Drawings
FIG. 1 is a flow chart of music score intelligent video-song based on speech synthesis according to the present invention;
fig. 2 is a diagram of the effect of synthesizing audio results based on a score according to the present invention.
Detailed Description
In order to make the objects, technical processes and technical innovation points of the present invention more clearly illustrated, the present invention is further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. In addition, the technical features involved in the embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
In order to achieve the above purpose, the invention provides a music score intelligent video-singing method based on voice synthesis. The main process is shown in fig. 1, and the method comprises the following steps:
step one, data preparation, namely inputting and analyzing an abc music score to obtain pitch and duration information of each note in the specific abc music score;
the data to be processed in the application is an abc file, the abc file comprises two parts of information, the first five parts of information are rhythm, tone and the like of a music score, the lower part of the information is notes, the music score is different from a language, the notation of the whole music score is specified in the head of the music score, and the language is that each word has an independent pronunciation rule, so when the abc music score is processed, a similar processing method needs to be considered, and the score information in the head is brought into each note.
Step two, training parameters, namely generating notes with the length within 5 when training data are made, namely dividing all notes of a complete abc music score into a group of 5 notes when the complete abc music score is processed;
step three, synthesizing audio splicing, specifically comprising three substeps of music score segmentation identification, segment splicing, waveform alignment and blank segment filling;
and step four, performing visual display on the synthesized audio.
Preferably, the data preparing step further comprises: each note setting comprises three parts of duration, note and pitch, wherein the unit of the shortest duration selects 1/8 beat, the duration of the note is 1/8, 1/4, 3/8, 1/2, 3/4 and 1 beat, the range of the note is f 3-f #5, data because the collection of human voice data is difficult, the vocallid software is used for synthesizing audio to replace human voice, the falling half pitch is expressed by the rising half pitch of the falling half pitch, and in order to mark the data accurately, all the tones expressed by the black keys are uniformly expressed by the rising half pitch. By the combined mode, the music score header information can be brought into each note, and the abc music score translation problem is solved.
Preferably, the training process further comprises: this application has used the script to generate 11000 data totally, and the data set divides into 10000 data as training data, and 1000 data remain and are used for testing data test model effect, and the test mode is artifical listening, distinguishes whether the duration and the pronunciation of sound are accurate. The alignment condition of the check point and the current encoder and decoder can be generated every 1000 training steps, and the training can be recovered from the check point again after the training is interrupted in the midway; the number # and Arabic numerals are both replaced by English letters, the length of the bar is still fixed, if the pronunciation word is short, the data with unfixed length is used, and the 'r' sound is directly added into the synthesized audio in the subsequent synthesis.
A Mel scale spectrogram with the bandwidth of 80 is used as target output of a decoder, the sample rate is 20000hz, the frame length is 50ms, the frame offset is 12.5ms, the optimizer adopts conventional adam, the batch size is 32, and the condition of overfitting of a model can be effectively reduced by the delayed learning rate.
Preferably, the synthetic audio splicing specifically includes:
performing segmentation recognition on a music score, namely splitting an abc file, taking 5 notes as a group, splitting the abc file into a plurality of measures, splitting the abc file when the r symbol is met, taking the rest notes as a measure, processing each measure by using a trained model to synthesize audio, and generating a wav file corresponding to each measure;
segment splicing, namely splicing the audio synthesized by the segments;
waveform alignment and blank section filling, for a continuously sung music score, a rough splicing mark can be generated, firstly, software is utilized to carry out simple splicing observation, two basic problems need to be processed, firstly, the head and the tail are pinched and removed, short blank time exists at the head and the tail of a synthesized audio, therefore, the blank position needs to be trimmed, as the head and the tail blank time of the synthesized audio are almost the same, the processing can be uniformly carried out, the second problem is the problem of 'papa' sound of the rough splicing, the main reason is that the sound is received after a certain sound, namely, the four sounds of 'duo', 'Re', 'Mi' and 'La', namely, the situation can be generated, and the noise is found to be caused by sudden change of the waveform at the position after the waveform diagram is amplified. In order to solve the problems, the following scheme is adopted in the application: the 'r' in the abc music score represents an unvoiced empty sound segment, when the audio is synthesized, the audio with blank duration is directly added to the part needing to be added as a buffer zone, sox is used for synthesizing the measure, the r sound comprises two parts, namely pronunciation length and r, the corresponding 'r' audio is selected for processing according to the requirements of the abc music score, and each splicing part is processed and output by using a very short r sound which can eliminate the noise and does not influence the duration feeling. This approach has unexpected consequences for the elimination of noise. After experiments, as shown in fig. 2, the blank r segment added at the splicing part can be seen after the result diagram of the synthesized audio frequency of the music score is amplified, and no obvious sense is felt on the hearing. The actual effect is the same as that of the audio frequency which is directly synthesized manually.
As another aspect, the present application further provides a music score intelligent video-song system based on speech synthesis, the system including:
the data preparation module is used for inputting and analyzing the abc music score to obtain the pitch and duration information of each note in the specific abc music score;
the training parameter module generates notes with the length within 5 when training data are produced, namely, all notes of a complete abc music score are divided into a group of 5 notes when the complete abc music score is processed;
the synthesis audio splicing module comprises a music score segmentation identification sub-module, a segment splicing sub-module and a waveform alignment and blank segment filling sub-module;
and the visualization module is used for visually displaying the synthesized audio.
Preferably, the data preparation module further comprises: each note setting comprises three parts of duration, note and pitch, wherein the unit of the shortest duration selects 1/8 beat, the duration of the note is 1/8, 1/4, 3/8, 1/2, 3/4 and 1 beat, the range of the note is f 3-f #5, data because the collection of human voice data is really difficult, the vocalogid software is used for synthesizing audio to replace human voice, the half pitch is represented by the half pitch of the half pitch, and all the tones represented by the black keys are uniformly represented by the half pitch in order to mark the data accurately.
Preferably, the training parameter module is further configured to:
the alignment condition of the check point and the current encor and decoder can be generated every 1000 training steps, and the training can be recovered from the check point again after the training is interrupted in the midway;
the number # and Arabic numerals are both replaced by English letters, the length of the bar is still fixed, if the pronunciation word is short, the data with unfixed length is used, and the 'r' sound is directly added into the synthesized audio in the subsequent synthesis.
Preferably, the synthesized audio splicing module specifically includes:
the music score segmentation recognition sub-module is used for splitting an abc file, splitting the abc file into a group of 5 notes and a plurality of measures, splitting the abc file when the r symbol is met, using the rest notes as a measure, processing each measure by using a trained model to synthesize audio, and generating a wav file corresponding to each measure;
the segment splicing submodule is used for splicing the audio synthesized by segments;
the waveform alignment and blank section filling submodule is used for 'r' in an abc music score to represent an unvoiced blank section, when the audio is synthesized, the audio with blank duration is directly added to a part needing to be added to serve as a buffer zone, sox is used for synthesizing a measure, r sound is composed of two parts, namely pronunciation length and r, the corresponding 'r' audio is selected according to the requirements of the abc music score to be processed, and each section of spliced part is processed and output by using a very short r sound which can eliminate the noise and does not influence the duration feeling.
As another aspect, the present application further provides a computer device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the embodiments of the present application when executing the computer program.
As another aspect, the present application also provides a computer-readable storage medium, which may be the computer-readable storage medium included in the foregoing device in the foregoing embodiment; or it may be a separate computer readable storage medium not incorporated into the device. The computer readable storage medium stores one or more programs for use by one or more processors in performing the methods described in the embodiments of the present application.
It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. If implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic Gate circuit for realizing a logic function for a data signal, an asic having an appropriate combinational logic Gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), and the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a separate product, may also be stored in a computer-readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. While embodiments of the present application have been shown and described above, it will be understood that the above embodiments are exemplary and should not be construed as limiting the present application and that changes, modifications, substitutions and alterations in the above embodiments may be made by those of ordinary skill in the art within the scope of the present application.
Claims (8)
1. A music score intelligent video-singing method based on voice synthesis comprises the following steps:
step one, data preparation, namely inputting and analyzing an abc music score to obtain pitch and duration information of each note in the specific abc music score;
step two, training parameters, namely generating notes with the length within 5 when training data are made, namely dividing all notes of a complete abc music score into a group of 5 notes when the complete abc music score is processed;
step three, synthesizing audio splicing, specifically comprising three substeps of music score segmentation identification, segment splicing, waveform alignment and blank segment filling;
fourthly, visually displaying the synthesized audio;
the synthesized audio concatenation specifically includes:
segmenting and identifying a music score, namely segmenting an abc file, segmenting the abc file into a plurality of measures by taking 5 notes as a group, segmenting the abc file when meeting an r symbol, taking the rest notes as a measure, processing each measure by using a trained model to synthesize audio, and generating a wav file corresponding to each measure;
segment splicing, namely splicing the audio synthesized by the segments;
the waveform is aligned and the blank section is filled, r' in the abc music score represents an unvoiced blank sound section, when the audio is synthesized, the audio with blank duration is directly added to the part needing to be added to serve as a buffer zone, sox is used for synthesizing the measure, r sound is composed of two parts, namely pronunciation length and r, the corresponding r audio is selected according to the requirements of the abc music score for processing, and each section of spliced part is processed and output by using a very short r sound which can eliminate the noise and does not influence the duration feeling.
2. The method of claim 1, wherein the data preparation step further comprises: each note setting comprises three parts of duration, note and pitch, wherein 1/8 beat is selected in the shortest unit of duration, the duration of the note is 1/8, 1/4, 3/8, 1/2, 3/4 and 1 beat, the range of the note is f 3-f #5, because the human voice data is difficult to collect, audio is synthesized by using vocaloloid software to replace the human voice, the falling half tone is expressed by the rising half tone of the falling half tone, and in order to mark accurately, the tones expressed by all black keys are uniformly expressed by the rising half tone.
3. The method of claim 1, wherein the training process further comprises:
the alignment condition of the check point and the current encoder and decoder can be generated every 1000 training steps, the training is interrupted in the midway, and the training is recovered from the check point again;
the number # and Arabic numerals are both replaced by English letters, the length of the bar is still fixed, if the pronunciation word is short, the data with unfixed length is used, and the 'r' sound is directly added into the synthesized audio in the subsequent synthesis.
4. A music score intelligent video-song system based on speech synthesis, the system comprising:
the data preparation module is used for inputting and analyzing the abc music score to obtain the pitch and duration information of each note in the specific abc music score;
the training parameter module generates notes with the length within 5 when training data are produced, namely, all notes of a complete abc music score are divided into a group of 5 notes when the complete abc music score is processed;
the synthesis audio splicing module comprises a music score segmentation identification sub-module, a segment splicing sub-module and a waveform alignment and blank segment filling sub-module;
the visualization module is used for visually displaying the synthesized audio;
the synthesized audio splicing module specifically comprises:
the music score segmentation recognition sub-module is used for splitting an abc file, splitting the abc file into a group of 5 notes and a plurality of measures, splitting the abc file when the r symbol is met, using the rest notes as a measure, processing each measure by using a trained model to synthesize audio, and generating a wav file corresponding to each measure;
the segment splicing submodule is used for splicing the audio synthesized by segments;
the waveform alignment and blank section filling submodule is used for 'r' in an abc music score to represent an unvoiced blank section, when the audio is synthesized, the audio with blank duration is directly added to a part needing to be added to serve as a buffer zone, sox is used for synthesizing a measure, r sound is composed of two parts, namely pronunciation length and r, the corresponding 'r' audio is selected according to the requirements of the abc music score to be processed, and each spliced part is processed and output by using a very short r sound which can eliminate the noise and does not influence the duration feeling.
5. The system of claim 4, wherein the data preparation module further comprises: each note setting comprises three parts of duration, note and pitch, wherein 1/8 beat is selected in the shortest unit of duration, the duration of the note is 1/8, 1/4, 3/8, 1/2, 3/4 and 1 beat, the range of the note is f 3-f #5, because the human voice data is difficult to collect, audio is synthesized by using vocaloloid software to replace the human voice, the falling half tone is expressed by the rising half tone of the falling half tone, and in order to mark accurately, all the tones expressed by the black keys are uniformly expressed by the rising half tone.
6. The system of claim 4, wherein the training parameter module is further configured to:
the alignment condition of the check point and the current encoder and decoder can be generated every 1000 training steps, the training is interrupted in the midway, and the training is recovered from the check point again;
the number # and Arabic numerals are replaced by English letters, the lengths of the bars are still fixed, if the pronunciation words are short, data with unfixed lengths are used, and the 'r' sound is directly added into the synthesized audio in the subsequent synthesis.
7. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the method according to any of claims 1 to 3 when executing the computer program.
8. A computer-readable storage medium having stored thereon a computer program for: the computer program, when executed by a processor, implements the method of any one of claims 1-3.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010590726.0A CN111816157B (en) | 2020-06-24 | 2020-06-24 | Music score intelligent video-singing method and system based on voice synthesis |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010590726.0A CN111816157B (en) | 2020-06-24 | 2020-06-24 | Music score intelligent video-singing method and system based on voice synthesis |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111816157A CN111816157A (en) | 2020-10-23 |
CN111816157B true CN111816157B (en) | 2023-01-31 |
Family
ID=72854997
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010590726.0A Expired - Fee Related CN111816157B (en) | 2020-06-24 | 2020-06-24 | Music score intelligent video-singing method and system based on voice synthesis |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111816157B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111816148B (en) * | 2020-06-24 | 2023-04-07 | 厦门大学 | Virtual human voice and video singing method and system based on generation countermeasure network |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN2101314U (en) * | 1991-05-09 | 1992-04-08 | 北京电子专科学校 | Numbered musical notation recorded automatically playing music apparatus |
CN103902647A (en) * | 2013-12-27 | 2014-07-02 | 上海斐讯数据通信技术有限公司 | Music score identifying method used on intelligent equipment and intelligent equipment |
CN104978884A (en) * | 2015-07-18 | 2015-10-14 | 呼和浩特职业学院 | Teaching system of preschool education profession student music theory and solfeggio learning |
RU2690863C1 (en) * | 2015-10-25 | 2019-06-06 | Коммусикатор Лтд. | System and method for computerized teaching of a musical language |
JP6610715B1 (en) * | 2018-06-21 | 2019-11-27 | カシオ計算機株式会社 | Electronic musical instrument, electronic musical instrument control method, and program |
CN110148394B (en) * | 2019-04-26 | 2024-03-01 | 平安科技(深圳)有限公司 | Singing voice synthesizing method, singing voice synthesizing device, computer equipment and storage medium |
CN110738980A (en) * | 2019-09-16 | 2020-01-31 | 平安科技(深圳)有限公司 | Singing voice synthesis model training method and system and singing voice synthesis method |
-
2020
- 2020-06-24 CN CN202010590726.0A patent/CN111816157B/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
CN111816157A (en) | 2020-10-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10347238B2 (en) | Text-based insertion and replacement in audio narration | |
CN102360543B (en) | HMM-based bilingual (mandarin-english) TTS techniques | |
RU2690863C1 (en) | System and method for computerized teaching of a musical language | |
US9196240B2 (en) | Automated text to speech voice development | |
US6865533B2 (en) | Text to speech | |
US20090305203A1 (en) | Pronunciation diagnosis device, pronunciation diagnosis method, recording medium, and pronunciation diagnosis program | |
US20060004567A1 (en) | Method, system and software for teaching pronunciation | |
KR101992372B1 (en) | Learning system and method using sentence input and voice input of the learner | |
Beckman et al. | Methods for eliciting, annotating, and analyzing databases for child speech development | |
CN111816157B (en) | Music score intelligent video-singing method and system based on voice synthesis | |
CN110956870A (en) | Solfeggio teaching method and device | |
KR20070103095A (en) | System for studying english using bandwidth of frequency and method using thereof | |
Pyshkin et al. | Multimodal modeling of the mora-timed rhythm of Japanese and its application to computer-assisted pronunciation training | |
CN109165836A (en) | The processing of lyrics pronunciation and assessment method and system in a kind of singing marking | |
Van et al. | Adopting StudyIntonation CAPT tools to tonal languages through the example of Vietnamese | |
Ferris | Techniques and challenges in speech synthesis | |
Lan et al. | L2 accent and intelligibility by Chinese L2 speakers of English | |
KR102610871B1 (en) | Speech Training System For Hearing Impaired Person | |
CN114758560B (en) | Humming pitch evaluation method based on dynamic time warping | |
TWI806703B (en) | Auxiliary method and system for voice correction | |
Hussein et al. | Towards a computer-aided pronunciation training system for German learners of Mandarin-prosodic analysis | |
Hill et al. | Unrestricted text-to-speech revisited: rhythm and intonation. | |
Marsà Morales | Does L1 Catalan rhythm transfer to L2 English? | |
Nitisaroj et al. | The Lessac Technologies system for Blizzard Challenge 2010 | |
Walt | Your words are music to my ears: An analysis of the effects of musical affinity on the ability to identify composite pure tones as American English vowels |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20230131 |