CN102881283A - Method and system for processing voice - Google Patents

Method and system for processing voice Download PDF

Info

Publication number
CN102881283A
CN102881283A CN2011102043953A CN201110204395A CN102881283A CN 102881283 A CN102881283 A CN 102881283A CN 2011102043953 A CN2011102043953 A CN 2011102043953A CN 201110204395 A CN201110204395 A CN 201110204395A CN 102881283 A CN102881283 A CN 102881283A
Authority
CN
China
Prior art keywords
voice
parameter
speech sounds
speech
sound template
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011102043953A
Other languages
Chinese (zh)
Other versions
CN102881283B (en
Inventor
陈晓晓
李远友
向春
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics China R&D Center
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics China R&D Center, Samsung Electronics Co Ltd filed Critical Samsung Electronics China R&D Center
Priority to CN201110204395.3A priority Critical patent/CN102881283B/en
Publication of CN102881283A publication Critical patent/CN102881283A/en
Application granted granted Critical
Publication of CN102881283B publication Critical patent/CN102881283B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

The invention provides a method and a system for processing a voice. The system comprises a voice characteristic parameter acquisition module for acquiring voice characteristic parameters for representing voice characteristics of a first voice and a second voice, a voice template generation module for generating the voice characteristic parameter of the first voice into a voice template, and a voice processing module for adjusting the voice characteristic parameter of the second voice according to the voice template and applying the adjusted voice characteristic parameter to the second voice.

Description

The method and system that is used for speech processes
Technical field
The present invention relates to a kind of method and system for speech processes, more particularly, relate to a kind of method and system that can use sound template that voice are processed.
Background technology
In recent years, along with the fast development of voice processing technology, people are more and more deep to the understanding of voice, and multiple application about voice occurred, for example, speech recognition, record, repeat the words of others like a parrot etc.Because the starting point of various voice application is different, thereby these application differ from one another, and can satisfy all kinds of crowds' different demands.
Although many application and method about the voice change of voice in the speech processes have occurred in the prior art, but most of changes of voice are used and can only be processed voice with predetermined pattern, and be difficult to multifarious, variational voice are effectively processed and the change of voice, so that the user can't come voice are processed flexibly according to the actual requirements.Therefore, along with the continuous variation of the user's request of the widespread use of digital device and digital device, the existing change of voice is used and can't have been satisfied current and needs future development.In this case, need a kind of method and system that can come voice are processed to realize neatly the change of voice according to user's demand.
Summary of the invention
The object of the present invention is to provide a kind of method and system that can become sound template and use sound template that voice are processed next life according to user's request, thereby so that the user can more flexibly and process voice effectively, wherein, can produce sound template by the characteristics of speech sounds parameter of extracting voice signal.
According to an aspect of the present invention, provide a kind of speech processing system, described system comprises: the characteristics of speech sounds parameter acquisition module, for the characteristics of speech sounds parameter of the characteristics of speech sounds that obtains performance the first voice and the second voice; Voice masterplate generation module is used for the characteristics of speech sounds parameter of the first voice is generated as the voice masterplate; Speech processing module, for the characteristics of speech sounds parameter of adjusting the second voice according to sound template, and the characteristics of speech sounds parameter after will adjusting is applied to the second voice.
Described system also can comprise: the voice acquisition module is used for obtaining the first voice and/or the second voice.
Described system also can comprise: memory module is used for the storaged voice template.
Described characteristics of speech sounds can comprise at least one in volume, tone and the tone color characteristic of voice.
Described voice acquisition module can be chosen the first voice and/or the second voice from pre-stored voice.
Described voice acquisition module can use sound pick-up outfit to record the first voice and/or the second voice.
Described characteristics of speech sounds parameter can comprise at least one in the following parameter: frequency and the range parameter of the overtone of the predetermined quantity of the frequency of the fundamental tone of the volume parameter of performance volume characteristic, performance tone characteristic and range parameter, performance tone color characteristic.
The characteristics of speech sounds parameter acquisition module can directly arrange the every characteristics of speech sounds parameter that forms the first required voice of sound template, so that the characteristics of speech sounds parameter that arranges is generated as sound template by the sound template generation module.
Speech processing module is adjusted the characteristics of speech sounds parameter that the sound template of selecting from the sound template of storage comprises, and generates another sound template different from the sound template of selecting according to the characteristics of speech sounds parameter after adjusting by the sound template generation module.
According to a further aspect in the invention, also provide a kind of method of speech processing, described method comprises: the characteristics of speech sounds parameter of obtaining the characteristics of speech sounds of performance the first voice and the second voice; The characteristics of speech sounds parameter of the first voice is generated as the voice masterplate; Adjust the characteristics of speech sounds parameter of the second voice according to sound template, and the characteristics of speech sounds parameter after will adjusting is applied to the second voice.
Described method also can comprise: obtain the first voice and/or the second voice.
Described method also can comprise: the storaged voice template.
Described characteristics of speech sounds can comprise at least one in volume, tone and the tone color characteristic of voice.
Can from pre-stored voice, choose the first voice and/or the second voice.
Can use sound pick-up outfit to record the first voice and/or the second voice.
Described characteristics of speech sounds parameter can comprise at least one in the following parameter: frequency and the range parameter of the overtone of the predetermined quantity of the frequency of the fundamental tone of the volume parameter of performance volume characteristic, performance tone characteristic and range parameter, performance tone color characteristic.
The every characteristics of speech sounds parameter that forms the first required voice of sound template can directly be set, so that the characteristics of speech sounds parameter that arranges is generated as sound template.
The characteristics of speech sounds parameter that the sound template of selecting from the sound template of storage comprises is adjusted, and generated another sound template different from the sound template of selecting according to the characteristics of speech sounds parameter after adjusting.
The method of speech processing of the application of the invention and system can process voice according to user's demand more neatly, so that the result of speech processes is more true to nature and various, the purpose of user's entertainment life is enriched in realization.
Will be in ensuing description part set forth the present invention other aspect and/or advantage, some will be clearly by describing, and perhaps can learn through enforcement of the present invention.
Description of drawings
By the detailed description of carrying out below in conjunction with accompanying drawing, above-mentioned and/or other purpose, characteristics and advantage of the present invention will become apparent, wherein:
Fig. 1 is the block diagram that illustrates according to the speech processing system of exemplary embodiment of the present invention;
Fig. 2 is the process flow diagram that illustrates according to the method for speech processing of exemplary embodiment of the present invention;
Fig. 3 is the process flow diagram that illustrates according to the sound template generation method of another exemplary embodiment of the present invention;
Fig. 4 is the process flow diagram that sound template generation method in accordance with a further exemplary embodiment of the present invention is shown.
Embodiment
Below, exemplary embodiment of the present invention is described with reference to the accompanying drawings more fully, exemplary embodiment is shown in the drawings.Yet, can be with many different form exemplifying embodiment embodiment, and should not be construed as limited to exemplary embodiment set forth herein.On the contrary, thereby provide these embodiment disclosure will be thoroughly and complete, and will be fully the scope of exemplary embodiment be conveyed to those skilled in the art.In the accompanying drawings, identical label represents identical part.
Fig. 1 is the block diagram that illustrates according to the speech processing system 100 of exemplary embodiment of the present invention.With reference to Fig. 1, comprise according to the speech processing system 100 of exemplary embodiment of the present invention: characteristics of speech sounds parameter acquisition module 120, voice masterplate generation module 130 and speech processing module 140.
With reference to Fig. 1, characteristics of speech sounds parameter acquisition module 120 can be used for obtaining the characteristics of speech sounds parameter of at least a characteristics of speech sounds of performance (for example, the volume of voice, tone and tone color characteristic etc.).Only as example, the below will describe the method that the voice audio signals of using the PCM stream format (below, referred to as " pcm audio signal ") is obtained the characteristics of speech sounds parameter of at least a characteristics of speech sounds in performance volume, tone and the tone color characteristic.
Volume refers to the sound size strong and weak subjective feeling of people's ear to hearing, the amplitude size that its objective evaluation yardstick is sound.Therefore can show with the amplitude of pcm audio signal the volume of voice.
Tone is often referred to the signal with specific and stable pitch, is the height that sound sounds tune, depends primarily on frequency.The reaction of the sound people ear that frequency is high is that tone is high, and the reaction of the sound people ear that frequency is low is that tone is low.Tone is mainly determined by the fundamental frequency of sound, therefore, can pass through frequency (that is, fundamental frequency) and the amplitude of the fundamental tone of extraction pcm audio signal and obtain pitch parameters.
Tone color is the characteristic of sound, everyone voice have different tone colors, therefore can pick out different people according to its tone color, the difference of tone color depends on different overtones, each musical instrument, different people and all can sounding the sound that sends of object in, except a fundamental tone, also have the overtone of many different frequencies to follow, the various combination of the frequency of these overtones and amplitude has determined different tone colors just.Frequency and the amplitude of the overtone of predetermined quantity that therefore, can be by extracting sound signal are obtained the tone color characterisitic parameter.
Characteristics of speech sounds commonly used can also be summarised as fundamental tone, resonance peak, the linear prediction cepstrum coefficient coefficient, the digital parameters such as Mel frequency cepstral coefficient, by present more existing mainstream technologys, such as the Feature Extraction Technology based on LPCC, Feature Extraction Technology based on MFCC, Short Time Fourier Transform (processing the classic method of stationary signal) technology can be obtained at least one the following parameter that shows characteristics of speech sounds: the volume parameter of performance volume characteristic, frequency and the range parameter of the fundamental tone of performance tone characteristic, frequency and the range parameter of the overtone of the predetermined quantity of performance tone color characteristic.
After the extraction operation was finished, characteristics of speech sounds parameter acquisition module 120 can send to the characteristics of speech sounds parameter of obtaining sound template generation module 130 to generate sound template, perhaps keeps described parameter, subsequently these voice is processed to utilize these parameters.
Voice masterplate generation module 130 becomes the voice masterplate next life according to a plurality of characteristics of speech sounds parameter that obtains from characteristics of speech sounds parameter acquisition module 120, and with the voice template stores that generates in memory module 150, wherein, described voice masterplate refers to show the set of characteristics of speech sounds parameter of the multiple voice characteristic of special sound, described characteristics of speech sounds can comprise, but be not limited at least one in volume, tone color and the tone characteristic.Selectively, according to another embodiment, voice masterplate generation module 130 also can directly be input to speech processing module 140 with the sound template that generates to be come voice are processed.
In addition, also can according to forming the required various parameters of sound template each characteristics of speech sounds parameter be set directly by characteristics of speech sounds parameter acquisition module 120, and the characteristics of speech sounds parameter that arranges is delivered to sound template generation module 130, to generate self-defining voice masterplate.Specifically, in an embodiment of the present invention, can volume directly be set by the user, the frequency of the overtone of the frequency of fundamental tone and amplitude and predetermined quantity and amplitude, and the characteristics of speech sounds parameter that sets sent to sound template generation module 130, to generate the sound template of user's expectation.
In addition, also can be by the parameter of existing sound template being made amendment to generate new sound template.In this way, can increase easily the kind of the voice masterplate that can generate and use, thereby realize abundanter voice processing effect.
Speech processing module 140 is used for pending voice are processed.The voice masterplate that can select the user to expect according to user's request, and the sound template of selecting outputed to speech processing module 140, so that the user can process voice according to selected voice masterplate.In detail, speech processing module 140 can be come being adjusted from the characteristics of speech sounds parameter that pending voice extract by characteristics of speech sounds parameter acquisition module 120 according to the characteristics of speech sounds parameter that records in the voice masterplate of selecting, and the characteristics of speech sounds parameter after will adjusting is applied to pending voice, thereby makes pending voice have the characteristics of speech sounds of user's expectation.
For example, the fundamental frequency of pending voice and amplitude can be adjusted into respectively consistent with frequency and the amplitude of the fundamental tone that records in the voice masterplate of selecting, the frequency of each overtone of pending voice and amplitude can be adjusted into respectively consistent with frequency and the amplitude of each corresponding overtone of recording in the voice masterplate of selecting, also pending speech volume size can be adjusted into consistent with the volume that records in the voice masterplate of selecting, thereby make the volume of the voice that obtain, the volume that tone and tone color characteristic and voice masterplate can show, tone is consistent with the tone color characteristic, realizes the effect of the voice that imitation voice masterplate shows.
Only as example, suppose that the parameter of the pending voice that obtain by characteristics of speech sounds parameter acquisition module 120 is as follows: the frequency of fundamental tone and range parameter are (f 0, C 0), and having extracted 16 groups of overtone parameters, frequency and the range parameter of each overtone are respectively (f 1, C 1), (f 2, C 2) ..., (f 16, C 16), volume is V, wherein, and f 0, f 1... f 16Frequency parameter, C 0, C 1... C 16It is range parameter.The user uses 1 pair of pending voice of sound template to process, and wherein, the characteristics of speech sounds parameter that comprises in the sound template 1 is: frequency and the amplitude of fundamental tone are respectively (f R0, C R0), the frequency of overtone and range parameter are (f R1, C R1), (f R2, C R2) ..., (f R16, C R16), volume is V R, wherein, f R0, f R1... f R16Frequency parameter, C R0, C R1... C R16It is range parameter.For make pending voice after processing can with sound template in the characteristic voice that shows of characteristics of speech sounds parameter same or similar, respectively fundamental tone, overtone and the volume parameters of pending voice is adjusted into fundamental tone, overtone and the volume parameters of the record in the template, specifically, so that the speech parameter value of pending voice be adjusted to respectively: f 0=f R0, f 1=f R1, f 2=f R2..., f 16=f R16, C 0=C R0, C 1=C R1..., C 2=C R2, C 16=C R16, and so that the volume V of pending voice is adjusted into V R, that is to say, so that volume V=V R
After the adjustment of finishing the characteristics of speech sounds parameter for the treatment of processed voice, adjusted speech parameter is applied to pending voice, thereby finishes change of voice process.Specifically, in the present embodiment, by using and the corresponding inverse operation of operation that extracts the characteristics of speech sounds parameter information, the characteristics of speech sounds parameter after adjusting is applied to pending voice, thereby finish the change of voice of pending voice is processed.
Should be appreciated that said method only is exemplary, use the method that sound template processes pending voice and be not limited in this, can use sound template according to user's needs or predetermined arranging pending voice are processed.Perhaps the user can not use sound template that pending sound is carried out the change of voice, but each characteristics of speech sounds parameter of the pending voice that direct adjustment is extracted in speech processing module 140 is finished the change of voice process of pending voice.
In addition, also can in speech processing module 140, realize treated voice are adjusted and landscaping treatment, thereby so that described voice can obtain audio more true to nature.As example, only describe here by adjust the method for the tamber effect of voice with adjustment overtone parameter.
No matter voice, song, or the voice of musical instrument, they are not single-tones, but a complex tone.Namely fundamental tone and a series of overtone by voice consisted of.These overtones all are the multiples of fundamental frequency, and the characteristic of tone color is had very important impact.Overtone can be divided into low frequency overtone, intermediate frequency overtone and high frequency overtone.If the amplitude of low frequency overtone is stronger, tone color just shows mixed thickly; The amplitude of intermediate frequency overtone is more intense, and tone color just shows mellow and fullly, nature, harmony; The amplitude of high frequency overtone is more intense, tone color just shows brightly, clear thoroughly, parsing power is strong.
The frequency characteristic of the different formation tone colors of the quantity of overtone and overtone amplitude.This curve has just embodied the expressive force of tone color.The frequency characteristic of tone color is different.The intensity of 16 overtones of fundamental tone to the is drawn a straight line at coordinate, and this straight line just is called as best Western style of singing line.The frequency characteristic of tone color is more near this straight line, and the ratio of the basic, normal, high frequency overtone of described tone color is also balanced, and the expressive force of its tone color is also best.
Can carry out frequency processing to tone color by four sections balanced devices, improve the artistic expression of tone color.Audio frequency can be divided into 4 large frequency bands, that is:
HF:6kHz-16kHz affects expressive force, the parsing power of tone color;
MID HF:600Hz~6kHz affects lightness, the sharpness of tone color;
MID LF:200Hz~600Hz affects tone color and dynamics and compactedness;
LF:20Hz~200Hz affects mixed thickness and the richness of tone color.
If high-band frequency excessively a little less than, tone color the losing of color, charm, individual character that just become; If high-band frequency is excessively strong, tone color will become point make an uproar, hoarse, ear-piercing.If the frequency of medium-high frequency section excessively a little less than, it is dim, dim that tone color just becomes; If the frequency of medium-high frequency section is excessively strong, it is stiff that its tone color will become.If the frequency of medium and low frequency section excessively a little less than, it is hollow, unable, soft that tone color can become; If the frequency of medium and low frequency section is excessively strong, that tone color can become is stiff, lose vigor.If the frequency of low-frequency range excessively a little less than, it is thin, pale that tone color will become; If the frequency of low-frequency range is excessively strong, it is muddy that tone color can become.
Make tone color that aesthetic feeling be arranged, will enrich, have levels by overtone.After promoting a certain frequency range, also to consider the impact on other frequency ranges, generally consider sharpness and the richness of song.For example, female voice produces S sound (hiss) easily at HFS, then can eliminate the S sound at the 7-10KHz 3dB that decays; Man's voice domain is than low one the 8 degree interval of female voice, and frequency is hanged down a frequency multiplication, about 100Hz decay 3dB, can increase sharpness.In this way, can finish adjustment to tone color information.
As mentioned above, come method that voice are done further adjustment and beautified although described by adjusting overtone, the invention is not restricted to this, also can use additive method to realize the adjustment of voice and beautify.
In addition, according to exemplary embodiment of the present invention, speech processing system 100 also can comprise: voice acquisition module 110 and memory module 150.As shown in Figure 1, voice acquisition module 110 is used for obtaining pending voice, in exemplary embodiment of the present invention, voice acquisition module 110 can obtain pending voice with two kinds of voice obtain manners at least: can pass through voice deriving means (for example, microphone) from extraneous recorded speech; Also can directly from pre-stored voice, select pending voice.Finish obtain after, voice acquisition module 110 can be with pending voice output to characteristics of speech sounds parameter acquisition module 120.Memory module 150 is used for the sound template that storage generates, and the sound template of user selection is offered speech processing module 140, to help through the change of voice of pending voice is processed.
In addition, according to exemplary embodiment of the present invention, described speech processing system 100 can comprise that also the playing module (not shown) plays voice.
Fig. 2 is the process flow diagram that illustrates according to the speech processes of exemplary embodiment of the present invention.Describe hereinafter with reference to Fig. 2 and to use method of speech processing of the present invention to finish process to the processing of voice.
In step 201, voice acquisition module 110 can utilize recording device to record pending voice from the external world, perhaps selects pending voice from pre-stored voice, and the pending voice output that then will obtain is to characteristics of speech sounds parameter acquisition module 120.
In step 203, characteristics of speech sounds parameter acquisition module 120 with pending tone decoding be can be used for the characteristics of speech sounds parameter extraction form (for example, the PCM stream format), then the voice of decoding are analyzed, to extract each characteristics of speech sounds parameter (for example, at least a characteristics of speech sounds parameter in volume, tone and the tone color characteristic).
In step 205, determine whether that the characteristics of speech sounds parameter that will extract is generated as the voice masterplate in step 203.If determine to generate the voice masterplate, then enter step 207; If determine to be not the voice masterplate with described characteristics of speech sounds Information generation, then enter step 209.
In step 207, in voice masterplate generation module 130, generate corresponding voice masterplate according to the characteristics of speech sounds parameter that receives, and described voice masterplate is kept in the memory module 150.Selectively, according to another embodiment, the sound template that also can directly voice masterplate generation module 130 be generated is input to speech processing module 140 to be come voice are processed.
In step 209, determine whether the voice that obtain are processed, if need to process the voice that obtain, then enter step 211.
In step 211, then the voice masterplate from memory module 150 selects the user to expect is input to speech processing module 140 with the voice masterplate of selecting with the characteristics of speech sounds parameter of extracting in step 203.
In step 213, according to the voice masterplate of selecting in the step 211 the characteristics of speech sounds parameter of pending voice is adjusted, in conjunction with Fig. 1 detailed parameter adjustment process has been described, therefore no longer described at this.Characteristics of speech sounds parameter after adjusting is applied to pending voice obtaining new voice, thereby realizes the purpose of the sound effect of imitation voice masterplate.
In addition, also can realize beautifying of voice adjusted processing in step 213, for example, can pass through to adjust the tone color (that is, the frequency of overtone and range parameter) of voice so that the voice audio after the described variation is more true to nature.
Fig. 3 is the process flow diagram that illustrates according to the generation sound template of another exemplary embodiment of the present invention.
As shown in Figure 3, in step 301, in characteristics of speech sounds parameter acquisition module 120 the required every characteristics of speech sounds parameter of generation sound template is set directly, specifically, only as example, in exemplary embodiment of the present invention, the amplitude of volume, fundamental tone and amplitude and the frequency of frequency and overtone can be set directly.
In step 303, determine whether the setting of characteristics of speech sounds parameter is finished.
If determined to finish the setting of characteristics of speech sounds parameter in step 303, then in step 305, each characteristics of speech sounds parameter that arranges in sound template generation module 130 usefulness generates corresponding sound template, and in step 307 sound template that generates is kept at memory module 150.If the setting in step 303 characteristics of speech sounds parameter does not also finish, then can continue parameters, perhaps according to another embodiment, can select directly to finish the processing shown in Fig. 3
Fig. 4 is the process flow diagram that generation sound template in accordance with a further exemplary embodiment of the present invention is shown.
As shown in Figure 4, in step 401, select sound template from memory module 150.
In step 403, by each the characteristics of speech sounds parameter in the template of speech processing module 140 modification selections.
In step 405, determine whether the modification of characteristics of speech sounds parameter is finished.
If determine to have finished modification to the characteristics of speech sounds parameter of the sound template selected in step 405, then in step 407, in sound template generation module 130, generate new sound template with amended each characteristics of speech sounds parameter, and described new sound template is kept in the memory module 150.If the modification in step 405 characteristics of speech sounds parameter does not also finish, then can continue to revise the characteristics of speech sounds parameter, perhaps according to another embodiment, can select directly to finish the processing shown in Fig. 4.
Should be appreciated that, after the modification of finishing the characteristics of speech sounds parameter of the sound template selected, the new sound template that also can not generate, but directly preserve amended characteristics of speech sounds parameter at selected sound template, thus realize adjusting the effect of sound template.
Although specifically shown with reference to its exemplary embodiment and described the present invention, but it should be appreciated by those skilled in the art, in the situation that does not break away from the spirit and scope of the present invention that claim limits, can carry out various changes on form and the details to it.

Claims (18)

1. speech processing system, described system comprises:
The characteristics of speech sounds parameter acquisition module is for the characteristics of speech sounds parameter of the characteristics of speech sounds that obtains performance the first voice and the second voice;
Voice masterplate generation module is used for the characteristics of speech sounds parameter of the first voice is generated as the voice masterplate;
Speech processing module, for the characteristics of speech sounds parameter of adjusting the second voice according to sound template, and the characteristics of speech sounds parameter after will adjusting is applied to the second voice.
2. the system as claimed in claim 1 also comprises: the voice acquisition module is used for obtaining the first voice and/or the second voice.
3. the system as claimed in claim 1 also comprises: memory module is used for the storaged voice template.
4. the system as claimed in claim 1, wherein, described characteristics of speech sounds comprises at least one in volume, tone and the tone color characteristic of voice.
5. system as claimed in claim 2, wherein, described voice acquisition module is chosen the first voice and/or the second voice from pre-stored voice.
6. system as claimed in claim 2, wherein, described voice acquisition module uses sound pick-up outfit to record the first voice and/or the second voice.
7. system as claimed in claim 4, wherein, described characteristics of speech sounds parameter comprises at least one in the following parameter: frequency and the range parameter of the overtone of the predetermined quantity of the frequency of the fundamental tone of the volume parameter of performance volume characteristic, performance tone characteristic and range parameter, performance tone color characteristic.
8. the system as claimed in claim 1, wherein, the characteristics of speech sounds parameter acquisition module directly arranges each the characteristics of speech sounds parameter that forms the first required voice of sound template, so that the characteristics of speech sounds parameter that arranges is generated as sound template by the sound template generation module.
9. system as claimed in claim 3, wherein, speech processing module is adjusted the characteristics of speech sounds parameter that the sound template of selecting from the sound template of storage comprises, and generates another sound template different from the sound template of selecting according to the characteristics of speech sounds parameter after adjusting by the sound template generation module.
10. method of speech processing, described method comprises:
Obtain the characteristics of speech sounds parameter of the characteristics of speech sounds of performance the first voice and the second voice;
The characteristics of speech sounds parameter of the first voice is generated as the voice masterplate;
Adjust the characteristics of speech sounds parameter of the second voice according to sound template, and the characteristics of speech sounds parameter after will adjusting is applied to the second voice.
11. method as claimed in claim 10 also comprises: obtain the first voice and/or the second voice.
12. method as claimed in claim 10 also comprises: the storaged voice template.
13. method as claimed in claim 10, wherein, described characteristics of speech sounds comprises at least one in volume, tone and the tone color characteristic of voice.
14. method as claimed in claim 11 wherein, is chosen the first voice and/or the second voice from pre-stored voice.
15. method as claimed in claim 11 wherein, uses sound pick-up outfit to record the first voice and/or the second voice.
16. method as claimed in claim 13, wherein, described characteristics of speech sounds parameter comprises at least one in the following parameter: frequency and the range parameter of the overtone of the predetermined quantity of the frequency of the fundamental tone of the volume parameter of performance volume characteristic, performance tone characteristic and range parameter, performance tone color characteristic.
17. method as claimed in claim 10 wherein, directly arranges the every characteristics of speech sounds parameter that forms the first required voice of sound template, so that the characteristics of speech sounds parameter that arranges is generated as sound template.
18. method as claimed in claim 12, wherein, the characteristics of speech sounds parameter that the sound template of selecting from the voice masterplate of storage comprises is adjusted, and generated another sound template different from the sound template of selecting according to the characteristics of speech sounds parameter after adjusting.
CN201110204395.3A 2011-07-13 2011-07-13 Method and system for processing voice Active CN102881283B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110204395.3A CN102881283B (en) 2011-07-13 2011-07-13 Method and system for processing voice

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110204395.3A CN102881283B (en) 2011-07-13 2011-07-13 Method and system for processing voice

Publications (2)

Publication Number Publication Date
CN102881283A true CN102881283A (en) 2013-01-16
CN102881283B CN102881283B (en) 2014-05-28

Family

ID=47482584

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110204395.3A Active CN102881283B (en) 2011-07-13 2011-07-13 Method and system for processing voice

Country Status (1)

Country Link
CN (1) CN102881283B (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561305A (en) * 2013-10-30 2014-02-05 乐视致新电子科技(天津)有限公司 Method and device for searching smart television resources
CN105118523A (en) * 2015-07-13 2015-12-02 努比亚技术有限公司 Audio processing method and device
CN105448301A (en) * 2015-11-30 2016-03-30 惠州Tcl移动通信有限公司 Audio processing method and system based on voiceprint recognition
CN106791913A (en) * 2016-12-30 2017-05-31 深圳市九洲电器有限公司 Digital television program simultaneous interpretation output intent and system
CN107481735A (en) * 2017-08-28 2017-12-15 ***通信集团公司 Method for converting audio sound production, server and computer readable storage medium
CN109197674A (en) * 2018-08-31 2019-01-15 北京羽扇智信息科技有限公司 A kind of birds training method and device
CN109348274A (en) * 2018-09-12 2019-02-15 咪咕音乐有限公司 Live broadcast interaction method and device and storage medium
CN110942765A (en) * 2019-11-11 2020-03-31 珠海格力电器股份有限公司 Method, device, server and storage medium for constructing corpus
CN111868821A (en) * 2018-03-13 2020-10-30 尼尔森(美国)有限公司 Method and apparatus for extracting tone-independent timbre attributes from a media signal
CN111933161A (en) * 2020-07-16 2020-11-13 腾讯音乐娱乐科技(深圳)有限公司 Method for generating filter parameter of equalizer, audio signal filtering method and equalizer
WO2020232578A1 (en) * 2019-05-17 2020-11-26 Xu Junli Memory, microphone, audio data processing method and apparatus, and device and system
CN113035167A (en) * 2021-01-28 2021-06-25 广州朗国电子科技有限公司 Audio frequency tuning method and storage medium for active noise reduction
CN113066503A (en) * 2021-03-15 2021-07-02 广州酷狗计算机科技有限公司 Method, device and equipment for adjusting audio frame and readable storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000305589A (en) * 1999-04-16 2000-11-02 Kobe Steel Ltd Adaptive type voice recognition device, voice processing device and pet toy
CN1510590A (en) * 2002-12-24 2004-07-07 英业达股份有限公司 Language learning system and method with visual prompting to pronunciaton
CN101064104A (en) * 2006-04-24 2007-10-31 中国科学院自动化研究所 Emotion voice creating method based on voice conversion
CN101753709A (en) * 2008-12-11 2010-06-23 深圳富泰宏精密工业有限公司 Auxiliary voice inputting system and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000305589A (en) * 1999-04-16 2000-11-02 Kobe Steel Ltd Adaptive type voice recognition device, voice processing device and pet toy
CN1510590A (en) * 2002-12-24 2004-07-07 英业达股份有限公司 Language learning system and method with visual prompting to pronunciaton
CN101064104A (en) * 2006-04-24 2007-10-31 中国科学院自动化研究所 Emotion voice creating method based on voice conversion
CN101753709A (en) * 2008-12-11 2010-06-23 深圳富泰宏精密工业有限公司 Auxiliary voice inputting system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
邵艳秋等: "《韵律参数和频谱包络修改相结合的情感语音合成技术研究》", 《信号处理》 *

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103561305A (en) * 2013-10-30 2014-02-05 乐视致新电子科技(天津)有限公司 Method and device for searching smart television resources
CN105118523A (en) * 2015-07-13 2015-12-02 努比亚技术有限公司 Audio processing method and device
CN105448301A (en) * 2015-11-30 2016-03-30 惠州Tcl移动通信有限公司 Audio processing method and system based on voiceprint recognition
CN106791913A (en) * 2016-12-30 2017-05-31 深圳市九洲电器有限公司 Digital television program simultaneous interpretation output intent and system
CN107481735A (en) * 2017-08-28 2017-12-15 ***通信集团公司 Method for converting audio sound production, server and computer readable storage medium
CN111868821A (en) * 2018-03-13 2020-10-30 尼尔森(美国)有限公司 Method and apparatus for extracting tone-independent timbre attributes from a media signal
CN109197674A (en) * 2018-08-31 2019-01-15 北京羽扇智信息科技有限公司 A kind of birds training method and device
CN109197674B (en) * 2018-08-31 2021-01-26 北京羽扇智信息科技有限公司 Bird training method and device
CN109348274A (en) * 2018-09-12 2019-02-15 咪咕音乐有限公司 Live broadcast interaction method and device and storage medium
CN109348274B (en) * 2018-09-12 2021-03-23 咪咕音乐有限公司 Live broadcast interaction method and device and storage medium
WO2020232578A1 (en) * 2019-05-17 2020-11-26 Xu Junli Memory, microphone, audio data processing method and apparatus, and device and system
CN110942765A (en) * 2019-11-11 2020-03-31 珠海格力电器股份有限公司 Method, device, server and storage medium for constructing corpus
CN111933161A (en) * 2020-07-16 2020-11-13 腾讯音乐娱乐科技(深圳)有限公司 Method for generating filter parameter of equalizer, audio signal filtering method and equalizer
CN113035167A (en) * 2021-01-28 2021-06-25 广州朗国电子科技有限公司 Audio frequency tuning method and storage medium for active noise reduction
CN113066503A (en) * 2021-03-15 2021-07-02 广州酷狗计算机科技有限公司 Method, device and equipment for adjusting audio frame and readable storage medium
CN113066503B (en) * 2021-03-15 2023-12-08 广州酷狗计算机科技有限公司 Audio frame adjusting method, device, equipment and readable storage medium

Also Published As

Publication number Publication date
CN102881283B (en) 2014-05-28

Similar Documents

Publication Publication Date Title
CN102881283B (en) Method and system for processing voice
EP3675122B1 (en) Text-to-speech from media content item snippets
CN112382257B (en) Audio processing method, device, equipment and medium
CN103035235A (en) Method and device for transforming voice into melody
DE102012103553A1 (en) AUDIO SYSTEM AND METHOD FOR USING ADAPTIVE INTELLIGENCE TO DISTINCT THE INFORMATION CONTENT OF AUDIOSIGNALS IN CONSUMER AUDIO AND TO CONTROL A SIGNAL PROCESSING FUNCTION
CN107481735A (en) Method for converting audio sound production, server and computer readable storage medium
US20100125582A1 (en) Music search method based on querying musical piece information
CN109952609A (en) Speech synthesizing method
CN105957515A (en) Voice Synthesis Method, Voice Synthesis Device, Medium for Storing Voice Synthesis Program
CN109416911B (en) Speech synthesis device and speech synthesis method
US11687314B2 (en) Digital audio workstation with audio processing recommendations
US11842720B2 (en) Audio processing method and audio processing system
CN110459196A (en) A kind of method, apparatus and system adjusting singing songs difficulty
CN101379549B (en) Speech synthesizing device, and speech synthesizing method
CN112970058A (en) Information processing method and information processing system
JP5598516B2 (en) Voice synthesis system for karaoke and parameter extraction device
CN111354325B (en) Automatic word and song creation system and method thereof
CN114402382A (en) Information processing method, estimation model construction method, information processing device, and estimation model construction device
CN101370216B (en) Emotional processing and playing method for mobile phone audio files
CN114743527A (en) Matching method of sound filter
CN104464717B (en) Speech synthesizing device
CN104954369A (en) Multimedia content sending, generating and transmitting and playing methods and devices
JP2016071187A (en) Voice synthesis device and voice synthesis system
JP3446666B2 (en) Apparatus and method for speaker adaptation of acoustic model for speech recognition
Zhao The Study on the Performance Characteristics of the Violin Tone in the Computer Music

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CP02 Change in the address of a patent holder
CP02 Change in the address of a patent holder

Address after: 5-12 / F, building 6, 57 Andemen street, Yuhuatai District, Nanjing City, Jiangsu Province

Patentee after: Samsung Electronics (China) R&D Center

Patentee after: SAMSUNG ELECTRONICS Co.,Ltd.

Address before: 17-19f, Xindi center, 188 Lushan Road, Nanjing, Jiangsu 210019

Patentee before: Samsung Electronics (China) R&D Center

Patentee before: SAMSUNG ELECTRONICS Co.,Ltd.