CN101409022A - Language learning system with mouth shape comparison and method thereof - Google Patents

Language learning system with mouth shape comparison and method thereof Download PDF

Info

Publication number
CN101409022A
CN101409022A CNA2007101525539A CN200710152553A CN101409022A CN 101409022 A CN101409022 A CN 101409022A CN A2007101525539 A CNA2007101525539 A CN A2007101525539A CN 200710152553 A CN200710152553 A CN 200710152553A CN 101409022 A CN101409022 A CN 101409022A
Authority
CN
China
Prior art keywords
mouth
speaks
shape
film
rehearsal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CNA2007101525539A
Other languages
Chinese (zh)
Inventor
邱全成
邵晓慧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inventec Corp
Original Assignee
Inventec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Corp filed Critical Inventec Corp
Priority to CNA2007101525539A priority Critical patent/CN101409022A/en
Publication of CN101409022A publication Critical patent/CN101409022A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Electrically Operated Instructional Devices (AREA)

Abstract

A language learning system with a mouth shape comparison and a method thereof aim at solving the problems that in the existing language learning system and the method thereof, the language learning effect of a user is checked only by a scoring mechanism, which can not assist the user in finding out wrong mouth shape when in learning reading and pronunciation to cause pronunciation variation. The language learning system and the method thereof realize the efficacy of adjusting mouth shape in a visual manner and correcting the reading pronunciation when the user is in practicing and learning by providing the mouth shape comparison.

Description

The langue leaning system and the method for the comparison of the tool shape of the mouth as one speaks
Technical field
A kind of langue leaning system and method mean especially about a kind of shape of the mouth as one speaks that provides and compare with auxiliary langue leaning system and the method for reading pronunciation of proofreading and correct.
Background technology
Language is interpersonal bridge of linking up.By language, we can express our thought emotion, and also so no matter be mother tongue or Second Foreign Language, language learning is a considerable problem in the daily life.Language learning in the past is to teach mode by true man, demonstrated for Students ' Learning by teacher, and in the learning process, incorrect part when teacher can point out the student to revise language learning.
Owing to the appearance of digital studying mode, professor's mode of user's language learning effect has also appearred inspecting with scoring.Langue leaning system and the method for at present general digital studying mode are the demonstrations when arranging earlier a cover teaching material to carry out language learning as the user.When the user carries out reading practice according to teaching material, the audio-visual acquisition during just to reading practice, and directly mark for the acquisition film, when user's scoring was low, the user can learn that just own the reading pronounce to have incorrect part.
Yet, the user pronounces to have incorrect part when aforesaid scoring only can learn that oneself is read, but can't therefrom learn the own incorrect reason of when reading, pronouncing to produce, therefore just can't find difference part own and teaching material apace, and improve at incorrect part.
In sum, there are the problem that can't assist user's pronunciation difference that discovery causes because of the shape of the mouth as one speaks is incorrect when pronunciation is read in study for a long time in langue leaning system in the past and method always as can be known, therefore be necessary to propose improved technological means, solve this problem.
Summary of the invention
In view of there is the present situation that can't assist user's correction reading pronunciation when rehearsal is learnt for a long time in above langue leaning system and the method that proposes in the prior art in the past always, the object of the invention is to provide a kind of langue leaning system and method for tool shape of the mouth as one speaks comparison, can be used for auxiliary user to find the problem of the pronunciation difference that causes because the shape of the mouth as one speaks is incorrect when pronunciation is read in study.
In the langue leaning system of the disclosed tool shape of the mouth as one speaks comparison of the present invention, it includes: the model data bank, in order to store the language model; Select module, use the language model of selecting wish study for the user; The model output module, the language model of selecting in order to export the user is drilled study for the user; Acquisition module is in order to the rehearsal process that captures the user and save as the rehearsal archives; And overlapping output module, in order to temporary rehearsal archives, and the copy (copy) that will drill shape of the mouth as one speaks film is with to read shape of the mouth as one speaks film overlapping, makes overlapping shape of the mouth as one speaks film and exports.
In the interactive learning methods of the disclosed tool shape of the mouth as one speaks comparison of the present invention, it includes: provide and select the interface, use for the user and select a language model with output in the model data bank that has the language model; The language model that the output user selects is drilled study for the user; Acquisition user's rehearsal process also saves as the rehearsal archives, and wherein these rehearsal archives have rehearsal shape of the mouth as one speaks film; Temporary rehearsal archives, and the overlapping overlapping shape of the mouth as one speaks film of making of the copy (copy) that produces this rehearsal shape of the mouth as one speaks film and this readings shape of the mouth as one speaks film is also exported.
By above-mentioned technological means, the present invention can reach auxiliary user and adjust the shape of the mouth as one speaks and proofread and correct the effect of reading pronunciation in the visualization mode when rehearsal study.
Description of drawings
Fig. 1 is the langue leaning system calcspar of tool shape of the mouth as one speaks comparison of the present invention.
Fig. 2 is the interactive learning methods process flow diagram of tool shape of the mouth as one speaks comparison of the present invention.
Fig. 3 is the embodiment synoptic diagram that the present invention selects the language model.
Fig. 4 A is the embodiment synoptic diagram that the present invention plays the language model.
Fig. 4 B is the acquisition embodiment synoptic diagram that the present invention drills process.
Fig. 4 C is the embodiment synoptic diagram of the overlapping output of the present invention.
Embodiment
Below will cooperate drawings and Examples to describe embodiments of the present invention in detail, how to provide shape of the mouth as one speaks comparison for langue leaning system and method to the present invention by this, and solve in the past langue leaning system and method only with scoring inspection user's language learning effect with this, and can't assist the user when pronunciation is read in study, to find the problem of the pronunciation difference that causes because the shape of the mouth as one speaks is incorrect, and reach auxiliary user when rehearsal study, adjust the shape of the mouth as one speaks in the visualization mode and proofread and correct read pronunciation implementation procedure to fully understand and to implement according to this.
Make an explanation at term of the present invention at first, earlier.So-called langue leaning system and method refer to the system and method for each side language abilitys such as listening, say, read and write when being used for assisting language learning, by the demonstration of various literal, film, voice etc. is provided, the language learner can be trained the part that itself needs to strengthen as study in true classroom.Langue leaning system of the present invention and method then are to be absorbed in listening when user's language learning is provided, say, read the partly training of ability, by being connected in the sound effect player (as: loudspeaker on the computer apparatus, earphone) plays the reading shape of the mouth as one speaks film when reading pronunciation in the pre-set language model and read the voice archives of pronunciation with display unit (as: screen), demonstrate simultaneously the words and phrases of reading, again the rehearsal process of language learner's (following will be called " user ") study is captured by web camera (Web Camera) and microphone and get off to go forward side by side line output, and then auxiliary user find individual rehearsal process and provide the demonstration difference of reading pronunciation mouth shape between audio-visual, to improve the learning effect of user when carrying out language learning.
Fig. 1 illustrates that with being used for the present invention respectively forms the function mode between the square for the langue leaning system calcspar of tool shape of the mouth as one speaks comparison of the present invention.The langue leaning system of tool shape of the mouth as one speaks comparison of the present invention, it includes model data bank 101, selects module 102, model output module 103, acquisition module 104 and overlapping output module 105.
Model data bank 101, be responsible for storing the language model, and the language model (not shown) that these are deposited is all multi-medium file (multimedia file), all include at least in same language model: from the demonstrate correct reading shape of the mouth as one speaks film of being recorded when reading the words and phrases mode and read voice of language fugleman, also comprised the study words and phrases that to read simultaneously in advance.
Select module 102, be responsible for selecting for the user language model of wish study.The user can select to want vocabulary or the statement learnt by user interface, and the language model that chooses then can be presented in the middle of the model output module 103.
Model output module 103, be responsible for the selected language model of output user, and the process of output comprises by display device (not shown) output reading shape of the mouth as one speaks film and study words and phrases, and by audio playing device (not shown) such as loudspeaker output voice.And the form of model output can be exported complete demonstration archives or emphasis and play.So-called emphasis play be the pronunciation syllable of learning words and phrases be that unit will read shape of the mouth as one speaks film and read speech differentiation and be several data sections, and the part that will be play by user's decision.When reading shape of the mouth as one speaks film and reading speech play, the study words and phrases of demonstration also can produce the part that corresponding mark prompting user is reading at present.
Acquisition module 104, the rehearsal process of being responsible for acquisition user when the user reads rehearsal saves as the rehearsal archives.The mode of acquisition comprises the web camera (not shown) acquisition user's who connects from the user rehearsal shape of the mouth as one speaks film on computer apparatus, and the rehearsal voice that capture the user on computer apparatus by the microphone (not shown) that connects.If the web camera that the user installs can be controlled by computer program the direction of phtographic lens, the position that then also can directly move for the user in the process of acquisition rehearsal shape of the mouth as one speaks film is followed the trail of and is improved the acquisition effect.In addition, in the process of acquisition, the image that web camera captured also can be presented in the acquisition interface.
Overlapping output module 105, the archives starting point of being responsible for drilling in the voice is alignd with the archives starting point of rehearsal shape of the mouth as one speaks film.Then, overlapping output module 105 can temporaryly be drilled archives, and generation a rehearsal shape of the mouth as one speaks film copy (copy) carries out overlapping processing with reading shape of the mouth as one speaks film.In the process of overlapping processing, must increase earlier the transparency (transparency) of reading shape of the mouth as one speaks film, and then the reading shape of the mouth as one speaks film after will increasing transparency synthesizes the shape of the mouth as one speaks film that overlaps with rehearsal shape of the mouth as one speaks film, and shows it by display unit.And when exporting overlapping shape of the mouth as one speaks film, the rehearsal voice also can be exported by sound effect player.
Next, will implementation step of the present invention be described by the interactive learning methods process flow diagram of Fig. 2 tool shape of the mouth as one speaks comparison of the present invention.
At first, the present invention can provide one to select the interface to select language model (step 201) for the user in model data bank 101, then, with the language model output that the user selects, drills study (step 202) for the user.Comprise reading shape of the mouth as one speaks film in the language model, read voice and study words and phrases, when output is read shape of the mouth as one speaks film and read voice, also can occur the present part that reads of mark prompting user on the study words and phrases.When the user drilled study, acquisition module 104 just can capture the process of user's rehearsal study, and saved as rehearsal archives (step 203).The mode of acquisition rehearsal process comprises web camera (Web Camera) the acquisition user's who connects from the user rehearsal shape of the mouth as one speaks film on computer apparatus, and the rehearsal voice that capture the user on computer apparatus by the microphone that connects.If the web camera that the user installs can be controlled by computer program the direction of phtographic lens, the position that then also can directly move for the user in the process of acquisition rehearsal shape of the mouth as one speaks film is followed the trail of and is improved the acquisition effect.In addition, in the process of acquisition, the image that web camera captured also can be presented in the acquisition interface.At last, overlapping output module 105 can temporary rehearsal archives, and produce the copy (copy) of rehearsal shape of the mouth as one speaks film, and read that shape of the mouth as one speaks film is overlapping makes an overlapping shape of the mouth as one speaks film and an output (step 204), simultaneously, the rehearsal voice also can be exported in the lump by the audio playing device.
Then, will cooperate accompanying drawing of the present invention that implementation process of the present invention is described with an embodiment.
Suppose to have user's wish to use system and method for the present invention to carry out language learning, selection interface 300 that at first can be by as shown in Figure 3 is for the vocabulary of wish study or statement is inquired about and selected.When user's vocabulary " pronounce " that input is wanted to learn in speech selection input row 301, select just can to occur in the interface 300 contents such as the words usage of " pronounce " and phonetic symbol.And in selecting interface 300, can provide one to be used for starting the model function key 302 of reading " pronunciation demonstration ", when the user presses model function key 302, select interface 300 just can be linked to and find out the corresponding language model of vocabulary " pronounce " in the model data bank 101 and export the study for the user.
During the output language model, a new form can occur in the display unit, shown in Fig. 4 A, the user can click " playing demonstration " function key 401 and play the language model.When playing the language model, the reading shape of the mouth as one speaks film of language model can be shown in the middle of the model output lattice 402, reads voice by exporting such as sound effect players such as loudspeaker, earphones simultaneously.In addition, the literal of study words and phrases can be presented at study words and phrases output lattice 406.In language model reading learning words and phrases, the part 407 (example with reference to the accompanying drawings illustrates) that the present language model of meeting show tags prompting user is read on the study words and phrases.Though the mark in present embodiment represents with boldface letter, only be used for signal, the also available prompting round dot of mark in fact beat or other mark mode reaches the effect of prompting.
When the user has viewed and admired the demonstration of language model, just can start " acquisition rehearsal process " function key 403, acquisition module 104 just can capture user's rehearsal shape of the mouth as one speaks film and rehearsal voice and save as the rehearsal archives this moment.Shown in Fig. 4 B, in the process of acquisition, user's rehearsal shape of the mouth as one speaks film can show in the middle of rehearsal the output of process lattice 404 simultaneously, just the user can learn whether the rehearsal shape of the mouth as one speaks film that captures captures for the tram.Shown in Fig. 4 C, after acquisition was finished, just overlapping output module 105 can be kept in the rehearsal shape of the mouth as one speaks film that captures, and the copy of generation rehearsal shape of the mouth as one speaks film carried out the overlapping new archive made from the image of reading shape of the mouth as one speaks film in addition.In the process of overlapping processing, must increase earlier the transparency (shown in dotted portion among Fig. 4 C) of reading shape of the mouth as one speaks film, the reading shape of the mouth as one speaks film after will increasing transparency then synthesizes with rehearsal shape of the mouth as one speaks film, just can be made into overlapping shape of the mouth as one speaks film.When the user clicks " comparison is play " function key 405, start overlapping output module 105 and namely export overlapping shape of the mouth as one speaks film, the user can watch the picture 404 of overlapping reading shape of the mouth as one speaks film on the rehearsal shape of the mouth as one speaks film, can hear the rehearsal voice of oneself simultaneously.In the process of playing, why not pronunciation mouth shape when the user can find oneself to read and the pronunciation mouth shape in the model have same part, as shown in 404, the user can be improved for the incorrect part of pronunciation mouth shape by this, the results of learning when improving study reading pronunciation.And the rehearsal archives that captured, the user also can save as model function key 408 become new model to model data bank 101 by clicking.
As mentioned above, the present invention system provides shape of the mouth as one speaks comparison for langue leaning system and method as can be known, adjusts the shape of the mouth as one speaks and proofreaies and correct the effect of reading pronunciation in the visualization mode when rehearsal study and reach auxiliary user.Though the disclosed embodiment of the present invention as above, described content is not in order to direct qualification scope of patent protection of the present invention.Any persond having ordinary knowledge in the technical field of the present invention under the prerequisite that does not break away from the disclosed spirit and scope of the present invention, can do a little change and retouching in the details that reaches of implementing in form.Scope of patent protection of the present invention, still must with appending claims the person of being defined be as the criterion.

Claims (14)

1, a kind of langue leaning system of tool shape of the mouth as one speaks comparison, this system comprises:
One model data bank, in order to store several language models, wherein respectively this language model more comprises a reading shape of the mouth as one speaks film;
One selects module, uses this language model of selecting wish study for the user;
One model output module, this language model of selecting in order to export the user is drilled study for the user;
One acquisition module, in order to acquisition user's rehearsal process and save as rehearsal archives, these rehearsal archives more comprise one and drill shape of the mouth as one speaks film; And
One overlapping output module in order to temporary this rehearsal archives, and will drill the overlapping overlapping shape of the mouth as one speaks film of making of the copy of shape of the mouth as one speaks film and this reading shape of the mouth as one speaks film and also export.
2, the langue leaning system of tool shape of the mouth as one speaks comparison as claimed in claim 1, wherein those language models more comprise reading voice and study words and phrases.
3, the langue leaning system of tool shape of the mouth as one speaks comparison as claimed in claim 2 when wherein this model output module is exported this reading shape of the mouth as one speaks film, more comprises according to the pronunciation syllable of these study words and phrases and should read shape of the mouth as one speaks film segmentation output.
4, the langue leaning system of tool shape of the mouth as one speaks comparison as claimed in claim 1, wherein these rehearsal archives more comprise rehearsal voice.
5, the langue leaning system of the tool shape of the mouth as one speaks as claimed in claim 4 comparison, wherein this acquisition module more comprises these rehearsal archives is saved as a language model.
6, the langue leaning system of tool shape of the mouth as one speaks comparison as claimed in claim 2, wherein this model output module more comprises these study words and phrases of output, and learns words and phrases with the part that mark points out this rehearsal shape of the mouth as one speaks film to read at present.
7, the langue leaning system of tool shape of the mouth as one speaks comparison as claimed in claim 1, copy and this overlapping system of reading shape of the mouth as one speaks film that wherein will drill shape of the mouth as one speaks film synthesize by the transparency of this reading shape of the mouth as one speaks film of increase and with this rehearsal shape of the mouth as one speaks film.
8, a kind of interactive learning methods of tool shape of the mouth as one speaks comparison, this method comprises the following step:
Provide one to select the interface, use for the user and select a language model with output in the model data bank that has several language models, wherein respectively this language model all more comprises a reading shape of the mouth as one speaks film;
This language model that the output user selects is drilled study for the user;
Acquisition user's rehearsal process also saves as rehearsal archives, and wherein these rehearsal archives more comprise a rehearsal shape of the mouth as one speaks film; And
Temporary this rehearsal archives, and the overlapping overlapping shape of the mouth as one speaks film of making of the copy that produces this rehearsal shape of the mouth as one speaks film and this reading shape of the mouth as one speaks film is also exported.
9, the interactive learning methods of tool shape of the mouth as one speaks comparison as claimed in claim 8, wherein those language models more comprise reading voice and study words and phrases.
10, the interactive learning methods of tool shape of the mouth as one speaks comparison as claimed in claim 9 wherein when selecting the language model with output in the model data bank that has several language models, more comprises according to the pronunciation syllable of these study words and phrases and should read shape of the mouth as one speaks film segmentation output.
11, the interactive learning methods of tool shape of the mouth as one speaks comparison as claimed in claim 8, wherein these rehearsal archives more comprise rehearsal voice.
12, the interactive learning methods of the tool shape of the mouth as one speaks as claimed in claim 11 comparison when wherein capturing user's rehearsal process and saving as the rehearsal archives, more comprises these rehearsal archives is saved as a language model.
13, the interactive learning methods of tool shape of the mouth as one speaks comparison as claimed in claim 9 when wherein exporting this language model of user's selection, more comprises these study words and phrases of output, and points out the part study words and phrases of at present reading of this rehearsal shape of the mouth as one speaks film with mark.
14, the interactive learning methods of tool shape of the mouth as one speaks comparison as claimed in claim 8, copy and this overlapping system of reading shape of the mouth as one speaks film that wherein will drill shape of the mouth as one speaks film synthesize by the transparency of this reading shape of the mouth as one speaks film of increase and with this rehearsal shape of the mouth as one speaks film.
CNA2007101525539A 2007-10-11 2007-10-11 Language learning system with mouth shape comparison and method thereof Pending CN101409022A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNA2007101525539A CN101409022A (en) 2007-10-11 2007-10-11 Language learning system with mouth shape comparison and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNA2007101525539A CN101409022A (en) 2007-10-11 2007-10-11 Language learning system with mouth shape comparison and method thereof

Publications (1)

Publication Number Publication Date
CN101409022A true CN101409022A (en) 2009-04-15

Family

ID=40572021

Family Applications (1)

Application Number Title Priority Date Filing Date
CNA2007101525539A Pending CN101409022A (en) 2007-10-11 2007-10-11 Language learning system with mouth shape comparison and method thereof

Country Status (1)

Country Link
CN (1) CN101409022A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105070118A (en) * 2015-07-30 2015-11-18 广东小天才科技有限公司 Method of correcting pronunciation aiming at language class learning and device of correcting pronunciation aiming at language class learning
CN106228996A (en) * 2016-07-15 2016-12-14 黄河科技学院 Vocality study electron assistant articulatory system
CN110444053A (en) * 2019-07-04 2019-11-12 卓尔智联(武汉)研究院有限公司 Interactive learning methods, computer installation and readable storage medium storing program for executing
CN114842690A (en) * 2022-04-26 2022-08-02 深圳市企鹅网络科技有限公司 Pronunciation interaction method and system for language course, electronic equipment and storage medium

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105070118A (en) * 2015-07-30 2015-11-18 广东小天才科技有限公司 Method of correcting pronunciation aiming at language class learning and device of correcting pronunciation aiming at language class learning
CN106228996A (en) * 2016-07-15 2016-12-14 黄河科技学院 Vocality study electron assistant articulatory system
CN106228996B (en) * 2016-07-15 2019-08-02 黄河科技学院 Vocality study electron assistant articulatory system
CN110444053A (en) * 2019-07-04 2019-11-12 卓尔智联(武汉)研究院有限公司 Interactive learning methods, computer installation and readable storage medium storing program for executing
CN110444053B (en) * 2019-07-04 2021-11-30 卓尔智联(武汉)研究院有限公司 Language learning method, computer device and readable storage medium
CN114842690A (en) * 2022-04-26 2022-08-02 深圳市企鹅网络科技有限公司 Pronunciation interaction method and system for language course, electronic equipment and storage medium
CN114842690B (en) * 2022-04-26 2024-03-01 深圳市企鹅网络科技有限公司 Pronunciation interaction method, system, electronic equipment and storage medium for language courses

Similar Documents

Publication Publication Date Title
US6435876B1 (en) Interactive learning of a foreign language
CN201993924U (en) Reading material learning machine
KR100900085B1 (en) Language learning control method
US20110053123A1 (en) Method for teaching language pronunciation and spelling
JP6976996B2 (en) Dynamic story-oriented digital language education methods and systems
KR100900081B1 (en) Language learning control method
WO2006064295A2 (en) Computerised system and method for teaching handwriting and reading
Aydin et al. A Brief Comparison of the Current Approaches in Teaching Pronunciation.
CN101409022A (en) Language learning system with mouth shape comparison and method thereof
KR20200081707A (en) A apparatus of learning feedback and making express for speaking trainee
Duffy Shaping musical performance through conversation
KR20140087956A (en) Apparatus and method for learning phonics by using native speaker's pronunciation data and word and sentence and image data
Campbell et al. The need for a speech corpus
Sarkar et al. A translator for bangla text to sign language
CN109872602A (en) A kind of music teaching device
Gozali Developing phonics material to improve the spoken English of Indonesian tertiary students
US20050158696A1 (en) [interactive computer-assisted language learning method and system thereof]
Kissova The role and goals in teaching English pronunciation
KR20140107067A (en) Apparatus and method for learning word by using native speakerpronunciation data and image data
KR20140087951A (en) Apparatus and method for learning english grammar by using native speaker's pronunciation data and image data.
JP6155102B2 (en) Learning support device
KR20140082127A (en) Apparatus and method for learning word by using native speaker's pronunciation data and origin of a word
JP7383325B1 (en) English learning system, English teaching method and program
JP2005140881A (en) Device and method for learning english
Wedin et al. Teachers’ perceptions of letter learning among adults: The case of basic literacy education in Swedish for immigrants

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20090415