CN105206123A - Communication device for deaf-mutes - Google Patents
Communication device for deaf-mutes Download PDFInfo
- Publication number
- CN105206123A CN105206123A CN201510706510.5A CN201510706510A CN105206123A CN 105206123 A CN105206123 A CN 105206123A CN 201510706510 A CN201510706510 A CN 201510706510A CN 105206123 A CN105206123 A CN 105206123A
- Authority
- CN
- China
- Prior art keywords
- deaf
- sign language
- display screen
- button
- touch display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/04—Devices for conversing with the deaf-blind
Landscapes
- Engineering & Computer Science (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention provides a communication device for deaf-mutes. The communication device comprises a main control unit, a touch display screen, a memory card, a microphone and a loudspeaker, wherein the main control unit is connected with the touch display screen, the memory card, the microphone and the loudspeaker; the micro control unit converts voice frequency obtained from the microphone into a cartoon sign language and text, and the cartoon sign language and text are output on the touch display screen; or, the micro control unit obtains text information or sign language cartoon from the touch display screen and converts into voice, and the voice is output from the loudspeaker. Deaf-mutes can conveniently communicate with ordinary people through the communication device; the device is also provided with a phonetic sign language communication button, a voice play button, a writing exercise button and a sign language corpora button, and the use functions of the device are expanded in different aspects, so that the device is more convenient to use.
Description
Technical field
The invention belongs to deaf and dumb patient's aid field, be specifically related to a kind of deaf and dumb patient's ac equipment based on speech recognition and semantic understanding.
Background technology
Along with the whole society is to the care of deaf and dumb patient and help and school for deaf-mutes's effort for many years, the universal of sign language in recent years improves a lot.Sign language has all been learned from the deaf and dumb patient of school for deaf-mutes's graduation, also often can see that in street corner deaf and dumb patients are chatted by sign language, they talk with one's hands out abundant thought, glad or excited or sorrow is even quarreled with sign language, but for can not other people of sign language just exchanging with them, the happiness anger cannot understanding them is sad.
Simultaneously, because the versatility on word read is limited, many deaf-mutes are also illiterate, and sign language interchange is the deaf-dumb language of Global Access, if people are when exchanging with deaf-mute, expressed information sign language information can be converted to, just communication can be carried out with deaf-mute easily.
As mentioned above, when deaf and dumb needs of patients handles public affair, such as, go to bank or hospital, because cannot sounding, generally all need people and accompany, very inconvenient.If deaf and dumb patient can carry with a device, this device can carry out speech recognition and the translation of sign language animation, deaf and dumb for help patient can be exchanged with non-deaf and dumb patient, improve the quality of life of deaf and dumb patient.
The invention provides a kind of deaf and dumb patient's ac equipment based on speech recognition and semantic understanding, to solve the problem.
Summary of the invention
The invention provides a kind of deaf and dumb patient's ac equipment, comprise main control unit, touch display screen, storage card, microphone, loudspeaker, described main control unit connects touch display screen, storage card, microphone and loudspeaker, the audio conversion obtained from microphone is that animation sign language and word export on touch display screen by described main control unit, or is that voice export from loudspeaker from touch display screen acquisition Word message or sign language animated transition.
Preferably, described deaf and dumb patient's ac equipment also comprises voice sign language and exchanges button, and after pressing described voice sign language interchange button, microphone starts to gather voice audio data.
Preferably, described deaf and dumb patient's ac equipment also comprises speech play button, and after pressing described speech play button, the list of touch display screen display works and expressions for everyday use, plays corresponding voice messaging and sign language animation after clicking.
Preferably, described deaf and dumb patient's ac equipment also comprises writing training button, presses described writing training button, and starts writing Chinese characters on touch display screen, and described deaf and dumb patient's ac equipment carries out identifying processing, plays voice messaging and sign language animation.
Preferably, described deaf and dumb patient's ac equipment also comprises sign language library button, and after pressing described sign language library button, touch display screen display sign language storehouse animation, user operates sign language animation.
Preferably, described deaf and dumb patient's ac equipment also comprises battery apparatus.
By deaf and dumb patient's ac equipment provided by the invention, be provided with main control unit, touch display screen, storage card, microphone, loudspeaker, described main control unit connects touch display screen, storage card, microphone and loudspeaker, the audio conversion obtained from microphone is that animation sign language and word export on touch display screen by described main control unit, or obtaining Word message or sign language animated transition from touch display screen is that voice export from loudspeaker, and deaf-mute can be made to exchange easily with ordinary people.Meanwhile, this device is also provided with voice sign language and exchanges button, speech play button, writing training button and sign language library button, extends the using function of device different aspect, more convenient during use.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings.
Fig. 1 is deaf and dumb patient's ac equipment inner structure schematic diagram that present pre-ferred embodiments provides;
Fig. 2 is deaf and dumb patient's ac equipment external structure schematic diagram that present pre-ferred embodiments provides;
Fig. 3 is that deaf and dumb patient's AC system built-in function that present pre-ferred embodiments provides distributes schematic diagram;
Fig. 4 a is that the external voice that provides of present pre-ferred embodiments is to touch display screen flow path switch figure;
Fig. 4 b be present pre-ferred embodiments provide from touch display screen to loudspeaker flow path switch figure;
Fig. 5 is deaf and dumb patient's ac equipment Chinese character writing training process flow diagram that present pre-ferred embodiments provides.
Embodiment
Hereinafter also describe the present invention in detail with reference to accompanying drawing in conjunction with the embodiments.It should be noted that, when not conflicting, the embodiment in the application and the feature in embodiment can combine mutually.
Fig. 1 is deaf and dumb patient's ac equipment inner structure schematic diagram that present pre-ferred embodiments provides.As shown in Figure 1, deaf and dumb patient's ac equipment that present pre-ferred embodiments provides comprises touch display screen 1, storage card 2, main control unit 3, microphone 4 and loudspeaker 5, described main control unit 3 connects touch display screen 1, storage card 2, microphone 4 and loudspeaker 5, the audio conversion obtained from microphone 4 is that animation sign language and word export on touch display screen 1 by described main control unit 3, or obtains Word message from touch display screen 1 or sign language animated transition is that voice export from loudspeaker 5.
In this, described main control unit is made by embedded chip, and described touch display screen is touching liquid-crystal display screen, and described storage card is SD storage card.Microphone 4 can be fixed on device, also can take off, and take off rear aligning microphone and speak, the voice messaging better quality of collection, accuracy is higher.Described deaf and dumb patient's ac equipment also comprises battery apparatus 6, and described battery apparatus is touching liquid-crystal display screen, loudspeaker, microphone and SD storage card provide electric power.
Fig. 2 is deaf and dumb patient's ac equipment external structure schematic diagram that present pre-ferred embodiments provides.As shown in Figure 2, deaf and dumb patient's ac equipment that present pre-ferred embodiments provides also comprises support 7, voice sign language exchanges button 8, speech play button 9, writing training button 10 and sign language library button 11.
In the present embodiment, described support, for supporting this device, makes it be placed on desktop, conveniently adopts sound and exchange.In addition, multiple outer button that deaf and dumb patient's ac equipment is arranged, for realizing the conversion between voice and text or sign language animation, and provide the exercise etc. of daily sign language animation.Described each button is as follows.
Voice sign language exchanges button, and after pressing described voice sign language interchange button, microphone starts to gather voice audio data.Meanwhile, described voice audio data is sent to main control unit, after carrying out speech recognition, syntactic analysis, semantic understanding and sign language animation coupling by described main control unit, and display sign language animation, and the Chinese text of display coupling.
Speech play button, after pressing described speech play button, the list of touch display screen display works and expressions for everyday use, plays corresponding voice messaging and sign language animation after clicking.Particularly, press described speech play button button, display screen lists the list of daily life term, list display speech items numbering and Chinese text, corresponding voice messaging can be play after deaf and dumb patient clicks certain information, sign language animation can be play simultaneously, help the patient failing to see Chinese to remember the entry of voice messaging.
Writing training button, presses described writing training button, and starts writing Chinese characters on touch display screen, and described deaf and dumb patient's ac equipment carries out identifying processing, plays voice messaging and sign language animation.Particularly, carry out text and sign language animation coupling by the Chinese character of main control unit to input, after the match is successful, play voice messaging and sign language animation.
Sign language library button, after pressing described sign language library button, touch display screen display sign language storehouse animation, user operates sign language animation.Particularly, described sign language storehouse is stored in SD storage card, and comprising daily sign language animation, user can sort to conventional sign language animation item, also can draw a string simple graph symbol and mark, to be memonic sign language animation item.
Fig. 3 is that deaf and dumb patient's AC system built-in function that present pre-ferred embodiments provides distributes schematic diagram.As shown in Figure 3, after program write main control unit, sign language animation, speech audio and Hanzi features model information leave in SD storage card, and plug-in comprises sign language animation library, store all sign language animation information, user can carry out browsing and marking of sign language animation; Comprise sound bank, store the corresponding relation data of all speech audio information and Chinese, daily voice messaging broadcasting can be carried out, sign language animation can be carried out after selecting speech items and browse; Comprise Hanzi features model bank, store the hand-write recognition function use altogether of Hanzi features model data.
Fig. 4 a is that the external voice that provides of present pre-ferred embodiments is to touch display screen flow path switch figure; Fig. 4 b be present pre-ferred embodiments provide from touch display screen to loudspeaker flow path switch figure.As shown in Fig. 4 a and Fig. 4 b, when non-deaf and dumb patient exchanges with deaf and dumb patient, first speech audio information is gathered by microphone, speech recognition is carried out by program, carry out syntactic analysis and semantic understanding, then determine corresponding Chinese text, show, the Chinese text coupling sign language animation according to coupling is play; When deaf and dumb needs of patients is expressed, daily life term can be selected to play-over its speech audio, also can play speech audio after handwritten Chinese text, after also can selecting sign language animation in sign language storehouse, then mate speech audio by this device coupling Chinese text and play.
Fig. 5 is deaf and dumb patient's ac equipment Chinese character writing training process flow diagram that present pre-ferred embodiments provides.With reference to Fig. 5, user, at touch display screen handwritten Chinese character, carries out Chinese Character Recognition by system according to Hanzi features model, and words recognition and sign language animation coupling, finally play sign language animation again.
In sum, by deaf and dumb patient's ac equipment that present pre-ferred embodiments provides, be provided with main control unit, touch display screen, storage card, microphone, loudspeaker, described main control unit connects touch display screen, storage card, microphone and loudspeaker, the audio conversion obtained from microphone is that animation sign language and word export on touch display screen by described main control unit, or obtaining Word message or sign language animated transition from touch display screen is that voice export from loudspeaker, and deaf-mute can be made to exchange easily with ordinary people.Meanwhile, this device is also provided with voice sign language and exchanges button, speech play button, writing training button and sign language library button, extends the using function of device different aspect, more convenient during use.
To the above-mentioned explanation of the disclosed embodiments, professional and technical personnel in the field are realized or uses the present invention.To be apparent for those skilled in the art to the multiple amendment of these embodiments, General Principle as defined herein can without departing from the spirit or scope of the present invention, realize in other embodiments.Therefore, the present invention can not be restricted to embodiment illustrated herein, but will meet the widest scope consistent with principle disclosed herein and features of novelty.
Claims (6)
1. deaf and dumb patient's ac equipment, is characterized in that, comprises main control unit, touch display screen, storage card, microphone, loudspeaker, and described main control unit connects touch display screen, storage card, microphone and loudspeaker,
The audio conversion obtained from microphone is that animation sign language and word export on touch display screen by described main control unit, or is that voice export from loudspeaker from touch display screen acquisition Word message or sign language animated transition.
2. deaf and dumb patient's ac equipment according to claim 1, is characterized in that, described deaf and dumb patient's ac equipment also comprises voice sign language and exchanges button, and after pressing described voice sign language interchange button, microphone starts to gather voice audio data.
3. deaf and dumb patient's ac equipment according to claim 1, it is characterized in that, described deaf and dumb patient's ac equipment also comprises speech play button, after pressing described speech play button, the list of touch display screen display works and expressions for everyday use, plays corresponding voice messaging and sign language animation after clicking.
4. deaf and dumb patient's ac equipment according to claim 1, it is characterized in that, described deaf and dumb patient's ac equipment also comprises writing training button, press described writing training button, and start writing Chinese characters on touch display screen, described deaf and dumb patient's ac equipment carries out identifying processing, plays voice messaging and sign language animation.
5. deaf and dumb patient's ac equipment according to claim 1, is characterized in that, described deaf and dumb patient's ac equipment also comprises sign language library button, and after pressing described sign language library button, touch display screen display sign language storehouse animation, user operates sign language animation.
6. deaf and dumb patient's ac equipment according to claim 1, is characterized in that, described deaf and dumb patient's ac equipment also comprises battery apparatus.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510706510.5A CN105206123B (en) | 2015-10-27 | 2015-10-27 | A kind of deaf and dumb patient's ac equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510706510.5A CN105206123B (en) | 2015-10-27 | 2015-10-27 | A kind of deaf and dumb patient's ac equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105206123A true CN105206123A (en) | 2015-12-30 |
| CN105206123B CN105206123B (en) | 2018-06-29 |
Family
ID=54953762
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510706510.5A Active CN105206123B (en) | 2015-10-27 | 2015-10-27 | A kind of deaf and dumb patient's ac equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105206123B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105551346A (en) * | 2016-03-11 | 2016-05-04 | 京东方科技集团股份有限公司 | Communication auxiliary system, communication auxiliary equipment and control method of communication auxiliary equipment |
| CN106981238A (en) * | 2017-03-20 | 2017-07-25 | 南昌大学 | A kind of sign language ac equipment based on computer vision |
| CN107231289A (en) * | 2017-04-19 | 2017-10-03 | 王宏飞 | Information interchange device, information exchanging system and method |
| CN108074569A (en) * | 2017-12-06 | 2018-05-25 | 安徽省科普产品工程研究中心有限责任公司 | A kind of intelligence voice identifies in real time and methods of exhibiting |
| CN108470495A (en) * | 2018-04-04 | 2018-08-31 | 温州大学 | A kind of deaf and dumb patient's ac equipment |
| CN109003481A (en) * | 2018-08-23 | 2018-12-14 | 江南大学 | Split type intelligent language learner |
| CN110890097A (en) * | 2019-11-21 | 2020-03-17 | 京东数字科技控股有限公司 | Voice processing method and device, computer storage medium and electronic equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5636038A (en) * | 1996-06-24 | 1997-06-03 | Lynt; Ingrid H. | Apparatus for converting visual images into tactile representations for use by a person who is visually impaired |
| CN201035501Y (en) * | 2006-10-10 | 2008-03-12 | 刘向东 | Intelligent synchronous hand language translation system |
| KR20110128399A (en) * | 2010-05-24 | 2011-11-30 | (주)소프트코리아 | Deaf ministry in the church to the normal activities of the electrical signal to convert video and audio and video motion capture to generate |
| CN202454123U (en) * | 2011-11-21 | 2012-09-26 | 天津三星光电子有限公司 | Sign language image output device |
| CN102708866A (en) * | 2012-06-01 | 2012-10-03 | 武汉大学 | Semantic-computing-based interaction system and method for person with hearing or language disorder |
| CN204720033U (en) * | 2015-04-23 | 2015-10-21 | 江苏卡罗卡国际动漫城有限公司 | A kind of sign language learning machine being suitable for interactive learning |
| CN205177193U (en) * | 2015-10-27 | 2016-04-20 | 苏州大学 | Deaf and dumb patient AC installation |
-
2015
- 2015-10-27 CN CN201510706510.5A patent/CN105206123B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5636038A (en) * | 1996-06-24 | 1997-06-03 | Lynt; Ingrid H. | Apparatus for converting visual images into tactile representations for use by a person who is visually impaired |
| CN201035501Y (en) * | 2006-10-10 | 2008-03-12 | 刘向东 | Intelligent synchronous hand language translation system |
| KR20110128399A (en) * | 2010-05-24 | 2011-11-30 | (주)소프트코리아 | Deaf ministry in the church to the normal activities of the electrical signal to convert video and audio and video motion capture to generate |
| CN202454123U (en) * | 2011-11-21 | 2012-09-26 | 天津三星光电子有限公司 | Sign language image output device |
| CN102708866A (en) * | 2012-06-01 | 2012-10-03 | 武汉大学 | Semantic-computing-based interaction system and method for person with hearing or language disorder |
| CN204720033U (en) * | 2015-04-23 | 2015-10-21 | 江苏卡罗卡国际动漫城有限公司 | A kind of sign language learning machine being suitable for interactive learning |
| CN205177193U (en) * | 2015-10-27 | 2016-04-20 | 苏州大学 | Deaf and dumb patient AC installation |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105551346A (en) * | 2016-03-11 | 2016-05-04 | 京东方科技集团股份有限公司 | Communication auxiliary system, communication auxiliary equipment and control method of communication auxiliary equipment |
| CN106981238A (en) * | 2017-03-20 | 2017-07-25 | 南昌大学 | A kind of sign language ac equipment based on computer vision |
| CN107231289A (en) * | 2017-04-19 | 2017-10-03 | 王宏飞 | Information interchange device, information exchanging system and method |
| CN108074569A (en) * | 2017-12-06 | 2018-05-25 | 安徽省科普产品工程研究中心有限责任公司 | A kind of intelligence voice identifies in real time and methods of exhibiting |
| CN108470495A (en) * | 2018-04-04 | 2018-08-31 | 温州大学 | A kind of deaf and dumb patient's ac equipment |
| CN109003481A (en) * | 2018-08-23 | 2018-12-14 | 江南大学 | Split type intelligent language learner |
| CN110890097A (en) * | 2019-11-21 | 2020-03-17 | 京东数字科技控股有限公司 | Voice processing method and device, computer storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105206123B (en) | 2018-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105206123A (en) | Communication device for deaf-mutes | |
| Freitas et al. | Speech technologies for blind and low vision persons | |
| CN101115088A (en) | Mobile phone dedicated for deaf-mutes | |
| CN103077625A (en) | Blind electronic reader and blind assistance reading method | |
| CN205177193U (en) | Deaf and dumb patient AC installation | |
| CN101645190A (en) | Word inquiring system and inquiring system method thereof | |
| CN103631506A (en) | Reading method based on terminal and corresponding terminal | |
| CN206210144U (en) | Gesture language-voice converts cap | |
| CN201035501Y (en) | Intelligent synchronous hand language translation system | |
| CN113901186A (en) | Telephone recording marking method, device, equipment and storage medium | |
| CN202071566U (en) | Pen capable of reading English words | |
| CN205281851U (en) | Electronic reading equipment | |
| CN205211232U (en) | Multi -purpose flat panel language learning machine | |
| CN103186247A (en) | Formula input method and system | |
| CN109947977A (en) | A kind of intension recognizing method and device, terminal device of combination image | |
| CN105488034A (en) | Summary translator | |
| CN105632514A (en) | Method and device for converting voice into characters through semantic analysis | |
| CN201780773U (en) | LED lyric display intelligent song system | |
| CN203217570U (en) | Translation machine | |
| CN102591477A (en) | Character selection method and character selection device for typing in short sentence | |
| CN207925131U (en) | Read aloud equipment | |
| CN202916793U (en) | Single-hand Chinese character sounding stenograph | |
| CN207473897U (en) | Wearable Braille reading equipment | |
| CN202334671U (en) | Mobile phone with translation function | |
| CN205540722U (en) | Portable business english interpreting equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |