CN204965839U - Sign language voice conversion device - Google Patents

Sign language voice conversion device Download PDF

Info

Publication number
CN204965839U
CN204965839U CN201520757716.6U CN201520757716U CN204965839U CN 204965839 U CN204965839 U CN 204965839U CN 201520757716 U CN201520757716 U CN 201520757716U CN 204965839 U CN204965839 U CN 204965839U
Authority
CN
China
Prior art keywords
sign language
display
language
voice
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201520757716.6U
Other languages
Chinese (zh)
Inventor
王超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201520757716.6U priority Critical patent/CN204965839U/en
Application granted granted Critical
Publication of CN204965839U publication Critical patent/CN204965839U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The utility model provides a sign language voice conversion device, including display, bracelet, ring and controller, install in the display and be used for receiving the microphone of pronunciation and translating the chip with voice conversion for the pronunciation characters of characters, be provided with the speaker on the bracelet, the distance value that controller receiving range detector detected when sign language person expressed to match the sign language action distance value that prestores in the database with the alphabet syllable that corresponds, then the control loudspeaker sound production, when pronunciation person expressed, the controller controlling display showed the text message that the conversion of pronunciation characters translation chip obtained. The utility model discloses based on two bors d's oeuveres palm language, combine electrical distance recognition technology, wrist, finger and human distance realize the sign language and change to the accurate of pronunciation in the accurate measuring sign language action, whole device is low to hardware requirement, is fit for production and promotes, and it is relatively easy to establishhing of data, need not to contain the sign language action of thousands of lengthy and tedious complicacies, easily realize.

Description

A kind of gesture language-voice conversion equipment
Technical field
The utility model belongs to sign language interpreter field, particularly relates to the conversion equipment of a kind of sign language to voice.
Background technology
The existing deaf person's population 2,057 ten thousand of China according to statistics, sign language is that they express thoughts, carry out the main tool of communicating.Sign language is the most familiar thing only concerning deaf-mute, but for ordinary people, similarly is more a foreign language.At home, as Shanghai, sign language number can be no more than 10,000 people, popularity rate is less than per mille.Lower sign language popularity rate greatly hinders the effective communication listening barrier people and abled person.Therefore, a kind of instrument that deaf-mute and ordinary people can be allowed to carry out language communication is designed very necessary.
Because China is vast in territory, there is numerous local sign languages, bringing inconvenience to exchanging between deaf person.Two bors d's oeuveres palm language is based on the Chinese phonetic alphabet, and sign language action is simple, is easy to grasp, and is applicable to very much applying.Two bors d's oeuveres palm language, to slap the angle, four rooms of language people supposition for reference system, two palms stretch to different orientation expresses a word tone, two palms bend cooperation also can express a word tone, twice sign language manual expression word tone, alphabetical action is clear, and requirement deaf-mute being pointed to flexibility ratio is lower.The action of such as initial consonant b is: the left hand palm points to the front upper place on opposite, and the right hand palm points to the front upper place on opposite; The action of simple or compound vowel of a Chinese syllable a is the front upper place that the left hand palm points to opposite, and the right hand palm embraces chest.Two actions coordinate the pronunciation being ba.Be equipped with tone again, the left palmar flexion of falling tone action, right palmar flexion, namely express " father " accurately.
If by each action of instrument identification Two bors d's oeuveres palm language, and be converted into voice, then can realize the direct speech exchange of deaf-mute and ordinary people.
Utility model content
The utility model is for the technical matters lacking deaf-mute and the direct speech exchange equipment of ordinary people in prior art, a kind of hardware requirement is proposed low, database is easy to set up, and can realize deaf-mute exchanges arbitrary statement gesture language-voice conversion equipment and method with ordinary people.
In order to achieve the above object, the technical solution adopted in the utility model is:
A kind of gesture language-voice conversion equipment, comprises display, bracelet, finger ring and controller, is provided with microphone for receiving voice and is the language and characters translation chip of word by speech conversion in described display; Described bracelet is provided with loudspeaker; Described finger ring is provided with switching push button, described switching push button comprise the different pinyin syllable that switching two is expressed by same action shift button and from multiple constraint term the selected button of select target value; All be provided with distance detector in described display, bracelet and finger ring, described distance detector comprises signal transceiver and distance transforms chip; Described controller is connected with display, distance detector, loud speaker signalling, sign language person expresses the distance value that Time Controller receiving range detecting device detects, and the sign language operating distance value prestored in database is mated with corresponding pinyin syllable, then control loudspeaker sounding; When voice person expresses, controller controls the Word message that display display voice character translation chip obtains.
As preferably, described display is the head mounted display comprising spectacle frame and display screen, and described controller is arranged on spectacle frame side.
As preferably, described distance detector is TICC2541 integrated chip, and described signal transceiver is radio-frequency (RF) transceiver.
As preferably, described spectacle frame is provided with the system switching controlling conversion equipment and open and close.
As preferably, described finger ring is made up of soft material, described bracelet is provided with the finger ring groove depositing displacement.
Compared with prior art, advantage of the present utility model and good effect are:
The utility model, based on Two bors d's oeuveres palm language, in conjunction with electrical distance recognition technology, accurately detects wrist, finger and human body distance in sign language action, realizes the accurate conversion of sign language to voice; Whole device is low to hardware requirement, is applicable to producing promoting; And relatively easy for the foundation of data, only need comprising the basic sign language action that phonetic phonetic symbol, tone and numeral etc. are corresponding, without the need to comprising the sign language action of thousands of lengthy and tedious complexity, being easy to realize.
Accompanying drawing explanation
Fig. 1 is the control structure schematic diagram of the utility model gesture language-voice conversion equipment;
Fig. 2 is the structural representation of the utility model gesture language-voice conversion equipment;
Fig. 3 is that the sign language of the utility model gesture language-voice conversion equipment is to speech conversion process flow diagram;
Above in each figure: 1, display; 11, display screen; 12, spectacle frame; 2, left hand ring; 3, right hand ring; 4, left finger ring; 5, right finger ring.
Embodiment
In order to better understand the utility model, illustrate below in conjunction with drawings and Examples.
Utility model people has carefully studied each action of Two bors d's oeuveres palm language, the expression of discovery Two bors d's oeuveres palm language everything only leans on the sensing of forearm and palm and palm to stretch change in the wrong can complete the expression of all statements, the distance of wrist distance human body and the specifically different of finger distance human body between different action.In conjunction with electrical distance recognition technology, can realize the one_to_one corresponding of sign language action and phonetic phonetic symbol, sign language is accurate to the conversion of voice.And relatively easy for the foundation of data, only need comprise the basic sign language action that phonetic phonetic symbol, tone and numeral etc. are corresponding, without the need to comprising the sign language action of thousands of lengthy and tedious complexity.
Embodiment one: as shown in Figure 1 and Figure 2, a kind of gesture language-voice conversion equipment, comprises display 1, bracelet, finger ring and controller, and finger ring comprises left finger ring 4 and right finger ring 5, and bracelet comprises left hand ring 2 and right hand ring 3.The phonetic symbol that described display display sign language person (deaf-mute) is expressed, and the language of voice person is transformed the word obtained show sign language person.For convenience of sign language person's viewing, display selects the head mounted display comprising spectacle frame and small display screen, and described controller is arranged on spectacle frame side.This class display at present existing many companies is succeeded in developing, as Google's glasses that Google produces.
When distance detector is for detecting sign language person's sign language, finger to wrist and finger to the distance of display screen, and is transferred to controller.Distance detector adopts TICC2541 integrated chip, and comprising radio-frequency (RF) transceiver, radio-frequency (RF) transceiver comprises transmitter and receiver.The range finding of CC2541 module realizes principle and is, transmitter emitting radio frequency signal, and signal intensity reduces along with the increase of distance, and receiver receives signal, often organize between transceiver the size of spacing obtain form with RSSI value and show.Simultaneously according to formula, the actual range between one group of transceiver can be calculated.Radio-frequency (RF) transceiver comprises four groups, be respectively detect right finger to human body distance first transceiver, detect right finger to the second transceiver of right hand wrist distance, detection left-hand finger to the 3rd transceiver of human body distance and detection left-hand finger to the 4th transceiver of left hand wrist distance.Four groups of transceivers are placed in bracelet and finger ring and spectacle frame.
Described language and characters translation chip is arranged on spectacle-frame side, the speech recognition softwares such as the voice of language person (ordinary people) are flown by the local voice identification in chip or use news by language and characters translation module after microphone is collected, Baidu's voice, are converted to word and are transferred to controller;
Described switching push button comprises shift button and selected button, and shift button is positioned on right hand finger ring, for switching two different pinyin syllable expressed by same action; Selected button is positioned on left hand finger ring, for select target value from multiple constraint term;
Described controller is connected with display, distance detector, loud speaker signalling.Sign language person expresses the distance value that Time Controller receiving range detecting device detects, and the sign language operating distance value prestored in database is mated with corresponding pinyin syllable, then control loudspeaker sounding; When enunciator expresses, controller controls the Word message that display display voice character translation chip is converted to.Can be voice by the sign language action accurate translation of sign language person by this gesture language-voice conversion equipment, also the language of voice person can be translated as word and show sign language person, realize deaf-mute and exchange with the effective of ordinary people.
Described spectacle frame is provided with system switching, the opening and closing of control device, when needing to belong to expression, toggle switch open system, avoids some ordinary actions, and as held handrail, drink water etc., action thinks it is sign language action by mistake.
For making the suitable different people of finger ring wear, described left finger ring and right finger ring are made up of elastic caoutchouc.Described left and right bracelet is provided with finger ring groove, finger ring can be placed in finger ring groove when not using.
Embodiment two: based on the gesture language-voice conversion equipment described in embodiment one, the utility model also provides a kind of gesture language-voice conversion method, by the method not only can realize sign language person do the conversion of sign language to voice, also speech conversion voice person can said is that word shows sign language person, realizes the normal communication of sign language person to voice person.
As shown in Figure 1 to Figure 3, when sign language person uses this device, finger ring is worn over finger front end, bracelet is worn in wrist, and brings head mounted display.
Due to everyone arm length and hand length difference, also initialization procedure is comprised: after opening system switching before this device of first use, after pressing shift button and selected button 10s simultaneously, display screen instruction sign language person makes required movement, and controller obtains distance value corresponding to phonetic symbol and stores.
When sign language person wants to express statement to voice person, press system switching, start up system.Sign language person makes breeder mother, simple or compound vowel of a Chinese syllable and tone action, and now receiver receives the electromagnetic wave of transmitter, after distance detector analysis, target range value is transferred to controller.After this distance value mates with the phonetic phonetic symbol in database by controller, shows on a display screen after obtaining target phonetic symbol.Last initial consonant, simple or compound vowel of a Chinese syllable and tone are one group and form a pronunciation, pronounce through loudspeaker.CC2541 module radio-frequency (RF) transceiver transmitting-receiving frequency is p.s. about 10 times, due to the custom of people, finish an action can slightly pause, so the residence time of subject performance is longer than middle action, the number of times of detected distance value is more, it is subject performance distance value (37cm) that system default obtained distance value (as 37cm) more than 7 times in one second, and employing rounds algorithm, and the decimal about subject performance distance value is classified as round values record.Owing to artificially expressing mistake or part getting stuck, system may obtain two desired values after a manual expression terminates, then can provide corresponding option in display screen, and user can be selected by selected button.
When voice person expresses to sign language person, only need normal speech, the voice that voice person collected by microphone are converted into word through voice literary composition translation chip, and display on a display screen.
Namely exchanging of sign language person and voice person is completed, shutdown system switch after talk by above process.
With utility model people certainly as example, phonetic phonetic symbol, sign language action, detecting distance and shift push-botton operation correspondence table are as follows:
Wherein, in shift button, " Y " refers to press shift button, and "/" refers to not according to shift button.Experiment shows, effectively sign language can be converted to by this method the voice that sign language person thinks expression.
The above; it is only preferred embodiment of the present utility model; it is not restriction the utility model being made to other form; the Equivalent embodiments that any those skilled in the art may utilize the technology contents of above-mentioned announcement to be changed or be modified as equivalent variations is applied to other field; but everyly do not depart from technical solutions of the utility model content; according to any simple modification, equivalent variations and remodeling that technical spirit of the present utility model is done above embodiment, still belong to the protection domain of technical solutions of the utility model.

Claims (5)

1. a gesture language-voice conversion equipment, is characterized in that: comprise display, bracelet, finger ring and controller, is provided with microphone for receiving voice and is the language and characters translation chip of word by speech conversion in described display;
Described bracelet is provided with loudspeaker; Described finger ring is provided with switching push button, described switching push button comprise the different pinyin syllable that switching two is expressed by same action shift button and from multiple constraint term the selected button of select target value;
All be provided with distance detector in described display, bracelet and finger ring, described distance detector comprises signal transceiver and distance transforms chip;
Described controller is connected with display, distance detector, loud speaker signalling, sign language person expresses the distance value that Time Controller receiving range detecting device detects, and the sign language operating distance value prestored in database is mated with corresponding pinyin syllable, then control loudspeaker sounding; When voice person expresses, controller controls the Word message that display display voice character translation chip obtains.
2. gesture language-voice conversion equipment according to claim 1, is characterized in that: described display is the head mounted display comprising spectacle frame and display screen, and described controller is arranged on spectacle frame side.
3. gesture language-voice conversion equipment according to claim 2, is characterized in that: described distance detector is TICC2541 integrated chip, and described signal transceiver is radio-frequency (RF) transceiver.
4. gesture language-voice conversion equipment according to claim 3, is characterized in that: described spectacle frame is provided with the system switching controlling conversion equipment and open and close.
5. gesture language-voice conversion equipment according to claim 4, is characterized in that: described finger ring is made up of soft material, described bracelet is provided with the finger ring groove depositing finger ring.
CN201520757716.6U 2015-09-28 2015-09-28 Sign language voice conversion device Active CN204965839U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201520757716.6U CN204965839U (en) 2015-09-28 2015-09-28 Sign language voice conversion device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201520757716.6U CN204965839U (en) 2015-09-28 2015-09-28 Sign language voice conversion device

Publications (1)

Publication Number Publication Date
CN204965839U true CN204965839U (en) 2016-01-13

Family

ID=55060889

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201520757716.6U Active CN204965839U (en) 2015-09-28 2015-09-28 Sign language voice conversion device

Country Status (1)

Country Link
CN (1) CN204965839U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105118356A (en) * 2015-09-28 2015-12-02 王超 Sign language voice conversion method and device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105118356A (en) * 2015-09-28 2015-12-02 王超 Sign language voice conversion method and device
CN105118356B (en) * 2015-09-28 2018-02-23 王超 A kind of gesture language-voice conversion method and device

Similar Documents

Publication Publication Date Title
Zhang et al. MyoSign: enabling end-to-end sign language recognition with wearables
CN105118356A (en) Sign language voice conversion method and device
WO2017152531A1 (en) Ultrasonic wave-based air gesture recognition method and system
CN104410883A (en) Mobile wearable non-contact interaction system and method
CN102981615B (en) Gesture identifying device and recognition methods
CN105807925A (en) Flexible electronic skin based lip language identification system and method
CN104796584A (en) Prompt device with voice recognition function
CN103279734A (en) Novel intelligent sign language translation and man-machine interaction system and use method thereof
CN109117484B (en) A kind of voice translation method and speech translation apparatus
Zhang et al. Wisign: Ubiquitous american sign language recognition using commercial wi-fi devices
CN104361787A (en) System and method for converting signals
Rizwan et al. American sign language translation via smart wearable glove technology
CN110097875A (en) Interactive voice based on microphone signal wakes up electronic equipment, method and medium
CN110428806A (en) Interactive voice based on microphone signal wakes up electronic equipment, method and medium
CN207216921U (en) A kind of deaf-mute and the Wearable of normal person's two-way exchange
CN105551327A (en) Interactive pronunciation correcting system and method based on soft electronic skin
Dhanjal et al. Tools and techniques of assistive technology for hearing impaired people
CN105206123A (en) Communication device for deaf-mutes
CN107301862A (en) A kind of audio recognition method, identification model method for building up, device and electronic equipment
CN102063282A (en) Chinese speech input system and method
CN204965839U (en) Sign language voice conversion device
CN206210144U (en) Gesture language-voice converts cap
CN107942700A (en) A kind of appliance control system, method and computer-readable recording medium
Rishan et al. Translation of sri lankan sign language to sinhala text: A leap motion technology-based approach
CN106683668A (en) Method of awakening control of intelligent device and system

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant