CN103078783A - Assistive barrier-free communication method based on mode recognition technology - Google Patents
Assistive barrier-free communication method based on mode recognition technology Download PDFInfo
- Publication number
- CN103078783A CN103078783A CN2012105490864A CN201210549086A CN103078783A CN 103078783 A CN103078783 A CN 103078783A CN 2012105490864 A CN2012105490864 A CN 2012105490864A CN 201210549086 A CN201210549086 A CN 201210549086A CN 103078783 A CN103078783 A CN 103078783A
- Authority
- CN
- China
- Prior art keywords
- voice
- input
- gesture
- text message
- login
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
The invention provides an assistive barrier-free communication method based on a mode recognition technology for solving a communication problem of disabled people. The method comprises the following steps that (1) users are logged in; (2) a chatter opens a chatting function and inputs chatting contents; a deaf-mute can input sign language and gestures, and inputs characters; a blind person can input voice; and disabled people can input voice; (3) a system can automatically realize conversion of the voice, the characters and the sign language according to different input forms, a text message is transmitted through a network, and after the message arrives at a local place, conversion from text to voice as well as from text to gesture is carried out, so that a message receiving manner familiar with corresponding disabled people is adapted; and (4) for the blind person, the text message sent by an opposite side arrives at a local computer so as to be converted into voice; for the deaf-mute, the text message sent by the opposite side arrives at the local computer so as to be converted into gesture; and for the disabled people, the text message sent by the opposite side arrives at the local computer so as to be converted into the gesture and the voice.
Description
Technical field
The present invention relates to a kind of accessible communication method of helping the disabled, especially a kind of accessible communication method of helping the disabled of Schema-based recognition technology.
Background technology
Along with the develop rapidly of science and technology, the people of different regions exchanges more and more convenient, but the communication of some special population still exists problem.Along with society is to the lifting of disadvantaged group's concern in recent years, the interchange problem between physical disabilities also more and more receives publicity.The computer software content is single, the online chat instrument can't be applicable to the disabled person and the disabled person controls.
Summary of the invention
The invention provides a kind of accessible communication method of helping the disabled of Schema-based recognition technology of the disabled's of solution flock-mate flow problem.
Realize the accessible communication method of helping the disabled of the Schema-based recognition technology of the object of the invention, comprise the steps:
(1) login user;
(2) chat person opens chat feature, the input chat content; The deaf-mute can input sign language and gesture, input characters, and blind person people can input voice, and handicapped people can input voice;
(3) system is different according to the form of input, automatically realize the conversion of voice, literal and sign language, text message is carried out the transmission of network, after information arrives this locality, carry out Text To Speech and text to the conversion of gesture, to adapt to receiving party's formula of corresponding disabled person's custom;
(4) for the blind person, the text message that the other side is transmitted arrives local computing and is changed into voice; For the deaf-mute, the text message that the other side is transmitted arrives local computing and is changed into gesture; For handicapped people, the text message that the other side is transmitted arrives local computing and is changed into gesture and voice;
(5) recipient receives chat content, replys, and constantly refreshes chat record.
The login user of described step (1) comprises that the blind person logins and other login modes;
Described blind person's login mode is the phonetic entry login password, carries out speech recognition, and system takes a decision as to whether validated user;
Described other login modes are that recognition of face is carried out in phonetic entry " begin identification ", input simultaneously login password, and system takes a decision as to whether validated user.
For the deaf-mute, the operation of system and ordinary people are as good as the operation of computer, and click that can be by mouse and the input of keyboard realize, also can control computer with voice.
The beneficial effect of the accessible communication method of helping the disabled of Schema-based recognition technology of the present invention is as follows:
The accessible communication method of helping the disabled of Schema-based recognition technology of the present invention for blind person's speech control computer, is listened to the music, and listens cross-talk, calendar prompting, and the functions such as voice-enabled chat have satisfied blind person's daily communation demand substantially.For deaf-mute and handicapped people have designed the login feature of recognition of face, make its fast simple login system, the use system, the speech control computer that provides simultaneously is succinct clog-free use computer comprehensively.Aspect disabled person's interchange, blind person, deaf-mute, handicapped people and normal person can select the mode of oneself custom to transmit the information that own information and reception the other side are transmitted, and have really realized clog-free interchange.Applying flexible, versatility is high, not only can satisfy the application demand of disabled person's accessible use computer, solved simultaneously the problem that there is communication disorder in disabled person's online chat, this system can be widely used in the field of helping the disabled, and helps the disabled person better to use information, obtaining information, exchange of information.
Description of drawings
Fig. 1 is the flow chart of the accessible communication method embodiment 1 of helping the disabled of Schema-based recognition technology of the present invention.
Fig. 2 is the flow chart of the accessible communication method embodiment 2 of helping the disabled of Schema-based recognition technology of the present invention.
Fig. 3 is the flow chart of the accessible communication method embodiment 3 of helping the disabled of Schema-based recognition technology of the present invention.
Embodiment
Embodiment 1
As shown in Figure 1, the accessible communication method of helping the disabled of the Schema-based recognition technology of present embodiment comprises the steps:
(1) login user;
(2) chat person opens chat feature, the input chat content; The deaf-mute can input sign language and gesture, input characters, and blind person people can input voice, and handicapped people can input voice;
(3) system is different according to the form of input, automatically realize the conversion of voice, literal and sign language, text message is carried out the transmission of network, after information arrives this locality, carry out Text To Speech and text to the conversion of gesture, to adapt to receiving party's formula of corresponding disabled person's custom;
(4) for the blind person, the text message that the other side is transmitted arrives local computing and is changed into voice; For the deaf-mute, the text message that the other side is transmitted arrives local computing and is changed into gesture; For handicapped people, the text message that the other side is transmitted arrives local computing and is changed into gesture and voice;
(5) recipient receives chat content, replys, and constantly refreshes chat record.
Embodiment 2
As shown in Figure 2, the accessible communication method of helping the disabled of the Schema-based recognition technology of present embodiment comprises the steps:
At first by the phonetic entry login password, carry out speech recognition, system takes a decision as to whether validated user.Corresponding function is selected by voice reminder by system, comprising: listen to the music, listen cross-talk, calendar prompting, four functions of voice-enabled chat.The function title that corresponding function is opened in the user speech input, speech recognition is to open corresponding function.After opening different functions; speech prompting system state and the operation that can carry out; the user says corresponding voice command or content according to prompting; system finishes corresponding task after carrying out speech recognition, comprises the selection song; suspend or the recovery music playing; create calendar prompting option date, input chat content etc.The user can carry out the function switching by switching the speech voice input function instruction.
Embodiment 3
As shown in Figure 3, the accessible communication method of helping the disabled of the Schema-based recognition technology of present embodiment comprises the steps:
For the deaf-mute, the operation of system and ordinary people are as good as the operation of computer, and click that can be by mouse and the input of keyboard realize, also can control computer with voice.And for handicapped people, at first phonetic entry " begins identification " and carries out recognition of face, inputs simultaneously login password, and system takes a decision as to whether validated user.
Can proceed as follows behind the login system: voice control computer program (such as browsing page etc.), manually write document, open chat feature.Finish the rear return information interface of above-mentioned certain operation, open again other functions.
Embodiment recited above is described preferred implementation of the present invention; be not that scope of the present invention is limited; design under the spiritual prerequisite not breaking away from the present invention; various distortion and improvement that the common engineers and technicians in this area make technical solution of the present invention all should fall in the definite protection range of claims of the present invention.
Claims (2)
1. the accessible communication method of helping the disabled of a Schema-based recognition technology comprises the steps:
(1) login user;
(2) chat person opens chat feature, the input chat content; The deaf-mute can input sign language and gesture, input characters, and blind person people can input voice, and handicapped people can input voice;
(3) system is different according to the form of input, automatically realize the conversion of voice, literal and sign language, text message is carried out the transmission of network, after information arrives this locality, carry out Text To Speech and text to the conversion of gesture, to adapt to receiving party's formula of corresponding disabled person's custom;
(4) for the blind person, the text message that the other side is transmitted arrives local computing and is changed into voice; For the deaf-mute, the text message that the other side is transmitted arrives local computing and is changed into gesture; For handicapped people, the text message that the other side is transmitted arrives local computing and is changed into gesture and voice;
(5) recipient receives chat content, replys, and constantly refreshes chat record.
2. the accessible communication method of helping the disabled of Schema-based recognition technology according to claim 1, it is characterized in that: the login user of described step (1) comprises that the blind person logins and other login modes;
Described blind person's login mode is the phonetic entry login password, carries out speech recognition, and system takes a decision as to whether validated user;
Described other login modes are that recognition of face is carried out in phonetic entry " begin identification ", input simultaneously login password, and system takes a decision as to whether validated user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012105490864A CN103078783A (en) | 2012-12-18 | 2012-12-18 | Assistive barrier-free communication method based on mode recognition technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012105490864A CN103078783A (en) | 2012-12-18 | 2012-12-18 | Assistive barrier-free communication method based on mode recognition technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103078783A true CN103078783A (en) | 2013-05-01 |
Family
ID=48155192
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012105490864A Pending CN103078783A (en) | 2012-12-18 | 2012-12-18 | Assistive barrier-free communication method based on mode recognition technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103078783A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105976675A (en) * | 2016-05-17 | 2016-09-28 | 福建万亿店中店电子商务有限责任公司 | Intelligent information exchange device and method for deaf-mute and average person |
| CN106095340A (en) * | 2016-06-14 | 2016-11-09 | 深圳市国华识别科技开发有限公司 | Gage data stores method and apparatus |
| WO2017124582A1 (en) * | 2016-01-19 | 2017-07-27 | 钟世雄 | Image selection-based sign language input method, device, and mobile phone |
| CN107483736A (en) * | 2017-08-23 | 2017-12-15 | 广东小天才科技有限公司 | A kind of message treatment method and device of instant messaging application program |
| CN107707726A (en) * | 2016-08-09 | 2018-02-16 | 深圳市鹏华联宇科技通讯有限公司 | A kind of terminal and call method communicated for normal person with deaf-mute |
| CN108920721A (en) * | 2018-07-31 | 2018-11-30 | 锐嘉科集团有限公司 | Image generating method and video generation device |
| CN109462539A (en) * | 2018-10-02 | 2019-03-12 | 陶慧 | Multi-person speech chat system and method |
| CN109636410A (en) * | 2018-11-14 | 2019-04-16 | 广州小黑智能包装科技有限公司 | A kind of intelligence illustrates book system and its implementation method |
-
2012
- 2012-12-18 CN CN2012105490864A patent/CN103078783A/en active Pending
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017124582A1 (en) * | 2016-01-19 | 2017-07-27 | 钟世雄 | Image selection-based sign language input method, device, and mobile phone |
| CN105976675A (en) * | 2016-05-17 | 2016-09-28 | 福建万亿店中店电子商务有限责任公司 | Intelligent information exchange device and method for deaf-mute and average person |
| CN106095340A (en) * | 2016-06-14 | 2016-11-09 | 深圳市国华识别科技开发有限公司 | Gage data stores method and apparatus |
| US10832033B2 (en) | 2016-06-14 | 2020-11-10 | Shenzhen Prtek Co., Ltd. | Measurement gauge data storage method and apparatus |
| CN106095340B (en) * | 2016-06-14 | 2021-04-13 | 深圳市国华识别科技开发有限公司 | Measuring instrument data storage method and device |
| CN107707726A (en) * | 2016-08-09 | 2018-02-16 | 深圳市鹏华联宇科技通讯有限公司 | A kind of terminal and call method communicated for normal person with deaf-mute |
| CN107483736A (en) * | 2017-08-23 | 2017-12-15 | 广东小天才科技有限公司 | A kind of message treatment method and device of instant messaging application program |
| CN107483736B (en) * | 2017-08-23 | 2020-05-15 | 广东小天才科技有限公司 | Message processing method and device for instant messaging application program |
| CN108920721A (en) * | 2018-07-31 | 2018-11-30 | 锐嘉科集团有限公司 | Image generating method and video generation device |
| CN109462539A (en) * | 2018-10-02 | 2019-03-12 | 陶慧 | Multi-person speech chat system and method |
| CN109636410A (en) * | 2018-11-14 | 2019-04-16 | 广州小黑智能包装科技有限公司 | A kind of intelligence illustrates book system and its implementation method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103078783A (en) | Assistive barrier-free communication method based on mode recognition technology | |
| US20190095050A1 (en) | Application Gateway for Providing Different User Interfaces for Limited Distraction and Non-Limited Distraction Contexts | |
| AU2021218193B2 (en) | Far-field extension for digital assistant services | |
| EP3005668B1 (en) | Application gateway for providing different user interfaces for limited distraction and non-limited distraction contexts | |
| US10679605B2 (en) | Hands-free list-reading by intelligent automated assistant | |
| AU2016200568A1 (en) | Automatically adapting user interfaces for hands-free interaction | |
| CN104050966B (en) | The voice interactive method of terminal device and the terminal device for using this method | |
| CN114207710A (en) | Detecting and/or registering a thermal command to trigger a response action by an automated assistant | |
| US20130275875A1 (en) | Automatically Adapting User Interfaces for Hands-Free Interaction | |
| Vtyurina et al. | Verse: Bridging screen readers and voice assistants for enhanced eyes-free web search | |
| CN106471570A (en) | Order single language input method more | |
| CN105244042B (en) | A kind of speech emotional interactive device and method based on finite-state automata | |
| WO2016203805A1 (en) | Information processing device, information processing system, information processing method, and program | |
| CN109887508A (en) | A kind of meeting automatic record method, electronic equipment and storage medium based on vocal print | |
| CN105892624A (en) | Disabled-helping barrier-free communication method based on pattern recognition technology | |
| Alnfiai et al. | Social and communication apps for the deaf and hearing impaired | |
| CN202601031U (en) | Translation equipment for communication between the deaf and blind and ordinary people | |
| EP3005075A1 (en) | Automatically adapting user interfaces for hands-free interaction | |
| Darics | Instant messaging in work-based virtual teams: the analysis of non-verbal communication used for the contextualisation of transactional and relational communicative goals. | |
| CN1901041B (en) | Voice dictionary forming method and voice identifying system and its method | |
| KR102498263B1 (en) | Choose what content to render to your Assistant device's display | |
| Goggin et al. | Disabling cell phones | |
| CN202998144U (en) | Disabled-assisting barrier-free communication system based on pattern recognition technology | |
| Patil et al. | Voice Assistant-A Review | |
| CN102880392B (en) | A kind of method, device and mobile terminal of browsing pictures |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20130501 |