CN102799433A - Implementing method of software capable of being used by disabled people - Google Patents

Implementing method of software capable of being used by disabled people Download PDF

Info

Publication number
CN102799433A
CN102799433A CN2012102283063A CN201210228306A CN102799433A CN 102799433 A CN102799433 A CN 102799433A CN 2012102283063 A CN2012102283063 A CN 2012102283063A CN 201210228306 A CN201210228306 A CN 201210228306A CN 102799433 A CN102799433 A CN 102799433A
Authority
CN
China
Prior art keywords
voice
software
text
speech
control
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012102283063A
Other languages
Chinese (zh)
Inventor
王勇
钟艳如
汪华登
付莉
陈智勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guilin University of Electronic Technology
Original Assignee
Guilin University of Electronic Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guilin University of Electronic Technology filed Critical Guilin University of Electronic Technology
Priority to CN2012102283063A priority Critical patent/CN102799433A/en
Publication of CN102799433A publication Critical patent/CN102799433A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to an implementing method of software capable of being used by disabled people. In order to solve the problem that the disabled people have difficulty in using software, voice prompt is used to replace a display-based displaying manner, and the operation of a keyboard and a mouse is replaced by voice input and voice control. To help the blind to find a mouse, the software can produce a proper voice prompt when the mouse is dragged within or beyond a software interface, and reminds users of taking proper operations. An operational guidance for the disabled is set in the software, and voice prompt is carried out in a tree form to remind the disabled of making choices. The disabled can make choices in voice until the specific content is broadcasted in voice. The keyboard reminding function is provided, and the key pressing operation in the software operation process can be changed into corresponding voice for reminding. The focus switching can be controlled by voice, and the implementation of controls in the focus state can be controlled by voice instructions. The software can change voice input into corresponding texts and can enter the texts in an input box.

Description

A kind of disabled person can use method of software realization
Technical field
The invention belongs to computer software fields, relate to a kind of software implementation method, the operable software implementation method of particularly a kind of disabled person.
Background technology
Society provides various cares and consideration to the disabled person now, such as sidewalk for visually impaired people, Wheelchair Accessible etc.Some mobile phones all have certain speech play and speech identifying function, such as voice reporting cell-phone number, recognizing voice name.But existing computer software design still lacks the consideration for disabled person's operational computations machine relatively, and along with popularizing of infotech and software application, and society is to disabled person's care, and software seems for disabled person's operability and becomes more and more important and give prominence to.The software that design can let the disabled person operate can be obtained employment for the disabled person, foundation, studying and living bring very big facility, lets them in informationalized society, can enjoy the benefit that infotech is brought.
Present Software Operation generally needs the operation of hand to keyboard and mouse, and eyes obtain information from screen, and this people for blind person, upper limb disability is inconvenient.This mode is unfavorable for that equally long-range control, particularly sight line are away from controlling computer under the situation of screen.Concern to screen for a long time causes visual fatigue and feels dizzy, and many people's body and mind is all seriously influenced.Present wireless mouse is operating computer at a distance, but because present software need be seen screen could operate, makes the operated from a distance function of wireless mouse be restricted.
Exploitation can utilize voice control, and the software that can point out the user to operate with the mode of voice, implements corresponding operation and interactive through voice; Can avoid above-mentioned defective, can help the disabled person, and the normal person can carry out remote computer control through voice Software Operation; Perhaps in the operational computations machine, on one side can close the eyes for rest, Yi Bian carry out voice operating and the voice suggestion that obtains software; Reduce and use kopiopia, some researchs and practice to show, the user can cause many-sided injury in the face of computer for a long time; Therefore, be necessary to avoid to face for a long time computer, and above-mentioned software can reach the purpose of interactive voice.
Summary of the invention
For the ease of disabled person's operation and operated from a distance, the present invention mainly adopts voice suggestion and speech recognition to reach voice output and phonetic entry, confirms various operations and mutual voice coding through the rule of setting; This coding rule should be easy to learn; Simply, be beneficial to realize voice-based man-machine interaction, thereby; Can need not to obtain the information of computer screen and software demonstration, and need not to come Control Software through manual operation keyboard and mouse through vision.
Some phonetic entries among the present invention, output, control function can be provided with, and before the disabled person uses, under normal person's help, are provided with earlier; Perhaps software startup the time; The user makes a choice with voice reminder, and the user also can adopt voice-operated mode to select and dispose, promptly if the blind person; He can use voice is corresponding pattern with software arrangements, and it is the order that text is discerned the user that the computer expert crosses speech conversion.Therefore, phonetic functions more of the present invention are optional, and are configurable.
Be directed to the blind person, in software design, adopt voice suggestion, voice suggestion can use the text-to-speech technology to realize; Through the text that will be provided with in advance, perhaps the texts such as existing title in the program convert voice into; Play through voice-output device, the content of voice suggestion can comprise following aspect: the first, when mouse moves to a certain control (perhaps instrument, button, menu) last time; Adopt the title of voice suggestion control, and concise and to the point operation helping prompt.Second; Which border the borderline region of a frame type is set in the periphery at the interface of software, when mouse moves into or shifts out the software border, can points out like this, be in order to let the operator know on earth; Can arrange the title on border up and down; Such as, coboundary and so on perhaps points out the user to let a certain direction rolling mouse promptly get into a certain interface zone of so-and-so software.The 3rd, the help function of software is except can also adopting voice suggestion display screen reality; Except being designed to convert into the form prompting of speech play, in addition, go back specialized designs disabled person software operation guide to normal person's help document; The document adopts tree-like institutional framework, provides voice suggestion step by step, lets the disabled person make the selection of refinement; Voice for disabled persons make a choice, and system converts voice selecting into corresponding text, and triggering system is made finer prompting; The disabled person passes through selection step by step, finally can obtain required help, and software is play help content through the text-to-speech technology.The 4th, voice reminder is carried out in the operation and the affirmation thereof of the button in the software interface, control, menu, to avoid maloperation.The 5th, in order to strengthen interactivity, be speech play with the content of text of software demonstration and the text employing text to speech technical transform of the contents such as various promptings in the software interface.Six, be directed to the blind person that some can't remember keyboard; Through being provided with; Make the button operation in the software operation process also obtain voice reminder, as finding key errors, can be by the particular key cancellation of certain appointment; Particular key is generally used the space bar that is easy to blind person's differentiation, or is in the esc key etc. of specific position.The 7th, software can increase some complementary voice prompting functions, such as, carry out Weather forecast prompting after the data of time-indicating awaking, alarm clock calling, download weather forecast website.
Can't observe the difficulty of mouse and keyboard operation to the blind person; And the difficulty of upper limb disability personage's mouse and keyboard operation, the present invention adopts voice control function to accomplish and assist input and control: the first, and system default adopts tab key control focus to switch; Carry out the corresponding current control (or button) of focus with enter key; There is operational difficulty in these for disabled person and blind person, and the blind person can't see the focus position, can be through being provided with among the present invention; Adopt specific voice control command to come the control focus to switch; After focus switches to next control, remind the title of switching the corresponding current control of back focus, and can control the pairing current control of focus with voice command and carry out with the pronunciation of text-to-speech (text-to-speech) technology.The second, have speech voice input function, be provided with down in phonetic entry, can larding speech with literary allusions with voice, this (speech-to-text) is technological to be converted into text with phonetic entry, the typing input frame.The 3rd, have voice control function, be the may command certain operations through sounding, microphone obtains voice, is text with speech conversion, and when this text just was certain order in the current available command set, triggering should the corresponding operation of order.Design voice-operated rule through certain mode, prevent the ambiguity between the voice control, phonetic entry and voice control possibly obscured, so after the input of phonetic entry state is accomplished, adopt a certain order to finish the voice input state.
In order to reduce disabled person's operation, can increase the function of certain automatic operation, for example software starts automatically, login automatically, the computer setting of this type function of shutting down automatically when computer is not operated.For the disabled person is offered help, can increase the subsidiary function that some are directed to the disabled person, such as p.m.entry timing prompting function, arrived preset time and reminded the disabled person should do something.
Above partial function also is useful for the normal person, and it can also realize long-range control, reduces with eye, and present many people dislike in the face of computer, and this software can be avoided for a long time not accommodating fatigue etc. in the face of what computer brought.
Receive the interference of speech play for fear of speech recognition, can suspend speech recognition in the period of speech play, a kind of in addition artificial solution adopts earphone exactly.
Description of drawings
Fig. 1 is disabled person's support function synoptic diagram of the present invention.
Fig. 2 is an embodiments of the invention interfacial boundary synoptic diagram.
Embodiment
Below be embodiments of the invention:
In the present embodiment, computer is connected to earphone and microphone, through microphone input voice command or information, the voice suggestion of listening to software through earphone.The TTS speech engine is arranged in the system, and it can be voice with text-converted, simultaneously speech recognition engine is arranged also, can convert sound into text, perhaps further again text-converted is order.Software can be provided with, and promptly when these phonetic functions become a kind of obstruction, can close various phonetic functions.How much what the phonetic function of software was launched can carry out certain division; Can be divided into and be applicable to only upper limb disability setting; Be applicable to that the blind person is provided with (comprising upper limb disability); And the setting that is applicable to other people, the certainly common people's setting that also can select the blind person for use is closed the eyes for rest to reach, purpose such as Long-distance Control.Also have an option during the blind person is provided with, start keyboard input prompting function exactly, this is aimed at those blind persons that can't remember keyboard.This keyboard prompting function also can be used for the blind person and at the beginning of using keyboard, grasp keyboard position.
Voice suggestion adopts the TTS speech engine to realize, the implementation method of these voice reminders adopts audio amplifier or earphone to play for being voice with the text-converted in the software then; Voice prompting function is presented as the following aspects in software, introduce their concrete realization below respectively: the first, when mouse moves to a certain control (perhaps button) last time; Utilize corresponding mouse moving event; Trigger event sends the sound of control title, and if be necessary to give certain prompting: " like the need operation; please press left mouse button (right button) ", and operation subsequently provided certain prompting.The second, when the interface of software was not full frame, the blind person possibly can't confirm the scope of this software interface, thereby, cause certain maloperation.The borderline region of a frame type is set in the periphery at each interface of software in the present embodiment, and as shown in Figure 2, its interface is not when being in maximized state, and zone 2,3,4,5 is respectively its border, and 6 is effective interface.Which border when mouse moves into or shifts out the software border, can be pointed out like this, be in order to let the operator know on earth, adopts voice reminder; Such as moved to for 2 zone time trigger event, prompting " getting into the coboundary at certain interface of certain software " when mouse; When getting into 4 zones; Prompting " getting into certain interface lower boundary of certain software ", when getting into 5 zones, prompting " getting into certain interface left margin of certain software "; When getting into 3 zones, prompting " getting into certain interface right margin of certain software ".The 3rd, help can utilize the voice controls playing, and when ordering with special sound, system utilizes the text-to-speech engine, with the content of text automatic reading that helps.In addition, having more targetedly is to also have special disabled person's operating guidance; With all possible help content, progressively be divided into different types, let the disabled person progressively select with the same prompting mode of multiple-choice question; The disabled person can do selection with voice, and system is a text with speech conversion, is corresponding selection with text-converted; Through adopting the selection mode of such step thinning; Progressively refinement and the content of confirming help, the content that finally can get help is play with the text-to-speech technology by software.The 4th, to the operation and the affirmation thereof of the button in the software interface, control, menu, carry out voice reminder through text-to-speech.The 5th, in order to strengthen interactivity, it is speech play that the text of contents such as the various promptings in software videotex content and the software interface, demonstration, warning is adopted text to speech technical transform.Six, be directed to the blind person that some can't remember keyboard; Launch the keyboard prompting function through setting; Make the button operation in the software operation process, intercepted and captured and employing text-to-speech technology, become the title that speech play is reminded current button by hook; As find key errors, can cancel by esc key.The 7th, software setting complementary time-indicating awaking function, when time during,, will the time transfer speech play to through the text-to-speech technology to specific point, prompting can't be seen the blind person of time like this.The 7th, more residing special states in the operational process of software when particularly mistake occurring, with the text-to-speech technology, are play voice and are reminded.
Be directed to the difficulty that the blind person can't observe mouse and keyboard operation; And the difficulty of upper limb disability personage's mouse and keyboard operation, the present invention adopts voice control function to accomplish and assist input and control: the first, through being provided with; Can adopt specific voice to control the control focus to switch; After focus switches to next control, remind the title of switching the corresponding current control of back focus, and can carry out by the pairing current control of term sound control system focus with the pronunciation of text-to-speech technology.The second, have speech voice input function, when phonetic entry starts, can with voice lard speech with literary allusions this (speech-to-text) technology phonetic entry is converted into text, in typing input frame or the file.The 3rd, voice control function is during this function on; Monitoring the voice that microphone receives, utilize voice to lard speech with literary allusions this, is text with speech conversion; When text just was the correspondence order of some controls corresponding under the current state, button, operation etc., triggering should operation.
The text of phonetic entry possibly be identical with voice-operated text, and the length of phonetic entry text also is variable.Between phonetic entry text and voice command,, may both be obscured if do not distinguish.When realizing, a switching should be arranged, adopt the voice command of some impossible input texts, perhaps adopt one section set time silence, expression text input state finishes, and switches to and can carry out the voice command state.
Being provided with of function choosing-item; Can adopt dual mode to realize: 1) when initial operating software; Software is used the setting whether voice reminder will be correlated with; And can adopt voice to control the setting of carrying out aforesaid voice reminder, voice control function, the normal person can not select the phonetic function of being correlated with; 2) before the disabled person used, software carried out the related voice setting by the normal person.
The phonetic function of software is not limited only to support that the disabled person uses this software, and some other disabled person's help function can also be set, and in the present embodiment, adopts similar method to shut down etc. through voice control, and the mode of realization is the same.

Claims (7)

1. a disabled person can use method of software realization; It is characterized in that for blind person and upper limb disabled person can: 1) adopt the voice present technique of larding speech with literary allusions to convert phonetic entry into text input that text replaces general keyboard; 2) use the voice present technique of larding speech with literary allusions that speech conversion is text; Again corresponding some order of text and then realization voice are controlled, and replaced general mouse action and keyboard; Can adopt the text-to-speech technology to change text preset in the software into voice for the blind person; Play back and replace computer display screen prompting; Comprise: after A) launching voice reminder, when mouse dragged in software interface, in last times such as the button in moving to software interface, control, menu, utilized the text-to-speech technology to carry out speech play and remind; Play its title and operate help; B) to the button in the software interface, control, when menu is operated, the prompting of text-to-speech is carried out in corresponding operation and affirmation thereof, and can be play the concise and to the point help of further operation.
2. method of software realization as claimed in claim 1; It is characterized in that: when launching voice reminder; The voice reminder zone of frame type is set at the outer boundary of the interface zone of software; When mouse shifts out or moves into from the window interface of software, inform the operator with the mode of agreement, what direction to be mouse to be shifted out or moves into so-and-so interface zone of software towards under the current state.
3. method of software realization as claimed in claim 1; It is characterized in that: when launching voice reminder, the help file of its software operation, disabled person's software operation guide usable text are changeed voice technology and are converted into speech play, and disabled person's operating guidance carries out voice reminder with tree-like structure to the disabled person; Prompting the disabled person make a choice; Voice for disabled persons make a choice, and phonetic entry converts text into, trigger software and make further careful prompting; So the help that the disabled person needs is to the last confirmed in circulation, and the text of help is play with speech form.
4. method of software realization as claimed in claim 3 is characterized in that: when launching voice reminder, the content of text usable text of the file that software videotex content and software are related to is changeed voice technology and is converted into speech play.
5. method of software realization as claimed in claim 4; It is characterized in that: when launching the keyboard prompting function; Button operation in the software operation process; Intercepted and captured and remind by hook,, can cancel by certain particular key as finding key errors with the voice that preset text title changes corresponding title into.
6. method of software realization as claimed in claim 5; It is characterized in that: when launching voice control function, can adopt the switching of voice control control focus, after focus switches to next control; Pronounce with the text-to-speech technology; Remind to switch the title of the corresponding current control of back focus, and as user during, convert voice command into text with the voice present technique of larding speech with literary allusions with the voice command of the current control of voice output (saying) execution; With the text matches order, control the execution of the control that is in focus condition.
7. method of software realization as claimed in claim 6 is characterized in that: have speech voice input function, when speech voice input function starts; When being in the text input state; Phonetic entry will become the corresponding text of voice, the typing input frame with lard speech with literary allusions this (speech-to-text) technology of voice; Disabled person's sounding finishes the voice input state if during the voice command of some appointments.
CN2012102283063A 2012-07-04 2012-07-04 Implementing method of software capable of being used by disabled people Pending CN102799433A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2012102283063A CN102799433A (en) 2012-07-04 2012-07-04 Implementing method of software capable of being used by disabled people

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012102283063A CN102799433A (en) 2012-07-04 2012-07-04 Implementing method of software capable of being used by disabled people

Publications (1)

Publication Number Publication Date
CN102799433A true CN102799433A (en) 2012-11-28

Family

ID=47198550

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012102283063A Pending CN102799433A (en) 2012-07-04 2012-07-04 Implementing method of software capable of being used by disabled people

Country Status (1)

Country Link
CN (1) CN102799433A (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049843A (en) * 2012-12-14 2013-04-17 广东欧珀移动通信有限公司 Date and time selecting method for user terminal equipment and user terminal equipment
CN103092466A (en) * 2013-01-22 2013-05-08 北京小米科技有限责任公司 Method and device of mobile terminal operating
CN105117097A (en) * 2015-07-29 2015-12-02 韦东 Human-computer interaction method and system and intelligent equipment
CN106131297A (en) * 2016-06-08 2016-11-16 太原工业学院 Blind mobile phone operating system
CN106406867A (en) * 2016-09-05 2017-02-15 深圳市联谛信息无障碍有限责任公司 Android system-based screen reading method and apparatus
CN107613352A (en) * 2017-09-28 2018-01-19 深圳Tcl数字技术有限公司 Sound control method, intelligent television and storage medium for intelligent television
CN109166584A (en) * 2018-10-30 2019-01-08 深圳融昕医疗科技有限公司 Sound control method, device, ventilator and storage medium
CN109241541A (en) * 2018-08-14 2019-01-18 平安普惠企业管理有限公司 Exchange method and terminal device based on voice conversion
CN109636410A (en) * 2018-11-14 2019-04-16 广州小黑智能包装科技有限公司 A kind of intelligence illustrates book system and its implementation method
CN111263204A (en) * 2018-11-30 2020-06-09 青岛海尔多媒体有限公司 Control method and device for multimedia playing equipment and computer storage medium
CN113253909A (en) * 2021-06-30 2021-08-13 浙江口碑网络技术有限公司 Control method and device for resource information display and play, storage and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1323003A (en) * 2001-06-22 2001-11-21 清华大学 Intelligent Chinese computer system for the blind
CN101419546A (en) * 2007-10-26 2009-04-29 英业达股份有限公司 Graphic user interface speech prompting system and method
CN101493996A (en) * 2009-01-15 2009-07-29 北方工业大学 Intelligent reader and implementation method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1323003A (en) * 2001-06-22 2001-11-21 清华大学 Intelligent Chinese computer system for the blind
CN101419546A (en) * 2007-10-26 2009-04-29 英业达股份有限公司 Graphic user interface speech prompting system and method
CN101493996A (en) * 2009-01-15 2009-07-29 北方工业大学 Intelligent reader and implementation method thereof

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
郑志: ""残疾人人机交互辅助***设计与实现"", 《中国优秀硕士学位论文全文数据库(信息科技辑)》 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049843A (en) * 2012-12-14 2013-04-17 广东欧珀移动通信有限公司 Date and time selecting method for user terminal equipment and user terminal equipment
CN103049843B (en) * 2012-12-14 2015-12-23 广东欧珀移动通信有限公司 A kind of Time of Day system of selection of subscriber terminal equipment and subscriber terminal equipment
CN103092466A (en) * 2013-01-22 2013-05-08 北京小米科技有限责任公司 Method and device of mobile terminal operating
CN103092466B (en) * 2013-01-22 2016-03-30 小米科技有限责任公司 A kind of method of operating of mobile terminal and device
CN105117097A (en) * 2015-07-29 2015-12-02 韦东 Human-computer interaction method and system and intelligent equipment
CN106131297A (en) * 2016-06-08 2016-11-16 太原工业学院 Blind mobile phone operating system
CN106406867A (en) * 2016-09-05 2017-02-15 深圳市联谛信息无障碍有限责任公司 Android system-based screen reading method and apparatus
CN106406867B (en) * 2016-09-05 2020-02-14 深圳市联谛信息无障碍有限责任公司 Screen reading method and device based on android system
CN107613352A (en) * 2017-09-28 2018-01-19 深圳Tcl数字技术有限公司 Sound control method, intelligent television and storage medium for intelligent television
CN109241541A (en) * 2018-08-14 2019-01-18 平安普惠企业管理有限公司 Exchange method and terminal device based on voice conversion
CN109166584A (en) * 2018-10-30 2019-01-08 深圳融昕医疗科技有限公司 Sound control method, device, ventilator and storage medium
CN109636410A (en) * 2018-11-14 2019-04-16 广州小黑智能包装科技有限公司 A kind of intelligence illustrates book system and its implementation method
CN111263204A (en) * 2018-11-30 2020-06-09 青岛海尔多媒体有限公司 Control method and device for multimedia playing equipment and computer storage medium
CN113253909A (en) * 2021-06-30 2021-08-13 浙江口碑网络技术有限公司 Control method and device for resource information display and play, storage and electronic equipment

Similar Documents

Publication Publication Date Title
CN102799433A (en) Implementing method of software capable of being used by disabled people
US20110197156A1 (en) System and method of providing an interactive zoom frame interface
CN108337380A (en) Adjust automatically user interface is for hands-free interaction
CN107003823B (en) Head-mounted display device and operation method thereof
US20080195394A1 (en) Device For Communication For Persons With Speech and/or Hearing Handicap
KR20230003281A (en) Multi-modal interaction between users, automated assistants, and other computing services
CN102428440A (en) System and method for multi-modal input synchronization and disambiguation
EP1807812A2 (en) Assistive communication device
KR20200059054A (en) Electronic apparatus for processing user utterance and controlling method thereof
Mayer et al. Examples of multimodal user interfaces for socially assistive robots in Ambient Assisted Living environments
Derboven et al. Designing voice interaction for people with physical and speech impairments
CN102945120A (en) Children application based man-machine interaction auxiliary system and interaction method
JP2022169645A (en) Device and program, or the like
Krajnc et al. A touch sensitive user interface approach on smartphones for visually impaired and blind persons
Alajarmeh Non-visual access to mobile devices: A survey of touchscreen accessibility for users who are visually impaired
CN113287117A (en) Interactive system and method
KR20180116725A (en) Method for displaying operation screen of speech recognition service and electronic device supporting the same
KR20130128172A (en) Mobile terminal and inputting keying method for the disabled
KR20150137831A (en) Portable device for auditory handicapped person and control method thereof
Tarneja et al. Voice Commands Control Recognition Android Apps
Sansen et al. vAssist: building the personal assistant for dependent people: Helping dependent people to cope with technology through speech interaction
Hofmann Intuitive speech interface technology for information exchange tasks
CN115877997B (en) Voice interaction method, system and storage medium for interaction elements
Veekshita et al. Smart Assistive Device for Physically Challenged People
Li et al. Making speech-based assistive technology work for a real user

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20121128